2024-09-21T00:55:20.986 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T00:55:21.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T00:55:21.109 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913357' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObkQqDZErXgLOhSQHYxQzBrTZuvUlLsXndJkd6CR3SxmVgloGxMVSHAkvP/R64kq82qNtKviIPGDdQIuzxtRcc= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4pk/Jkn4nfoY2ndM9qQxB0zif+DNSacjIgMXnztTFM1cswIG1sY080W+t0wrroHtpu0ZNC4UJbluTV3xLYCC0= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcZvsHz3dGUZr2nY5lYJHI4sUze6bfDp/wpCNMF5EpeK2rNz0lQiUKg8zpvjuohY1fRZEJOHubGVuNRaJG5W/0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T00:55:21.109 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T00:55:21.110 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T00:55:21.110 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T00:55:21.112 INFO:teuthology.task.internal:Checking packages... 2024-09-21T00:55:21.133 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T00:55:21.133 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T00:55:21.133 INFO:teuthology.packaging:ref: None 2024-09-21T00:55:21.133 INFO:teuthology.packaging:tag: None 2024-09-21T00:55:21.133 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:55:21.133 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T00:55:21.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T00:55:21.278 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T00:55:21.279 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T00:55:21.286 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T00:55:21.286 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T00:55:21.308 INFO:teuthology.task.internal:Saving configuration 2024-09-21T00:55:21.326 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T00:55:21.333 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T00:55:21.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:50:27.407991', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObkQqDZErXgLOhSQHYxQzBrTZuvUlLsXndJkd6CR3SxmVgloGxMVSHAkvP/R64kq82qNtKviIPGDdQIuzxtRcc='} 2024-09-21T00:55:21.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:50:27.410732', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB4pk/Jkn4nfoY2ndM9qQxB0zif+DNSacjIgMXnztTFM1cswIG1sY080W+t0wrroHtpu0ZNC4UJbluTV3xLYCC0='} 2024-09-21T00:55:21.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 00:50:27.409456', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcZvsHz3dGUZr2nY5lYJHI4sUze6bfDp/wpCNMF5EpeK2rNz0lQiUKg8zpvjuohY1fRZEJOHubGVuNRaJG5W/0='} 2024-09-21T00:55:21.386 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T00:55:21.392 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T00:55:21.392 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T00:55:21.392 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T00:55:21.392 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T00:55:21.481 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdecf210160>, signals=[15]) 2024-09-21T00:55:21.481 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T00:55:21.488 INFO:teuthology.task.internal:Opening connections... 2024-09-21T00:55:21.488 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T00:55:21.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:55:21.572 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-21T00:55:21.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:55:21.663 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-21T00:55:21.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:55:21.770 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T00:55:21.777 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-21T00:55:21.796 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-21T00:55:21.796 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:55:21.853 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:55:21.854 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:55:21.854 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-21T00:55:21.869 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-21T00:55:21.888 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-21T00:55:21.888 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-21T00:55:21.945 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-09-21T00:55:21.945 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:55:21.946 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:55:21.947 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-21T00:55:21.969 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-21T00:55:21.988 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-21T00:55:21.989 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-21T00:55:22.046 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-21T00:55:22.046 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T00:55:22.047 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T00:55:22.048 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-21T00:55:22.069 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T00:55:22.086 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T00:55:22.106 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T00:55:22.107 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:55:22.109 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:55:22.111 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-21T00:55:22.129 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T00:55:22.143 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T00:55:22.144 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:55:22.166 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:55:22.169 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-21T00:55:22.256 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T00:55:22.330 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T00:55:22.344 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T00:55:22.345 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T00:55:22.345 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T00:55:22.345 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:55:22.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:55:22.363 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-21T00:55:22.421 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-21T00:55:22.421 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-503.el9.x86_64 2024-09-21T00:55:22.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-09-21T00:55:26.179 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.3 MB 00:02 2024-09-21T00:55:29.322 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-21T00:55:35.015 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-21T00:55:36.432 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 139 kB/s | 19 kB 00:00 2024-09-21T00:55:37.886 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-21T00:55:43.692 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T00:55:45.665 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T00:55:45.665 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T00:55:45.768 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T00:55:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 79 M 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 126 M 2024-09-21T00:55:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-21T00:55:45.944 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 313 kB/s | 36 kB 00:00 2024-09-21T00:55:48.960 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.0 MB/s | 16 MB 00:03 2024-09-21T00:55:50.435 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.4 MB/s | 29 MB 00:04 2024-09-21T00:55:51.060 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.6 MB/s | 35 MB 00:05 2024-09-21T00:55:51.061 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-21T00:55:51.061 INFO:teuthology.orchestra.run.smithi037.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-21T00:55:51.767 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-21T00:55:52.144 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-21T00:55:52.144 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-21T00:55:53.100 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-21T00:55:53.101 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-21T00:55:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-21T00:55:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:55:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:55:59.192 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:55:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:56:04.461 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:56:04.499 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:56:09.647 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:56:48.591 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:56:48.632 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:56:48.929 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:56:48.929 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T00:56:48.929 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T00:56:48.929 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T00:56:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T00:56:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T00:56:49.837 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-21T00:56:50.318 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:56:50.414 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:56:50.415 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:56:50.415 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T00:56:50.415 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T00:56:50.415 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T00:56:50.415 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T00:56:50.416 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T00:56:50.416 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T00:56:50.475 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T00:56:50.475 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T00:56:50.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-21T00:56:50.506 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T00:56:50.507 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T00:56:50.508 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T00:56:50.509 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T00:56:50.509 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-508.el9.x86_64 2024-09-21T00:56:50.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T00:56:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-21T00:56:52.433 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T00:56:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-21T00:56:52.464 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-21T00:56:52.479 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.NXoFmORID0 2024-09-21T00:56:52.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NXoFmORID0 2024-09-21T00:56:52.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.NXoFmORID0 2024-09-21T00:56:52.692 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.NXoFmORID0 is 6KB 2024-09-21T00:56:52.740 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.NXoFmORID0 2024-09-21T00:56:52.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T00:56:52.822 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T00:56:52.822 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T00:56:52.822 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T00:56:52.822 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T00:56:52.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T00:56:52.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-21T00:57:22.970 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T00:57:22.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T00:57:22.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:57:41.359 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-21T00:57:50.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T00:57:50.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:58:08.751 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-21T00:58:20.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T00:58:20.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T00:58:24.377 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-21T00:58:24.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T00:58:24.810 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T00:58:24.811 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-21T00:58:24.825 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-508.el9.x86_64 2024-09-21T00:58:24.825 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T00:58:24.826 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T00:58:24.826 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T00:58:25.827 DEBUG:teuthology.parallel:result is None 2024-09-21T00:58:25.827 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T00:58:25.835 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T00:58:25.835 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:58:25.838 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:58:25.841 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T00:58:25.860 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T00:58:25.866 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T00:58:25.874 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T00:58:25.874 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:58:25.894 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:58:25.899 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T00:58:25.944 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T00:58:25.950 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T00:58:25.950 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:58:25.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:58:25.995 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T00:58:26.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:58:26.012 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:58:26.014 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:58:26.038 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T00:58:26.089 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:58:26.099 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:58:26.114 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:58:26.117 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:58:26.135 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:58:26.141 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T00:58:26.143 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T00:58:26.151 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T00:58:26.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:58:26.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:58:26.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T00:58:26.183 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T00:58:26.192 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T00:58:26.192 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:58:26.221 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:58:26.224 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T00:58:26.241 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:58:26.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:58:26.369 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:58:26.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:58:26.492 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T00:58:26.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:58:26.572 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:58:26.616 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:58:26.666 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:58:26.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:58:26.793 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T00:58:26.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:58:26.860 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:58:26.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T00:58:26.961 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:58:27.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T00:58:27.090 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T00:58:27.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T00:58:27.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-21T00:58:27.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-21T00:58:27.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-21T00:58:27.197 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:58:27.203 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:58:27.245 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T00:58:27.712 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T00:58:27.724 INFO:teuthology.task.internal:Starting timer... 2024-09-21T00:58:27.724 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T00:58:27.739 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T00:58:27.805 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T00:58:27.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-21T00:58:27.869 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-21T00:58:27.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-09-21T00:58:27.941 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-09-21T00:58:27.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-21T00:58:28.003 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-21T00:58:28.005 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T00:58:28.005 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-21T00:58:28.032 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-21T00:58:28.032 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-09-21T00:58:28.058 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-09-21T00:58:28.058 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-21T00:58:28.080 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-21T00:58:28.080 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2024-09-21T00:58:28.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:58:28.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:58:28.107 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:58:28.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:58:28.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T00:58:28.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T00:58:28.164 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T00:58:28.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:58:28.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:58:28.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-21T00:58:28.263 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T00:58:28.272 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T00:58:28.274 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T00:58:28.379 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T00:58:28.389 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T00:58:28.390 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi137.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T01:02:32.882 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-09-21T01:02:32.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T01:02:32.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:02:32.960 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-21T01:02:33.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-21T01:02:33.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-21T01:02:33.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:02:33.113 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-21T01:02:33.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-21T01:02:33.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-21T01:02:33.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:02:33.223 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-21T01:02:33.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-21T01:02:33.259 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T01:02:33.269 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T01:02:33.269 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:02:33.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:02:33.272 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:02:33.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:02:33.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:02:33.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:02:33.303 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:02:33.303 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:02:33.318 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:02:33.319 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:02:33.328 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:02:33.342 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:02:33.344 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-09-21T01:02:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-21T01:02:33.355 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-09-21T01:02:33.357 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-21T01:02:33.367 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-21T01:02:33.370 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:02:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:02:33.378 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-21T01:02:33.385 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:02:33.387 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:02:33.393 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:02:33.407 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:02:33.440 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:02:33.443 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:02:33.444 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-21T01:02:33.444 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.444 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.444 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.444 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:02:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:02:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-21T01:02:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.448 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.461 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:02:33.465 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:02:33.465 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-21T01:02:33.465 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.465 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.465 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.465 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:02:33.466 INFO:teuthology.run_tasks:Running task install... 2024-09-21T01:02:33.474 DEBUG:teuthology.task.install:project ceph 2024-09-21T01:02:33.477 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T01:02:33.478 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T01:02:33.478 INFO:teuthology.task.install:Using flavor: default 2024-09-21T01:02:33.483 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T01:02:33.483 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T01:02:33.483 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:02:33.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:33.485 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:02:33.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:33.486 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:02:33.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:02:33.636 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:02:33.636 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:02:33.650 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:02:33.650 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:02:33.654 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:02:33.654 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:02:33.745 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:02:33.745 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:02:33.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:02:33.756 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:02:33.757 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:02:33.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:02:33.764 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:02:33.765 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:02:33.765 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:02:33.771 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:02:33.771 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:02:33.783 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:02:33.783 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:02:33.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:02:33.792 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:02:33.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:02:33.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:02:33.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:02:33.911 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:02:33.927 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:02:33.931 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:02:33.975 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-21T01:02:33.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-21T01:02:33.992 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-21T01:02:33.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-21T01:02:33.995 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-09-21T01:02:33.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-09-21T01:02:34.201 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-21T01:02:34.219 INFO:teuthology.orchestra.run.smithi137.stdout:45 files removed 2024-09-21T01:02:34.228 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:02:34.231 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-21T01:02:34.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:02:34.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:02:34.769 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T01:02:34.781 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 326 kB/s | 84 kB 00:00 2024-09-21T01:02:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-21T01:02:35.045 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-21T01:02:35.057 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-21T01:02:35.113 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T01:02:35.304 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-21T01:02:35.316 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-21T01:02:35.389 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T01:02:35.816 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-21T01:02:36.979 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.3 MB 00:01 2024-09-21T01:02:37.906 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-21T01:02:38.067 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-21T01:02:38.722 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T01:02:39.807 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-21T01:02:42.934 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-09-21T01:02:43.040 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T01:02:44.141 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-21T01:02:44.452 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-21T01:02:44.665 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-21T01:02:45.684 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-21T01:02:45.694 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T01:02:45.697 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-21T01:02:47.324 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-21T01:02:51.135 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-21T01:02:51.137 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T01:02:52.911 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T01:02:53.246 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:02:53.247 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:02:53.260 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:02:53.261 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:02:53.262 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:02:53.264 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:02:53.265 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:02:53.268 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:02:53.269 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:02:53.280 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:02:53.281 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:02:53.292 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:02:53.293 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:02:53.293 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:02:53.295 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:02:53.296 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:02:53.298 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:02:53.299 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:02:53.333 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:02:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:02:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:02:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:02:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:02:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:02:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:02:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:02:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:02:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:02:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:02:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:02:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout:Install 149 Packages 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 8 Packages 2024-09-21T01:02:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:02:53.368 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-21T01:02:53.368 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 228 M 2024-09-21T01:02:53.368 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-21T01:02:53.380 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-09-21T01:02:53.380 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-21T01:02:53.380 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:02:53.381 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:02:53.382 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:02:53.383 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:02:53.384 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:02:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:02:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:02:53.387 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:02:53.388 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:02:53.389 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:02:53.390 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:02:53.391 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-21T01:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-09-21T01:02:53.393 INFO:teuthology.orchestra.run.smithi137.stdout:Install 149 Packages 2024-09-21T01:02:53.393 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 8 Packages 2024-09-21T01:02:53.393 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:02:53.393 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 228 M 2024-09-21T01:02:53.393 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-21T01:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-21T01:02:54.186 INFO:teuthology.orchestra.run.smithi144.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T01:02:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T01:02:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T01:02:54.437 INFO:teuthology.orchestra.run.smithi144.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T01:02:54.447 INFO:teuthology.orchestra.run.smithi137.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-09-21T01:02:54.737 INFO:teuthology.orchestra.run.smithi144.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T01:02:54.847 INFO:teuthology.orchestra.run.smithi137.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.1 MB/s | 873 kB 00:00 2024-09-21T01:02:54.914 INFO:teuthology.orchestra.run.smithi137.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T01:02:54.929 INFO:teuthology.orchestra.run.smithi144.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T01:02:54.980 INFO:teuthology.orchestra.run.smithi144.stdout:(8/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.2 MB/s | 2.3 MB 00:00 2024-09-21T01:02:55.055 INFO:teuthology.orchestra.run.smithi144.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 337 kB/s | 25 kB 00:00 2024-09-21T01:02:55.321 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:02:55.322 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:02:55.334 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:02:55.335 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:02:55.336 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:02:55.337 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:02:55.338 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:02:55.341 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:02:55.342 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:02:55.408 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-21T01:02:55.413 INFO:teuthology.orchestra.run.smithi144.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 22 MB/s | 10 MB 00:00 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:02:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:02:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:02:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:02:55.432 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:02:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:02:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:02:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:02:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:02:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:02:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:02:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:02:55.440 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout:Install 149 Packages 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:02:55.441 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 228 M 2024-09-21T01:02:55.442 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-21T01:02:55.463 INFO:teuthology.orchestra.run.smithi144.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T01:02:55.464 INFO:teuthology.orchestra.run.smithi137.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.2 MB/s | 2.3 MB 00:00 2024-09-21T01:02:55.531 INFO:teuthology.orchestra.run.smithi144.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T01:02:55.539 INFO:teuthology.orchestra.run.smithi137.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 4.2 MB/s | 5.5 MB 00:01 2024-09-21T01:02:55.689 INFO:teuthology.orchestra.run.smithi137.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-09-21T01:02:55.731 INFO:teuthology.orchestra.run.smithi144.stdout:(13/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 18 MB/s | 18 MB 00:00 2024-09-21T01:02:55.756 INFO:teuthology.orchestra.run.smithi144.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 141 kB/s | 32 kB 00:00 2024-09-21T01:02:55.806 INFO:teuthology.orchestra.run.smithi144.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T01:02:55.832 INFO:teuthology.orchestra.run.smithi144.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.0 MB/s | 158 kB 00:00 2024-09-21T01:02:55.857 INFO:teuthology.orchestra.run.smithi144.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.4 MB/s | 127 kB 00:00 2024-09-21T01:02:55.890 INFO:teuthology.orchestra.run.smithi137.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.0 MB 00:00 2024-09-21T01:02:55.893 INFO:teuthology.orchestra.run.smithi144.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.2 MB/s | 507 kB 00:00 2024-09-21T01:02:55.968 INFO:teuthology.orchestra.run.smithi144.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 603 kB/s | 45 kB 00:00 2024-09-21T01:02:56.052 INFO:teuthology.orchestra.run.smithi144.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T01:02:56.144 INFO:teuthology.orchestra.run.smithi144.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.3 MB 00:00 2024-09-21T01:02:56.177 INFO:teuthology.orchestra.run.smithi144.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.3 MB/s | 161 kB 00:00 2024-09-21T01:02:56.211 INFO:teuthology.orchestra.run.smithi144.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T01:02:56.228 INFO:teuthology.orchestra.run.smithi037.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-09-21T01:02:56.253 INFO:teuthology.orchestra.run.smithi144.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T01:02:56.278 INFO:teuthology.orchestra.run.smithi144.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.5 MB/s | 99 kB 00:00 2024-09-21T01:02:56.345 INFO:teuthology.orchestra.run.smithi144.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 938 kB/s | 86 kB 00:00 2024-09-21T01:02:56.445 INFO:teuthology.orchestra.run.smithi144.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T01:02:56.529 INFO:teuthology.orchestra.run.smithi144.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T01:02:56.554 INFO:teuthology.orchestra.run.smithi144.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 315 kB/s | 34 kB 00:00 2024-09-21T01:02:56.588 INFO:teuthology.orchestra.run.smithi144.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T01:02:56.615 INFO:teuthology.orchestra.run.smithi137.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 14 MB/s | 10 MB 00:00 2024-09-21T01:02:56.854 INFO:teuthology.orchestra.run.smithi037.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 873 kB 00:00 2024-09-21T01:02:56.996 INFO:teuthology.orchestra.run.smithi037.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.0 MB/s | 148 kB 00:00 2024-09-21T01:02:57.080 INFO:teuthology.orchestra.run.smithi144.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-21T01:02:57.124 INFO:teuthology.orchestra.run.smithi137.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 49 kB/s | 25 kB 00:00 2024-09-21T01:02:57.172 INFO:teuthology.orchestra.run.smithi144.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T01:02:57.322 INFO:teuthology.orchestra.run.smithi144.stdout:(33/157): ceph-mgr-dashboard-19.3.0-5120.g18432 18 MB/s | 14 MB 00:00 2024-09-21T01:02:57.347 INFO:teuthology.orchestra.run.smithi144.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 281 kB/s | 49 kB 00:00 2024-09-21T01:02:57.389 INFO:teuthology.orchestra.run.smithi144.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 247 kB/s | 16 kB 00:00 2024-09-21T01:02:57.448 INFO:teuthology.orchestra.run.smithi144.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.8 MB/s | 285 kB 00:00 2024-09-21T01:02:57.490 INFO:teuthology.orchestra.run.smithi144.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.6 MB/s | 784 kB 00:00 2024-09-21T01:02:57.516 INFO:teuthology.orchestra.run.smithi144.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 274 kB/s | 18 kB 00:00 2024-09-21T01:02:57.538 INFO:teuthology.orchestra.run.smithi037.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.2 MB/s | 2.3 MB 00:00 2024-09-21T01:02:57.565 INFO:teuthology.orchestra.run.smithi137.stdout:(10/157): ceph-common-19.3.0-5120.g18432218.el9 6.0 MB/s | 20 MB 00:03 2024-09-21T01:02:57.632 INFO:teuthology.orchestra.run.smithi144.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-21T01:02:57.705 INFO:teuthology.orchestra.run.smithi037.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 9.1 MB/s | 1.5 MB 00:00 2024-09-21T01:02:57.708 INFO:teuthology.orchestra.run.smithi144.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T01:02:57.732 INFO:teuthology.orchestra.run.smithi137.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 8.7 MB/s | 18 MB 00:02 2024-09-21T01:02:57.733 INFO:teuthology.orchestra.run.smithi144.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T01:02:57.757 INFO:teuthology.orchestra.run.smithi137.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.1 MB/s | 226 kB 00:00 2024-09-21T01:02:57.758 INFO:teuthology.orchestra.run.smithi144.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-21T01:02:57.783 INFO:teuthology.orchestra.run.smithi137.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T01:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T01:02:57.808 INFO:teuthology.orchestra.run.smithi137.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 633 kB/s | 32 kB 00:00 2024-09-21T01:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-21T01:02:57.858 INFO:teuthology.orchestra.run.smithi137.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T01:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T01:02:57.875 INFO:teuthology.orchestra.run.smithi137.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T01:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T01:02:57.917 INFO:teuthology.orchestra.run.smithi137.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T01:02:57.918 INFO:teuthology.orchestra.run.smithi144.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T01:02:57.942 INFO:teuthology.orchestra.run.smithi137.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T01:02:58.009 INFO:teuthology.orchestra.run.smithi137.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 676 kB/s | 45 kB 00:00 2024-09-21T01:02:58.084 INFO:teuthology.orchestra.run.smithi137.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T01:02:58.088 INFO:teuthology.orchestra.run.smithi037.stdout:(6/157): ceph-base-19.3.0-5120.g18432218.el9.x8 2.7 MB/s | 5.5 MB 00:02 2024-09-21T01:02:58.143 INFO:teuthology.orchestra.run.smithi137.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T01:02:58.155 INFO:teuthology.orchestra.run.smithi037.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-21T01:02:58.168 INFO:teuthology.orchestra.run.smithi144.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-21T01:02:58.202 INFO:teuthology.orchestra.run.smithi137.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T01:02:58.219 INFO:teuthology.orchestra.run.smithi144.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-21T01:02:58.261 INFO:teuthology.orchestra.run.smithi144.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-21T01:02:58.277 INFO:teuthology.orchestra.run.smithi137.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T01:02:58.286 INFO:teuthology.orchestra.run.smithi144.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-21T01:02:58.336 INFO:teuthology.orchestra.run.smithi144.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-21T01:02:58.344 INFO:teuthology.orchestra.run.smithi137.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T01:02:58.369 INFO:teuthology.orchestra.run.smithi137.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.1 MB/s | 99 kB 00:00 2024-09-21T01:02:58.387 INFO:teuthology.orchestra.run.smithi144.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T01:02:58.403 INFO:teuthology.orchestra.run.smithi137.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T01:02:58.437 INFO:teuthology.orchestra.run.smithi144.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-21T01:02:58.478 INFO:teuthology.orchestra.run.smithi137.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T01:02:58.487 INFO:teuthology.orchestra.run.smithi144.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T01:02:58.545 INFO:teuthology.orchestra.run.smithi137.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 515 kB/s | 34 kB 00:00 2024-09-21T01:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T01:02:58.621 INFO:teuthology.orchestra.run.smithi137.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.0 MB/s | 154 kB 00:00 2024-09-21T01:02:58.655 INFO:teuthology.orchestra.run.smithi144.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-21T01:02:58.696 INFO:teuthology.orchestra.run.smithi144.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T01:02:58.737 INFO:teuthology.orchestra.run.smithi137.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.4 MB/s | 3.1 MB 00:00 2024-09-21T01:02:58.847 INFO:teuthology.orchestra.run.smithi037.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 15 MB/s | 10 MB 00:00 2024-09-21T01:02:58.863 INFO:teuthology.orchestra.run.smithi144.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-21T01:02:58.922 INFO:teuthology.orchestra.run.smithi037.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 336 kB/s | 25 kB 00:00 2024-09-21T01:02:59.006 INFO:teuthology.orchestra.run.smithi144.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T01:02:59.081 INFO:teuthology.orchestra.run.smithi144.stdout:(61/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-21T01:02:59.106 INFO:teuthology.orchestra.run.smithi144.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-21T01:02:59.131 INFO:teuthology.orchestra.run.smithi144.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T01:02:59.190 INFO:teuthology.orchestra.run.smithi144.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T01:02:59.215 INFO:teuthology.orchestra.run.smithi144.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T01:02:59.240 INFO:teuthology.orchestra.run.smithi144.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-21T01:02:59.913 INFO:teuthology.orchestra.run.smithi137.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 14 MB/s | 40 MB 00:02 2024-09-21T01:03:00.013 INFO:teuthology.orchestra.run.smithi137.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 5.8 MB/s | 7.4 MB 00:01 2024-09-21T01:03:00.038 INFO:teuthology.orchestra.run.smithi137.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.3 MB/s | 292 kB 00:00 2024-09-21T01:03:00.091 INFO:teuthology.orchestra.run.smithi144.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-09-21T01:03:00.149 INFO:teuthology.orchestra.run.smithi144.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.3 MB/s | 4.9 MB 00:00 2024-09-21T01:03:00.189 INFO:teuthology.orchestra.run.smithi137.stdout:(34/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.0 MB/s | 14 MB 00:01 2024-09-21T01:03:00.205 INFO:teuthology.orchestra.run.smithi137.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 99 kB/s | 16 kB 00:00 2024-09-21T01:03:00.222 INFO:teuthology.orchestra.run.smithi137.stdout:(36/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 236 kB/s | 49 kB 00:00 2024-09-21T01:03:00.256 INFO:teuthology.orchestra.run.smithi137.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 4.2 MB/s | 285 kB 00:00 2024-09-21T01:03:00.273 INFO:teuthology.orchestra.run.smithi137.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 367 kB/s | 18 kB 00:00 2024-09-21T01:03:00.306 INFO:teuthology.orchestra.run.smithi137.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.6 MB/s | 784 kB 00:00 2024-09-21T01:03:00.317 INFO:teuthology.orchestra.run.smithi144.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-21T01:03:00.382 INFO:teuthology.orchestra.run.smithi137.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-21T01:03:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-21T01:03:00.407 INFO:teuthology.orchestra.run.smithi137.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T01:03:00.409 INFO:teuthology.orchestra.run.smithi144.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T01:03:00.457 INFO:teuthology.orchestra.run.smithi137.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-21T01:03:00.516 INFO:teuthology.orchestra.run.smithi137.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-21T01:03:00.564 INFO:teuthology.orchestra.run.smithi037.stdout:(10/157): ceph-test-19.3.0-5120.g18432218.el9.x 24 MB/s | 40 MB 00:01 2024-09-21T01:03:00.574 INFO:teuthology.orchestra.run.smithi137.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-21T01:03:00.600 INFO:teuthology.orchestra.run.smithi137.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 751 kB/s | 106 kB 00:00 2024-09-21T01:03:00.609 INFO:teuthology.orchestra.run.smithi144.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-21T01:03:00.614 INFO:teuthology.orchestra.run.smithi037.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T01:03:00.625 INFO:teuthology.orchestra.run.smithi137.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-21T01:03:00.656 INFO:teuthology.orchestra.run.smithi037.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 652 kB/s | 27 kB 00:00 2024-09-21T01:03:00.675 INFO:teuthology.orchestra.run.smithi137.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-21T01:03:00.698 INFO:teuthology.orchestra.run.smithi037.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 762 kB/s | 32 kB 00:00 2024-09-21T01:03:00.717 INFO:teuthology.orchestra.run.smithi137.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-21T01:03:00.786 INFO:teuthology.orchestra.run.smithi037.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.6 MB/s | 766 kB 00:00 2024-09-21T01:03:00.809 INFO:teuthology.orchestra.run.smithi144.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-21T01:03:00.832 INFO:teuthology.orchestra.run.smithi037.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.4 MB/s | 158 kB 00:00 2024-09-21T01:03:00.882 INFO:teuthology.orchestra.run.smithi037.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:03:00.933 INFO:teuthology.orchestra.run.smithi037.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T01:03:01.026 INFO:teuthology.orchestra.run.smithi137.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 346 kB/s | 107 kB 00:00 2024-09-21T01:03:01.093 INFO:teuthology.orchestra.run.smithi137.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 326 kB/s | 22 kB 00:00 2024-09-21T01:03:01.133 INFO:teuthology.orchestra.run.smithi037.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 26 MB/s | 5.3 MB 00:00 2024-09-21T01:03:01.175 INFO:teuthology.orchestra.run.smithi037.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.1 MB/s | 45 kB 00:00 2024-09-21T01:03:01.218 INFO:teuthology.orchestra.run.smithi144.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 6.9 MB/s | 5.8 MB 00:00 2024-09-21T01:03:01.225 INFO:teuthology.orchestra.run.smithi037.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T01:03:01.251 INFO:teuthology.orchestra.run.smithi137.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-09-21T01:03:01.267 INFO:teuthology.orchestra.run.smithi037.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.8 MB/s | 161 kB 00:00 2024-09-21T01:03:01.268 INFO:teuthology.orchestra.run.smithi144.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T01:03:01.326 INFO:teuthology.orchestra.run.smithi037.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T01:03:01.335 INFO:teuthology.orchestra.run.smithi137.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-09-21T01:03:01.344 INFO:teuthology.orchestra.run.smithi144.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-21T01:03:01.360 INFO:teuthology.orchestra.run.smithi137.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T01:03:01.376 INFO:teuthology.orchestra.run.smithi037.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T01:03:01.411 INFO:teuthology.orchestra.run.smithi137.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 986 kB/s | 313 kB 00:00 2024-09-21T01:03:01.418 INFO:teuthology.orchestra.run.smithi037.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 2.3 MB/s | 99 kB 00:00 2024-09-21T01:03:01.428 INFO:teuthology.orchestra.run.smithi137.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 269 kB/s | 18 kB 00:00 2024-09-21T01:03:01.444 INFO:teuthology.orchestra.run.smithi144.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-21T01:03:01.468 INFO:teuthology.orchestra.run.smithi037.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:03:01.478 INFO:teuthology.orchestra.run.smithi137.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-21T01:03:01.554 INFO:teuthology.orchestra.run.smithi137.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-21T01:03:01.601 INFO:teuthology.orchestra.run.smithi037.stdout:(26/157): rbd-mirror-19.3.0-5120.g18432218.el9. 23 MB/s | 3.1 MB 00:00 2024-09-21T01:03:01.619 INFO:teuthology.orchestra.run.smithi144.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 146 kB/s | 26 kB 00:00 2024-09-21T01:03:01.621 INFO:teuthology.orchestra.run.smithi137.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 680 kB/s | 45 kB 00:00 2024-09-21T01:03:01.651 INFO:teuthology.orchestra.run.smithi037.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T01:03:01.669 INFO:teuthology.orchestra.run.smithi144.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-21T01:03:01.679 INFO:teuthology.orchestra.run.smithi137.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 799 kB/s | 160 kB 00:00 2024-09-21T01:03:01.702 INFO:teuthology.orchestra.run.smithi037.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 684 kB/s | 34 kB 00:00 2024-09-21T01:03:01.720 INFO:teuthology.orchestra.run.smithi144.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T01:03:01.752 INFO:teuthology.orchestra.run.smithi037.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T01:03:01.770 INFO:teuthology.orchestra.run.smithi144.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-21T01:03:01.921 INFO:teuthology.orchestra.run.smithi137.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-21T01:03:01.928 INFO:teuthology.orchestra.run.smithi144.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-09-21T01:03:01.980 INFO:teuthology.orchestra.run.smithi137.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T01:03:02.021 INFO:teuthology.orchestra.run.smithi144.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-21T01:03:02.038 INFO:teuthology.orchestra.run.smithi137.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-21T01:03:02.080 INFO:teuthology.orchestra.run.smithi137.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-21T01:03:02.104 INFO:teuthology.orchestra.run.smithi144.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-21T01:03:02.155 INFO:teuthology.orchestra.run.smithi144.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T01:03:02.194 INFO:teuthology.orchestra.run.smithi037.stdout:(30/157): ceph-mgr-dashboard-19.3.0-5120.g18432 32 MB/s | 14 MB 00:00 2024-09-21T01:03:02.205 INFO:teuthology.orchestra.run.smithi144.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-09-21T01:03:02.214 INFO:teuthology.orchestra.run.smithi137.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-21T01:03:02.289 INFO:teuthology.orchestra.run.smithi144.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-21T01:03:02.306 INFO:teuthology.orchestra.run.smithi137.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-09-21T01:03:02.323 INFO:teuthology.orchestra.run.smithi137.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-21T01:03:02.355 INFO:teuthology.orchestra.run.smithi144.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T01:03:02.439 INFO:teuthology.orchestra.run.smithi144.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-21T01:03:02.453 INFO:teuthology.orchestra.run.smithi037.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 29 MB/s | 7.4 MB 00:00 2024-09-21T01:03:02.481 INFO:teuthology.orchestra.run.smithi144.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T01:03:02.503 INFO:teuthology.orchestra.run.smithi037.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T01:03:02.553 INFO:teuthology.orchestra.run.smithi037.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 987 kB/s | 49 kB 00:00 2024-09-21T01:03:02.595 INFO:teuthology.orchestra.run.smithi037.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 393 kB/s | 16 kB 00:00 2024-09-21T01:03:02.646 INFO:teuthology.orchestra.run.smithi037.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T01:03:02.698 INFO:teuthology.orchestra.run.smithi137.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-09-21T01:03:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 12 MB/s | 784 kB 00:00 2024-09-21T01:03:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 446 kB/s | 18 kB 00:00 2024-09-21T01:03:02.831 INFO:teuthology.orchestra.run.smithi144.stdout:(91/157): ceph-test-19.3.0-5120.g18432218.el9.x 5.1 MB/s | 40 MB 00:07 2024-09-21T01:03:02.856 INFO:teuthology.orchestra.run.smithi144.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 143 kB/s | 54 kB 00:00 2024-09-21T01:03:02.897 INFO:teuthology.orchestra.run.smithi037.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-21T01:03:02.932 INFO:teuthology.orchestra.run.smithi144.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-21T01:03:02.949 INFO:teuthology.orchestra.run.smithi144.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-21T01:03:02.974 INFO:teuthology.orchestra.run.smithi144.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T01:03:03.016 INFO:teuthology.orchestra.run.smithi144.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 866 kB/s | 36 kB 00:00 2024-09-21T01:03:03.041 INFO:teuthology.orchestra.run.smithi144.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T01:03:03.067 INFO:teuthology.orchestra.run.smithi144.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T01:03:03.072 INFO:teuthology.orchestra.run.smithi037.stdout:(39/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 3.6 MB/s | 18 MB 00:04 2024-09-21T01:03:03.117 INFO:teuthology.orchestra.run.smithi144.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T01:03:03.151 INFO:teuthology.orchestra.run.smithi144.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-21T01:03:03.176 INFO:teuthology.orchestra.run.smithi144.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T01:03:03.201 INFO:teuthology.orchestra.run.smithi144.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T01:03:03.215 INFO:teuthology.orchestra.run.smithi137.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-09-21T01:03:03.227 INFO:teuthology.orchestra.run.smithi144.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T01:03:03.272 INFO:teuthology.orchestra.run.smithi037.stdout:(40/157): ceph-common-19.3.0-5120.g18432218.el9 2.8 MB/s | 20 MB 00:07 2024-09-21T01:03:03.285 INFO:teuthology.orchestra.run.smithi144.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-21T01:03:03.360 INFO:teuthology.orchestra.run.smithi144.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-21T01:03:03.394 INFO:teuthology.orchestra.run.smithi144.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T01:03:03.397 INFO:teuthology.orchestra.run.smithi037.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-21T01:03:03.419 INFO:teuthology.orchestra.run.smithi144.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-21T01:03:03.439 INFO:teuthology.orchestra.run.smithi037.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 521 kB/s | 191 kB 00:00 2024-09-21T01:03:03.489 INFO:teuthology.orchestra.run.smithi037.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T01:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-21T01:03:03.514 INFO:teuthology.orchestra.run.smithi037.stdout:(44/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-21T01:03:03.540 INFO:teuthology.orchestra.run.smithi037.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T01:03:03.548 INFO:teuthology.orchestra.run.smithi137.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-21T01:03:03.553 INFO:teuthology.orchestra.run.smithi144.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-21T01:03:03.565 INFO:teuthology.orchestra.run.smithi037.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T01:03:03.599 INFO:teuthology.orchestra.run.smithi037.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-21T01:03:03.612 INFO:teuthology.orchestra.run.smithi144.stdout:(110/157): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-21T01:03:03.615 INFO:teuthology.orchestra.run.smithi137.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T01:03:03.632 INFO:teuthology.orchestra.run.smithi037.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T01:03:03.637 INFO:teuthology.orchestra.run.smithi144.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-21T01:03:03.662 INFO:teuthology.orchestra.run.smithi144.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T01:03:03.688 INFO:teuthology.orchestra.run.smithi144.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T01:03:03.722 INFO:teuthology.orchestra.run.smithi144.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T01:03:03.733 INFO:teuthology.orchestra.run.smithi037.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-21T01:03:03.747 INFO:teuthology.orchestra.run.smithi144.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:03:03.758 INFO:teuthology.orchestra.run.smithi037.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-21T01:03:03.772 INFO:teuthology.orchestra.run.smithi144.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T01:03:03.783 INFO:teuthology.orchestra.run.smithi037.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T01:03:03.797 INFO:teuthology.orchestra.run.smithi144.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-21T01:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T01:03:03.825 INFO:teuthology.orchestra.run.smithi037.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-21T01:03:03.842 INFO:teuthology.orchestra.run.smithi037.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T01:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T01:03:03.849 INFO:teuthology.orchestra.run.smithi137.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-09-21T01:03:03.867 INFO:teuthology.orchestra.run.smithi037.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T01:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T01:03:03.884 INFO:teuthology.orchestra.run.smithi037.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-21T01:03:03.901 INFO:teuthology.orchestra.run.smithi037.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-21T01:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.4 MB/s | 220 kB 00:00 2024-09-21T01:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-21T01:03:03.951 INFO:teuthology.orchestra.run.smithi037.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T01:03:03.966 INFO:teuthology.orchestra.run.smithi144.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T01:03:03.976 INFO:teuthology.orchestra.run.smithi037.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-21T01:03:03.991 INFO:teuthology.orchestra.run.smithi144.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T01:03:04.002 INFO:teuthology.orchestra.run.smithi037.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-21T01:03:04.007 INFO:teuthology.orchestra.run.smithi137.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-21T01:03:04.017 INFO:teuthology.orchestra.run.smithi144.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 704 kB/s | 18 kB 00:00 2024-09-21T01:03:04.042 INFO:teuthology.orchestra.run.smithi144.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-21T01:03:04.044 INFO:teuthology.orchestra.run.smithi037.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T01:03:04.067 INFO:teuthology.orchestra.run.smithi144.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-21T01:03:04.094 INFO:teuthology.orchestra.run.smithi037.stdout:(61/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-21T01:03:04.099 INFO:teuthology.orchestra.run.smithi137.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 955 kB/s | 87 kB 00:00 2024-09-21T01:03:04.119 INFO:teuthology.orchestra.run.smithi037.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-21T01:03:04.126 INFO:teuthology.orchestra.run.smithi144.stdout:(128/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-21T01:03:04.143 INFO:teuthology.orchestra.run.smithi144.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-09-21T01:03:04.144 INFO:teuthology.orchestra.run.smithi037.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T01:03:04.168 INFO:teuthology.orchestra.run.smithi144.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:03:04.170 INFO:teuthology.orchestra.run.smithi037.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T01:03:04.195 INFO:teuthology.orchestra.run.smithi037.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-21T01:03:04.201 INFO:teuthology.orchestra.run.smithi144.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:03:04.229 INFO:teuthology.orchestra.run.smithi037.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 653 kB/s | 38 kB 00:00 2024-09-21T01:03:04.236 INFO:teuthology.orchestra.run.smithi144.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-21T01:03:04.757 INFO:teuthology.orchestra.run.smithi137.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-21T01:03:04.758 INFO:teuthology.orchestra.run.smithi137.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 408 kB/s | 61 kB 00:00 2024-09-21T01:03:04.758 INFO:teuthology.orchestra.run.smithi137.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-21T01:03:04.758 INFO:teuthology.orchestra.run.smithi137.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-21T01:03:04.758 INFO:teuthology.orchestra.run.smithi137.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 13 MB/s | 4.9 MB 00:00 2024-09-21T01:03:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-21T01:03:04.760 INFO:teuthology.orchestra.run.smithi037.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T01:03:04.760 INFO:teuthology.orchestra.run.smithi037.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T01:03:04.760 INFO:teuthology.orchestra.run.smithi037.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T01:03:04.760 INFO:teuthology.orchestra.run.smithi144.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 983 kB/s | 58 kB 00:00 2024-09-21T01:03:04.760 INFO:teuthology.orchestra.run.smithi144.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(145/157): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:03:04.761 INFO:teuthology.orchestra.run.smithi144.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T01:03:04.765 INFO:teuthology.orchestra.run.smithi037.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T01:03:04.799 INFO:teuthology.orchestra.run.smithi037.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T01:03:04.818 INFO:teuthology.orchestra.run.smithi137.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-21T01:03:04.884 INFO:teuthology.orchestra.run.smithi137.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T01:03:04.941 INFO:teuthology.orchestra.run.smithi037.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 146 kB/s | 26 kB 00:00 2024-09-21T01:03:04.941 INFO:teuthology.orchestra.run.smithi144.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 14 MB/s | 3.2 MB 00:00 2024-09-21T01:03:04.952 INFO:teuthology.orchestra.run.smithi137.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-09-21T01:03:04.966 INFO:teuthology.orchestra.run.smithi037.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 115 kB/s | 19 kB 00:00 2024-09-21T01:03:04.983 INFO:teuthology.orchestra.run.smithi037.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-21T01:03:05.008 INFO:teuthology.orchestra.run.smithi037.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-09-21T01:03:05.041 INFO:teuthology.orchestra.run.smithi144.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.5 MB/s | 3.4 MB 00:00 2024-09-21T01:03:05.092 INFO:teuthology.orchestra.run.smithi037.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-21T01:03:05.117 INFO:teuthology.orchestra.run.smithi037.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T01:03:05.125 INFO:teuthology.orchestra.run.smithi144.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T01:03:05.143 INFO:teuthology.orchestra.run.smithi037.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T01:03:05.167 INFO:teuthology.orchestra.run.smithi144.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 989 kB/s | 41 kB 00:00 2024-09-21T01:03:05.168 INFO:teuthology.orchestra.run.smithi037.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T01:03:05.193 INFO:teuthology.orchestra.run.smithi037.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-21T01:03:05.208 INFO:teuthology.orchestra.run.smithi144.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-21T01:03:05.218 INFO:teuthology.orchestra.run.smithi037.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T01:03:05.243 INFO:teuthology.orchestra.run.smithi037.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T01:03:05.250 INFO:teuthology.orchestra.run.smithi144.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 8.6 MB/s | 1.8 MB 00:00 2024-09-21T01:03:05.269 INFO:teuthology.orchestra.run.smithi037.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T01:03:05.292 INFO:teuthology.orchestra.run.smithi144.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-21T01:03:05.293 INFO:teuthology.orchestra.run.smithi037.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T01:03:05.319 INFO:teuthology.orchestra.run.smithi037.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T01:03:05.368 INFO:teuthology.orchestra.run.smithi144.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-21T01:03:05.394 INFO:teuthology.orchestra.run.smithi037.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T01:03:05.411 INFO:teuthology.orchestra.run.smithi037.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-21T01:03:05.428 INFO:teuthology.orchestra.run.smithi037.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T01:03:05.443 INFO:teuthology.orchestra.run.smithi137.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.2 MB/s | 5.8 MB 00:01 2024-09-21T01:03:05.453 INFO:teuthology.orchestra.run.smithi037.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-21T01:03:05.479 INFO:teuthology.orchestra.run.smithi037.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 710 kB/s | 36 kB 00:00 2024-09-21T01:03:05.495 INFO:teuthology.orchestra.run.smithi037.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T01:03:05.521 INFO:teuthology.orchestra.run.smithi037.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-21T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-21T01:03:05.563 INFO:teuthology.orchestra.run.smithi037.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-21T01:03:05.588 INFO:teuthology.orchestra.run.smithi037.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T01:03:05.614 INFO:teuthology.orchestra.run.smithi037.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-21T01:03:05.706 INFO:teuthology.orchestra.run.smithi037.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-21T01:03:05.746 INFO:teuthology.orchestra.run.smithi137.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 836 kB/s | 250 kB 00:00 2024-09-21T01:03:05.765 INFO:teuthology.orchestra.run.smithi037.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T01:03:05.877 INFO:teuthology.orchestra.run.smithi137.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-09-21T01:03:05.911 INFO:teuthology.orchestra.run.smithi137.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-21T01:03:05.931 INFO:teuthology.orchestra.run.smithi037.stdout:(106/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T01:03:05.944 INFO:teuthology.orchestra.run.smithi137.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T01:03:05.965 INFO:teuthology.orchestra.run.smithi037.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 1.5 MB/s | 308 kB 00:00 2024-09-21T01:03:05.978 INFO:teuthology.orchestra.run.smithi137.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-21T01:03:05.998 INFO:teuthology.orchestra.run.smithi037.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-21T01:03:06.024 INFO:teuthology.orchestra.run.smithi037.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-21T01:03:06.053 INFO:teuthology.orchestra.run.smithi137.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-21T01:03:06.065 INFO:teuthology.orchestra.run.smithi037.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T01:03:06.087 INFO:teuthology.orchestra.run.smithi137.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-21T01:03:06.099 INFO:teuthology.orchestra.run.smithi037.stdout:(111/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-09-21T01:03:06.124 INFO:teuthology.orchestra.run.smithi037.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-21T01:03:06.158 INFO:teuthology.orchestra.run.smithi037.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-21T01:03:06.162 INFO:teuthology.orchestra.run.smithi137.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-21T01:03:06.196 INFO:teuthology.orchestra.run.smithi137.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-21T01:03:06.208 INFO:teuthology.orchestra.run.smithi037.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T01:03:06.233 INFO:teuthology.orchestra.run.smithi037.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:03:06.259 INFO:teuthology.orchestra.run.smithi037.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T01:03:06.271 INFO:teuthology.orchestra.run.smithi137.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-09-21T01:03:06.317 INFO:teuthology.orchestra.run.smithi037.stdout:(117/157): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T01:03:06.338 INFO:teuthology.orchestra.run.smithi137.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-21T01:03:06.342 INFO:teuthology.orchestra.run.smithi037.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-21T01:03:06.368 INFO:teuthology.orchestra.run.smithi037.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T01:03:06.384 INFO:teuthology.orchestra.run.smithi144.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-09-21T01:03:06.389 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:03:06.389 INFO:teuthology.orchestra.run.smithi144.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-21T01:03:06.393 INFO:teuthology.orchestra.run.smithi037.stdout:(120/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-09-21T01:03:06.413 INFO:teuthology.orchestra.run.smithi137.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.5 MB/s | 5.1 MB 00:01 2024-09-21T01:03:06.426 INFO:teuthology.orchestra.run.smithi037.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-21T01:03:06.430 INFO:teuthology.orchestra.run.smithi137.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-21T01:03:06.452 INFO:teuthology.orchestra.run.smithi037.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T01:03:06.477 INFO:teuthology.orchestra.run.smithi037.stdout:(123/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-21T01:03:06.489 INFO:teuthology.orchestra.run.smithi137.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-21T01:03:06.502 INFO:teuthology.orchestra.run.smithi037.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-21T01:03:06.519 INFO:teuthology.orchestra.run.smithi037.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-21T01:03:06.530 INFO:teuthology.orchestra.run.smithi137.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T01:03:06.536 INFO:teuthology.orchestra.run.smithi037.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 524 kB/s | 18 kB 00:00 2024-09-21T01:03:06.547 INFO:teuthology.orchestra.run.smithi137.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-21T01:03:06.553 INFO:teuthology.orchestra.run.smithi037.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 687 kB/s | 23 kB 00:00 2024-09-21T01:03:06.570 INFO:teuthology.orchestra.run.smithi037.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 581 kB/s | 19 kB 00:00 2024-09-21T01:03:06.587 INFO:teuthology.orchestra.run.smithi037.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-09-21T01:03:06.604 INFO:teuthology.orchestra.run.smithi037.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T01:03:06.630 INFO:teuthology.orchestra.run.smithi037.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:03:06.655 INFO:teuthology.orchestra.run.smithi037.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T01:03:06.656 INFO:teuthology.orchestra.run.smithi137.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-21T01:03:06.681 INFO:teuthology.orchestra.run.smithi137.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-21T01:03:06.697 INFO:teuthology.orchestra.run.smithi037.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-21T01:03:06.722 INFO:teuthology.orchestra.run.smithi037.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-21T01:03:06.723 INFO:teuthology.orchestra.run.smithi137.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-21T01:03:06.747 INFO:teuthology.orchestra.run.smithi037.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-21T01:03:06.773 INFO:teuthology.orchestra.run.smithi037.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T01:03:06.782 INFO:teuthology.orchestra.run.smithi137.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-09-21T01:03:06.789 INFO:teuthology.orchestra.run.smithi037.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T01:03:06.799 INFO:teuthology.orchestra.run.smithi137.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 544 kB/s | 64 kB 00:00 2024-09-21T01:03:06.815 INFO:teuthology.orchestra.run.smithi037.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-09-21T01:03:06.840 INFO:teuthology.orchestra.run.smithi037.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:03:06.865 INFO:teuthology.orchestra.run.smithi037.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:03:06.891 INFO:teuthology.orchestra.run.smithi037.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-21T01:03:06.899 INFO:teuthology.orchestra.run.smithi137.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-21T01:03:06.916 INFO:teuthology.orchestra.run.smithi037.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T01:03:06.966 INFO:teuthology.orchestra.run.smithi137.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-21T01:03:06.969 INFO:teuthology.orchestra.run.smithi037.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-21T01:03:06.991 INFO:teuthology.orchestra.run.smithi037.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T01:03:06.999 INFO:teuthology.orchestra.run.smithi137.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T01:03:07.016 INFO:teuthology.orchestra.run.smithi137.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T01:03:07.017 INFO:teuthology.orchestra.run.smithi037.stdout:(145/157): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-09-21T01:03:07.042 INFO:teuthology.orchestra.run.smithi037.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T01:03:07.067 INFO:teuthology.orchestra.run.smithi037.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:03:07.083 INFO:teuthology.orchestra.run.smithi137.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-21T01:03:07.092 INFO:teuthology.orchestra.run.smithi037.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.4 MB/s | 427 kB 00:00 2024-09-21T01:03:07.125 INFO:teuthology.orchestra.run.smithi137.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-09-21T01:03:07.143 INFO:teuthology.orchestra.run.smithi037.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T01:03:07.151 INFO:teuthology.orchestra.run.smithi137.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T01:03:07.176 INFO:teuthology.orchestra.run.smithi137.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T01:03:07.243 INFO:teuthology.orchestra.run.smithi137.stdout:(112/157): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-21T01:03:07.268 INFO:teuthology.orchestra.run.smithi137.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-21T01:03:07.302 INFO:teuthology.orchestra.run.smithi137.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T01:03:07.319 INFO:teuthology.orchestra.run.smithi137.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T01:03:07.352 INFO:teuthology.orchestra.run.smithi137.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-21T01:03:07.369 INFO:teuthology.orchestra.run.smithi137.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-21T01:03:07.386 INFO:teuthology.orchestra.run.smithi137.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-09-21T01:03:07.411 INFO:teuthology.orchestra.run.smithi137.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T01:03:07.445 INFO:teuthology.orchestra.run.smithi137.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T01:03:07.460 INFO:teuthology.orchestra.run.smithi037.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.6 MB/s | 3.2 MB 00:00 2024-09-21T01:03:07.470 INFO:teuthology.orchestra.run.smithi137.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-21T01:03:07.496 INFO:teuthology.orchestra.run.smithi137.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T01:03:07.530 INFO:teuthology.orchestra.run.smithi137.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T01:03:07.555 INFO:teuthology.orchestra.run.smithi137.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T01:03:07.579 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-21T01:03:07.582 INFO:teuthology.orchestra.run.smithi137.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-21T01:03:07.585 INFO:teuthology.orchestra.run.smithi037.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 5.3 MB/s | 2.3 MB 00:00 2024-09-21T01:03:07.605 INFO:teuthology.orchestra.run.smithi137.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-21T01:03:07.631 INFO:teuthology.orchestra.run.smithi137.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-21T01:03:07.652 INFO:teuthology.orchestra.run.smithi037.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 5.8 MB/s | 3.4 MB 00:00 2024-09-21T01:03:07.656 INFO:teuthology.orchestra.run.smithi137.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-21T01:03:07.677 INFO:teuthology.orchestra.run.smithi037.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 447 kB/s | 41 kB 00:00 2024-09-21T01:03:07.706 INFO:teuthology.orchestra.run.smithi137.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-21T01:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-21T01:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-21T01:03:07.731 INFO:teuthology.orchestra.run.smithi137.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:03:07.752 INFO:teuthology.orchestra.run.smithi037.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-21T01:03:07.757 INFO:teuthology.orchestra.run.smithi137.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:03:07.782 INFO:teuthology.orchestra.run.smithi137.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T01:03:07.794 INFO:teuthology.orchestra.run.smithi037.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.4 MB/s | 1.8 MB 00:00 2024-09-21T01:03:07.816 INFO:teuthology.orchestra.run.smithi137.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-21T01:03:07.841 INFO:teuthology.orchestra.run.smithi137.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-21T01:03:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-21T01:03:07.866 INFO:teuthology.orchestra.run.smithi137.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-21T01:03:07.891 INFO:teuthology.orchestra.run.smithi137.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T01:03:07.903 INFO:teuthology.orchestra.run.smithi037.stdout:(157/157): NetworkManager-tui-1.51.0-1.el9.x86_ 993 kB/s | 249 kB 00:00 2024-09-21T01:03:07.910 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:03:07.910 INFO:teuthology.orchestra.run.smithi037.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T01:03:07.917 INFO:teuthology.orchestra.run.smithi137.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T01:03:07.942 INFO:teuthology.orchestra.run.smithi137.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T01:03:07.967 INFO:teuthology.orchestra.run.smithi137.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:03:07.993 INFO:teuthology.orchestra.run.smithi137.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:03:08.018 INFO:teuthology.orchestra.run.smithi137.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-21T01:03:08.043 INFO:teuthology.orchestra.run.smithi137.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T01:03:08.068 INFO:teuthology.orchestra.run.smithi137.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T01:03:08.094 INFO:teuthology.orchestra.run.smithi137.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T01:03:08.119 INFO:teuthology.orchestra.run.smithi137.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-21T01:03:08.144 INFO:teuthology.orchestra.run.smithi137.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T01:03:08.161 INFO:teuthology.orchestra.run.smithi137.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T01:03:08.212 INFO:teuthology.orchestra.run.smithi137.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-21T01:03:08.429 INFO:teuthology.orchestra.run.smithi137.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T01:03:08.487 INFO:teuthology.orchestra.run.smithi137.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T01:03:08.671 INFO:teuthology.orchestra.run.smithi137.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.9 MB/s | 1.8 MB 00:00 2024-09-21T01:03:08.713 INFO:teuthology.orchestra.run.smithi137.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.2 MB/s | 2.3 MB 00:00 2024-09-21T01:03:08.763 INFO:teuthology.orchestra.run.smithi137.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 446 kB/s | 41 kB 00:00 2024-09-21T01:03:08.814 INFO:teuthology.orchestra.run.smithi137.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-21T01:03:08.914 INFO:teuthology.orchestra.run.smithi137.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-21T01:03:09.072 INFO:teuthology.orchestra.run.smithi137.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-21T01:03:09.187 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-21T01:03:09.357 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-21T01:03:09.357 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-21T01:03:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-21T01:03:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-21T01:03:10.181 INFO:teuthology.orchestra.run.smithi137.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-09-21T01:03:10.186 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:03:10.187 INFO:teuthology.orchestra.run.smithi137.stdout:Total 14 MB/s | 228 MB 00:16 2024-09-21T01:03:11.426 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-21T01:03:11.578 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-21T01:03:11.578 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-21T01:03:11.709 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-21T01:03:11.710 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-21T01:03:13.399 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-21T01:03:13.400 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-21T01:03:16.028 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-21T01:03:16.138 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:03:16.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:03:16.238 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:03:16.272 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:03:16.297 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:03:16.342 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:03:16.672 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:03:16.791 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:03:16.917 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:03:16.941 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:03:17.033 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:03:17.062 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:03:17.100 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:03:17.260 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:03:17.318 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:03:17.361 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:03:17.469 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:03:17.497 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:03:17.560 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:03:17.582 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:03:17.602 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:03:17.800 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:03:17.950 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:03:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:03:18.150 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:18.210 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:18.487 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-21T01:03:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:03:18.581 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:03:18.583 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:03:18.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:03:18.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:03:18.680 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:03:18.692 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:03:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:03:18.741 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:03:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:03:18.766 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:03:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:03:18.819 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:03:18.833 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:03:18.861 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:03:18.929 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:03:18.991 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:03:19.022 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:03:19.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:03:19.138 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:03:19.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:03:19.195 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:03:19.220 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:03:19.249 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:03:19.318 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:03:19.325 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:03:19.372 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:03:19.445 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:03:19.455 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:03:19.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:03:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:03:19.585 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:03:19.615 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:03:19.632 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:03:19.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:03:19.780 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-21T01:03:19.838 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:03:19.895 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:03:19.902 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:03:19.923 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:03:19.939 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:03:20.000 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:03:20.030 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:03:20.035 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:03:20.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:03:20.060 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:03:20.111 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:03:20.124 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:03:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:03:20.169 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:03:20.170 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:03:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:03:20.368 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:03:20.415 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:03:20.444 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:03:20.556 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:03:20.561 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:03:20.565 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:03:20.628 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:03:20.687 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:03:20.698 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:03:20.712 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:03:20.727 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:03:20.792 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:03:20.795 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:03:20.808 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:20.825 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:03:20.854 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:03:20.865 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:03:20.883 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:20.897 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:03:20.933 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:03:20.979 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:03:21.006 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:03:21.056 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:03:21.059 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:03:21.084 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:03:21.109 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:03:21.128 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:21.173 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:03:21.202 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:03:21.243 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:03:21.244 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:03:21.265 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:03:21.270 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:03:21.286 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:03:21.286 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:03:21.305 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:03:21.306 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:03:21.327 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:03:21.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:03:21.449 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:03:21.462 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:03:21.497 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:03:21.540 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:03:21.573 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:03:21.589 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:03:21.600 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:03:21.673 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:03:21.687 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:03:21.701 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:03:21.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:03:21.753 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:03:21.795 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:03:21.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:03:21.804 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:21.836 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:03:21.860 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:03:21.878 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:21.890 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:03:21.932 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:03:21.940 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:03:21.976 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:03:22.004 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:03:22.071 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:03:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:03:22.095 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:03:22.109 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:03:22.119 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:03:22.137 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:03:22.171 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:03:22.197 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:03:22.204 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:03:22.218 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:03:22.250 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:03:22.256 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:03:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:03:22.291 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:03:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:03:22.334 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:03:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:03:22.373 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:03:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:03:22.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:03:22.417 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:03:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:03:22.449 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:03:22.493 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:03:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:03:22.525 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:03:22.553 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:03:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:03:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:03:22.621 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:03:22.675 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:03:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:03:22.705 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:03:22.741 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:03:22.745 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:03:22.831 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:03:22.881 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:03:22.923 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:03:22.952 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:03:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:03:23.021 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:03:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:03:23.067 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:03:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:03:23.140 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:03:23.140 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:03:23.186 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:03:23.237 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:03:23.272 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:03:23.319 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:03:23.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:03:23.452 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:03:23.463 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:03:23.501 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:03:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:03:23.558 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:03:23.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:03:23.632 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:03:23.689 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:03:23.695 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:03:23.734 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:03:23.740 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:03:23.776 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:03:23.821 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:03:23.824 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:03:23.840 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:03:23.860 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:03:23.862 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:03:23.922 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:03:23.952 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:03:23.986 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:03:24.024 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:03:24.048 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:03:24.066 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:03:24.085 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:03:24.138 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:03:24.210 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:03:24.239 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:03:24.278 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:03:24.370 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:03:24.385 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:03:24.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:03:24.433 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:03:24.463 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:03:24.505 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:03:24.546 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:03:24.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:03:24.582 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:03:24.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:03:24.629 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:03:24.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:03:24.665 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:03:24.694 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:03:24.708 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:03:24.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:03:24.759 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:03:24.789 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:03:24.816 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:03:24.895 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:03:24.935 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:03:24.951 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:03:24.977 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:03:24.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:03:25.022 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:03:25.055 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:03:25.079 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:03:25.098 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:03:25.111 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:03:25.138 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:03:25.150 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:03:25.167 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:03:25.176 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:03:25.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:03:25.244 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:03:25.286 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:03:25.319 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:03:25.409 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:03:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:03:25.459 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:03:25.490 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:03:25.597 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:03:25.606 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:03:25.666 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:03:25.738 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:03:25.783 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:03:25.811 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:03:25.845 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:03:25.884 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:03:25.916 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:03:25.946 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:03:25.972 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:03:26.005 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:03:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:03:26.081 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:03:26.094 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:03:26.165 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:03:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:03:26.192 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:03:26.211 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:03:26.225 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:03:26.243 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:03:26.345 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:03:26.402 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:03:26.439 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:03:26.488 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:03:26.521 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:03:26.549 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:03:26.597 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:03:26.626 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:03:26.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:03:26.688 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:03:26.718 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:03:26.722 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:03:26.754 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:03:26.821 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:03:26.857 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:03:27.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:03:27.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:03:27.117 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:03:27.157 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:03:27.167 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:03:27.191 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:03:27.260 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:03:27.289 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:03:27.338 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:03:27.382 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:03:27.469 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:03:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:03:27.527 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:03:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:03:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:03:27.711 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:03:27.741 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:03:27.819 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:03:27.853 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:03:27.981 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:03:28.466 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:03:28.597 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:03:29.308 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:03:29.382 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:03:29.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:03:29.442 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:03:29.785 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:03:29.817 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:03:29.830 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:03:29.895 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:03:29.913 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:29.922 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:03:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:03:29.948 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:29.956 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:03:29.960 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:03:29.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:03:30.282 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:03:30.336 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:03:30.435 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:03:30.465 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:03:30.501 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:30.542 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:03:30.559 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:03:30.568 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:03:30.640 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:03:30.643 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:03:30.643 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:03:30.644 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:03:30.644 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:30.670 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:03:30.678 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:03:31.000 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:03:31.032 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:03:31.103 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:03:31.133 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:03:33.088 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:33.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:33.427 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:33.463 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:33.728 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:33.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:03:33.871 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:03:33.871 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:03:33.871 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:03:33.871 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:33.904 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:03:34.032 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:03:34.075 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:03:34.170 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:03:34.170 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:03:34.170 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:03:34.170 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:34.201 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:03:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-21T01:03:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:42.681 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:03:42.697 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:03:42.698 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:42.698 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:03:42.698 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:44.293 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:03:44.320 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:03:44.320 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:44.320 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:03:44.320 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:03:44.320 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:03:44.320 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:44.544 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:03:44.567 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:03:44.567 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:44.567 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:03:44.567 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:03:44.567 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:03:44.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:03:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:03:45.060 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:45.060 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:03:45.060 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:03:45.060 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:03:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:45.166 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:03:45.223 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:03:45.279 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:03:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:03:45.520 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:03:45.598 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:03:45.687 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:03:45.831 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:03:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:03:45.911 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:03:45.947 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:03:46.088 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:03:46.088 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-09-21T01:03:46.088 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-09-21T01:03:46.088 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-09-21T01:03:46.088 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-09-21T01:03:46.088 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-09-21T01:03:46.089 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-09-21T01:03:46.089 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-09-21T01:03:46.089 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:46.262 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:03:46.278 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:03:46.278 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:46.279 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:03:46.279 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:46.382 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:03:46.382 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-21T01:03:46.383 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:46.390 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:03:46.420 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:03:46.453 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:03:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:03:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:03:46.565 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:03:46.582 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:03:46.582 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:46.582 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:03:46.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:47.873 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:03:47.900 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:03:47.900 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:47.900 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:03:47.901 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:03:47.901 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:03:47.901 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:48.124 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:03:48.147 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:03:48.147 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:48.148 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:03:48.148 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:03:48.148 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:03:48.148 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:48.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:48.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:03:48.536 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:03:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:03:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:03:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:03:48.536 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:48.625 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:03:48.648 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:03:48.649 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:48.649 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:03:48.649 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:03:48.649 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:03:48.649 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:48.754 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:03:48.803 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:03:48.858 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:03:49.027 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:03:49.050 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:03:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:03:49.053 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:49.053 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:03:49.053 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:03:49.053 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:03:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:49.099 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:03:49.159 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:03:49.168 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:03:49.217 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:03:49.257 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:03:49.288 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:03:49.397 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:03:49.433 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:03:49.465 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:03:49.493 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:03:49.494 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:03:49.537 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:03:49.619 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:03:49.706 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:03:49.717 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:03:49.759 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:03:49.868 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:03:49.896 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:03:49.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:03:49.925 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:03:49.944 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:03:49.949 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:03:49.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:03:50.007 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:03:50.032 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:03:50.376 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:03:50.403 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:03:50.436 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:03:50.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:03:50.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:03:50.714 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:03:50.742 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:03:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:03:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:03:51.053 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:03:51.076 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:03:51.076 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:51.076 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:03:51.076 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:03:51.076 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:03:51.077 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:51.120 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:03:51.132 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:03:51.230 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:03:51.276 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:03:52.239 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:03:52.273 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:03:52.296 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:03:52.297 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:52.340 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:03:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:03:52.363 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:52.363 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:03:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:03:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:03:52.430 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:52.430 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:03:52.430 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:03:52.430 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:03:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:03:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:03:52.772 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:52.773 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:03:52.773 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:03:52.773 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:03:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:03:53.198 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:03:53.254 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:03:53.936 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:03:53.998 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:03:54.214 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:03:54.246 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:03:54.359 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:03:54.529 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:03:54.556 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:03:54.581 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:03:54.581 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:54.581 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:03:54.582 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:03:54.582 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:03:54.582 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:54.632 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:03:54.644 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:03:54.742 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:03:54.788 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:03:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:03:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:03:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:03:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:03:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:03:55.401 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:55.401 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:03:55.401 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:03:55.402 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:03:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:03:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:03:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:03:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:03:55.754 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:03:55.784 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:03:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:03:55.809 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:55.809 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:03:55.809 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:03:55.809 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:03:55.809 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:55.852 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:03:55.875 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:03:55.875 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:55.875 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:03:55.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:55.927 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:03:55.951 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:03:55.951 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:55.951 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:03:55.952 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:03:55.952 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:03:55.952 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:56.278 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:03:56.302 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:03:56.302 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:56.302 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:03:56.302 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:03:56.302 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:03:56.303 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:03:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:03:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:03:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:03:56.704 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:56.704 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:03:56.704 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:03:56.704 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:03:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:56.739 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:03:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:03:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:03:56.770 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:56.770 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:03:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:56.778 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:03:56.819 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:03:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:03:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:03:56.847 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:56.847 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:03:56.847 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:03:56.847 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:03:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:56.876 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:03:56.903 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:03:57.081 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:03:57.159 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:03:57.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:03:57.189 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:03:57.206 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:03:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:03:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:03:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:03:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:03:57.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:03:57.219 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:03:57.265 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:03:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:03:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:03:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:03:58.720 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:03:58.809 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:03:58.850 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:03:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:03:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:03:59.038 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:03:59.064 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:03:59.064 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:03:59.132 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:03:59.132 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:03:59.199 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:03:59.224 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:03:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:03:59.229 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:03:59.409 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:03:59.409 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:03:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:03:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:00.274 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:04:00.315 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:04:00.356 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:04:00.388 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:04:00.415 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:04:00.595 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:04:00.645 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:04:00.675 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:04:00.705 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:04:00.743 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:04:01.256 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:04:01.299 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:04:01.320 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:04:01.461 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:04:01.502 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:04:01.543 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:04:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:04:01.601 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:04:01.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:04:01.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:04:01.886 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:04:01.916 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:04:01.962 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:04:02.152 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:04:02.254 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:04:02.294 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:04:02.383 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:04:02.431 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:04:02.457 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:04:02.483 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:04:02.483 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:04:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:04:02.575 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:04:02.636 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:04:02.642 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:04:02.667 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:04:02.673 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:04:02.673 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:04:02.676 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:04:02.698 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:04:02.844 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:04:02.845 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:04:02.937 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:04:02.999 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:03.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:04:03.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:04:03.742 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:04:03.832 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:04:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:04:03.892 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:04:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:04:03.918 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:04:03.994 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:04:03.994 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:04:04.070 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:04:04.094 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:04:04.100 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:04:04.101 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:04:04.288 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:04:04.288 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:04:04.381 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:04:04.450 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:05.846 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:04:05.847 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:04:05.848 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:04:05.849 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:04:05.861 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:04:05.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:04:05.863 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:04:05.864 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:04:05.865 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:04:05.866 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:04:05.867 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:04:05.868 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:04:05.869 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:04:05.870 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:04:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-21T01:04:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:04:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:04:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:04:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:04:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:04:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:04:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:04:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:04:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:04:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:04:08.474 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-21T01:04:08.910 DEBUG:teuthology.parallel:result is None 2024-09-21T01:04:09.321 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:04:09.322 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:04:09.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:04:09.324 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:04:09.324 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:04:09.324 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:04:09.324 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:04:09.335 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:04:09.335 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:04:09.335 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:04:09.335 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:04:09.335 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:04:09.336 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:04:09.337 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:04:09.337 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:04:09.337 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:04:09.338 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:04:09.338 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:04:09.338 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:04:09.338 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:04:09.339 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:04:09.340 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:04:09.341 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:04:09.342 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:04:09.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:04:09.344 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:04:09.345 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:04:09.346 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:04:09.347 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:04:09.348 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:04:09.349 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:04:10.644 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:10.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:04:10.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:04:10.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:04:10.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:04:10.659 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:04:10.659 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:04:10.659 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:04:10.659 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:04:10.659 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:04:10.660 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:04:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:04:10.662 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:04:10.663 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:04:10.664 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:04:10.665 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:04:10.666 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:04:10.667 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:04:10.668 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:04:10.669 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:04:10.670 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:04:11.793 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:11.794 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.795 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.796 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:04:11.797 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:04:11.798 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:04:11.799 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.800 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:04:11.801 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:04:11.802 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:04:11.803 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:04:11.804 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:04:11.805 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:04:11.806 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:04:11.806 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:04:11.806 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-21T01:04:12.185 DEBUG:teuthology.parallel:result is None 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:04:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.281 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.282 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:04:13.283 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.284 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:04:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.286 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:04:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:04:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:04:13.289 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:04:13.290 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:04:13.291 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:04:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-21T01:04:13.687 DEBUG:teuthology.parallel:result is None 2024-09-21T01:04:13.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:13.838 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:04:13.861 INFO:teuthology.orchestra.run.smithi037.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:04:13.862 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:04:13.862 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:04:13.864 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:14.006 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:04:14.033 INFO:teuthology.orchestra.run.smithi137.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:04:14.033 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:04:14.034 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:04:14.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:14.180 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:04:14.206 INFO:teuthology.orchestra.run.smithi144.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:04:14.207 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:04:14.207 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:04:14.208 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T01:04:14.209 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:04:14.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:04:14.240 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:04:14.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:04:14.273 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:04:14.273 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:04:14.305 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T01:04:14.305 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:04:14.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:04:14.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:04:14.406 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:04:14.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:04:14.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:04:14.504 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:04:14.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:04:14.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:04:14.605 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T01:04:14.605 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:04:14.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:04:14.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:04:14.707 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:04:14.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:04:14.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:04:14.804 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:04:14.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:04:14.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:04:14.903 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T01:04:14.903 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:04:14.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:04:14.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:04:15.003 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:04:15.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:04:15.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:04:15.100 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:04:15.100 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:04:15.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:04:15.201 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T01:04:15.294 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T01:04:15.295 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:15.295 INFO:tasks.cephadm:Cluster fsid is 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:04:15.295 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T01:04:15.295 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.137', 'mon.c': '172.21.15.144'} 2024-09-21T01:04:15.295 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-09-21T01:04:15.295 INFO:tasks.cephadm:First mgr is x 2024-09-21T01:04:15.296 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T01:04:15.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-09-21T01:04:15.327 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname $(hostname -s) 2024-09-21T01:04:15.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname $(hostname -s) 2024-09-21T01:04:15.386 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T01:04:15.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:15.533 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T01:04:15.680 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:04:15.682 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T01:04:15.683 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T01:04:15.683 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:16.244 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:04 /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:16.245 DEBUG:teuthology.orchestra.run.smithi137:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:16.802 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:04 /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:16.802 DEBUG:teuthology.orchestra.run.smithi144:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:17.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:04 /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:17.360 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:17.381 DEBUG:teuthology.orchestra.run.smithi137:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:17.401 DEBUG:teuthology.orchestra.run.smithi144:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:04:17.436 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T01:04:17.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:04:17.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:04:17.443 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:04:18.950 INFO:teuthology.orchestra.run.smithi137.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:04:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:04:19.135 INFO:teuthology.orchestra.run.smithi144.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "repo_digests": [ 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-21T01:04:48.603 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:05:09.841 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:05:09.980 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-21T01:05:09.981 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:05:09.981 INFO:teuthology.orchestra.run.smithi137.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:05:09.981 INFO:teuthology.orchestra.run.smithi137.stdout: "repo_digests": [ 2024-09-21T01:05:09.981 INFO:teuthology.orchestra.run.smithi137.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:05:09.981 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-09-21T01:05:09.982 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-21T01:05:10.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-09-21T01:05:10.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph 2024-09-21T01:05:10.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph 2024-09-21T01:05:10.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-09-21T01:05:10.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /etc/ceph 2024-09-21T01:05:10.150 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /etc/ceph 2024-09-21T01:05:10.177 INFO:tasks.cephadm:Writing seed config... 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T01:05:10.178 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T01:05:10.179 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T01:05:10.180 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T01:05:10.180 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:05:10.180 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T01:05:10.196 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6bc9e062-77b5-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T01:05:10.197 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T01:05:10.239 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T01:05:10.281 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T01:05:10.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:10.492 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:05:10.492 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-09-21T01:05:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T01:05:10.493 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-09-21T01:05:10.524 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-21T01:05:10.524 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-09-21T01:05:10.525 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-09-21T01:05:10.532 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T01:05:10.532 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T01:05:10.539 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T01:05:10.539 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T01:05:10.545 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-21T01:05:10.552 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-21T01:05:10.552 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-21T01:05:10.552 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-09-21T01:05:10.575 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-21T01:05:10.575 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T01:05:10.575 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-09-21T01:05:10.575 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-09-21T01:05:10.581 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T01:05:10.582 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T01:05:10.588 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T01:05:10.588 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T01:05:10.595 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-21T01:05:10.601 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-21T01:05:10.601 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140686443724416 on /run/cephadm/6bc9e062-77b5-11ef-baf5-efdc52797490.lock 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140686443724416 acquired on /run/cephadm/6bc9e062-77b5-11ef-baf5-efdc52797490.lock 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-09-21T01:05:10.602 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-21T01:05:10.606 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-09-21T01:05:10.606 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-09-21T01:05:10.608 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T01:05:10.609 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T01:05:10.609 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1755sec hoplimit 64 pref medium 2024-09-21T01:05:10.611 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T01:05:10.611 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T01:05:10.611 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T01:05:10.611 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T01:05:10.611 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-21T01:05:10.611 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T01:05:10.612 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-21T01:05:10.612 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-21T01:05:10.612 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T01:05:10.612 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T01:05:10.613 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:05:11.094 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T01:05:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:05:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T01:05:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T01:05:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T01:05:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T01:05:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T01:05:12.006 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T01:05:12.006 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T01:05:12.006 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T01:05:13.004 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-09-21T01:05:13.005 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-09-21T01:05:13.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDJG+5mpQwGFRAA+jzxAVbFkilPpWsYdF+lFg== 2024-09-21T01:05:14.749 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDKG+5mARA9DRAACka04jVkc/I8AYEnPrN1Jw== 2024-09-21T01:05:15.663 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDLG+5mr4/GBxAAEDYnD2DBYviR/jOCZ8zwXA== 2024-09-21T01:05:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T01:05:16.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:05:16.611 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-09-21T01:05:17.524 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-09-21T01:05:17.737 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T01:05:17.888 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T01:05:18.060 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490.target. 2024-09-21T01:05:18.060 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490.target. 2024-09-21T01:05:18.301 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:05:18.301 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T01:05:18.462 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490.target.wants/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@.service. 2024-09-21T01:05:18.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:18 smithi037 podman[30719]: 2024-09-21 01:05:18.928291595 +0000 UTC m=+0.336160549 container start 60d46482327b1e4b5d16c55b508e4f234207b4dda0fc4d18986854551dcd06ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T01:05:18.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:18 smithi037 ceph-mon[30738]: mkfs 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:19.026 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:05:19.026 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T01:05:19.034 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T01:05:19.034 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-09-21T01:05:19.034 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-09-21T01:05:19.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:18 smithi037 ceph-mon[30738]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:05:19.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 bash[30719]: 60d46482327b1e4b5d16c55b508e4f234207b4dda0fc4d18986854551dcd06ab 2024-09-21T01:05:19.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 systemd[1]: Started Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:20.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: monmap epoch 1 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: last_changed 2024-09-21T01:05:16.008204+0000 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: min_mon_release 19 (squid) 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: election_strategy: 1 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: fsmap 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: mgrmap e1: no daemons active 2024-09-21T01:05:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:19 smithi037 ceph-mon[30738]: from='client.? 172.21.15.37:0/2806882311' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.5483s) 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T01:05:20.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-09-21T01:05:20.137 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T01:05:21.123 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:21.125 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T01:05:21.125 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T01:05:21.126 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T01:05:21.127 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T01:05:21.127 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T01:05:21.127 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-09-21T01:05:21.246 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:20 smithi037 ceph-mon[30738]: from='client.? 172.21.15.37:0/1126749508' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T01:05:21.247 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:20 smithi037 ceph-mon[30738]: from='client.? 172.21.15.37:0/1126749508' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T01:05:22.089 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-09-21T01:05:22.108 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:21 smithi037 ceph-mon[30738]: from='client.? 172.21.15.37:0/2395626896' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:05:22.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:22 smithi037 systemd[1]: Stopping Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:05:22.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:22 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a[30734]: 2024-09-21T01:05:22.338+0000 7fb798776640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:05:22.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:22 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a[30734]: 2024-09-21T01:05:22.338+0000 7fb798776640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T01:05:22.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:22 smithi037 podman[30980]: 2024-09-21 01:05:22.41088891 +0000 UTC m=+0.154691477 container died 60d46482327b1e4b5d16c55b508e4f234207b4dda0fc4d18986854551dcd06ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:05:23.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 podman[30980]: 2024-09-21 01:05:23.038582883 +0000 UTC m=+0.782385437 container cleanup 60d46482327b1e4b5d16c55b508e4f234207b4dda0fc4d18986854551dcd06ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:05:23.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 bash[30980]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:05:23.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 podman[30992]: 2024-09-21 01:05:23.222734517 +0000 UTC m=+0.807889068 container remove 60d46482327b1e4b5d16c55b508e4f234207b4dda0fc4d18986854551dcd06ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T01:05:23.651 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T01:05:23.651 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 systemd[1]: Stopped Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:23.651 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 systemd[1]: Starting Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:05:23.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 podman[31087]: 2024-09-21 01:05:23.648459204 +0000 UTC m=+0.085404614 container create 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T01:05:23.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 podman[31087]: 2024-09-21 01:05:23.579190387 +0000 UTC m=+0.016135752 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:05:23.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 podman[31087]: 2024-09-21 01:05:23.884011257 +0000 UTC m=+0.320956627 container init 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:05:23.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 podman[31087]: 2024-09-21 01:05:23.887162281 +0000 UTC m=+0.324107646 container start 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:05:23.972 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T01:05:24.178 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: pidfile_write: ignore empty --pid-file 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: load: jerasure load: lrc 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Git sha 0 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: DB SUMMARY 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: DB Session ID: 54AG7Y3M3ZAZSEAG398W 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:05:24.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94252 ; 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:05:24.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.env: 0x55b90cbf7d60 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.info_log: 0x55b912c57360 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.statistics: (nil) 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.use_fsync: 0 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:05:24.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.db_log_dir: 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.wal_dir: 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:05:24.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.write_buffer_manager: 0x55b912c5bd60 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:05:24.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.unordered_write: 0 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.row_cache: None 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.wal_filter: None 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:05:24.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.wal_compression: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:05:24.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:05:24.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_open_files: -1 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:05:24.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Compression algorithms supported: 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kZSTD supported: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:05:24.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.merge_operator: 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_filter: None 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b912c56fa0) 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:05:24.189 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x55b90ec1b610 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:05:24.190 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-09-21T01:05:24.191 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression: NoCompression 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.num_levels: 7 2024-09-21T01:05:24.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:05:24.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:05:24.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:05:24.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:05:24.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.ttl: 2592000 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:05:24.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T01:05:24.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: efa8236c-49c0-415d-a015-04713d129160 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880723924701, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880723925961, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90448, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 281, "table_properties": {"data_size": 88518, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11464, "raw_average_key_size": 47, "raw_value_size": 82075, "raw_average_value_size": 341, "num_data_blocks": 11, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880723, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "efa8236c-49c0-415d-a015-04713d129160", "db_session_id": "54AG7Y3M3ZAZSEAG398W", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880723926065, "job": 1, "event": "recovery_finished"} 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b912c7aa80 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: DB pointer 0x55b913a20000 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-09-21T01:05:24.199 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 90.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 108.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 90.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 108.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 108.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:05:24.200 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 108.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:05:24.201 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 24.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 24.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x55b90ec1b610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???) e1 preinit fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).mds e1 new map 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).mds e1 print_map 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: btime 2024-09-21T01:05:18:978125+0000 2024-09-21T01:05:24.202 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 bash[31087]: 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 systemd[1]: Started Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: monmap epoch 1 2024-09-21T01:05:24.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: last_changed 2024-09-21T01:05:16.008204+0000 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: min_mon_release 19 (squid) 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: election_strategy: 1 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: fsmap 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T01:05:24.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:23 smithi037 ceph-mon[31105]: mgrmap e1: no daemons active 2024-09-21T01:05:26.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:26 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2256662767' entity='client.admin' 2024-09-21T01:05:31.675 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T01:05:31.935 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:05:31.935 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-09-21T01:05:31.936 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T01:05:31.936 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T01:05:32.954 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:05:32.955 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T01:05:33.449 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490.target.wants/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@.service. 2024-09-21T01:05:33.751 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:33 smithi037 podman[31319]: 2024-09-21 01:05:33.585474911 +0000 UTC m=+0.016292695 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:05:33.944 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:05:33.944 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T01:05:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:05:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T01:05:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T01:05:33.952 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T01:05:33.961 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:05:33.961 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T01:05:33.970 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:05:33.970 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T01:05:33.970 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T01:05:33.970 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T01:05:33.970 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-09-21T01:05:33.970 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-09-21T01:05:34.094 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:33 smithi037 podman[31319]: 2024-09-21 01:05:33.870939588 +0000 UTC m=+0.301757361 container init c3925f9af261d77b221054ca8b5f3c8606c661ef5d3b0c2197fbcb384434231f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T01:05:34.094 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:33 smithi037 podman[31319]: 2024-09-21 01:05:33.873839909 +0000 UTC m=+0.304657683 container start c3925f9af261d77b221054ca8b5f3c8606c661ef5d3b0c2197fbcb384434231f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T01:05:34.094 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:33 smithi037 bash[31319]: c3925f9af261d77b221054ca8b5f3c8606c661ef5d3b0c2197fbcb384434231f 2024-09-21T01:05:34.094 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:33 smithi037 systemd[1]: Started Ceph mgr.x for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:05:34.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:34 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4039505979' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:05:35.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:35.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:05:35.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:05:35.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:05:35.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:05:35.100 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:05:35.101 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:05:35.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:05:35.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:05:18:978125+0000", 2024-09-21T01:05:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.106 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:05:18.978981+0000", 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:05:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-09-21T01:05:37.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:37 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/535986846' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:38.280 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:05:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:05:38.282 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:05:38.284 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:05:18:978125+0000", 2024-09-21T01:05:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:05:38.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:38.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:05:18.978981+0000", 2024-09-21T01:05:38.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:05:38.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:38.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:05:38.287 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:05:38.287 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: Activating manager daemon x 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: mgrmap e2: x(active, starting, since 0.00401999s) 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: Manager daemon x is now available 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' 2024-09-21T01:05:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' 2024-09-21T01:05:39.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:39 smithi037 ceph-mon[31105]: from='mgr.14100 172.21.15.37:0/3109007967' entity='mgr.x' 2024-09-21T01:05:41.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:41 smithi037 ceph-mon[31105]: mgrmap e3: x(active, since 1.00756s) 2024-09-21T01:05:42.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:42 smithi037 ceph-mon[31105]: mgrmap e4: x(active, since 2s) 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:05:42.913 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.914 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:05:42.915 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:42.915 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:05:42.915 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:05:42.915 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:05:42.915 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:05:42.918 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:05:18:978125+0000", 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:05:42.919 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:05:18.978981+0000", 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:05:42.920 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:05:42.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:05:42.921 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-09-21T01:05:43.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:43 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/881757633' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:05:44.347 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:44 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3561052160' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T01:05:44.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:44.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T01:05:44.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T01:05:44.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T01:05:44.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T01:05:44.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T01:05:44.354 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-09-21T01:05:45.462 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:45 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1864066075' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T01:05:45.463 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: ignoring --setuser ceph since I am not root 2024-09-21T01:05:45.463 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: ignoring --setgroup ceph since I am not root 2024-09-21T01:05:46.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:46 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1864066075' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T01:05:46.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:46 smithi037 ceph-mon[31105]: mgrmap e5: x(active, since 6s) 2024-09-21T01:05:47.014 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:05:47.014 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T01:05:47.014 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:05:47.014 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T01:05:47.014 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T01:05:47.014 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:05:47.015 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-21T01:05:47.015 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-09-21T01:05:47.261 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:47 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/735834069' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T01:05:50.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: Active manager daemon x restarted 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: Activating manager daemon x 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: mgrmap e6: x(active, starting, since 0.0038311s) 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:05:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:50 smithi037 ceph-mon[31105]: Manager daemon x is now available 2024-09-21T01:05:52.019 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:05:52.019 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T01:05:52.019 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T01:05:52.019 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:05:52.019 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-09-21T01:05:52.019 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying orchestrator module is enabled... 2024-09-21T01:05:52.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: Found migration_current of "None". Setting to last migration. 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:05:52.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:51 smithi037 ceph-mon[31105]: mgrmap e7: x(active, since 1.00676s) 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-mon[31105]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-mon[31105]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3569917460' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:05:52.746+0000 7f089767c640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:05:52] ENGINE Error in HTTPServer.serve 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: Traceback (most recent call last): 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:05:53.000 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self._connections.run(self.expiration_interval) 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self._run(expiration_interval) 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: s = self.context.wrap_socket( 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: return self.sslsocket_class._create( 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self.do_handshake() 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:05:53.001 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self._sslobj.do_handshake() 2024-09-21T01:05:53.002 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:05:53.002 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:05:53.534 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T01:05:53.534 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-09-21T01:05:54.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: [21/Sep/2024:01:05:52] ENGINE Bus STARTING 2024-09-21T01:05:54.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: [21/Sep/2024:01:05:52] ENGINE Serving on http://172.21.15.37:8765 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: [21/Sep/2024:01:05:52] ENGINE Serving on https://172.21.15.37:7150 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: [21/Sep/2024:01:05:52] ENGINE Bus STARTED 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: [21/Sep/2024:01:05:52] ENGINE Error in HTTPServer.serve 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:05:54.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3569917460' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T01:05:54.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:53 smithi037 ceph-mon[31105]: mgrmap e8: x(active, since 2s) 2024-09-21T01:05:55.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:55 smithi037 ceph-mon[31105]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:55.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:55 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:55.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:55 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:05:55.948 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T01:05:55.948 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-09-21T01:05:56.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:56 smithi037 ceph-mon[31105]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:57.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-mon[31105]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:05:57.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-mon[31105]: Generating ssh key... 2024-09-21T01:05:57.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: Generating public/private rsa key pair. 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: Your identification has been saved in /tmp/tmpco0punku/key 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: Your public key has been saved in /tmp/tmpco0punku/key.pub 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: The key fingerprint is: 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: SHA256:dKfmBKuUHMq6oWMUZWpCqBvqOAlz/1h9Ppu/DsN2RkE ceph-6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: The key's randomart image is: 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: +---[RSA 3072]----+ 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |. E | 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |.. o . | 2024-09-21T01:05:57.551 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |o + . o . o | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |++ . o + + o . | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |+o. o + S + . | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |=... . o = . | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |=+o. o . B o | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |=+ o.o +.* | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: |oo. ... +=+. | 2024-09-21T01:05:57.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:05:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: +----[SHA256]-----+ 2024-09-21T01:05:59.035 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:05:59.035 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:05:59.035 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T01:05:59.045 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-09-21T01:05:59.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:05:59 smithi037 ceph-mon[31105]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:00.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:00 smithi037 ceph-mon[31105]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:01.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:01 smithi037 ceph-mon[31105]: Deploying cephadm binary to smithi037 2024-09-21T01:06:03.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-09-21T01:06:03.934 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-09-21T01:06:04.609 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:04 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:04.610 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:04 smithi037 ceph-mon[31105]: Added host smithi037 2024-09-21T01:06:04.610 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:04 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:05.409 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T01:06:05.410 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-09-21T01:06:05.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:05 smithi037 ceph-mon[31105]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:05.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:05 smithi037 ceph-mon[31105]: Saving service mon spec with placement count:5 2024-09-21T01:06:05.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:05 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:07.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:07 smithi037 ceph-mon[31105]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:07.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:07 smithi037 ceph-mon[31105]: Saving service mgr spec with placement count:2 2024-09-21T01:06:07.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:07 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:07.370 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:07 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T01:06:08.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:08 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:08 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2299980785' entity='client.admin' 2024-09-21T01:06:10.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:09 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:09 smithi037 ceph-mon[31105]: from='mgr.14118 172.21.15.37:0/435106772' entity='mgr.x' 2024-09-21T01:06:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:09 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4227183578' entity='client.admin' 2024-09-21T01:06:10.538 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-09-21T01:06:11.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:11 smithi037 ceph-mon[31105]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:11.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:11 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3198272740' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T01:06:11.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:11 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: ignoring --setuser ceph since I am not root 2024-09-21T01:06:11.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:11 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: ignoring --setgroup ceph since I am not root 2024-09-21T01:06:12.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:12 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3198272740' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T01:06:12.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:12 smithi037 ceph-mon[31105]: mgrmap e9: x(active, since 21s) 2024-09-21T01:06:13.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:13 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1927692315' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T01:06:13.865 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:06:13.866 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T01:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T01:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T01:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-21T01:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-09-21T01:06:17.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: Active manager daemon x restarted 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: Activating manager daemon x 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: mgrmap e10: x(active, starting, since 0.00439626s) 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:06:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:16 smithi037 ceph-mon[31105]: Manager daemon x is now available 2024-09-21T01:06:18.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:18.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:06:18.163 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:06:18.163 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:17 smithi037 ceph-mon[31105]: mgrmap e11: x(active, since 1.00731s) 2024-09-21T01:06:18.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-mon[31105]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T01:06:18.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-mon[31105]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T01:06:18.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:06:18.848+0000 7f81c5cb1640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:06:18] ENGINE Error in HTTPServer.serve 2024-09-21T01:06:18.997 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: Traceback (most recent call last): 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self._connections.run(self.expiration_interval) 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self._run(expiration_interval) 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: s = self.context.wrap_socket( 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: return self.sslsocket_class._create( 2024-09-21T01:06:18.998 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:06:18.999 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self.do_handshake() 2024-09-21T01:06:18.999 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:06:18.999 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: self._sslobj.do_handshake() 2024-09-21T01:06:18.999 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:06:18.999 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:06:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:06:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:06:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T01:06:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T01:06:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:06:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-09-21T01:06:19.000 INFO:teuthology.orchestra.run.smithi037.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T01:06:20.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: [21/Sep/2024:01:06:18] ENGINE Bus STARTING 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: mgrmap e12: x(active, since 2s) 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: [21/Sep/2024:01:06:18] ENGINE Serving on https://172.21.15.37:7150 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: [21/Sep/2024:01:06:18] ENGINE Error in HTTPServer.serve 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:06:20.250 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: [21/Sep/2024:01:06:18] ENGINE Serving on http://172.21.15.37:8765 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: [21/Sep/2024:01:06:18] ENGINE Bus STARTED 2024-09-21T01:06:20.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:21.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:21 smithi037 ceph-mon[31105]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:21.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:21.418 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUI2PrWeIUgYMcA3aRxJE7/kNNWQswDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAxMDYyMFoXDTM0\nMDkyMjAxMDYyMFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjM3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAquWzXuq9+Hpi5onlvfRXaEN32yg4VaBiCY5Y\n60dqDVIZHXR09gin3ybnZVLEE/+Oa2BlX1W+MS6B8xyRf3C/xjAzTaoroupZL0Ig\no4WY13iUr1nRqBG3itwzD3Nr02kf8oNn/GEvQTQZsIqbmUkoTEt8eE0YCvcnjP9o\nedB43C4IX/zG0QmrydFo7ht3l61edlKuGbhaK4vLOqIOo3WiNe6jNK7Hi51idOWB\nfRkt+aRJbIYEk8RT68CbTuf9yyLHS6YTuMMDqboPfxu+cuEHGbCqypjTI+DLJU0k\n7KQlTtR4MiSq1zB8aqqztrEWlqDBNkh+tELeStbv6bJWJodULomDDlsqZWlg+D1A\nU1CJKoGcoqmdcolYxLbEUHMXklwM6O4yWU2rFvS0OXJTdgiUDdjuKIXguVgfSq5m\nrBACh3aW0pkA8whNPHwclZLfhpyQomNMFbAVrUUIdwVmWHNcqv/ZNiuLWeQnaEox\n+cguEOURQh4oaBvg1kYVn5z/kNJH7im8t5udOC7EGZNAEPczuax2mcaMmb0bAeaC\nCKfavAbFQQNMBKohMoPQCnLHaW4738AI0wqZyBKAf/i4bd0BHfZSehyBHUONyLtI\nFLnzPo821SYp1ALs70bpQmRlrH/o7FQg8DXPGfAnWtGBzgpuTkoacFTPRfzy877V\nitv1nDECAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDM3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPJTAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCz\n0zMRYQdJlJXifqMb1Hvf8InRvnm6D250337Oa2iarT6sahgbRwzE8EBNyzR+qpT4\noFVOBiRJOcBV+nHv/iO11P+cnC1SY5inF6KRv8m8kRA0dtRB/HuDScOv0zPeaiyn\nBjgWK1/8KB8dnJCdSY0B78P3XumpwzXuqxLOHiMbfXmkxZGognTqZgVuhp1iPwCa\naLtgzvkXXqwidI19F6nFqej8T7L1GVpKja8R6X80IIanDGA16H5UFcfY9SiZL4Ll\neWyo+8CxpAwvPxe3x2omRzTBmshla9sZmL73FwC+vq3UtR36c5S1xLLHjWifiFS6\nOiWCXx/nUIZL/4uRo/DnZssffWIWrZasPPFepBM3/JUUXdrP8smei0XsKowC+7Ud\nYEN+oA7nU35frv4mKqfzl1FFjUiGCp6OGkDwgBZV5VqLB2Bg1VBjq4HvH9CLU++s\nG2fFOBm46WojY32yFYndE+h+m6jXnMJTjVJ6HJPkRBbQ9GAt+obyqRzX/M1VGfTq\nTH/KJ6E0QBK4hM3CnkvjyTygBbSUy2WNM6ugPyG2rcNcfISctGpgI9O0bJunY3ol\nV0mGGwL1Lse5wKXe9KGiwqBM4qj5+ZuzknQd971njtncusoC8DlyxbpRksE2Wv65\nJcncZGLY2+oJIsGa4H8LezyR6c9KCKUgh3QVKt4+ww==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAquWzXuq9+Hpi5onlvfRXaEN32yg4VaBiCY5Y60dqDVIZHXR0\n9gin3ybnZVLEE/+Oa2BlX1W+MS6B8xyRf3C/xjAzTaoroupZL0Igo4WY13iUr1nR\nqBG3itwzD3Nr02kf8oNn/GEvQTQZsIqbmUkoTEt8eE0YCvcnjP9oedB43C4IX/zG\n0QmrydFo7ht3l61edlKuGbhaK4vLOqIOo3WiNe6jNK7Hi51idOWBfRkt+aRJbIYE\nk8RT68CbTuf9yyLHS6YTuMMDqboPfxu+cuEHGbCqypjTI+DLJU0k7KQlTtR4MiSq\n1zB8aqqztrEWlqDBNkh+tELeStbv6bJWJodULomDDlsqZWlg+D1AU1CJKoGcoqmd\ncolYxLbEUHMXklwM6O4yWU2rFvS0OXJTdgiUDdjuKIXguVgfSq5mrBACh3aW0pkA\n8whNPHwclZLfhpyQomNMFbAVrUUIdwVmWHNcqv/ZNiuLWeQnaEox+cguEOURQh4o\naBvg1kYVn5z/kNJH7im8t5udOC7EGZNAEPczuax2mcaMmb0bAeaCCKfavAbFQQNM\nBKohMoPQCnLHaW4738AI0wqZyBKAf/i4bd0BHfZSehyBHUONyLtIFLnzPo821SYp\n1ALs70bpQmRlrH/o7FQg8DXPGfAnWtGBzgpuTkoacFTPRfzy877Vitv1nDECAwEA\nAQKCAgAWtN29TyFIl4ehK/ymMts+PjX5nNbHVxT6QhCXH5j8BhwnfrwKSKIiveTh\nizqu5uCsbFVrx6pf7IGq+fEXEWBZsTklKOa9XGKB1fPHkPj61XROoXeAMO0bJSDK\nUm1Rh1aNqV9dTX2y2Hz6qPVS9kEaygN9ac43qW523HoBiBfW4W2Oxg5Ajga7kk2y\nfVx0Kb6IUs9RGYku31cfBj3oWA6NGJT/a02WGPuQ8+wy4UVA4HmPqCA0O1IPMTsx\neRTj3aNvQ19myCUqHaTwyuXmFky+4WtVRIhL7GfxdSuNHvjaCCmkN/JUadvOFw+O\ncZRtFRThj9ujOyiVTF5PcGOOoPfSiGqqA/cG5nKWGYAMs/7hliN6QSVBAX42l5l7\n6kwMNNhzmM6AUqszj8v5NNxiIygBn+PyQtDWHb3mmU29dXvLXGt4uyDE/5O+UA93\nAc6v8lfpqRFAT0f0HMr3vi280wGt6zSK8yWMZf9Uckgvw9M5Cq3yUbv/yRuWcx/c\nwQ7hjQNXwjvX2/TNHYGohNGO/mdo8LQIW8gPyOMPaBJHlZTv0jzQ19poXFgSF/X8\n1cqLieytseWIi1YhHz+aaRmaz2x1EARdIPbpy/Ouhw6oIQmB96KAGJCNc56uc1/2\nauIHlCAbWIPtOt1UetsXjykKhQnEAEnzP/LqB5zN+q5WKDCH1QKCAQEA7T1yDFSc\nZSrZerCpn33ZrQKXjRTDe4zXxeZfKf7joMQ775hEdb6l5niMWmbGZpE2ZmVX5aun\nALck2ciN2GaisEVpapzWjXJfwqu71CrItV0QH/3kIIH5TtAP6pQAf0gK4g+oMNsL\nwdEMczNmxgVHnuGSJ3ghkNNMKTQzpQh/36Jl8hyanOCBSxAucTuA2cMWCE7qRcSa\nshgP548V7nlxgzysxK4vqcdg0LuzooPJRA+jv/wY/BnsmtD5WcbEgxh55zp1R3Cp\nkKpBhHYg2bsrDEA2pQQOF9MgjoZa8TrOdtaR4ezh6EtV0X+fbLd89YKO1a+nRQkq\nvkHI+vnkWl0gcwKCAQEAuGk/4J2WXfGQducDIgnKGjKu6A+IyIj2B+JqatuYbi3r\nS0XHoDnLXtwgyO5BC8GmZwhEQDIkvP2xQYhKg/inPEh1j3F79/x9EIdAO6SMy6OG\nKScDQsIpeoPiddP4YjIihAtdjsxEgSYF3is7BAgMjXhm4Fhxv1BjGTdPirBDrzon\nFZo7DBCoR1qQL8PArJBcX7HITU9nKFPGcRYtwJtVTFoMGxW8a8X3cokelDqwNnmV\n5XnLmiLxGCfRjIyg2BpFtlMWdlaWFxjiPgcA1JPo8mcUZ2TsKXF0bF3zlii/Ll6A\n4dgpMJQ9PV7bvEPkf2gntA70jlpbu00iCe1S/xxbywKCAQAAq3C7+i0q1/EfOIpy\nCc/ofh5hZpKasa4WP+062B5aYNNufLaMwooDWYnD45Bhz70gkt6ppk9lYB75gmhs\nGPYSm0+N3n14jr8YdJWmJqzEXkviWzwen19NyqaQ2fQaZ+Cn/LVT1fp1hJqNZLLA\nklk+aJKaC+vEVeRcJWqT5688uV+iTFRfZv7WcGhBJ5LYioVwZpCgu8pYAFtjIvND\n5hHc9fni4D8AMrDiRfVe2xJhX83th8+mPoh9c2OQzk/Vsub9MRwNpJLF9sUSk6bK\nFo4rja7ZzmYfyRfJbzWogqr8iOSGh72ngzbtzXdsviPbKZAvqDxHpJv7R4JCuxva\n6XJjAoIBAQC0n6pIWDISu+uS+rxv14TT2jbE54pDWRsaJ+Ox3HrV2DYx2RwpTNJs\njFG0XODrIfbZzhgDhNnFHvtCQ7swvhkXi6VSJYaWJAFfcgoxIQAi6X0by7F+7uxv\nqsPiQwdzLsXt7a/qkRq8IMD4lgFM9pFM89RYA2kOSS93YFyRbAovlFb56sHRFHOu\nx/6YOjT7EL7ZoCmfx5kzv7KLy3xuvfZzPXPEB6sxKIsw7Ss9Zqp4AOkYBg6tX3Ik\nBcRS1N8qK7mCVqmWqUKDRwU6WeOvU1yEKQCsMQa7pPuytOdEeY6gXUIBc5cMlPXS\nqZmyMhGZ1SumSkuxLsHQmEEx1flIFL+3AoIBAQDbnB1I9riiF1Ebv/Wo7HO8X7FC\nHZZxyN6E81Ys9bEvMGk4d+FKjSoYoI37nchhflsQzPv2YmivYwnUJnX3L00VhKWF\nZh5v1CUPcPqepHxeGbp7LIuKrfzP9u2C1Tip4auPgR+MihnqN3aI/peGwSi3wqnC\nTsZcLDqRZglP2EdoIcJwMP/I7hz5uxJOejlGz8GTRnEFOeG1zEKwSIgz7kgPdaAd\nx3hgTCF3aCdgwTc+A3rB8SBa5pZrBLKzUpZOfMNQk3tJLbQ+2ZBAhnY6iW7tyHu+\n0F5LKx5V64ajeoB1avsVj+/tqTNlV9vGxG8g1LbSmPRRefHigdx791zATMOY\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T01:06:23.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T01:06:23.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:23 smithi037 ceph-mon[31105]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:23.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:23 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:24.283 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T01:06:24.283 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-09-21T01:06:24.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:24 smithi037 ceph-mon[31105]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:25.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:25.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ayjJNCELT8SntvZvpzTeyuSlBKTs9D6/mUkvDYgP5yVR.r85rW9VO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726880785, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T01:06:25.847 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-09-21T01:06:26.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:26 smithi037 ceph-mon[31105]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:26.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:26 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:26.853 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T01:06:26.864 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:06:26.864 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-21T01:06:26.872 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:06:26.872 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-21T01:06:26.872 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-21T01:06:26.872 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T01:06:26.874 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-09-21T01:06:26.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:26.874 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037.front.sepia.ceph.com:8443/ 2024-09-21T01:06:26.874 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-09-21T01:06:26.874 INFO:teuthology.orchestra.run.smithi037.stdout: Password: loxsmx1hse 2024-09-21T01:06:26.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:26.875 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config directory 2024-09-21T01:06:27.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:27 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2287613883' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T01:06:28.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T01:06:28.286 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T01:06:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:28.287 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-09-21T01:06:28.330 INFO:tasks.cephadm:Fetching config... 2024-09-21T01:06:28.331 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:06:28.331 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T01:06:28.347 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T01:06:28.347 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:06:28.348 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T01:06:28.404 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T01:06:28.405 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:06:28.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T01:06:28.470 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T01:06:28.470 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:06:28.470 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T01:06:28.526 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T01:06:28.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:06:28.615 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:28.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:06:28.670 INFO:teuthology.orchestra.run.smithi137.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:28.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:06:28.724 INFO:teuthology.orchestra.run.smithi144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDglKUqK3vrtSySfyLAH6LWOgRQVQ3GqSxGUI4LFbg3hgaD1RdvuE96rhaNEGzZOwGjpG4iRcdV0Ye2b1YPMz5p2OtbxjJYAOVRIXamzyquCFXbQyg9XRc9MNCbto7HVtJBtSKU6esP/K54q0KIPoA2s3UROKpLFLe3GprHplXtOEUZZ6cku3seaiMa0bjq6w2fJcBzbJxXeZ+R1f5lxDa0OoEF/d5CqiKmp88i7R/0sZfescVPTiHtd6uqtcX9e27s83tew3aUSWZRXbU36i7rHmOnjZ2tbJHhETMIK97vdxP/UfS/K3S91W2iXmVlZ61Q+OOarDB6nmEPJrGAI6Dl+bN2QBHF9SerzNOpb2XITelbju94Ys8KqXnY6sJAJiv4hRSP1EIK0UJ1g3lMK2Ivmlil2/2mlwH8uhVgHbxJJxt4CIq45V3dszAzlPOd1NDXjhSujVW01GGODWOEErEMpZJ3gjCqQAogTC+yJqsKQTH2h3YrZJfjlOMbUGBW+t0= ceph-6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:28.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T01:06:28.995 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:28.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:28 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3549781810' entity='client.admin' 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: mgrmap e13: x(active, since 12s) 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/449247672' entity='client.admin' 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:30.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:30.831 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T01:06:30.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T01:06:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:33.102 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi137 2024-09-21T01:06:33.102 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:06:33.102 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.conf 2024-09-21T01:06:33.122 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:06:33.122 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:33.181 INFO:tasks.cephadm:Adding host smithi137 to orchestrator... 2024-09-21T01:06:33.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch host add smithi137 2024-09-21T01:06:33.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: Updating smithi037:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: Updating smithi037:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:33.437 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:34.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:34 smithi037 ceph-mon[31105]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi137", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:35.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:35 smithi037 ceph-mon[31105]: Deploying cephadm binary to smithi137 2024-09-21T01:06:37.744 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi137' with addr '172.21.15.137' 2024-09-21T01:06:37.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:37 smithi037 ceph-mon[31105]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:38.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:38.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:38.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T01:06:38.656 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:39.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:38 smithi037 ceph-mon[31105]: Added host smithi137 2024-09-21T01:06:39.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:39.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:39.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}] 2024-09-21T01:06:39.942 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi144 2024-09-21T01:06:39.943 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:06:39.943 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.conf 2024-09-21T01:06:39.961 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:06:39.962 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:40.019 INFO:tasks.cephadm:Adding host smithi144 to orchestrator... 2024-09-21T01:06:40.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch host add smithi144 2024-09-21T01:06:40.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:40 smithi037 ceph-mon[31105]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:40.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:40 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:40.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:40 smithi037 ceph-mon[31105]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:06:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:42.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:43.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: Deploying cephadm binary to smithi144 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:43.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:44.670 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi144' with addr '172.21.15.144' 2024-09-21T01:06:44.684 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:44 smithi037 ceph-mon[31105]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:45.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T01:06:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:45.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:45.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:45 smithi037 ceph-mon[31105]: Added host smithi144 2024-09-21T01:06:45.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:45.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:45 smithi037 ceph-mon[31105]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:45.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:45.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:46.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:06:46.186 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}] 2024-09-21T01:06:46.752 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T01:06:46.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T01:06:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:06:47.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:47.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:47 smithi037 ceph-mon[31105]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:06:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-21T01:06:48.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:48 smithi037 ceph-mon[31105]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:48.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:48 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2511766274' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:06:48.683 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-09-21T01:06:48.683 INFO:tasks.cephadm:Adding mon.b on smithi137 2024-09-21T01:06:48.683 INFO:tasks.cephadm:Adding mon.c on smithi144 2024-09-21T01:06:48.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c' 2024-09-21T01:06:48.931 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T01:06:48.977 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T01:06:49.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2511766274' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:06:49.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:06:49.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:49.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:49.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:49.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:49.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:49.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:49.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:49.709 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mon update... 2024-09-21T01:06:50.291 DEBUG:teuthology.orchestra.run.smithi137:mon.b> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T01:06:50.294 DEBUG:teuthology.orchestra.run.smithi144:mon.c> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T01:06:50.296 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:06:50.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:06:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T01:06:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:06:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:50.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:50.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:06:50.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:06:51.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:51 smithi037 ceph-mon[31105]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:51 smithi037 ceph-mon[31105]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c;count:3 2024-09-21T01:06:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:51 smithi037 ceph-mon[31105]: Deploying daemon mon.c on smithi144 2024-09-21T01:06:52.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:52 smithi037 ceph-mon[31105]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:06:52.983 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":1,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:05:16.008204Z","created":"2024-09-21T01:05:16.008204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T01:06:52.983 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 1 2024-09-21T01:06:53.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/1078234630' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:06:54.261 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:06:54.261 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:06:54.261 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:06:54.261 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:06:54.261 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_open_files: -1 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Compression algorithms supported: 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kZSTD supported: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:06:54.262 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.merge_operator: 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_filter: None 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:06:54.263 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557673c0cfa0) 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: index_type: 0 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: data_block_index_type: 0 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: index_shortening: 1 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: checksum: 4 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: no_block_cache: 0 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_cache: 0x55766fbd1610 2024-09-21T01:06:54.264 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_cache_options: 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: capacity : 536870912 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: num_shard_bits : 4 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: strict_capacity_limit : 0 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_cache_compressed: (nil) 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: persistent_cache: (nil) 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_size: 4096 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_size_deviation: 10 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_restart_interval: 16 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: index_block_restart_interval: 1 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: metadata_block_size: 4096 2024-09-21T01:06:54.265 INFO:journalctl@ceph.mon.c.smithi144.stdout: partition_filters: 0 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: use_delta_encoding: 1 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: filter_policy: bloomfilter 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: whole_key_filtering: 1 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: verify_compression: 0 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: format_version: 5 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: enable_index_compression: 1 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: block_align: 0 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: max_auto_readahead_size: 262144 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: prepopulate_block_cache: 0 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:06:54.266 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression: NoCompression 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.num_levels: 7 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:06:54.267 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:06:54.268 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:06:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:06:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:06:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:06:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:06:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:06:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:06:54.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:06:54.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:06:54.674 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:06:54.674 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:06:54.674 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.ttl: 2592000 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:06:54.675 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T01:06:54.676 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 40c85a11-459e-4f1d-8e4e-ff1c4606935f 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880814259923, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880814260361, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880814, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "40c85a11-459e-4f1d-8e4e-ff1c4606935f", "db_session_id": "HVX7ORQJPTVB3E4C8F57", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880814260479, "job": 1, "event": "recovery_finished"} 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557673c30a80 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: DB pointer 0x5576749d6000 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout: ** DB Stats ** 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:06:54.677 INFO:journalctl@ceph.mon.c.smithi144.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: ** Compaction Stats [default] ** 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: ** Compaction Stats [default] ** 2024-09-21T01:06:54.678 INFO:journalctl@ceph.mon.c.smithi144.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: Cumulative compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:06:54.679 INFO:journalctl@ceph.mon.c.smithi144.stdout: Interval compaction: 0.00 GB write, 0.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: Block cache BinnedLRUCache@0x55766fbd1610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: using public_addr v2:172.21.15.144:0/0 -> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: starting mon.c rank -1 at public addrs [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] at bind addrs [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(???) e0 preinit fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: e1 2024-09-21T01:06:54.680 INFO:journalctl@ceph.mon.c.smithi144.stdout: btime 2024-09-21T01:05:18:978125+0000 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout: legacy client fscid: -1 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout: 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout: No filesystems configured 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:06:54.681 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:54.682 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Deploying cephadm binary to smithi144 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Added host smithi144 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.683 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2511766274' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2511766274' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:54.684 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:06:54.685 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c;count:3 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: Deploying daemon mon.c on smithi144 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/1078234630' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 ceph-mon[34818]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 bash[34798]: 3aa7a3dee8d747d11f1e1b973a658e83dba2a0e4539a9239b05a777be4c9bdbe 2024-09-21T01:06:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:54 smithi144 systemd[1]: Started Ceph mon.c for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:06:54.821 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:06:54.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:06:55.069 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:06:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:06:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: mon.a calling monitor election 2024-09-21T01:06:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: mon.c calling monitor election 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: monmap epoch 2 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: last_changed 2024-09-21T01:06:54.288658+0000 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: min_mon_release 19 (squid) 2024-09-21T01:06:59.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: election_strategy: 1 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: fsmap 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: mgrmap e13: x(active, since 42s) 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: overall HEALTH_OK 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:06:59.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:06:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:06:59.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:06:59.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: mon.a calling monitor election 2024-09-21T01:06:59.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:59.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: mon.c calling monitor election 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: monmap epoch 2 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: last_changed 2024-09-21T01:06:54.288658+0000 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: min_mon_release 19 (squid) 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: election_strategy: 1 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:06:59.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: fsmap 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: mgrmap e13: x(active, since 42s) 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: overall HEALTH_OK 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:06:59.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:06:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:00.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:07:00.180 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:06:54.288658Z","created":"2024-09-21T01:05:16.008204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T01:07:00.180 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-21T01:07:00.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:00 smithi144 ceph-mon[34818]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:00.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:00 smithi144 ceph-mon[34818]: Deploying daemon mon.b on smithi137 2024-09-21T01:07:00.459 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:00 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/3668674955' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:00.460 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:00.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:00 smithi037 ceph-mon[31105]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:00 smithi037 ceph-mon[31105]: Deploying daemon mon.b on smithi137 2024-09-21T01:07:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:00 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/3668674955' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:01.738 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:07:01.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:07:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:02.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:02 smithi144 ceph-mon[34818]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:02.674 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:07:02.674 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:06:54.288658Z","created":"2024-09-21T01:05:16.008204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T01:07:02.674 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-21T01:07:02.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:02 smithi037 ceph-mon[31105]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:02 smithi137 podman[34588]: 2024-09-21 01:07:02.785368652 +0000 UTC m=+0.015613067 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:03.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 podman[34588]: 2024-09-21 01:07:03.020187286 +0000 UTC m=+0.250431689 container init d7f3fcde4b7969d1a59a9daf292924f98192315e8d8473ac0535962f4da5b3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:07:03.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 podman[34588]: 2024-09-21 01:07:03.02343416 +0000 UTC m=+0.253678566 container start d7f3fcde4b7969d1a59a9daf292924f98192315e8d8473ac0535962f4da5b3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:07:03.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pidfile_write: ignore empty --pid-file 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: load: jerasure load: lrc 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Git sha 0 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: DB SUMMARY 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: DB Session ID: I9O7EE3Y9HDGINIJD0V9 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:07:03.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.env: 0x55f8f6577d60 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.info_log: 0x55f8fc929360 2024-09-21T01:07:03.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:07:03.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.statistics: (nil) 2024-09-21T01:07:03.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.use_fsync: 0 2024-09-21T01:07:03.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:07:03.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.db_log_dir: 2024-09-21T01:07:03.425 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.wal_dir: 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:07:03.426 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.write_buffer_manager: 0x55f8fc92dd60 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.unordered_write: 0 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:07:03.427 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.row_cache: None 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.wal_filter: None 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.wal_compression: 0 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:07:03.428 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:07:03.429 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_open_files: -1 2024-09-21T01:07:03.430 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Compression algorithms supported: 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kZSTD supported: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:07:03.431 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.merge_operator: 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_filter: None 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:07:03.432 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f8fc928fa0) 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: index_type: 0 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: data_block_index_type: 0 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: index_shortening: 1 2024-09-21T01:07:03.433 INFO:journalctl@ceph.mon.b.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: checksum: 4 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: no_block_cache: 0 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache: 0x55f8f88ed610 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache_options: 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: capacity : 536870912 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: num_shard_bits : 4 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: strict_capacity_limit : 0 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_cache_compressed: (nil) 2024-09-21T01:07:03.434 INFO:journalctl@ceph.mon.b.smithi137.stdout: persistent_cache: (nil) 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_size: 4096 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_size_deviation: 10 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_restart_interval: 16 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: index_block_restart_interval: 1 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: metadata_block_size: 4096 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: partition_filters: 0 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: use_delta_encoding: 1 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: filter_policy: bloomfilter 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: whole_key_filtering: 1 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: verify_compression: 0 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: format_version: 5 2024-09-21T01:07:03.435 INFO:journalctl@ceph.mon.b.smithi137.stdout: enable_index_compression: 1 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout: block_align: 0 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout: max_auto_readahead_size: 262144 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout: prepopulate_block_cache: 0 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression: NoCompression 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:07:03.436 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.num_levels: 7 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:07:03.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:07:03.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:07:03.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:07:03.440 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:07:03.440 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:07:03.440 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:07:03.441 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:07:03.442 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:07:03.443 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.ttl: 2592000 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:07:03.444 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 14f6be30-7b33-44a9-9449-41843bfa0c5c 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880823060618, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880823061048, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726880823, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "14f6be30-7b33-44a9-9449-41843bfa0c5c", "db_session_id": "I9O7EE3Y9HDGINIJD0V9", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726880823061141, "job": 1, "event": "recovery_finished"} 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f8fc94ca80 2024-09-21T01:07:03.445 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: DB pointer 0x55f8fd6f2000 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** DB Stats ** 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-09-21T01:07:03.446 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** Compaction Stats [default] ** 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** Compaction Stats [default] ** 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-09-21T01:07:03.447 INFO:journalctl@ceph.mon.b.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:07:03.448 INFO:journalctl@ceph.mon.b.smithi137.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout: Block cache BinnedLRUCache@0x55f8f88ed610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: using public_addr v2:172.21.15.137:0/0 -> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: starting mon.b rank -1 at public addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] at bind addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(???) e0 preinit fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 bash[34588]: d7f3fcde4b7969d1a59a9daf292924f98192315e8d8473ac0535962f4da5b3d0 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 systemd[1]: Started Ceph mon.b for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:07:03.449 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: e1 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: btime 2024-09-21T01:05:18:978125+0000 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: legacy client fscid: -1 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout: No filesystems configured 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T01:07:03.450 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.451 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Deploying cephadm binary to smithi144 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:03.452 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Added host smithi144 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.453 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2511766274' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2511766274' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:03.454 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:03.455 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c;count:3 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Deploying daemon mon.c on smithi144 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/1078234630' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.a calling monitor election 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.456 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.c calling monitor election 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: monmap epoch 2 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: last_changed 2024-09-21T01:06:54.288658+0000 2024-09-21T01:07:03.457 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: min_mon_release 19 (squid) 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: election_strategy: 1 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: fsmap 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mgrmap e13: x(active, since 42s) 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: overall HEALTH_OK 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:03.458 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: Deploying daemon mon.b on smithi137 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/3668674955' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:03.459 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:03 smithi137 ceph-mon[34607]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T01:07:04.286 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:07:04.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:07:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:08.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:08.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: mon.a calling monitor election 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: mon.c calling monitor election 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: mon.b calling monitor election 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: monmap epoch 3 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: last_changed 2024-09-21T01:07:03.088254+0000 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: min_mon_release 19 (squid) 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: election_strategy: 1 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: fsmap 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:07:08.423 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: mgrmap e13: x(active, since 51s) 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: overall HEALTH_OK 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: mon.a calling monitor election 2024-09-21T01:07:08.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: mon.c calling monitor election 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: mon.b calling monitor election 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: monmap epoch 3 2024-09-21T01:07:08.425 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: last_changed 2024-09-21T01:07:03.088254+0000 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: min_mon_release 19 (squid) 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: election_strategy: 1 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: fsmap 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: mgrmap e13: x(active, since 51s) 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: overall HEALTH_OK 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.426 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.427 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.496 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:07:08.496 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","modified":"2024-09-21T01:07:03.088254Z","created":"2024-09-21T01:05:16.008204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T01:07:08.496 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 3 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: mon.a calling monitor election 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: mon.c calling monitor election 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:07:08.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: mon.b calling monitor election 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: monmap epoch 3 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: last_changed 2024-09-21T01:07:03.088254+0000 2024-09-21T01:07:08.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: created 2024-09-21T01:05:16.008204+0000 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: min_mon_release 19 (squid) 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: election_strategy: 1 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: 2: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: fsmap 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: mgrmap e13: x(active, since 51s) 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: overall HEALTH_OK 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:08.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:09.109 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T01:07:09.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T01:07:09.366 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:09.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:09.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:09 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/3144712625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:09.375 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:09.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:09.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:09 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/3144712625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:09.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:09.487 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:09.487 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:09 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/3144712625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:07:09.487 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:07:10.185 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:10.186 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-21T01:07:10.186 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:07:10.186 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-09-21T01:07:10.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:10 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/82833726' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:10 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/82833726' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:10.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:10 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/82833726' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:10.983 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T01:07:10.983 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:07:10.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:07:11.012 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:07:11.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:11.079 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:07:11.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:07:11.112 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:07:11.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:11.181 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:07:11.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:07:11.212 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:07:11.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:07:11.280 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-09-21T01:07:11.280 INFO:tasks.cephadm:Adding mgr.y on smithi137 2024-09-21T01:07:11.280 INFO:tasks.cephadm:Adding mgr.z on smithi144 2024-09-21T01:07:11.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi037=x;smithi137=y;smithi144=z' 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Updating smithi037:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:07:11.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:11.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:11.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:11.422 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:11 smithi137 ceph-mon[34607]: Reconfiguring daemon mon.a on smithi037 2024-09-21T01:07:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-21T01:07:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-21T01:07:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T01:07:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Updating smithi037:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:11.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:11 smithi037 ceph-mon[31105]: Reconfiguring daemon mon.a on smithi037 2024-09-21T01:07:11.561 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Updating smithi137:/etc/ceph/ceph.conf 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Updating smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Updating smithi037:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Updating smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:11.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:07:11.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:11.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:11.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:11.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:11 smithi144 ceph-mon[34818]: Reconfiguring daemon mon.a on smithi037 2024-09-21T01:07:12.191 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mgr update... 2024-09-21T01:07:12.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:12 smithi037 ceph-mon[31105]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:12.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:12.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:12.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:12 smithi137 ceph-mon[34607]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:12.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:12.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:12 smithi144 ceph-mon[34818]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:12.769 DEBUG:teuthology.orchestra.run.smithi137:mgr.y> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T01:07:12.773 DEBUG:teuthology.orchestra.run.smithi144:mgr.z> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T01:07:12.776 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T01:07:12.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T01:07:12.779 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T01:07:12.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T01:07:12.824 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T01:07:12.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T01:07:12.831 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T01:07:12.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T01:07:12.878 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T01:07:12.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T01:07:12.923 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T01:07:12.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T01:07:12.969 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T01:07:12.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T01:07:13.013 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T01:07:13.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T01:07:13.057 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T01:07:13.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T01:07:13.102 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T01:07:13.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T01:07:13.148 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T01:07:13.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T01:07:13.199 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T01:07:13.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T01:07:13.258 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T01:07:13.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T01:07:13.302 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T01:07:13.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T01:07:13.345 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T01:07:13.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T01:07:13.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi137=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: Saving service mgr spec with placement smithi037=x;smithi137=y;smithi144=z;count:3 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:13.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:13 smithi037 ceph-mon[31105]: Reconfiguring daemon mgr.x on smithi037 2024-09-21T01:07:13.379 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T01:07:13.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T01:07:13.422 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T01:07:13.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T01:07:13.465 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T01:07:13.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T01:07:13.508 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T01:07:13.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T01:07:13.552 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T01:07:13.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T01:07:13.596 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T01:07:13.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T01:07:13.641 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T01:07:13.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T01:07:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi137=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: Saving service mgr spec with placement smithi037=x;smithi137=y;smithi144=z;count:3 2024-09-21T01:07:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:13 smithi137 ceph-mon[34607]: Reconfiguring daemon mgr.x on smithi037 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi137=y;smithi144=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: Saving service mgr spec with placement smithi037=x;smithi137=y;smithi144=z;count:3 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:13.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:07:13.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:13.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:13.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:13.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:13 smithi144 ceph-mon[34818]: Reconfiguring daemon mgr.x on smithi037 2024-09-21T01:07:13.684 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T01:07:13.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T01:07:13.733 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T01:07:13.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T01:07:13.790 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T01:07:13.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T01:07:13.853 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T01:07:13.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T01:07:13.904 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T01:07:13.904 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi037') 2024-09-21T01:07:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:14.555 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:14 smithi037 ceph-mon[31105]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:14.555 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:14 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:14.555 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:14 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:14.556 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:14 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:14.556 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:14 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:14.556 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:14 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:14.603 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:14 smithi137 ceph-mon[34607]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:14.603 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:14 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:14.603 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:14 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:14.604 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:14 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:14.604 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:14 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:14.604 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:14 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:14.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:14 smithi144 ceph-mon[34818]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:14.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:14 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:14.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:14 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:14.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:14 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:14.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:14 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:14.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:14 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.366 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.372 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: Reconfiguring daemon mon.b on smithi137 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:15 smithi137 ceph-mon[34607]: from='client.? ' entity='client.admin' 2024-09-21T01:07:15.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: Reconfiguring daemon mon.b on smithi137 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:15.498 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:15 smithi037 ceph-mon[31105]: from='client.? ' entity='client.admin' 2024-09-21T01:07:15.566 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:07:15.566 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: Reconfiguring daemon mon.b on smithi137 2024-09-21T01:07:15.566 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:15.567 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:15.567 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:07:15.567 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:07:15.567 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:15.567 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:15 smithi144 ceph-mon[34818]: from='client.? ' entity='client.admin' 2024-09-21T01:07:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:16 smithi037 ceph-mon[31105]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:16 smithi037 ceph-mon[31105]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:07:16.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:16 smithi037 ceph-mon[31105]: Reconfiguring daemon mon.c on smithi144 2024-09-21T01:07:16.341 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:16.343 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:16.343 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:16.570 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:16 smithi144 ceph-mon[34818]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:16.570 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:16 smithi144 ceph-mon[34818]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:07:16.570 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:16 smithi144 ceph-mon[34818]: Reconfiguring daemon mon.c on smithi144 2024-09-21T01:07:16.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:16 smithi137 ceph-mon[34607]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:16.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:16 smithi137 ceph-mon[34607]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:07:16.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:16 smithi137 ceph-mon[34607]: Reconfiguring daemon mon.c on smithi144 2024-09-21T01:07:17.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: Deploying daemon mgr.z on smithi144 2024-09-21T01:07:17.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:17 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2513335017' entity='client.admin' 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:17.645 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:07:17.646 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:17.646 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:17.646 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: Deploying daemon mgr.z on smithi144 2024-09-21T01:07:17.646 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:17 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2513335017' entity='client.admin' 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:17.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:07:17.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:17.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:17.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: Deploying daemon mgr.z on smithi144 2024-09-21T01:07:17.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:17 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2513335017' entity='client.admin' 2024-09-21T01:07:18.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:18 smithi037 ceph-mon[31105]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:18.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:18 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3466768023' entity='client.admin' 2024-09-21T01:07:18.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:18 smithi144 ceph-mon[34818]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:18.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:18 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3466768023' entity='client.admin' 2024-09-21T01:07:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:18 smithi137 ceph-mon[34607]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:18 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3466768023' entity='client.admin' 2024-09-21T01:07:19.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: Deploying daemon mgr.y on smithi137 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1018709442' entity='client.admin' 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3995849613' entity='client.admin' 2024-09-21T01:07:19.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='client.? ' entity='client.admin' 2024-09-21T01:07:19.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/77328054' entity='client.admin' 2024-09-21T01:07:19.816 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.816 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.816 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.816 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: Deploying daemon mgr.y on smithi137 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1018709442' entity='client.admin' 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3995849613' entity='client.admin' 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='client.? ' entity='client.admin' 2024-09-21T01:07:19.817 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/77328054' entity='client.admin' 2024-09-21T01:07:19.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: Deploying daemon mgr.y on smithi137 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1018709442' entity='client.admin' 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3995849613' entity='client.admin' 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='client.? ' entity='client.admin' 2024-09-21T01:07:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/77328054' entity='client.admin' 2024-09-21T01:07:20.421 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:07:20 smithi137 podman[35408]: 2024-09-21 01:07:20.280527183 +0000 UTC m=+0.015502469 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:07:20.920 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:07:20 smithi137 podman[35408]: 2024-09-21 01:07:20.579923465 +0000 UTC m=+0.314898740 container init b2b3dbcc6196cf51484000e570b628f1857f13b002a391532e39993268fa200c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T01:07:20.921 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:07:20 smithi137 podman[35408]: 2024-09-21 01:07:20.583382256 +0000 UTC m=+0.318357529 container start b2b3dbcc6196cf51484000e570b628f1857f13b002a391532e39993268fa200c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:07:20.921 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:07:20 smithi137 ceph-mgr[35427]: -- 172.21.15.137:0/3737392024 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576a3e8b0e0 con 0x5576a3ea9a80 2024-09-21T01:07:20.921 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:07:20 smithi137 bash[35408]: b2b3dbcc6196cf51484000e570b628f1857f13b002a391532e39993268fa200c 2024-09-21T01:07:20.921 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:07:20 smithi137 systemd[1]: Started Ceph mgr.y for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3563554916' entity='client.admin' 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='client.? ' entity='client.admin' 2024-09-21T01:07:22.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1266244692' entity='client.admin' 2024-09-21T01:07:22.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:21 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3563554916' entity='client.admin' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='client.? ' entity='client.admin' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1266244692' entity='client.admin' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:21 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3563554916' entity='client.admin' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='client.? ' entity='client.admin' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1266244692' entity='client.admin' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:22.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:21 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:23.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:23.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:24.482 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:24.482 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1194430350' entity='client.admin' 2024-09-21T01:07:24.482 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: Standby manager daemon z started 2024-09-21T01:07:24.482 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:07:24.482 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:07:24.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:07:24.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:24 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:07:24.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:24.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1194430350' entity='client.admin' 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: Standby manager daemon z started 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:24 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:24.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1194430350' entity='client.admin' 2024-09-21T01:07:24.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: Standby manager daemon z started 2024-09-21T01:07:24.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:07:24.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:07:24.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:07:24.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:24 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.144:0/1281678235' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:07:25.014 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.015 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.015 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.018 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.019 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.021 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 -- 172.21.15.37:0/4230114290 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f97a407b000 msgr2=0x7f97a407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 --2- 172.21.15.37:0/4230114290 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f97a407b000 0x7f97a407d510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005fd0 tx=0x7f97a8009280 comp rx=0 tx=0).stop 2024-09-21T01:07:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 -- 172.21.15.37:0/4230114290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b41024d0 msgr2=0x7f97b4073e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 --2- 172.21.15.37:0/4230114290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b41024d0 0x7f97b4073e90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f97a000b510 tx=0x7f97a000b9d0 comp rx=0 tx=0).stop 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 -- 172.21.15.37:0/4230114290 shutdown_connections 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 --2- 172.21.15.37:0/4230114290 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f97a407b000 0x7f97a407d510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 --2- 172.21.15.37:0/4230114290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b4074910 0x7f97b4072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 --2- 172.21.15.37:0/4230114290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97b4103560 0x7f97b40743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.284+0000 7f97bac6c640 1 --2- 172.21.15.37:0/4230114290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97b41024d0 0x7f97b4073e90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.285+0000 7f97bac6c640 1 -- 172.21.15.37:0/4230114290 >> 172.21.15.37:0/4230114290 conn(0x7f97b40fde80 msgr2=0x7f97b4106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.285+0000 7f97bac6c640 1 -- 172.21.15.37:0/4230114290 shutdown_connections 2024-09-21T01:07:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:25.285+0000 7f97bac6c640 1 -- 172.21.15.37:0/4230114290 wait complete. 2024-09-21T01:07:25.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:25 smithi137 ceph-mon[34607]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-21T01:07:25.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:25 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:07:25.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:25 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/4230114290' entity='client.admin' 2024-09-21T01:07:25.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:25 smithi144 ceph-mon[34818]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-21T01:07:25.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:25 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:07:25.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:25 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/4230114290' entity='client.admin' 2024-09-21T01:07:25.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:25 smithi037 ceph-mon[31105]: mgrmap e14: x(active, since 67s), standbys: z 2024-09-21T01:07:25.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:25 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:07:25.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:25 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4230114290' entity='client.admin' 2024-09-21T01:07:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 -- 172.21.15.37:0/2378555149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb644105180 msgr2=0x7fb64410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 --2- 172.21.15.37:0/2378555149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb644105180 0x7fb64410bb20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009ca0 tx=0x7fb63c02a950 comp rx=0 tx=0).stop 2024-09-21T01:07:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 -- 172.21.15.37:0/2378555149 shutdown_connections 2024-09-21T01:07:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 --2- 172.21.15.37:0/2378555149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb644105180 0x7fb64410bb20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 --2- 172.21.15.37:0/2378555149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6441047e0 0x7fb644104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 --2- 172.21.15.37:0/2378555149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb644103750 0x7fb644103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 -- 172.21.15.37:0/2378555149 >> 172.21.15.37:0/2378555149 conn(0x7fb6440ff0c0 msgr2=0x7fb644101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 -- 172.21.15.37:0/2378555149 shutdown_connections 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.141+0000 7fb64bc59640 1 -- 172.21.15.37:0/2378555149 wait complete. 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.142+0000 7fb64bc59640 1 Processor -- start 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.142+0000 7fb64bc59640 1 -- start start 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64bc59640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb644103750 0x7fb644199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64bc59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 0x7fb64419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64bc59640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb644105180 0x7fb64419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64bc59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410f380 con 0x7fb6441047e0 2024-09-21T01:07:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64bc59640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410f200 con 0x7fb644103750 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64bc59640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb64410f500 con 0x7fb644105180 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 0x7fb64419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 0x7fb64419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39536/0 (socket says 172.21.15.37:39536) 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 -- 172.21.15.37:0/922479540 learned_addr learned my addr 172.21.15.37:0/922479540 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6499f5640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb644103750 0x7fb644199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb64a1f6640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb644105180 0x7fb64419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 -- 172.21.15.37:0/922479540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb644105180 msgr2=0x7fb64419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb644105180 0x7fb64419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 -- 172.21.15.37:0/922479540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb644103750 msgr2=0x7fb644199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb644103750 0x7fb644199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6491f4640 1 -- 172.21.15.37:0/922479540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64419b910 con 0x7fb6441047e0 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.143+0000 7fb6499f5640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb644103750 0x7fb644199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.144+0000 7fb6491f4640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 0x7fb64419a5e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d950 tx=0x7fb63400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:26.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.144+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb634017070 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.144+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64419bc00 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.144+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb63400de80 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.144+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63400f620 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.144+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6440757c0 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.146+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb644103bc0 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.147+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7fb634009c30 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.148+0000 7fb63affd640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb63007afd0 0x7fb63007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.149+0000 7fb6499f5640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb63007afd0 0x7fb63007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.149+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb63409c920 con 0x7fb6441047e0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.150+0000 7fb6499f5640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb63007afd0 0x7fb63007d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb64000f3c0 tx=0x7fb64000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.154+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6340692e0 con 0x7fb6441047e0 2024-09-21T01:07:26.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.345+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fb64402e960 con 0x7fb6441047e0 2024-09-21T01:07:26.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.346+0000 7fb63affd640 1 -- 172.21.15.37:0/922479540 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7fb63406e190 con 0x7fb6441047e0 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb63007afd0 msgr2=0x7fb63007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb63007afd0 0x7fb63007d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb64000f3c0 tx=0x7fb64000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 msgr2=0x7fb64419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 0x7fb64419a5e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d950 tx=0x7fb63400dd50 comp rx=0 tx=0).stop 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 shutdown_connections 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb63007afd0 0x7fb63007d4e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb644105180 0x7fb64419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6441047e0 0x7fb64419a5e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 --2- 172.21.15.37:0/922479540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb644103750 0x7fb644199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 >> 172.21.15.37:0/922479540 conn(0x7fb6440ff0c0 msgr2=0x7fb644107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 shutdown_connections 2024-09-21T01:07:26.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:26.348+0000 7fb64bc59640 1 -- 172.21.15.37:0/922479540 wait complete. 2024-09-21T01:07:26.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:26 smithi037 ceph-mon[31105]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:26 smithi037 ceph-mon[31105]: Standby manager daemon y started 2024-09-21T01:07:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:26 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:07:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:26 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:07:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:26 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:07:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:26 smithi037 ceph-mon[31105]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:07:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:26 smithi137 ceph-mon[34607]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:26 smithi137 ceph-mon[34607]: Standby manager daemon y started 2024-09-21T01:07:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:26 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:26 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:26 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:26 smithi137 ceph-mon[34607]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:26 smithi144 ceph-mon[34818]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:26 smithi144 ceph-mon[34818]: Standby manager daemon y started 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:26 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:26 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:26 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:07:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:26 smithi144 ceph-mon[34818]: from='mgr.? 172.21.15.137:0/2570218796' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:07:27.435 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi037') 2024-09-21T01:07:27.435 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi037') 2024-09-21T01:07:27.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:27 smithi037 ceph-mon[31105]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-21T01:07:27.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:07:27.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:27 smithi137 ceph-mon[34607]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-21T01:07:27.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:07:27.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:27 smithi144 ceph-mon[34818]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-21T01:07:27.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:07:28.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:28 smithi037 ceph-mon[31105]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:28.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:28 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2012877742' entity='client.admin' 2024-09-21T01:07:28.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:28 smithi144 ceph-mon[34818]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:28.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:28 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2012877742' entity='client.admin' 2024-09-21T01:07:28.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.063+0000 7f5f4a314640 1 -- 172.21.15.37:0/2823767648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f44109490 msgr2=0x7f5f4410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.063+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2823767648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f44109490 0x7f5f4410b9a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009ca0 tx=0x7f5f3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.063+0000 7f5f4a314640 1 -- 172.21.15.37:0/2823767648 shutdown_connections 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.063+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2823767648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f44109490 0x7f5f4410b9a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2823767648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f441068f0 0x7f5f44108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2823767648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 0x7f5f441063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 -- 172.21.15.37:0/2823767648 >> 172.21.15.37:0/2823767648 conn(0x7f5f440fdfd0 msgr2=0x7f5f44100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 -- 172.21.15.37:0/2823767648 shutdown_connections 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 -- 172.21.15.37:0/2823767648 wait complete. 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 Processor -- start 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.064+0000 7f5f4a314640 1 -- start start 2024-09-21T01:07:28.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f4a314640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 0x7f5f44197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f4a314640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 0x7f5f44198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f4a314640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f44109490 0x7f5f44198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f4a314640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410d210 con 0x7f5f441068f0 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f4a314640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410d090 con 0x7f5f44109490 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f4a314640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410d390 con 0x7f5f4406c340 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 0x7f5f44198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 0x7f5f44198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39560/0 (socket says 172.21.15.37:39560) 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 -- 172.21.15.37:0/2012877742 learned_addr learned my addr 172.21.15.37:0/2012877742 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f43fff640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 0x7f5f44197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f488b1640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f44109490 0x7f5f44198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 -- 172.21.15.37:0/2012877742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 msgr2=0x7f5f44197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 0x7f5f44197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 -- 172.21.15.37:0/2012877742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f44109490 msgr2=0x7f5f44198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f44109490 0x7f5f44198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 -- 172.21.15.37:0/2012877742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f44199800 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f43fff640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 0x7f5f44197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.065+0000 7f5f437fe640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 0x7f5f44198440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f38011b20 tx=0x7f5f3800f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.066+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3801e070 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.066+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f44199af0 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.066+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f3800fc90 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.066+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38018700 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.066+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441a01f0 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.067+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f440ffaf0 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.068+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5f38021070 con 0x7f5f441068f0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.069+0000 7f5f417fa640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.069+0000 7f5f43fff640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:28.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.069+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f380e8ed0 con 0x7f5f441068f0 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.070+0000 7f5f43fff640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009fc0 tx=0x7f5f34005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.072+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f38014070 con 0x7f5f441068f0 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.262+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f5f4402e640 con 0x7f5f441068f0 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.268+0000 7f5f417fa640 1 -- 172.21.15.37:0/2012877742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v22)=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7f5f380b5810 con 0x7f5f441068f0 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f2c0b6480 msgr2=0x7f5f2c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009fc0 tx=0x7f5f34005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 msgr2=0x7f5f44198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 0x7f5f44198440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f38011b20 tx=0x7f5f3800f050 comp rx=0 tx=0).stop 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 shutdown_connections 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f2c0b6480 0x7f5f2c0b8990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f44109490 0x7f5f44198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f441068f0 0x7f5f44198440 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 --2- 172.21.15.37:0/2012877742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4406c340 0x7f5f44197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:28.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 >> 172.21.15.37:0/2012877742 conn(0x7f5f440fdfd0 msgr2=0x7f5f44104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:28.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 shutdown_connections 2024-09-21T01:07:28.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:28.271+0000 7f5f4a314640 1 -- 172.21.15.37:0/2012877742 wait complete. 2024-09-21T01:07:28.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:28 smithi137 ceph-mon[34607]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:28.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:28 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2012877742' entity='client.admin' 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 -- 172.21.15.37:0/2921372870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15901036d0 msgr2=0x7f1590103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 --2- 172.21.15.37:0/2921372870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15901036d0 0x7f1590103ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1584009900 tx=0x7f158402a480 comp rx=0 tx=0).stop 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 -- 172.21.15.37:0/2921372870 shutdown_connections 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 --2- 172.21.15.37:0/2921372870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1590104070 0x7f159010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 --2- 172.21.15.37:0/2921372870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15901036d0 0x7f1590103ae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 --2- 172.21.15.37:0/2921372870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1590102640 0x7f1590102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 -- 172.21.15.37:0/2921372870 >> 172.21.15.37:0/2921372870 conn(0x7f15900fdfb0 msgr2=0x7f1590100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 -- 172.21.15.37:0/2921372870 shutdown_connections 2024-09-21T01:07:29.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.296+0000 7f1596871640 1 -- 172.21.15.37:0/2921372870 wait complete. 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 Processor -- start 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 -- start start 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1590102640 0x7f1590106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15901036d0 0x7f1590104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 0x7f1590105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f159010e290 con 0x7f1590104070 2024-09-21T01:07:29.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f159010e110 con 0x7f15901036d0 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1596871640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f159010e410 con 0x7f1590102640 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1594e0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 0x7f1590105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1594e0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 0x7f1590105040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39584/0 (socket says 172.21.15.37:39584) 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.297+0000 7f1594e0e640 1 -- 172.21.15.37:0/3577187273 learned_addr learned my addr 172.21.15.37:0/3577187273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f158ffff640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1590102640 0x7f1590106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f158f7fe640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15901036d0 0x7f1590104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1594e0e640 1 -- 172.21.15.37:0/3577187273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1590102640 msgr2=0x7f1590106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1594e0e640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1590102640 0x7f1590106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1594e0e640 1 -- 172.21.15.37:0/3577187273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15901036d0 msgr2=0x7f1590104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1594e0e640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15901036d0 0x7f1590104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1594e0e640 1 -- 172.21.15.37:0/3577187273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1590105740 con 0x7f1590104070 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f158f7fe640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15901036d0 0x7f1590104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:29.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1594e0e640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 0x7f1590105040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1588009fd0 tx=0x7f158800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588017070 con 0x7f1590104070 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1588003e20 con 0x7f1590104070 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15901a40a0 con 0x7f1590104070 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588010460 con 0x7f1590104070 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.298+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15901a4500 con 0x7f1590104070 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.299+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1590102ab0 con 0x7f1590104070 2024-09-21T01:07:29.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.301+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1588003970 con 0x7f1590104070 2024-09-21T01:07:29.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.302+0000 7f158d7fa640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f15780b6480 0x7f15780b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:29.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.302+0000 7f158ffff640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f15780b6480 0x7f15780b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:29.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.302+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f15880e57b0 con 0x7f1590104070 2024-09-21T01:07:29.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.303+0000 7f158ffff640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f15780b6480 0x7f15780b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1580009bd0 tx=0x7f1580005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.306+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15880adcf0 con 0x7f1590104070 2024-09-21T01:07:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.500+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f15901a47f0 con 0x7f1590104070 2024-09-21T01:07:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.500+0000 7f158d7fa640 1 -- 172.21.15.37:0/3577187273 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7f15880b20d0 con 0x7f1590104070 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f15780b6480 msgr2=0x7f15780b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f15780b6480 0x7f15780b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1580009bd0 tx=0x7f1580005f90 comp rx=0 tx=0).stop 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 msgr2=0x7f1590105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 0x7f1590105040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1588009fd0 tx=0x7f158800b260 comp rx=0 tx=0).stop 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 shutdown_connections 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f15780b6480 0x7f15780b8990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1590104070 0x7f1590105040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15901036d0 0x7f1590104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 --2- 172.21.15.37:0/3577187273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1590102640 0x7f1590106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 >> 172.21.15.37:0/3577187273 conn(0x7f15900fdfb0 msgr2=0x7f15900ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 shutdown_connections 2024-09-21T01:07:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:29.504+0000 7f1596871640 1 -- 172.21.15.37:0/3577187273 wait complete. 2024-09-21T01:07:29.950 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T01:07:29.950 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T01:07:29.950 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi037') 2024-09-21T01:07:30.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 -- 172.21.15.37:0/3561611861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec1083b0 msgr2=0x7f1fec10a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/3561611861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec1083b0 0x7f1fec10a8c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009ca0 tx=0x7f1fe402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 -- 172.21.15.37:0/3561611861 shutdown_connections 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/3561611861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec1083b0 0x7f1fec10a8c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/3561611861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec105790 0x7f1fec107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/3561611861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fec102d10 0x7f1fec105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 -- 172.21.15.37:0/3561611861 >> 172.21.15.37:0/3561611861 conn(0x7f1fec0fd770 msgr2=0x7f1fec0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 -- 172.21.15.37:0/3561611861 shutdown_connections 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.647+0000 7f1ff26e6640 1 -- 172.21.15.37:0/3561611861 wait complete. 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 Processor -- start 2024-09-21T01:07:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 -- start start 2024-09-21T01:07:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 0x7f1fec199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fec105790 0x7f1fec19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec1083b0 0x7f1fec19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec10e2a0 con 0x7f1fec102d10 2024-09-21T01:07:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec10e120 con 0x7f1fec1083b0 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1ff26e6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec10e420 con 0x7f1fec105790 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1febfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 0x7f1fec199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1febfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 0x7f1fec199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39604/0 (socket says 172.21.15.37:39604) 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.648+0000 7f1febfff640 1 -- 172.21.15.37:0/972591808 learned_addr learned my addr 172.21.15.37:0/972591808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1feb7fe640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fec105790 0x7f1fec19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1ff0c83640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec1083b0 0x7f1fec19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1febfff640 1 -- 172.21.15.37:0/972591808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fec105790 msgr2=0x7f1fec19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1febfff640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fec105790 0x7f1fec19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1febfff640 1 -- 172.21.15.37:0/972591808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec1083b0 msgr2=0x7f1fec19b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1febfff640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec1083b0 0x7f1fec19b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1febfff640 1 -- 172.21.15.37:0/972591808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec19b950 con 0x7f1fec102d10 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1ff0c83640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec1083b0 0x7f1fec19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1febfff640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 0x7f1fec199f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00d950 tx=0x7f1fdc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc017070 con 0x7f1fec102d10 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec19bc40 con 0x7f1fec102d10 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fdc009c30 con 0x7f1fec102d10 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00f620 con 0x7f1fec102d10 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.649+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec103310 con 0x7f1fec102d10 2024-09-21T01:07:30.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.650+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec105c60 con 0x7f1fec102d10 2024-09-21T01:07:30.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.652+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1fdc010460 con 0x7f1fec102d10 2024-09-21T01:07:30.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.652+0000 7f1fe97fa640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1fd40b6480 0x7f1fd40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.653+0000 7f1feb7fe640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1fd40b6480 0x7f1fd40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.653+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1fdc0e5270 con 0x7f1fec102d10 2024-09-21T01:07:30.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.653+0000 7f1feb7fe640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1fd40b6480 0x7f1fd40b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00058c0 tx=0x7f1fe000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:30.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.657+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1fdc0ad7d0 con 0x7f1fec102d10 2024-09-21T01:07:30.723 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:30 smithi137 ceph-mon[34607]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:30.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:30 smithi037 ceph-mon[31105]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:30.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.847+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1fec103630 con 0x7f1fec102d10 2024-09-21T01:07:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.853+0000 7f1fe97fa640 1 -- 172.21.15.37:0/972591808 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f1fdc009de0 con 0x7f1fec102d10 2024-09-21T01:07:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1fd40b6480 msgr2=0x7f1fd40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1fd40b6480 0x7f1fd40b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00058c0 tx=0x7f1fe000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 msgr2=0x7f1fec199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 0x7f1fec199f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00d950 tx=0x7f1fdc00de10 comp rx=0 tx=0).stop 2024-09-21T01:07:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 shutdown_connections 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1fd40b6480 0x7f1fd40b8990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fec1083b0 0x7f1fec19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fec105790 0x7f1fec19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 --2- 172.21.15.37:0/972591808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fec102d10 0x7f1fec199f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 >> 172.21.15.37:0/972591808 conn(0x7f1fec0fd770 msgr2=0x7f1fec1078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 shutdown_connections 2024-09-21T01:07:30.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.856+0000 7f1ff26e6640 1 -- 172.21.15.37:0/972591808 wait complete. 2024-09-21T01:07:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.868+0000 7fd5270de640 1 -- 172.21.15.37:0/1751789195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 msgr2=0x7fd520105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.868+0000 7fd5270de640 1 --2- 172.21.15.37:0/1751789195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520105110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd514009900 tx=0x7fd51402a410 comp rx=0 tx=0).stop 2024-09-21T01:07:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 -- 172.21.15.37:0/1751789195 shutdown_connections 2024-09-21T01:07:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 --2- 172.21.15.37:0/1751789195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 0x7fd52010a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 --2- 172.21.15.37:0/1751789195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 0x7fd520107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 --2- 172.21.15.37:0/1751789195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520105110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 -- 172.21.15.37:0/1751789195 >> 172.21.15.37:0/1751789195 conn(0x7fd5200fd770 msgr2=0x7fd5200ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 -- 172.21.15.37:0/1751789195 shutdown_connections 2024-09-21T01:07:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.869+0000 7fd5270de640 1 -- 172.21.15.37:0/1751789195 wait complete. 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 Processor -- start 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 -- start start 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520102130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 0x7fd52019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 0x7fd5201a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010e250 con 0x7fd520102c90 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010e0d0 con 0x7fd520108370 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd5270de640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010e3d0 con 0x7fd520105750 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd524e7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520102130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd524e7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520102130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39622/0 (socket says 172.21.15.37:39622) 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd52567b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 0x7fd5201a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd524e7a640 1 -- 172.21.15.37:0/1705304637 learned_addr learned my addr 172.21.15.37:0/1705304637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.870+0000 7fd51ffff640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 0x7fd52019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd52567b640 1 -- 172.21.15.37:0/1705304637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 msgr2=0x7fd52019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd52567b640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 0x7fd52019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd52567b640 1 -- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 msgr2=0x7fd520102130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd52567b640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520102130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd52567b640 1 -- 172.21.15.37:0/1705304637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5201a19e0 con 0x7fd520108370 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd51ffff640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 0x7fd52019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd524e7a640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd52567b640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 0x7fd5201a1270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd518009fd0 tx=0x7fd51800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51800ce20 con 0x7fd520108370 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd518005020 con 0x7fd520108370 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518010690 con 0x7fd520108370 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5201a1cd0 con 0x7fd520108370 2024-09-21T01:07:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.871+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5201a21c0 con 0x7fd520108370 2024-09-21T01:07:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.872+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5200ff290 con 0x7fd520108370 2024-09-21T01:07:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.874+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd518004b20 con 0x7fd520108370 2024-09-21T01:07:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.875+0000 7fd51dffb640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd5100b6580 0x7fd5100b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.875+0000 7fd524e7a640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd5100b6580 0x7fd5100b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.875+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd5180e5d80 con 0x7fd520108370 2024-09-21T01:07:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.875+0000 7fd524e7a640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd5100b6580 0x7fd5100b8a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd514032fd0 tx=0x7fd5140314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:30.879+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5180eb020 con 0x7fd520108370 2024-09-21T01:07:30.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:30 smithi144 ceph-mon[34818]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:31.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.069+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fd52002e640 con 0x7fd520108370 2024-09-21T01:07:31.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.077+0000 7fd51dffb640 1 -- 172.21.15.37:0/1705304637 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fd5180ae240 con 0x7fd520108370 2024-09-21T01:07:31.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd5100b6580 msgr2=0x7fd5100b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd5100b6580 0x7fd5100b8a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd514032fd0 tx=0x7fd5140314a0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 msgr2=0x7fd5201a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 0x7fd5201a1270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd518009fd0 tx=0x7fd51800ef10 comp rx=0 tx=0).stop 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 shutdown_connections 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd5100b6580 0x7fd5100b8a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd520108370 0x7fd5201a1270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd520105750 0x7fd52019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 --2- 172.21.15.37:0/1705304637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520102c90 0x7fd520102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 >> 172.21.15.37:0/1705304637 conn(0x7fd5200fd770 msgr2=0x7fd520103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 shutdown_connections 2024-09-21T01:07:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.079+0000 7fd5270de640 1 -- 172.21.15.37:0/1705304637 wait complete. 2024-09-21T01:07:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 -- 172.21.15.37:0/2881985132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc1047e0 msgr2=0x7fd7dc104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/2881985132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc1047e0 0x7fd7dc104bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009900 tx=0x7fd7cc02a480 comp rx=0 tx=0).stop 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 -- 172.21.15.37:0/2881985132 shutdown_connections 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/2881985132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7dc105180 0x7fd7dc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/2881985132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc1047e0 0x7fd7dc104bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/2881985132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7dc103750 0x7fd7dc103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 -- 172.21.15.37:0/2881985132 >> 172.21.15.37:0/2881985132 conn(0x7fd7dc0ff0c0 msgr2=0x7fd7dc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 -- 172.21.15.37:0/2881985132 shutdown_connections 2024-09-21T01:07:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.956+0000 7fd7e3d43640 1 -- 172.21.15.37:0/2881985132 wait complete. 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 Processor -- start 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 -- start start 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 0x7fd7dc199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7dc1047e0 0x7fd7dc19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7dc105180 0x7fd7dc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc10f380 con 0x7fd7dc103750 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc10f200 con 0x7fd7dc105180 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e3d43640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc10f500 con 0x7fd7dc1047e0 2024-09-21T01:07:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e1adf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 0x7fd7dc199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e1adf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 0x7fd7dc199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39632/0 (socket says 172.21.15.37:39632) 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e1adf640 1 -- 172.21.15.37:0/1915717618 learned_addr learned my addr 172.21.15.37:0/1915717618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.957+0000 7fd7e12de640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7dc1047e0 0x7fd7dc19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e22e0640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7dc105180 0x7fd7dc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e1adf640 1 -- 172.21.15.37:0/1915717618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7dc1047e0 msgr2=0x7fd7dc19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e1adf640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7dc1047e0 0x7fd7dc19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e1adf640 1 -- 172.21.15.37:0/1915717618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7dc105180 msgr2=0x7fd7dc19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e1adf640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7dc105180 0x7fd7dc19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e1adf640 1 -- 172.21.15.37:0/1915717618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7dc19b9d0 con 0x7fd7dc103750 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e1adf640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 0x7fd7dc199fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800d950 tx=0x7fd7d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8017030 con 0x7fd7dc103750 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7d8004020 con 0x7fd7dc103750 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80047a0 con 0x7fd7dc103750 2024-09-21T01:07:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7dc19bcc0 con 0x7fd7dc103750 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.958+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7dc1a23c0 con 0x7fd7dc103750 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.959+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7dc10a930 con 0x7fd7dc103750 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.961+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd7d8009a30 con 0x7fd7dc103750 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.962+0000 7fd7d2ffd640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7c80b6580 0x7fd7c80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.962+0000 7fd7e12de640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7c80b6580 0x7fd7c80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.962+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd7d80e5790 con 0x7fd7dc103750 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.962+0000 7fd7e12de640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7c80b6580 0x7fd7c80b8a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc000c00 tx=0x7fd7cc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:31.965+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7d80adcd0 con 0x7fd7dc103750 2024-09-21T01:07:32.108 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:31 smithi037 ceph-mon[31105]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:32.108 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:31 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/972591808' entity='client.admin' 2024-09-21T01:07:32.108 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:31 smithi037 ceph-mon[31105]: from='client.? ' entity='client.admin' 2024-09-21T01:07:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.156+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fd7dc02e640 con 0x7fd7dc103750 2024-09-21T01:07:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.162+0000 7fd7d2ffd640 1 -- 172.21.15.37:0/1915717618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7fd7d80b20b0 con 0x7fd7dc103750 2024-09-21T01:07:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7c80b6580 msgr2=0x7fd7c80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7c80b6580 0x7fd7c80b8a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc000c00 tx=0x7fd7cc031400 comp rx=0 tx=0).stop 2024-09-21T01:07:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 msgr2=0x7fd7dc199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 0x7fd7dc199fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800d950 tx=0x7fd7d800de10 comp rx=0 tx=0).stop 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 shutdown_connections 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7c80b6580 0x7fd7c80b8a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7dc105180 0x7fd7dc19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7dc1047e0 0x7fd7dc19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 --2- 172.21.15.37:0/1915717618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7dc103750 0x7fd7dc199fa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 >> 172.21.15.37:0/1915717618 conn(0x7fd7dc0ff0c0 msgr2=0x7fd7dc107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 shutdown_connections 2024-09-21T01:07:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:32.165+0000 7fd7e3d43640 1 -- 172.21.15.37:0/1915717618 wait complete. 2024-09-21T01:07:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:31 smithi144 ceph-mon[34818]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:31 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/972591808' entity='client.admin' 2024-09-21T01:07:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:31 smithi144 ceph-mon[34818]: from='client.? ' entity='client.admin' 2024-09-21T01:07:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:31 smithi137 ceph-mon[34607]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:31 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/972591808' entity='client.admin' 2024-09-21T01:07:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:31 smithi137 ceph-mon[34607]: from='client.? ' entity='client.admin' 2024-09-21T01:07:33.224 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:33.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:33 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1915717618' entity='client.admin' 2024-09-21T01:07:33.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:33 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1915717618' entity='client.admin' 2024-09-21T01:07:33.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:33 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1915717618' entity='client.admin' 2024-09-21T01:07:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 -- 172.21.15.37:0/3868083766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37681068e0 msgr2=0x7f3768108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 --2- 172.21.15.37:0/3868083766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37681068e0 0x7f3768108d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f375c009900 tx=0x7f375c02a410 comp rx=0 tx=0).stop 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 -- 172.21.15.37:0/3868083766 shutdown_connections 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 --2- 172.21.15.37:0/3868083766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3768109480 0x7f376810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 --2- 172.21.15.37:0/3868083766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37681068e0 0x7f3768108d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 --2- 172.21.15.37:0/3868083766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376806c600 0x7f37681063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 -- 172.21.15.37:0/3868083766 >> 172.21.15.37:0/3868083766 conn(0x7f37680fdfa0 msgr2=0x7f3768100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 -- 172.21.15.37:0/3868083766 shutdown_connections 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.116+0000 7f376ccf8640 1 -- 172.21.15.37:0/3868083766 wait complete. 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.117+0000 7f376ccf8640 1 Processor -- start 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.117+0000 7f376ccf8640 1 -- start start 2024-09-21T01:07:34.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.117+0000 7f376ccf8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 0x7f376819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.117+0000 7f376ccf8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37681068e0 0x7f376819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376ccf8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3768109480 0x7f376819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376ccf8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f376810f3f0 con 0x7f376806c600 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376ccf8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f376810f270 con 0x7f37681068e0 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376ccf8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f376810f570 con 0x7f3768109480 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 0x7f376819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 0x7f376819a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39648/0 (socket says 172.21.15.37:39648) 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 -- 172.21.15.37:0/565617609 learned_addr learned my addr 172.21.15.37:0/565617609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f3766d9d640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3768109480 0x7f376819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f3765d9b640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37681068e0 0x7f376819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 -- 172.21.15.37:0/565617609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3768109480 msgr2=0x7f376819b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3768109480 0x7f376819b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 -- 172.21.15.37:0/565617609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37681068e0 msgr2=0x7f376819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37681068e0 0x7f376819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 -- 172.21.15.37:0/565617609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376819ba40 con 0x7f376806c600 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f3765d9b640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37681068e0 0x7f376819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376659c640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 0x7f376819a010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f375800d950 tx=0x7f375800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758017070 con 0x7f376806c600 2024-09-21T01:07:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3758009c30 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375800f620 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.118+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376819bd30 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.119+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37681a2430 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.120+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37680ffac0 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.122+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3758010460 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.123+0000 7f37577fe640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37500b6500 0x7f37500b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.123+0000 7f3765d9b640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37500b6500 0x7f37500b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.123+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f37580e5330 con 0x7f376806c600 2024-09-21T01:07:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.123+0000 7f3765d9b640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37500b6500 0x7f37500b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f375c005f70 tx=0x7f375c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.126+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37580ad870 con 0x7f376806c600 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.327+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f376802e640 con 0x7f376806c600 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.332+0000 7f37577fe640 1 -- 172.21.15.37:0/565617609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f3758009de0 con 0x7f376806c600 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37500b6500 msgr2=0x7f37500b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37500b6500 0x7f37500b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f375c005f70 tx=0x7f375c000bc0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 msgr2=0x7f376819a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 0x7f376819a010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f375800d950 tx=0x7f375800de10 comp rx=0 tx=0).stop 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 shutdown_connections 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37500b6500 0x7f37500b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3768109480 0x7f376819b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37681068e0 0x7f376819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 --2- 172.21.15.37:0/565617609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f376806c600 0x7f376819a010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 >> 172.21.15.37:0/565617609 conn(0x7f37680fdfa0 msgr2=0x7f3768104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 shutdown_connections 2024-09-21T01:07:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:33.334+0000 7f376ccf8640 1 -- 172.21.15.37:0/565617609 wait complete. 2024-09-21T01:07:34.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:34 smithi037 ceph-mon[31105]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:34.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:34 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/565617609' entity='client.admin' 2024-09-21T01:07:34.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:34 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2730216811' entity='client.admin' 2024-09-21T01:07:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:34 smithi137 ceph-mon[34607]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:34 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/565617609' entity='client.admin' 2024-09-21T01:07:34.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:34 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2730216811' entity='client.admin' 2024-09-21T01:07:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:34 smithi144 ceph-mon[34818]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:34 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/565617609' entity='client.admin' 2024-09-21T01:07:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:34 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2730216811' entity='client.admin' 2024-09-21T01:07:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 -- 172.21.15.37:0/3802090166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 msgr2=0x7f294410aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 --2- 172.21.15.37:0/3802090166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f294410aa40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f293c009ca0 tx=0x7f293c02a950 comp rx=0 tx=0).stop 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 -- 172.21.15.37:0/3802090166 shutdown_connections 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 --2- 172.21.15.37:0/3802090166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f294410aa40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 --2- 172.21.15.37:0/3802090166 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2944103700 0x7f2944103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 --2- 172.21.15.37:0/3802090166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944102670 0x7f2944102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 -- 172.21.15.37:0/3802090166 >> 172.21.15.37:0/3802090166 conn(0x7f29440fdfe0 msgr2=0x7f2944100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 -- 172.21.15.37:0/3802090166 shutdown_connections 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.045+0000 7f294abd3640 1 -- 172.21.15.37:0/3802090166 wait complete. 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 Processor -- start 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 -- start start 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2944102670 0x7f294406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944103700 0x7f29441a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f29441a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f294410e2c0 con 0x7f29441040a0 2024-09-21T01:07:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f294410e140 con 0x7f2944102670 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.046+0000 7f294abd3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f294410e440 con 0x7f2944103700 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f29441a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f29441a3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39670/0 (socket says 172.21.15.37:39670) 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 -- 172.21.15.37:0/2730216811 learned_addr learned my addr 172.21.15.37:0/2730216811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2943fff640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944103700 0x7f29441a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f294896f640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2944102670 0x7f294406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 -- 172.21.15.37:0/2730216811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944103700 msgr2=0x7f29441a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944103700 0x7f29441a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 -- 172.21.15.37:0/2730216811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2944102670 msgr2=0x7f294406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2944102670 0x7f294406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 -- 172.21.15.37:0/2730216811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29441a3c90 con 0x7f29441040a0 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2943fff640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944103700 0x7f29441a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2949170640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f29441a3680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f293c030040 tx=0x7f293c02fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c034040 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f293c0308f0 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29441a3f20 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c03a430 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.047+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29441a4370 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.049+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2944109850 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.050+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f293c037020 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.051+0000 7f2941ffb640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29300b6500 0x7f29300b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.051+0000 7f294896f640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29300b6500 0x7f29300b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.051+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f293c1067f0 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.051+0000 7f294896f640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29300b6500 0x7f29300b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f292c005fd0 tx=0x7f292c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.055+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f293c0cecb0 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.245+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2944063fc0 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.249+0000 7f2941ffb640 1 -- 172.21.15.37:0/2730216811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f293c0d3090 con 0x7f29441040a0 2024-09-21T01:07:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29300b6500 msgr2=0x7f29300b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29300b6500 0x7f29300b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f292c005fd0 tx=0x7f292c005850 comp rx=0 tx=0).stop 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 msgr2=0x7f29441a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f29441a3680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f293c030040 tx=0x7f293c02fc00 comp rx=0 tx=0).stop 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 shutdown_connections 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29300b6500 0x7f29300b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29441040a0 0x7f29441a3680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944103700 0x7f29441a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 --2- 172.21.15.37:0/2730216811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2944102670 0x7f294406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 >> 172.21.15.37:0/2730216811 conn(0x7f29440fdfe0 msgr2=0x7f2944106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 shutdown_connections 2024-09-21T01:07:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:34.252+0000 7f294abd3640 1 -- 172.21.15.37:0/2730216811 wait complete. 2024-09-21T01:07:36.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:36 smithi037 ceph-mon[31105]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:36.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi037') 2024-09-21T01:07:36.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi037') 2024-09-21T01:07:36.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi037') 2024-09-21T01:07:36.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi037') 2024-09-21T01:07:36.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:36 smithi137 ceph-mon[34607]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:36.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:36 smithi144 ceph-mon[34818]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:37.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:37 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/361094256' entity='client.admin' 2024-09-21T01:07:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 -- 172.21.15.37:0/2935736926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17741036d0 msgr2=0x7f1774103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 --2- 172.21.15.37:0/2935736926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17741036d0 0x7f1774103ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1764009900 tx=0x7f176402a480 comp rx=0 tx=0).stop 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 -- 172.21.15.37:0/2935736926 shutdown_connections 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 --2- 172.21.15.37:0/2935736926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774104070 0x7f177410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 --2- 172.21.15.37:0/2935736926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17741036d0 0x7f1774103ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 --2- 172.21.15.37:0/2935736926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1774102640 0x7f1774102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.718+0000 7f177b86b640 1 -- 172.21.15.37:0/2935736926 >> 172.21.15.37:0/2935736926 conn(0x7f17740fdfb0 msgr2=0x7f1774100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.719+0000 7f177b86b640 1 -- 172.21.15.37:0/2935736926 shutdown_connections 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.719+0000 7f177b86b640 1 -- 172.21.15.37:0/2935736926 wait complete. 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.719+0000 7f177b86b640 1 Processor -- start 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.719+0000 7f177b86b640 1 -- start start 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f177b86b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774102640 0x7f177406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f177b86b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17741036d0 0x7f177419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f177b86b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 0x7f17741a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f177b86b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f177410e270 con 0x7f1774104070 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f177b86b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f177410e0f0 con 0x7f17741036d0 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f177b86b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f177410e3f0 con 0x7f1774102640 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 0x7f17741a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 0x7f17741a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47380/0 (socket says 172.21.15.37:47380) 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 -- 172.21.15.37:0/1252563760 learned_addr learned my addr 172.21.15.37:0/1252563760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779607640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774102640 0x7f177406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1778e06640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17741036d0 0x7f177419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 -- 172.21.15.37:0/1252563760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774102640 msgr2=0x7f177406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774102640 0x7f177406b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 -- 172.21.15.37:0/1252563760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17741036d0 msgr2=0x7f177419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17741036d0 0x7f177419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 -- 172.21.15.37:0/1252563760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17741a1a70 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.720+0000 7f1779e08640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 0x7f17741a1270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f176c00eaa0 tx=0x7f176c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.721+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c00cdb0 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.721+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c005020 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.721+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0116d0 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.721+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17741a1d60 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.721+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17741a21e0 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.722+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1774109820 con 0x7f1774104070 2024-09-21T01:07:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.724+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f176c0051d0 con 0x7f1774104070 2024-09-21T01:07:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.725+0000 7f176a7fc640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17600b6580 0x7f17600b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.725+0000 7f1779607640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17600b6580 0x7f17600b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.725+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f176c0e5ba0 con 0x7f1774104070 2024-09-21T01:07:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.726+0000 7f1779607640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17600b6580 0x7f17600b8a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1770005d00 tx=0x7f177000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.728+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f176c016030 con 0x7f1774104070 2024-09-21T01:07:37.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:37 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/361094256' entity='client.admin' 2024-09-21T01:07:37.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:37 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/361094256' entity='client.admin' 2024-09-21T01:07:37.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.928+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f177402e640 con 0x7f1774104070 2024-09-21T01:07:37.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.932+0000 7f176a7fc640 1 -- 172.21.15.37:0/1252563760 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7f176c0ae0e0 con 0x7f1774104070 2024-09-21T01:07:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17600b6580 msgr2=0x7f17600b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17600b6580 0x7f17600b8a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1770005d00 tx=0x7f177000b410 comp rx=0 tx=0).stop 2024-09-21T01:07:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 msgr2=0x7f17741a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 0x7f17741a1270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f176c00eaa0 tx=0x7f176c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 shutdown_connections 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17600b6580 0x7f17600b8a90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1774104070 0x7f17741a1270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17741036d0 0x7f177419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 --2- 172.21.15.37:0/1252563760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774102640 0x7f177406b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 >> 172.21.15.37:0/1252563760 conn(0x7f17740fdfb0 msgr2=0x7f17741069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 shutdown_connections 2024-09-21T01:07:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.935+0000 7f177b86b640 1 -- 172.21.15.37:0/1252563760 wait complete. 2024-09-21T01:07:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 -- 172.21.15.37:0/4062286618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec102640 msgr2=0x7f24ec102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 --2- 172.21.15.37:0/4062286618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec102640 0x7f24ec102ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009900 tx=0x7f24e802a480 comp rx=0 tx=0).stop 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 -- 172.21.15.37:0/4062286618 shutdown_connections 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 --2- 172.21.15.37:0/4062286618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 0x7f24ec10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 --2- 172.21.15.37:0/4062286618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec1036d0 0x7f24ec103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 --2- 172.21.15.37:0/4062286618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec102640 0x7f24ec102ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 -- 172.21.15.37:0/4062286618 >> 172.21.15.37:0/4062286618 conn(0x7f24ec0fdfb0 msgr2=0x7f24ec100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 -- 172.21.15.37:0/4062286618 shutdown_connections 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.940+0000 7f24f4089640 1 -- 172.21.15.37:0/4062286618 wait complete. 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.941+0000 7f24f4089640 1 Processor -- start 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.941+0000 7f24f4089640 1 -- start start 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.941+0000 7f24f4089640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec102640 0x7f24ec199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.941+0000 7f24f4089640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 0x7f24ec19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.941+0000 7f24f4089640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 0x7f24ec19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f4089640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec10e280 con 0x7f24ec1036d0 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f4089640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec10e100 con 0x7f24ec102640 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f4089640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec10e400 con 0x7f24ec104070 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 0x7f24ec19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 0x7f24ec19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47404/0 (socket says 172.21.15.37:47404) 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 -- 172.21.15.37:0/3239225753 learned_addr learned my addr 172.21.15.37:0/3239225753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f2626640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 0x7f24ec19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1e25640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec102640 0x7f24ec199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 -- 172.21.15.37:0/3239225753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 msgr2=0x7f24ec19b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 0x7f24ec19b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 -- 172.21.15.37:0/3239225753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec102640 msgr2=0x7f24ec199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec102640 0x7f24ec199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 -- 172.21.15.37:0/3239225753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec19ba00 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1e25640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec102640 0x7f24ec199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f2626640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 0x7f24ec19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f1624640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 0x7f24ec19a640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00e9f0 tx=0x7f24dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00cd80 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec19bcf0 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24dc0108e0 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc018980 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.942+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec1a23f0 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.944+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ec1a2680 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.946+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f24dc010430 con 0x7f24ec1036d0 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.947+0000 7f24e2ffd640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24d80b6480 0x7f24d80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.947+0000 7f24f1e25640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24d80b6480 0x7f24d80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.947+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f24dc0e6010 con 0x7f24ec1036d0 2024-09-21T01:07:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.948+0000 7f24f1e25640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24d80b6480 0x7f24d80b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24e8005f70 tx=0x7f24e8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.949+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24dc0ae4d0 con 0x7f24ec1036d0 2024-09-21T01:07:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.139+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f24ec1a2850 con 0x7f24ec1036d0 2024-09-21T01:07:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.143+0000 7f24e2ffd640 1 -- 172.21.15.37:0/3239225753 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v31)=0 v31) ==== 119+0+0 (secure 0 0 0) 0x7f24dc0b28b0 con 0x7f24ec1036d0 2024-09-21T01:07:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24d80b6480 msgr2=0x7f24d80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24d80b6480 0x7f24d80b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24e8005f70 tx=0x7f24e8000bc0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 msgr2=0x7f24ec19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 0x7f24ec19a640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00e9f0 tx=0x7f24dc00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 shutdown_connections 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24d80b6480 0x7f24d80b8990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24ec104070 0x7f24ec19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24ec1036d0 0x7f24ec19a640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 --2- 172.21.15.37:0/3239225753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f24ec102640 0x7f24ec199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 >> 172.21.15.37:0/3239225753 conn(0x7f24ec0fdfb0 msgr2=0x7f24ec06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 shutdown_connections 2024-09-21T01:07:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:38.146+0000 7f24f4089640 1 -- 172.21.15.37:0/3239225753 wait complete. 2024-09-21T01:07:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.223+0000 7f47e88d9640 1 -- 172.21.15.37:0/4018172144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e41047e0 msgr2=0x7f47e4104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.223+0000 7f47e88d9640 1 --2- 172.21.15.37:0/4018172144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e41047e0 0x7f47e4104bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009900 tx=0x7f47d802a480 comp rx=0 tx=0).stop 2024-09-21T01:07:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 -- 172.21.15.37:0/4018172144 shutdown_connections 2024-09-21T01:07:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 --2- 172.21.15.37:0/4018172144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47e4105180 0x7f47e410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 --2- 172.21.15.37:0/4018172144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e41047e0 0x7f47e4104bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 --2- 172.21.15.37:0/4018172144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47e4103750 0x7f47e4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 -- 172.21.15.37:0/4018172144 >> 172.21.15.37:0/4018172144 conn(0x7f47e40ff0c0 msgr2=0x7f47e4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 -- 172.21.15.37:0/4018172144 shutdown_connections 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 -- 172.21.15.37:0/4018172144 wait complete. 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.224+0000 7f47e88d9640 1 Processor -- start 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 -- start start 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 0x7f47e4199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47e41047e0 0x7f47e419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47e4105180 0x7f47e419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47e410f3f0 con 0x7f47e4103750 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f47e410f270 con 0x7f47e41047e0 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e88d9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47e410f570 con 0x7f47e4105180 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 0x7f47e4199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 0x7f47e4199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47338/0 (socket says 172.21.15.37:47338) 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 -- 172.21.15.37:0/361094256 learned_addr learned my addr 172.21.15.37:0/361094256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e1d9b640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47e41047e0 0x7f47e419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e2d9d640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47e4105180 0x7f47e419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 -- 172.21.15.37:0/361094256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47e4105180 msgr2=0x7f47e419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47e4105180 0x7f47e419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 -- 172.21.15.37:0/361094256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47e41047e0 msgr2=0x7f47e419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47e41047e0 0x7f47e419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.225+0000 7f47e259c640 1 -- 172.21.15.37:0/361094256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e419ba10 con 0x7f47e4103750 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.226+0000 7f47e259c640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 0x7f47e4199fe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47d400e9f0 tx=0x7f47d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.226+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d400cd80 con 0x7f47e4103750 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.226+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47d40108e0 con 0x7f47e4103750 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.226+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e419bd00 con 0x7f47e4103750 2024-09-21T01:07:38.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.226+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4018980 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.226+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e41a2400 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.227+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e410a910 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.229+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f47d4010430 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.229+0000 7f47d37fe640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47cc0b6500 0x7f47cc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.230+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f47d40e5e00 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.230+0000 7f47e1d9b640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47cc0b6500 0x7f47cc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.230+0000 7f47e1d9b640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47cc0b6500 0x7f47cc0b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47d8004770 tx=0x7f47d80314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.233+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47d40ae360 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.424+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f47e402e640 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.428+0000 7f47d37fe640 1 -- 172.21.15.37:0/361094256 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f47d40b2740 con 0x7f47e4103750 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47cc0b6500 msgr2=0x7f47cc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47cc0b6500 0x7f47cc0b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47d8004770 tx=0x7f47d80314a0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 msgr2=0x7f47e4199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 0x7f47e4199fe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47d400e9f0 tx=0x7f47d400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 shutdown_connections 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47cc0b6500 0x7f47cc0b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47e4105180 0x7f47e419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47e41047e0 0x7f47e419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 --2- 172.21.15.37:0/361094256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47e4103750 0x7f47e4199fe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 >> 172.21.15.37:0/361094256 conn(0x7f47e40ff0c0 msgr2=0x7f47e4107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 shutdown_connections 2024-09-21T01:07:38.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:36.431+0000 7f47e88d9640 1 -- 172.21.15.37:0/361094256 wait complete. 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2206125645' entity='client.admin' 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1252563760' entity='client.admin' 2024-09-21T01:07:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:38 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3239225753' entity='client.admin' 2024-09-21T01:07:38.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2206125645' entity='client.admin' 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1252563760' entity='client.admin' 2024-09-21T01:07:38.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:38 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3239225753' entity='client.admin' 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2206125645' entity='client.admin' 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:38.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1252563760' entity='client.admin' 2024-09-21T01:07:38.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:38 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3239225753' entity='client.admin' 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 -- 172.21.15.37:0/3957445013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 msgr2=0x7fca3810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 --2- 172.21.15.37:0/3957445013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3810bb20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca30009ca0 tx=0x7fca3002a950 comp rx=0 tx=0).stop 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 -- 172.21.15.37:0/3957445013 shutdown_connections 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 --2- 172.21.15.37:0/3957445013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3810bb20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 --2- 172.21.15.37:0/3957445013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381047e0 0x7fca38104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 --2- 172.21.15.37:0/3957445013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 0x7fca38103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 -- 172.21.15.37:0/3957445013 >> 172.21.15.37:0/3957445013 conn(0x7fca380ff0c0 msgr2=0x7fca38101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 -- 172.21.15.37:0/3957445013 shutdown_connections 2024-09-21T01:07:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.619+0000 7fca407a2640 1 -- 172.21.15.37:0/3957445013 wait complete. 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.620+0000 7fca407a2640 1 Processor -- start 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.620+0000 7fca407a2640 1 -- start start 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.620+0000 7fca407a2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 0x7fca38199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.620+0000 7fca407a2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381047e0 0x7fca3819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca407a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca407a2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca3810f450 con 0x7fca38105180 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca407a2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca3810f2d0 con 0x7fca38103750 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca407a2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fca3810f5d0 con 0x7fca381047e0 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47358/0 (socket says 172.21.15.37:47358) 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 -- 172.21.15.37:0/2206125645 learned_addr learned my addr 172.21.15.37:0/2206125645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3dd3d640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381047e0 0x7fca3819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3e53e640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 0x7fca38199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 -- 172.21.15.37:0/2206125645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381047e0 msgr2=0x7fca3819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381047e0 0x7fca3819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 -- 172.21.15.37:0/2206125645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 msgr2=0x7fca38199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 0x7fca38199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 -- 172.21.15.37:0/2206125645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3819b960 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3e53e640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 0x7fca38199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca3ed3f640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3819b1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca3002f810 tx=0x7fca3002f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30034040 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca3002fe20 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3819bbf0 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30039430 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.621+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381a2210 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.623+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3810a930 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.624+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fca30037020 con 0x7fca38105180 2024-09-21T01:07:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.625+0000 7fca2f7fe640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fca240b6480 0x7fca240b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.626+0000 7fca3e53e640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fca240b6480 0x7fca240b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.626+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fca30106880 con 0x7fca38105180 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.626+0000 7fca3e53e640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fca240b6480 0x7fca240b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca3400baa0 tx=0x7fca34005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.628+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca300cedc0 con 0x7fca38105180 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.819+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fca3802e640 con 0x7fca38105180 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.823+0000 7fca2f7fe640 1 -- 172.21.15.37:0/2206125645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v29)=0 v29) ==== 111+0+0 (secure 0 0 0) 0x7fca300d31a0 con 0x7fca38105180 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fca240b6480 msgr2=0x7fca240b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fca240b6480 0x7fca240b8990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca3400baa0 tx=0x7fca34005d90 comp rx=0 tx=0).stop 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 msgr2=0x7fca3819b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3819b1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca3002f810 tx=0x7fca3002f660 comp rx=0 tx=0).stop 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 shutdown_connections 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fca240b6480 0x7fca240b8990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca38105180 0x7fca3819b1d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381047e0 0x7fca3819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 --2- 172.21.15.37:0/2206125645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca38103750 0x7fca38199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 >> 172.21.15.37:0/2206125645 conn(0x7fca380ff0c0 msgr2=0x7fca38107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 shutdown_connections 2024-09-21T01:07:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:37.826+0000 7fca407a2640 1 -- 172.21.15.37:0/2206125645 wait complete. 2024-09-21T01:07:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 -- 172.21.15.37:0/2335926177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 msgr2=0x7f772c108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 --2- 172.21.15.37:0/2335926177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c108d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7720009900 tx=0x7f772002a410 comp rx=0 tx=0).stop 2024-09-21T01:07:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 -- 172.21.15.37:0/2335926177 shutdown_connections 2024-09-21T01:07:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 --2- 172.21.15.37:0/2335926177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c109470 0x7f772c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 --2- 172.21.15.37:0/2335926177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c108d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 --2- 172.21.15.37:0/2335926177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f772c06b980 0x7f772c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.294+0000 7f7732d3f640 1 -- 172.21.15.37:0/2335926177 >> 172.21.15.37:0/2335926177 conn(0x7f772c0fdfb0 msgr2=0x7f772c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:40.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.295+0000 7f7732d3f640 1 -- 172.21.15.37:0/2335926177 shutdown_connections 2024-09-21T01:07:40.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.295+0000 7f7732d3f640 1 -- 172.21.15.37:0/2335926177 wait complete. 2024-09-21T01:07:40.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.295+0000 7f7732d3f640 1 Processor -- start 2024-09-21T01:07:40.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 -- start start 2024-09-21T01:07:40.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c06b980 0x7f772c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f772c109470 0x7f772c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772c10f3b0 con 0x7f772c1068d0 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f772c10f230 con 0x7f772c06b980 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7732d3f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f772c10f530 con 0x7f772c109470 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f7730adb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c06b980 0x7f772c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47418/0 (socket says 172.21.15.37:47418) 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 -- 172.21.15.37:0/1118319531 learned_addr learned my addr 172.21.15.37:0/1118319531 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f77312dc640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f772c109470 0x7f772c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 -- 172.21.15.37:0/1118319531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f772c109470 msgr2=0x7f772c19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f772c109470 0x7f772c19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 -- 172.21.15.37:0/1118319531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c06b980 msgr2=0x7f772c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.296+0000 7f772bfff640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c06b980 0x7f772c199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f772bfff640 1 -- 172.21.15.37:0/1118319531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c19b980 con 0x7f772c1068d0 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f7730adb640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c06b980 0x7f772c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:07:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f772bfff640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c19a650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7720031440 tx=0x7f7720003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772003f070 con 0x7f772c1068d0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7720031c50 con 0x7f772c1068d0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c19bc10 con 0x7f772c1068d0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720035030 con 0x7f772c1068d0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.297+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c1a2230 con 0x7f772c1068d0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.299+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772c0ffad0 con 0x7f772c1068d0 2024-09-21T01:07:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.300+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f7720042070 con 0x7f772c1068d0 2024-09-21T01:07:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.301+0000 7f7729ffb640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77140b6480 0x7f77140b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.302+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7720106600 con 0x7f772c1068d0 2024-09-21T01:07:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.302+0000 7f7730adb640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77140b6480 0x7f77140b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:40.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.303+0000 7f7730adb640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77140b6480 0x7f77140b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f771c00afb0 tx=0x7f771c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:40.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.307+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77200ceb60 con 0x7f772c1068d0 2024-09-21T01:07:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.496+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f772c02e640 con 0x7f772c1068d0 2024-09-21T01:07:40.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.500+0000 7f7729ffb640 1 -- 172.21.15.37:0/1118319531 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f77200d2f40 con 0x7f772c1068d0 2024-09-21T01:07:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77140b6480 msgr2=0x7f77140b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77140b6480 0x7f77140b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f771c00afb0 tx=0x7f771c00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 msgr2=0x7f772c19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c19a650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7720031440 tx=0x7f7720003c10 comp rx=0 tx=0).stop 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 shutdown_connections 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77140b6480 0x7f77140b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f772c109470 0x7f772c19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c1068d0 0x7f772c19a650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 --2- 172.21.15.37:0/1118319531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f772c06b980 0x7f772c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 >> 172.21.15.37:0/1118319531 conn(0x7f772c0fdfb0 msgr2=0x7f772c104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 shutdown_connections 2024-09-21T01:07:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:40.503+0000 7f7732d3f640 1 -- 172.21.15.37:0/1118319531 wait complete. 2024-09-21T01:07:40.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:40 smithi037 ceph-mon[31105]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:40.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:40 smithi137 ceph-mon[34607]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:40.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:40 smithi144 ceph-mon[34818]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 -- 172.21.15.37:0/2057972362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098102480 msgr2=0x7f90981028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 --2- 172.21.15.37:0/2057972362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098102480 0x7f90981028f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9088009900 tx=0x7f908802a480 comp rx=0 tx=0).stop 2024-09-21T01:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 -- 172.21.15.37:0/2057972362 shutdown_connections 2024-09-21T01:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 --2- 172.21.15.37:0/2057972362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098103eb0 0x7f909810a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 --2- 172.21.15.37:0/2057972362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9098103510 0x7f9098103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 --2- 172.21.15.37:0/2057972362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098102480 0x7f90981028f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.086+0000 7f909eb9d640 1 -- 172.21.15.37:0/2057972362 >> 172.21.15.37:0/2057972362 conn(0x7f90980fddf0 msgr2=0x7f90981002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.087+0000 7f909eb9d640 1 -- 172.21.15.37:0/2057972362 shutdown_connections 2024-09-21T01:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.087+0000 7f909eb9d640 1 -- 172.21.15.37:0/2057972362 wait complete. 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.087+0000 7f909eb9d640 1 Processor -- start 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.087+0000 7f909eb9d640 1 -- start start 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.087+0000 7f909eb9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098102480 0x7f9098199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909eb9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 0x7f909819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909eb9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9098103eb0 0x7f909819b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909eb9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f909810e0e0 con 0x7f9098103510 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909eb9d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f909810df60 con 0x7f9098103eb0 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909eb9d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f909810e260 con 0x7f9098102480 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 0x7f909819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 0x7f909819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 -- 172.21.15.37:0/314118689 learned_addr learned my addr 172.21.15.37:0/314118689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909e39c640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9098103eb0 0x7f909819b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909db9b640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098102480 0x7f9098199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 -- 172.21.15.37:0/314118689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098102480 msgr2=0x7f9098199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098102480 0x7f9098199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 -- 172.21.15.37:0/314118689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9098103eb0 msgr2=0x7f909819b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9098103eb0 0x7f909819b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 -- 172.21.15.37:0/314118689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909819b7f0 con 0x7f9098103510 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909db9b640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098102480 0x7f9098199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909d39a640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 0x7f909819a4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f909400d950 tx=0x7f909400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094017070 con 0x7f9098103510 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9094009c30 con 0x7f9098103510 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909400f620 con 0x7f9098103510 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.088+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909819bae0 con 0x7f9098103510 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.089+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90981a20a0 con 0x7f9098103510 2024-09-21T01:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.089+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90981a22d0 con 0x7f9098103510 2024-09-21T01:07:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.091+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f9094005030 con 0x7f9098103510 2024-09-21T01:07:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.092+0000 7f908effd640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90840b6500 0x7f90840b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.092+0000 7f909db9b640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90840b6500 0x7f90840b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.092+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f90940e5220 con 0x7f9098103510 2024-09-21T01:07:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.092+0000 7f909db9b640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90840b6500 0x7f90840b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9088031440 tx=0x7f9088005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.095+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90940ad760 con 0x7f9098103510 2024-09-21T01:07:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.287+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f90981a2540 con 0x7f9098103510 2024-09-21T01:07:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.292+0000 7f908effd640 1 -- 172.21.15.37:0/314118689 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v33)=0 v33) ==== 125+0+0 (secure 0 0 0) 0x7f9094009de0 con 0x7f9098103510 2024-09-21T01:07:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.294+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90840b6500 msgr2=0x7f90840b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.294+0000 7f909eb9d640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90840b6500 0x7f90840b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9088031440 tx=0x7f9088005d50 comp rx=0 tx=0).stop 2024-09-21T01:07:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.294+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 msgr2=0x7f909819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.294+0000 7f909eb9d640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 0x7f909819a4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f909400d950 tx=0x7f909400de10 comp rx=0 tx=0).stop 2024-09-21T01:07:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 shutdown_connections 2024-09-21T01:07:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90840b6500 0x7f90840b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9098103eb0 0x7f909819b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9098103510 0x7f909819a4c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 --2- 172.21.15.37:0/314118689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9098102480 0x7f9098199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 >> 172.21.15.37:0/314118689 conn(0x7f90980fddf0 msgr2=0x7f909806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 shutdown_connections 2024-09-21T01:07:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:41.295+0000 7f909eb9d640 1 -- 172.21.15.37:0/314118689 wait complete. 2024-09-21T01:07:41.576 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.576 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.576 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.576 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.576 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.577 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi037') 2024-09-21T01:07:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:41 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1118319531' entity='client.admin' 2024-09-21T01:07:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:41 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/314118689' entity='client.admin' 2024-09-21T01:07:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:41 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1118319531' entity='client.admin' 2024-09-21T01:07:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:41 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/314118689' entity='client.admin' 2024-09-21T01:07:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:41.933 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:41 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1118319531' entity='client.admin' 2024-09-21T01:07:41.933 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:41 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/314118689' entity='client.admin' 2024-09-21T01:07:41.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:07:42.238 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi037') 2024-09-21T01:07:42.778 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:42 smithi037 ceph-mon[31105]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:42.778 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:42.778 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:42.778 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:42.813 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '6bc9e062-77b5-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-09-21T01:07:42.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T01:07:42.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:42 smithi137 ceph-mon[34607]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:42.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:42.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:42.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:42.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:42 smithi144 ceph-mon[34818]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:42.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:42.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:07:42.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:07:43.075 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:43.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 -- 172.21.15.37:0/3848062774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300770e0 msgr2=0x7fd7300757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 --2- 172.21.15.37:0/3848062774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300770e0 0x7fd7300757b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd720009900 tx=0x7fd72002a410 comp rx=0 tx=0).stop 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 -- 172.21.15.37:0/3848062774 shutdown_connections 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 --2- 172.21.15.37:0/3848062774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd73010b6f0 0x7fd73010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 --2- 172.21.15.37:0/3848062774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd730075cf0 0x7fd730076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 --2- 172.21.15.37:0/3848062774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300770e0 0x7fd7300757b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 -- 172.21.15.37:0/3848062774 >> 172.21.15.37:0/3848062774 conn(0x7fd7300ff0c0 msgr2=0x7fd730101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 -- 172.21.15.37:0/3848062774 shutdown_connections 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 -- 172.21.15.37:0/3848062774 wait complete. 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.557+0000 7fd736460640 1 Processor -- start 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 -- start start 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd730075cf0 0x7fd73019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7300770e0 0x7fd73019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 0x7fd73019d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd730111560 con 0x7fd73010b6f0 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7301113e0 con 0x7fd7300770e0 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd736460640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd7301116e0 con 0x7fd730075cf0 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 0x7fd73019d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 0x7fd73019d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47472/0 (socket says 172.21.15.37:47472) 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd72ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd730075cf0 0x7fd73019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 -- 172.21.15.37:0/231325794 learned_addr learned my addr 172.21.15.37:0/231325794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd72f7fe640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7300770e0 0x7fd73019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 -- 172.21.15.37:0/231325794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd730075cf0 msgr2=0x7fd73019c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd730075cf0 0x7fd73019c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 -- 172.21.15.37:0/231325794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7300770e0 msgr2=0x7fd73019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7300770e0 0x7fd73019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.558+0000 7fd7349fd640 1 -- 172.21.15.37:0/231325794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73019db80 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.559+0000 7fd7349fd640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 0x7fd73019d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd72800cce0 tx=0x7fd72800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.559+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72800f450 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.559+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd72800faa0 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.559+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73019de70 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.559+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728018b70 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.559+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7301a4600 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.560+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73010a500 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.562+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd728018d10 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.562+0000 7fd72d7fa640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7180b6500 0x7fd7180b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.563+0000 7fd72ffff640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7180b6500 0x7fd7180b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.563+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd7280e5a90 con 0x7fd73010b6f0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.563+0000 7fd72ffff640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7180b6500 0x7fd7180b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd720000c00 tx=0x7fd720031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.565+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd728014030 con 0x7fd73010b6f0 2024-09-21T01:07:43.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.755+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd73002e640 con 0x7fd73010b6f0 2024-09-21T01:07:43.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.756+0000 7fd72d7fa640 1 -- 172.21.15.37:0/231325794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21112 (secure 0 0 0) 0x7fd7280ae100 con 0x7fd73010b6f0 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global dev auth_debug true 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global basic log_to_file true 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global basic log_to_journald false 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global basic log_to_stderr false 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_allow_pool_delete true 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T01:07:43.758 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global dev ms_die_on_bug true 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global dev ms_die_on_old_message true 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global dev ms_die_on_skipped_message false 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T01:07:43.759 INFO:teuthology.orchestra.run.smithi037.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced debug_mon 20/20 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced debug_ms 1/1 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced debug_paxos 20/20 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T01:07:43.760 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T01:07:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T01:07:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T01:07:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T01:07:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T01:07:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T01:07:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T01:07:43.763 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced client_mount_timeout 30 2024-09-21T01:07:43.763 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced debug_client 20/20 2024-09-21T01:07:43.763 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced debug_mgr 20/20 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced debug_ms 1/1 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev bdev_debug_aio true 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T01:07:43.764 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_bluefs 20/20 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_bluestore 20/20 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_ms 1/1 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_osd 20/20 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_op_order true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_shutdown true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T01:07:43.765 INFO:teuthology.orchestra.run.smithi037.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T01:07:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T01:07:43.768 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T01:07:43.768 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced debug_mds 20/20 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced debug_ms 2/2 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_bal_split_size 100 2024-09-21T01:07:43.769 INFO:teuthology.orchestra.run.smithi037.stdout:mds dev mds_debug_frag true 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:mds dev mds_debug_scatterstat true 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:mds dev mds_verify_scatter true 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced client_mount_timeout 600 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced debug_client 20/20 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced debug_ms 1/1 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T01:07:43.770 INFO:teuthology.orchestra.run.smithi037.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T01:07:43.771 INFO:teuthology.orchestra.run.smithi037.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T01:07:43.771 INFO:teuthology.orchestra.run.smithi037.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T01:07:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.759+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7180b6500 msgr2=0x7fd7180b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.759+0000 7fd736460640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7180b6500 0x7fd7180b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd720000c00 tx=0x7fd720031400 comp rx=0 tx=0).stop 2024-09-21T01:07:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.759+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 msgr2=0x7fd73019d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.759+0000 7fd736460640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 0x7fd73019d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd72800cce0 tx=0x7fd72800a620 comp rx=0 tx=0).stop 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 shutdown_connections 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7180b6500 0x7fd7180b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd73010b6f0 0x7fd73019d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7300770e0 0x7fd73019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 --2- 172.21.15.37:0/231325794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd730075cf0 0x7fd73019c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 >> 172.21.15.37:0/231325794 conn(0x7fd7300ff0c0 msgr2=0x7fd7301076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 shutdown_connections 2024-09-21T01:07:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:43.760+0000 7fd736460640 1 -- 172.21.15.37:0/231325794 wait complete. 2024-09-21T01:07:44.401 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T01:07:44.401 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:07:44.402 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:07:44.420 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:07:44.420 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-21T01:07:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:07:44.478 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 01:06:31.560866112 +0000 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 01:02:02.503123542 +0000 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 01:02:02.503123542 +0000 2024-09-21T01:07:44.479 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 01:02:02.503123542 +0000 2024-09-21T01:07:44.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:07:44.546 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T01:07:44.546 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T01:07:44.546 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000293989 s, 1.7 MB/s 2024-09-21T01:07:44.547 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:07:44.607 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-21T01:07:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:07:44.663 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 01:06:31.593865689 +0000 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 01:02:02.926118060 +0000 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 01:02:02.926118060 +0000 2024-09-21T01:07:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 01:02:02.926118060 +0000 2024-09-21T01:07:44.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:07:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:44 smithi037 ceph-mon[31105]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:44 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/231325794' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:07:44.728 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T01:07:44.729 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T01:07:44.729 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000196935 s, 2.6 MB/s 2024-09-21T01:07:44.730 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:07:44.788 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-21T01:07:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:07:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:44.844 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T01:07:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 01:06:31.623865305 +0000 2024-09-21T01:07:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 01:02:03.263113692 +0000 2024-09-21T01:07:44.845 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 01:02:03.263113692 +0000 2024-09-21T01:07:44.845 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 01:02:03.263113692 +0000 2024-09-21T01:07:44.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:07:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T01:07:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T01:07:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.00021715 s, 2.4 MB/s 2024-09-21T01:07:44.910 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:07:44.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:44 smithi137 ceph-mon[34607]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:44.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:44 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/231325794' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:07:44.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:44 smithi144 ceph-mon[34818]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:44.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:44 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/231325794' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:07:44.967 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-21T01:07:45.023 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:07:45.023 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:45.023 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T01:07:45.023 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:45.024 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:45.024 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 01:06:31.654864907 +0000 2024-09-21T01:07:45.024 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 01:02:03.620109066 +0000 2024-09-21T01:07:45.024 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 01:02:03.620109066 +0000 2024-09-21T01:07:45.024 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 01:02:03.620109066 +0000 2024-09-21T01:07:45.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:07:45.088 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-21T01:07:45.088 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-21T01:07:45.088 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000175243 s, 2.9 MB/s 2024-09-21T01:07:45.089 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:07:45.146 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-21T01:07:45.146 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:07:45.167 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:07:45.167 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-21T01:07:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:07:45.225 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:45.225 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-21T01:07:45.225 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:45.226 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:45.226 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-21 01:07:20.099657211 +0000 2024-09-21T01:07:45.226 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-21 01:02:07.438015672 +0000 2024-09-21T01:07:45.226 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-21 01:02:07.438015672 +0000 2024-09-21T01:07:45.226 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-21 01:02:07.438015672 +0000 2024-09-21T01:07:45.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:07:45.295 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-21T01:07:45.296 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-21T01:07:45.296 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000229163 s, 2.2 MB/s 2024-09-21T01:07:45.297 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:07:45.355 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-21T01:07:45.412 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-21 01:07:20.099657211 +0000 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-21 01:02:07.772009850 +0000 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-21 01:02:07.772009850 +0000 2024-09-21T01:07:45.413 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-21 01:02:07.772009850 +0000 2024-09-21T01:07:45.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:07:45.478 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-21T01:07:45.478 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-21T01:07:45.478 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000202166 s, 2.5 MB/s 2024-09-21T01:07:45.479 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:07:45.537 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-21T01:07:45.592 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-21 01:07:20.099657211 +0000 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-21 01:02:08.122003748 +0000 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-21 01:02:08.122003748 +0000 2024-09-21T01:07:45.593 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-21 01:02:08.122003748 +0000 2024-09-21T01:07:45.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:07:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-21T01:07:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-21T01:07:45.657 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000229147 s, 2.2 MB/s 2024-09-21T01:07:45.658 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:07:45.715 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-21 01:07:20.100657194 +0000 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-21 01:02:08.452997977 +0000 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-21 01:02:08.452997977 +0000 2024-09-21T01:07:45.771 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-21 01:02:08.452997977 +0000 2024-09-21T01:07:45.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:07:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-21T01:07:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-21T01:07:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000175532 s, 2.9 MB/s 2024-09-21T01:07:45.835 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:07:45.892 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T01:07:45.892 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:07:45.912 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:07:45.912 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-21T01:07:45.971 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:07:45.971 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:45.971 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T01:07:45.972 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:45.972 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:45.972 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 01:07:17.931673844 +0000 2024-09-21T01:07:45.972 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 01:02:12.677629310 +0000 2024-09-21T01:07:45.972 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 01:02:12.677629310 +0000 2024-09-21T01:07:45.972 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 01:02:12.677629310 +0000 2024-09-21T01:07:45.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:07:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T01:07:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T01:07:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000227204 s, 2.3 MB/s 2024-09-21T01:07:46.042 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:07:46.100 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-21T01:07:46.156 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 01:07:17.932673827 +0000 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 01:02:12.997623630 +0000 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 01:02:12.997623630 +0000 2024-09-21T01:07:46.157 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 01:02:12.997623630 +0000 2024-09-21T01:07:46.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:07:46.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T01:07:46.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T01:07:46.222 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000210553 s, 2.4 MB/s 2024-09-21T01:07:46.223 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:07:46.281 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 01:07:17.932673827 +0000 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 01:02:13.328617755 +0000 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 01:02:13.328617755 +0000 2024-09-21T01:07:46.337 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 01:02:13.328617755 +0000 2024-09-21T01:07:46.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:07:46.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T01:07:46.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T01:07:46.401 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00021497 s, 2.4 MB/s 2024-09-21T01:07:46.402 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:07:46.459 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 01:07:17.932673827 +0000 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 01:02:13.650612040 +0000 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 01:02:13.650612040 +0000 2024-09-21T01:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 01:02:13.650612040 +0000 2024-09-21T01:07:46.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:07:46.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T01:07:46.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T01:07:46.580 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000217626 s, 2.4 MB/s 2024-09-21T01:07:46.581 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:07:46.638 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-09-21T01:07:46.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:07:46.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:46 smithi144 ceph-mon[34818]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:46.904 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:46.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:46 smithi137 ceph-mon[34607]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:46.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:46 smithi037 ceph-mon[31105]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:48.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:48 smithi037 ceph-mon[31105]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:48.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:48 smithi137 ceph-mon[34607]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:48.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:48 smithi144 ceph-mon[34818]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:49.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:07:49.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-09-21T01:07:49.699 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 -- 172.21.15.37:0/1046401867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a406b980 msgr2=0x7fe3a4106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/1046401867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a406b980 0x7fe3a4106390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe394009900 tx=0x7fe39402a410 comp rx=0 tx=0).stop 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 -- 172.21.15.37:0/1046401867 shutdown_connections 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/1046401867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a4109470 0x7fe3a410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/1046401867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a41068d0 0x7fe3a4108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/1046401867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a406b980 0x7fe3a4106390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 -- 172.21.15.37:0/1046401867 >> 172.21.15.37:0/1046401867 conn(0x7fe3a40fdfb0 msgr2=0x7fe3a4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 -- 172.21.15.37:0/1046401867 shutdown_connections 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.178+0000 7fe3a8c74640 1 -- 172.21.15.37:0/1046401867 wait complete. 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.179+0000 7fe3a8c74640 1 Processor -- start 2024-09-21T01:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.179+0000 7fe3a8c74640 1 -- start start 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.179+0000 7fe3a8c74640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a406b980 0x7fe3a4199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a8c74640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a41068d0 0x7fe3a419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a8c74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 0x7fe3a419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a8c74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a410f3b0 con 0x7fe3a4109470 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a8c74640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a410f230 con 0x7fe3a41068d0 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a8c74640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a410f530 con 0x7fe3a406b980 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 0x7fe3a419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 0x7fe3a419b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44688/0 (socket says 172.21.15.37:44688) 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 -- 172.21.15.37:0/700911562 learned_addr learned my addr 172.21.15.37:0/700911562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a259c640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a406b980 0x7fe3a4199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe39bfff640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a41068d0 0x7fe3a419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 -- 172.21.15.37:0/700911562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a406b980 msgr2=0x7fe3a4199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a406b980 0x7fe3a4199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 -- 172.21.15.37:0/700911562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a41068d0 msgr2=0x7fe3a419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a41068d0 0x7fe3a419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 -- 172.21.15.37:0/700911562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a419b920 con 0x7fe3a4109470 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe39bfff640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a41068d0 0x7fe3a419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe3a2d9d640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 0x7fe3a419b190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00eaa0 tx=0x7fe39c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.180+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00cdb0 con 0x7fe3a4109470 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.181+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe39c005020 con 0x7fe3a4109470 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.181+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a419bc10 con 0x7fe3a4109470 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.181+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0116d0 con 0x7fe3a4109470 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.181+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a41a21d0 con 0x7fe3a4109470 2024-09-21T01:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.182+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a40ffad0 con 0x7fe3a4109470 2024-09-21T01:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.184+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fe39c0051d0 con 0x7fe3a4109470 2024-09-21T01:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.185+0000 7fe39b7fe640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3900b6480 0x7fe3900b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.185+0000 7fe3a259c640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3900b6480 0x7fe3900b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.185+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe39c0e5bc0 con 0x7fe3a4109470 2024-09-21T01:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.185+0000 7fe3a259c640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3900b6480 0x7fe3900b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe394004770 tx=0x7fe3940314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:07:50.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.188+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe39c016030 con 0x7fe3a4109470 2024-09-21T01:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:07:50.403+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe3a4063800 con 0x7fe3900b6480 2024-09-21T01:07:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:50 smithi037 ceph-mon[31105]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:50 smithi137 ceph-mon[34607]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:50.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:50 smithi144 ceph-mon[34818]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:07:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:07:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:07:51.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:51 smithi037 ceph-mon[31105]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:51.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:51 smithi137 ceph-mon[34607]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:51 smithi144 ceph-mon[34818]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:07:52.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:52 smithi037 ceph-mon[31105]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:52.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:52 smithi137 ceph-mon[34607]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:52.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:52 smithi144 ceph-mon[34818]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:53.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2410351485' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "af3439a3-c611-4fe4-9cc0-1070e5c3f4e8"} : dispatch 2024-09-21T01:07:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2410351485' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af3439a3-c611-4fe4-9cc0-1070e5c3f4e8"}]': finished 2024-09-21T01:07:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:53 smithi037 ceph-mon[31105]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T01:07:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:07:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1431218341' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:53 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2410351485' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "af3439a3-c611-4fe4-9cc0-1070e5c3f4e8"} : dispatch 2024-09-21T01:07:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:53 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2410351485' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af3439a3-c611-4fe4-9cc0-1070e5c3f4e8"}]': finished 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:53 smithi137 ceph-mon[34607]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:53 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1431218341' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:53 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2410351485' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "af3439a3-c611-4fe4-9cc0-1070e5c3f4e8"} : dispatch 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:53 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2410351485' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af3439a3-c611-4fe4-9cc0-1070e5c3f4e8"}]': finished 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:53 smithi144 ceph-mon[34818]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:07:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:53 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1431218341' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:07:54.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:54 smithi137 ceph-mon[34607]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:54 smithi144 ceph-mon[34818]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:54.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:54 smithi037 ceph-mon[31105]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:56 smithi137 ceph-mon[34607]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:56.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:56 smithi144 ceph-mon[34818]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:56.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:56 smithi037 ceph-mon[31105]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:58.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:07:58 smithi037 ceph-mon[31105]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:07:58 smithi137 ceph-mon[34607]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:07:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:07:58 smithi144 ceph-mon[34818]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:00 smithi037 ceph-mon[31105]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:00 smithi137 ceph-mon[34607]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:00 smithi144 ceph-mon[34818]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:01.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:01 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:08:01.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:01 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:01.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:01 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:08:01.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:01 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:01 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:08:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:01 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:02.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:02 smithi037 ceph-mon[31105]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:02.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:02 smithi037 ceph-mon[31105]: Deploying daemon osd.0 on smithi037 2024-09-21T01:08:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:02 smithi137 ceph-mon[34607]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:02 smithi137 ceph-mon[34607]: Deploying daemon osd.0 on smithi037 2024-09-21T01:08:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:02 smithi144 ceph-mon[34818]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:02 smithi144 ceph-mon[34818]: Deploying daemon osd.0 on smithi037 2024-09-21T01:08:03.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:03 smithi037 ceph-mon[31105]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:03.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:03 smithi137 ceph-mon[34607]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:03 smithi144 ceph-mon[34818]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:06.142 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:05 smithi037 ceph-mon[31105]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:06.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:05 smithi137 ceph-mon[34607]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:06.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:05 smithi144 ceph-mon[34818]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:08.113 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:07 smithi037 ceph-mon[31105]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:08.113 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:08.113 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:08.113 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:08.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:07 smithi137 ceph-mon[34607]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:08.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:08.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:08.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:08.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:07 smithi144 ceph-mon[34818]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:08.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:08.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:08.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:09.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:09 smithi037 ceph-mon[31105]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:10.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:09 smithi137 ceph-mon[34607]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:10.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:09 smithi144 ceph-mon[34818]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:11.284 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.284 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.284 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:11.284 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:11.284 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:11.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:11.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:11.991 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-09-21T01:08:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.989+0000 7fe39b7fe640 1 -- 172.21.15.37:0/700911562 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe3a4063800 con 0x7fe3900b6480 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.991+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3900b6480 msgr2=0x7fe3900b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.991+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3900b6480 0x7fe3900b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe394004770 tx=0x7fe3940314a0 comp rx=0 tx=0).stop 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 msgr2=0x7fe3a419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 0x7fe3a419b190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00eaa0 tx=0x7fe39c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 shutdown_connections 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3900b6480 0x7fe3900b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3a4109470 0x7fe3a419b190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3a41068d0 0x7fe3a419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 --2- 172.21.15.37:0/700911562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a406b980 0x7fe3a4199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 >> 172.21.15.37:0/700911562 conn(0x7fe3a40fdfb0 msgr2=0x7fe3a4104dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 shutdown_connections 2024-09-21T01:08:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:08:11.992+0000 7fe3a8c74640 1 -- 172.21.15.37:0/700911562 wait complete. 2024-09-21T01:08:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:12 smithi037 ceph-mon[31105]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:12 smithi137 ceph-mon[34607]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:12 smithi144 ceph-mon[34818]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:12.626 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T01:08:12.628 INFO:tasks.cephadm:Deploying osd.1 on smithi137 with /dev/vg_nvme/lv_4... 2024-09-21T01:08:12.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:08:12.879 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:08:13.810 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:08:13 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0[46813]: 2024-09-21T01:08:13.557+0000 7f388ae01640 -1 osd.0 0 log_to_monitors true 2024-09-21T01:08:14.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:14 smithi037 ceph-mon[31105]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:14.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:14 smithi037 ceph-mon[31105]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:08:14.152 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:14 smithi137 ceph-mon[34607]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:14.152 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:14 smithi137 ceph-mon[34607]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:08:14.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:14 smithi144 ceph-mon[34818]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:14.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:14 smithi144 ceph-mon[34818]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:08:15.139 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-mon[31105]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:08:15.139 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-mon[31105]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:08:15.139 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-mon[31105]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:08:15.139 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:15.139 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-mon[31105]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:08:15.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0[46813]: 2024-09-21T01:08:15.031+0000 7f3886d83640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T01:08:15.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:08:15 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0[46813]: 2024-09-21T01:08:15.040+0000 7f3882b81640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:08:15.186 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:08:15.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi137:vg_nvme/lv_4 2024-09-21T01:08:15.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:15 smithi137 ceph-mon[34607]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:08:15.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:15 smithi137 ceph-mon[34607]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:15 smithi137 ceph-mon[34607]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:15 smithi137 ceph-mon[34607]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:15 smithi144 ceph-mon[34818]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:15 smithi144 ceph-mon[34818]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:15 smithi144 ceph-mon[34818]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:15.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:15 smithi144 ceph-mon[34818]: from='osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:08:15.460 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 -- 172.21.15.137:0/1700862087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac01036d0 msgr2=0x7f3ac0103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 --2- 172.21.15.137:0/1700862087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac01036d0 0x7f3ac0103ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009900 tx=0x7f3abc02a480 comp rx=0 tx=0).stop 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 -- 172.21.15.137:0/1700862087 shutdown_connections 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 --2- 172.21.15.137:0/1700862087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac0104070 0x7f3ac010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 --2- 172.21.15.137:0/1700862087 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac01036d0 0x7f3ac0103ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 --2- 172.21.15.137:0/1700862087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ac0102640 0x7f3ac0102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 -- 172.21.15.137:0/1700862087 >> 172.21.15.137:0/1700862087 conn(0x7f3ac00fdfb0 msgr2=0x7f3ac0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 -- 172.21.15.137:0/1700862087 shutdown_connections 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.913+0000 7f3ac7870640 1 -- 172.21.15.137:0/1700862087 wait complete. 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 Processor -- start 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 -- start start 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 0x7f3ac0199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac01036d0 0x7f3ac019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ac0104070 0x7f3ac019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac010e270 con 0x7f3ac01036d0 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac010e0f0 con 0x7f3ac0102640 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac7870640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac010e3f0 con 0x7f3ac0104070 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac560c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 0x7f3ac0199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac560c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 0x7f3ac0199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47624/0 (socket says 172.21.15.137:47624) 2024-09-21T01:08:15.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac560c640 1 -- 172.21.15.137:0/4225634466 learned_addr learned my addr 172.21.15.137:0/4225634466 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.914+0000 7f3ac4e0b640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac01036d0 0x7f3ac019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac5e0d640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ac0104070 0x7f3ac019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac560c640 1 -- 172.21.15.137:0/4225634466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ac0104070 msgr2=0x7f3ac019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac560c640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ac0104070 0x7f3ac019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac560c640 1 -- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac01036d0 msgr2=0x7f3ac019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac560c640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac01036d0 0x7f3ac019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac560c640 1 -- 172.21.15.137:0/4225634466 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac019b940 con 0x7f3ac0102640 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac4e0b640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac01036d0 0x7f3ac019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac560c640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 0x7f3ac0199fa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c920 tx=0x7f3ab400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4007c70 con 0x7f3ac0102640 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ab4007e10 con 0x7f3ac0102640 2024-09-21T01:08:15.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac019bc30 con 0x7f3ac0102640 2024-09-21T01:08:15.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4018820 con 0x7f3ac0102640 2024-09-21T01:08:15.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.915+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac01a23c0 con 0x7f3ac0102640 2024-09-21T01:08:15.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.916+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac01a2590 con 0x7f3ac0102640 2024-09-21T01:08:15.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.918+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3ab400f450 con 0x7f3ac0102640 2024-09-21T01:08:15.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.919+0000 7f3ab27fc640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3aac0b6480 0x7f3aac0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:15.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.919+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f3ab40e5a70 con 0x7f3ac0102640 2024-09-21T01:08:15.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.919+0000 7f3ac4e0b640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3aac0b6480 0x7f3aac0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:15.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.920+0000 7f3ac4e0b640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3aac0b6480 0x7f3aac0b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000c00 tx=0x7f3abc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:15.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:15.922+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ab4014030 con 0x7f3ac0102640 2024-09-21T01:08:16.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:16.115+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3ac00fffa0 con 0x7f3aac0b6480 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi037 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:16.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi037 to 17092M 2024-09-21T01:08:16.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:16.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:16.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi037 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi037 to 17092M 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi037 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi037 to 17092M 2024-09-21T01:08:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:16.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:16.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:16.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] boot 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:17.341 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:17.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] boot 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: osd.0 [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] boot 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: from='client.24260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:17.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:18 smithi137 ceph-mon[34607]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:18 smithi137 ceph-mon[34607]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:08:18.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:18 smithi144 ceph-mon[34818]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:18.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:18 smithi144 ceph-mon[34818]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:08:18.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:18 smithi037 ceph-mon[31105]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:08:18.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:18 smithi037 ceph-mon[31105]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/2015998817' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"} : dispatch 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:19 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"} : dispatch 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:19 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"}]': finished 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:19 smithi137 ceph-mon[34607]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/4107531910' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:19.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/2015998817' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"} : dispatch 2024-09-21T01:08:19.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:19 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"} : dispatch 2024-09-21T01:08:19.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:19 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"}]': finished 2024-09-21T01:08:19.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:19 smithi144 ceph-mon[34818]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:08:19.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:19.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/4107531910' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:19.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/2015998817' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"} : dispatch 2024-09-21T01:08:19.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:19 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"} : dispatch 2024-09-21T01:08:19.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:19 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55683e3d-91c3-4a7e-8fd6-e493edcec0f4"}]': finished 2024-09-21T01:08:19.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:19 smithi037 ceph-mon[31105]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:08:19.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:19.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/4107531910' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:20.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:20 smithi137 ceph-mon[34607]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:20.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:20 smithi144 ceph-mon[34818]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:20.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:20 smithi037 ceph-mon[31105]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:22.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:22 smithi137 ceph-mon[34607]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:22.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:22 smithi144 ceph-mon[34818]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:22.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:22 smithi037 ceph-mon[31105]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:24.616 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:24 smithi137 ceph-mon[34607]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:24.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:24 smithi144 ceph-mon[34818]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:24.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:24 smithi037 ceph-mon[31105]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:26.532 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:26 smithi137 ceph-mon[34607]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:26.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:26 smithi144 ceph-mon[34818]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:26.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:26 smithi037 ceph-mon[31105]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:27.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:08:27.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:27.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:08:27.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:08:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:28.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:28 smithi137 ceph-mon[34607]: Deploying daemon osd.1 on smithi137 2024-09-21T01:08:28.519 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:28 smithi137 ceph-mon[34607]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:28.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:28 smithi144 ceph-mon[34818]: Deploying daemon osd.1 on smithi137 2024-09-21T01:08:28.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:28 smithi144 ceph-mon[34818]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:28.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:28 smithi037 ceph-mon[31105]: Deploying daemon osd.1 on smithi137 2024-09-21T01:08:28.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:28 smithi037 ceph-mon[31105]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:30.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:30 smithi144 ceph-mon[34818]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:30.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:30 smithi137 ceph-mon[34607]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:30.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:30 smithi037 ceph-mon[31105]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:32.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:32 smithi137 ceph-mon[34607]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:32.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:32 smithi144 ceph-mon[34818]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:32.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:32 smithi037 ceph-mon[31105]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:33.669 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:33.696 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:33.696 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:33.696 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:33.697 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:33.697 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:33.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:33.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:33.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:34.592 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:34 smithi137 ceph-mon[34607]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:34.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:34 smithi144 ceph-mon[34818]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:34.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:34 smithi037 ceph-mon[31105]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:36 smithi137 ceph-mon[34607]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:36 smithi144 ceph-mon[34818]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:36 smithi037 ceph-mon[31105]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.149+0000 7f3ab27fc640 1 -- 172.21.15.137:0/4225634466 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3ac00fffa0 con 0x7f3aac0b6480 2024-09-21T01:08:37.151 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 1 on host 'smithi137' 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3aac0b6480 msgr2=0x7f3aac0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3aac0b6480 0x7f3aac0b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000c00 tx=0x7f3abc031400 comp rx=0 tx=0).stop 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 msgr2=0x7f3ac0199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 0x7f3ac0199fa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c920 tx=0x7f3ab400cde0 comp rx=0 tx=0).stop 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 shutdown_connections 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3aac0b6480 0x7f3aac0b8990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ac0104070 0x7f3ac019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ac01036d0 0x7f3ac019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 --2- 172.21.15.137:0/4225634466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac0102640 0x7f3ac0199fa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:37.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 >> 172.21.15.137:0/4225634466 conn(0x7f3ac00fdfb0 msgr2=0x7f3ac00ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:37.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 shutdown_connections 2024-09-21T01:08:37.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:08:37.152+0000 7f3ac7870640 1 -- 172.21.15.137:0/4225634466 wait complete. 2024-09-21T01:08:37.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:37.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:37.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:37.815 DEBUG:teuthology.orchestra.run.smithi137:osd.1> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T01:08:37.817 INFO:tasks.cephadm:Deploying osd.2 on smithi144 with /dev/vg_nvme/lv_4... 2024-09-21T01:08:37.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:08:38.066 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:08:38.500 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:38 smithi144 ceph-mon[34818]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:38.651 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:38 smithi037 ceph-mon[31105]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:38 smithi137 ceph-mon[34607]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:39.035 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:08:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1[38550]: 2024-09-21T01:08:39.011+0000 7f0943e4e640 -1 osd.1 0 log_to_monitors true 2024-09-21T01:08:39.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:39 smithi037 ceph-mon[31105]: from='osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:08:39.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:39 smithi037 ceph-mon[31105]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:08:39.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:39 smithi137 ceph-mon[34607]: from='osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:08:39.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:39 smithi137 ceph-mon[34607]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:08:39.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:39 smithi144 ceph-mon[34818]: from='osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:08:39.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:39 smithi144 ceph-mon[34818]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:08:40.438 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:08:40.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_4 2024-09-21T01:08:40.617 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-mon[34607]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:40.618 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-mon[34607]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:08:40.618 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-mon[34607]: from='osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:08:40.618 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-mon[34607]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:08:40.618 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:40.618 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-mon[34607]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:08:40.618 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1[38550]: 2024-09-21T01:08:40.418+0000 7f093fdd0640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T01:08:40.618 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:08:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1[38550]: 2024-09-21T01:08:40.421+0000 7f093bbce640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:08:40.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:40 smithi144 ceph-mon[34818]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:40.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:40 smithi144 ceph-mon[34818]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:08:40.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:40 smithi144 ceph-mon[34818]: from='osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:08:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:40 smithi144 ceph-mon[34818]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:08:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:40 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:40 smithi144 ceph-mon[34818]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:08:40.723 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:08:40.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:40 smithi037 ceph-mon[31105]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:40.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:40 smithi037 ceph-mon[31105]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:08:40.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:40 smithi037 ceph-mon[31105]: from='osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:08:40.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:40 smithi037 ceph-mon[31105]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:08:40.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:40 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:40.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:40 smithi037 ceph-mon[31105]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:08:41.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.175+0000 7f4ac17e6640 1 -- 172.21.15.144:0/786435631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc1051a0 msgr2=0x7f4abc10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/786435631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc1051a0 0x7f4abc10bb40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009ca0 tx=0x7f4ab402a950 comp rx=0 tx=0).stop 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 -- 172.21.15.144:0/786435631 shutdown_connections 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/786435631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc1051a0 0x7f4abc10bb40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/786435631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc104800 0x7f4abc104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/786435631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc103770 0x7f4abc103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 -- 172.21.15.144:0/786435631 >> 172.21.15.144:0/786435631 conn(0x7f4abc0ff0c0 msgr2=0x7f4abc101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 -- 172.21.15.144:0/786435631 shutdown_connections 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 -- 172.21.15.144:0/786435631 wait complete. 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.176+0000 7f4ac17e6640 1 Processor -- start 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 -- start start 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc103770 0x7f4abc199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 0x7f4abc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc1051a0 0x7f4abc19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc10f3c0 con 0x7f4abc1051a0 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc10f240 con 0x7f4abc103770 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4ac17e6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc10f540 con 0x7f4abc104800 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 0x7f4abc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 0x7f4abc19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59306/0 (socket says 172.21.15.144:59306) 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 -- 172.21.15.144:0/3798758463 learned_addr learned my addr 172.21.15.144:0/3798758463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4abb7fe640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc1051a0 0x7f4abc19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4abaffd640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc103770 0x7f4abc199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 -- 172.21.15.144:0/3798758463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc103770 msgr2=0x7f4abc199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc103770 0x7f4abc199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 -- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc1051a0 msgr2=0x7f4abc19b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:08:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.177+0000 7f4aba7fc640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc1051a0 0x7f4abc19b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4aba7fc640 1 -- 172.21.15.144:0/3798758463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc19b9b0 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4abb7fe640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc1051a0 0x7f4abc19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4abaffd640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc103770 0x7f4abc199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4aba7fc640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 0x7f4abc19a5f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000e9f0 tx=0x7f4ab000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000cd80 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc19bca0 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ab00054d0 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0010690 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.178+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc1a23a0 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.180+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc10a930 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.181+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f4ab0004e90 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.182+0000 7f4aa3fff640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4aa40b6480 0x7f4aa40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.182+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f4ab00e5dd0 con 0x7f4abc104800 2024-09-21T01:08:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.182+0000 7f4abaffd640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4aa40b6480 0x7f4aa40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:08:41.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.183+0000 7f4abaffd640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4aa40b6480 0x7f4aa40b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009fc0 tx=0x7f4aac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:08:41.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.187+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ab00adfd0 con 0x7f4abc104800 2024-09-21T01:08:41.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:08:41.382+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4abc063800 con 0x7f4aa40b6480 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:41.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.796 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:41.797 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:08:41.797 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:41.797 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:08:41.797 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:08:41.797 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:08:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi137 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi137 to 17088M 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] boot 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:08:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi137 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi137 to 17088M 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] boot 2024-09-21T01:08:42.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:08:42.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi137 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi137 to 17088M 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: osd.1 [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] boot 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:08:42.801 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:08:43.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:43 smithi037 ceph-mon[31105]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:08:44.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:43 smithi037 ceph-mon[31105]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:44.007 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:43 smithi144 ceph-mon[34818]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:08:44.007 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:43 smithi144 ceph-mon[34818]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:44.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:43 smithi137 ceph-mon[34607]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:08:44.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:43 smithi137 ceph-mon[34607]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:45.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:44 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/3924148160' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"} : dispatch 2024-09-21T01:08:45.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:44 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"} : dispatch 2024-09-21T01:08:45.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:44 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"}]': finished 2024-09-21T01:08:45.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:44 smithi037 ceph-mon[31105]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:08:45.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:44 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:08:45.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:44 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/1877757179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:44 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/3924148160' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"} : dispatch 2024-09-21T01:08:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:44 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"} : dispatch 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:44 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"}]': finished 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:44 smithi137 ceph-mon[34607]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:44 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:44 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/1877757179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:44 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/3924148160' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"} : dispatch 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:44 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"} : dispatch 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:44 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d343aa5f-854c-4241-81bb-623964d18857"}]': finished 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:44 smithi144 ceph-mon[34818]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:44 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:08:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:44 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/1877757179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:08:45.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:45 smithi037 ceph-mon[31105]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:46.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:45 smithi137 ceph-mon[34607]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:46.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:45 smithi144 ceph-mon[34818]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:48.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:47 smithi137 ceph-mon[34607]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:48.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:47 smithi144 ceph-mon[34818]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:48.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:47 smithi037 ceph-mon[31105]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:50.080 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:49 smithi144 ceph-mon[34818]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:50.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:49 smithi137 ceph-mon[34607]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:50.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:49 smithi037 ceph-mon[31105]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:51.991 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:51 smithi144 ceph-mon[34818]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:52.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:51 smithi137 ceph-mon[34607]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:52.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:51 smithi037 ceph-mon[31105]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:53.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:52 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:08:53.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:52 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:53.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:52 smithi137 ceph-mon[34607]: Deploying daemon osd.2 on smithi144 2024-09-21T01:08:53.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:52 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:08:53.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:52 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:53.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:52 smithi144 ceph-mon[34818]: Deploying daemon osd.2 on smithi144 2024-09-21T01:08:53.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:52 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:08:53.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:52 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:08:53.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:52 smithi037 ceph-mon[31105]: Deploying daemon osd.2 on smithi144 2024-09-21T01:08:53.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:53 smithi144 ceph-mon[34818]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:54.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:53 smithi137 ceph-mon[34607]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:54.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:53 smithi037 ceph-mon[31105]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:56.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:55 smithi137 ceph-mon[34607]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:56.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:55 smithi144 ceph-mon[34818]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:56.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:55 smithi037 ceph-mon[31105]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:58.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:57 smithi144 ceph-mon[34818]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:58.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:57 smithi137 ceph-mon[34607]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:58.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:57 smithi037 ceph-mon[31105]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:08:58.993 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:58.993 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:58.993 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:08:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:59.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:59.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:59.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:08:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:59.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:08:59.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:08:59.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:08:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:00 smithi144 ceph-mon[34818]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:00.613 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:00 smithi137 ceph-mon[34607]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:00 smithi037 ceph-mon[31105]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:02.465 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:02 smithi144 ceph-mon[34818]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:02.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.506+0000 7f4aa3fff640 1 -- 172.21.15.144:0/3798758463 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4abc063800 con 0x7f4aa40b6480 2024-09-21T01:09:02.508 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 2 on host 'smithi144' 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4aa40b6480 msgr2=0x7f4aa40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4aa40b6480 0x7f4aa40b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009fc0 tx=0x7f4aac005f90 comp rx=0 tx=0).stop 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 msgr2=0x7f4abc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 0x7f4abc19a5f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000e9f0 tx=0x7f4ab000edf0 comp rx=0 tx=0).stop 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 shutdown_connections 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4aa40b6480 0x7f4aa40b8990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc1051a0 0x7f4abc19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:02.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4abc104800 0x7f4abc19a5f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:02.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 --2- 172.21.15.144:0/3798758463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4abc103770 0x7f4abc199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:02.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 >> 172.21.15.144:0/3798758463 conn(0x7f4abc0ff0c0 msgr2=0x7f4abc107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:02.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 shutdown_connections 2024-09-21T01:09:02.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:02.510+0000 7f4ac17e6640 1 -- 172.21.15.144:0/3798758463 wait complete. 2024-09-21T01:09:02.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:02 smithi137 ceph-mon[34607]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:02.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:02 smithi037 ceph-mon[31105]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:03.062 DEBUG:teuthology.orchestra.run.smithi144:osd.2> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T01:09:03.063 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-09-21T01:09:03.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:09:03.332 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:09:03.611 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:03.611 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:03.611 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:03.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:03.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:03.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:03.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:03.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:03.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:04.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:04 smithi144 ceph-mon[34818]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:04.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:04 smithi037 ceph-mon[31105]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:04 smithi137 ceph-mon[34607]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:05.070 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2[39226]: 2024-09-21T01:09:04.688+0000 7f638ec88640 -1 osd.2 0 log_to_monitors true 2024-09-21T01:09:05.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:05 smithi144 ceph-mon[34818]: from='osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:09:05.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:05 smithi144 ceph-mon[34818]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:09:05.796 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:05 smithi037 ceph-mon[31105]: from='osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:09:05.796 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:05 smithi037 ceph-mon[31105]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:09:05.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:05 smithi137 ceph-mon[34607]: from='osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:09:05.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:05 smithi137 ceph-mon[34607]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:09:06.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:09:06.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-09-21T01:09:06.297 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:09:06.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:06.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:09:06.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:09:06.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:06.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 -- 172.21.15.37:0/3968111641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c103750 msgr2=0x7f240c103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 --2- 172.21.15.37:0/3968111641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c103750 0x7f240c103bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009900 tx=0x7f23fc02a480 comp rx=0 tx=0).stop 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 -- 172.21.15.37:0/3968111641 shutdown_connections 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 --2- 172.21.15.37:0/3968111641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c105180 0x7f240c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 --2- 172.21.15.37:0/3968111641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c1047e0 0x7f240c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 --2- 172.21.15.37:0/3968111641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c103750 0x7f240c103bc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 -- 172.21.15.37:0/3968111641 >> 172.21.15.37:0/3968111641 conn(0x7f240c0ff0c0 msgr2=0x7f240c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 -- 172.21.15.37:0/3968111641 shutdown_connections 2024-09-21T01:09:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 -- 172.21.15.37:0/3968111641 wait complete. 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.775+0000 7f241284e640 1 Processor -- start 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 -- start start 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c103750 0x7f240c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 0x7f240c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c105180 0x7f240c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10f390 con 0x7f240c1047e0 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10f210 con 0x7f240c105180 2024-09-21T01:09:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f241284e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f240c10f510 con 0x7f240c103750 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 0x7f240c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c103750 0x7f240c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 0x7f240c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42948/0 (socket says 172.21.15.37:42948) 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 -- 172.21.15.37:0/913093977 learned_addr learned my addr 172.21.15.37:0/913093977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f2410deb640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c105180 0x7f240c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 -- 172.21.15.37:0/913093977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c103750 msgr2=0x7f240c199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c103750 0x7f240c199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 -- 172.21.15.37:0/913093977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c105180 msgr2=0x7f240c19b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c105180 0x7f240c19b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.776+0000 7f240b7fe640 1 -- 172.21.15.37:0/913093977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c19ba20 con 0x7f240c1047e0 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.777+0000 7f240b7fe640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 0x7f240c19a660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f240000e9f0 tx=0x7f240000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.777+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240000cd80 con 0x7f240c1047e0 2024-09-21T01:09:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.777+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c19bd10 con 0x7f240c1047e0 2024-09-21T01:09:06.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.777+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24000054d0 con 0x7f240c1047e0 2024-09-21T01:09:06.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.777+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400010690 con 0x7f240c1047e0 2024-09-21T01:09:06.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.777+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c1a2410 con 0x7f240c1047e0 2024-09-21T01:09:06.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.778+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c10a930 con 0x7f240c1047e0 2024-09-21T01:09:06.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.779+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2400004e30 con 0x7f240c1047e0 2024-09-21T01:09:06.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.780+0000 7f24097fa640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23f40b6480 0x7f23f40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:06.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.780+0000 7f240bfff640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23f40b6480 0x7f23f40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:06.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.780+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f24000e6210 con 0x7f240c1047e0 2024-09-21T01:09:06.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.781+0000 7f240bfff640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23f40b6480 0x7f23f40b8990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:06.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.784+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2400056710 con 0x7f240c1047e0 2024-09-21T01:09:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:06.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:06.982+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f240c063800 con 0x7f23f40b6480 2024-09-21T01:09:07.420 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2[39226]: 2024-09-21T01:09:06.938+0000 7f638b41f640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T01:09:07.421 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2[39226]: 2024-09-21T01:09:06.942+0000 7f6382a00640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi144 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='osd.2 ' entity='osd.2' 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:07.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi144 2024-09-21T01:09:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T01:09:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:09:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='osd.2 ' entity='osd.2' 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi144 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T01:09:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='osd.2 ' entity='osd.2' 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:08.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:09:08.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:09:08.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:08.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:08.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:08.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] boot 2024-09-21T01:09:08.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:09:08.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:09:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:09:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] boot 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: osd.2 [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] boot 2024-09-21T01:09:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:09:08.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:09:09.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:09:09.802 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51098]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:09:09.802 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51098]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:09.802 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:09.802 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51098]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:09.802 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51103]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:09:09.803 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51103]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:09.803 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:09.803 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51103]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:09.849 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43173]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43176]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:09.849 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:09.850 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43176]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:09.889 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:09:09.889 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42277]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:09:09.889 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42277]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:09.889 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:09.889 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42277]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:09.889 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42280]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:09:09.890 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42280]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:09.890 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:09.890 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42280]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.170 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51107]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51107]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51107]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51115]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:10.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:09 smithi037 sudo[51115]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42283]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42283]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42283]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42286]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42286]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:09 smithi137 sudo[42286]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.184 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43179]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43179]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43179]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43182]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43182]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:09:10.185 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:09 smithi144 sudo[43182]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:09:10.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:10.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:09:10.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:09:10.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:09:10.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2826312186' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3a46d7-bbc4-4211-a85c-450533a40330"} : dispatch 2024-09-21T01:09:10.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2826312186' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3a46d7-bbc4-4211-a85c-450533a40330"}]': finished 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:10.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:10.923 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:10 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3182572445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2826312186' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3a46d7-bbc4-4211-a85c-450533a40330"} : dispatch 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2826312186' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3a46d7-bbc4-4211-a85c-450533a40330"}]': finished 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:10.924 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:10.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:10 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3182572445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2826312186' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3a46d7-bbc4-4211-a85c-450533a40330"} : dispatch 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2826312186' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3a46d7-bbc4-4211-a85c-450533a40330"}]': finished 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:09:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:09:11.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:09:11.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:09:11.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:09:11.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:09:11.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:10 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3182572445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:11.562+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f24000a9d60 con 0x7f240c1047e0 2024-09-21T01:09:11.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:11 smithi137 ceph-mon[34607]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:09:11.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:11.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:11 smithi144 ceph-mon[34818]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:09:11.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:11.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:11 smithi037 ceph-mon[31105]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:09:12.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:12.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:12 smithi137 ceph-mon[34607]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:12.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:12 smithi137 ceph-mon[34607]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T01:09:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:12 smithi144 ceph-mon[34818]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:12 smithi144 ceph-mon[34818]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T01:09:12.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:12 smithi037 ceph-mon[31105]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:13.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:12 smithi037 ceph-mon[31105]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T01:09:14.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:14 smithi137 ceph-mon[34607]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:14.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:14 smithi144 ceph-mon[34818]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:15.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:14 smithi037 ceph-mon[31105]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:15.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:15 smithi037 ceph-mon[31105]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:15.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:15 smithi137 ceph-mon[34607]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:15.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:15 smithi144 ceph-mon[34818]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:18.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:17 smithi137 ceph-mon[34607]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:18.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:17 smithi144 ceph-mon[34818]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:17 smithi037 ceph-mon[31105]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:18.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:18 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:09:18.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:18 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:18.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:18 smithi037 ceph-mon[31105]: Deploying daemon osd.3 on smithi037 2024-09-21T01:09:19.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:18 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:09:19.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:18 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:19.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:18 smithi144 ceph-mon[34818]: Deploying daemon osd.3 on smithi037 2024-09-21T01:09:19.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:18 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:09:19.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:18 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:19.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:18 smithi137 ceph-mon[34607]: Deploying daemon osd.3 on smithi037 2024-09-21T01:09:19.944 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:19 smithi037 ceph-mon[31105]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:20.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:19 smithi137 ceph-mon[34607]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:20.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:19 smithi144 ceph-mon[34818]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:22.096 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:21 smithi037 ceph-mon[31105]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:22.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:21 smithi137 ceph-mon[34607]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:22.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:21 smithi144 ceph-mon[34818]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:24.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:23 smithi144 ceph-mon[34818]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:24.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:23 smithi137 ceph-mon[34607]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:24.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:23 smithi037 ceph-mon[31105]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:25.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:25.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:25.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:25.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:25.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:25.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:25.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:25.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:25.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:26.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:25 smithi137 ceph-mon[34607]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:26.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:25 smithi144 ceph-mon[34818]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:26.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:25 smithi037 ceph-mon[31105]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:27 smithi137 ceph-mon[34607]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:27 smithi144 ceph-mon[34818]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:27 smithi037 ceph-mon[31105]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:29.001 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-09-21T01:09:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:28.999+0000 7f24097fa640 1 -- 172.21.15.37:0/913093977 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f240c063800 con 0x7f23f40b6480 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23f40b6480 msgr2=0x7f23f40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23f40b6480 0x7f23f40b8990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc031400 comp rx=0 tx=0).stop 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 msgr2=0x7f240c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 0x7f240c19a660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f240000e9f0 tx=0x7f240000edf0 comp rx=0 tx=0).stop 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 shutdown_connections 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23f40b6480 0x7f23f40b8990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f240c105180 0x7f240c19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c1047e0 0x7f240c19a660 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 --2- 172.21.15.37:0/913093977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240c103750 0x7f240c199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 >> 172.21.15.37:0/913093977 conn(0x7f240c0ff0c0 msgr2=0x7f240c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:29.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 shutdown_connections 2024-09-21T01:09:29.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:09:29.002+0000 7f241284e640 1 -- 172.21.15.37:0/913093977 wait complete. 2024-09-21T01:09:29.734 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T01:09:29.736 INFO:tasks.cephadm:Deploying osd.4 on smithi137 with /dev/vg_nvme/lv_3... 2024-09-21T01:09:29.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:09:29.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:29 smithi037 ceph-mon[31105]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:29.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:29.995 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:29.995 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:29.998 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:09:30.119 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:29 smithi137 ceph-mon[34607]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:30.119 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:30.119 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:30.119 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:30.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:29 smithi144 ceph-mon[34818]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:30.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:30 smithi137 ceph-mon[34607]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:09:30.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:30 smithi037 ceph-mon[31105]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:09:31.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:09:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:09:30.681+0000 7fcac29cd640 -1 osd.3 0 log_to_monitors true 2024-09-21T01:09:31.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:30 smithi144 ceph-mon[34818]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:31 smithi144 ceph-mon[34818]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:31 smithi144 ceph-mon[34818]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:31 smithi144 ceph-mon[34818]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:31 smithi144 ceph-mon[34818]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:31 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:31 smithi137 ceph-mon[34607]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:31 smithi137 ceph-mon[34607]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:31 smithi137 ceph-mon[34607]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:31 smithi137 ceph-mon[34607]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:09:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:31 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:32.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:31 smithi037 ceph-mon[31105]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:32.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:31 smithi037 ceph-mon[31105]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:09:32.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:31 smithi037 ceph-mon[31105]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:09:32.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:31 smithi037 ceph-mon[31105]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:09:32.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:31 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:32.505 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:09:32.532 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi137:vg_nvme/lv_3 2024-09-21T01:09:32.682 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:09:32.349+0000 7fcabe94f640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T01:09:32.682 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:09:32.356+0000 7fcab6745640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:09:32.777 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.147 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:33.148 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:33.148 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:09:33.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699]' entity='osd.3' 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 -- 172.21.15.137:0/3109697901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 msgr2=0x7f1d9410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 --2- 172.21.15.137:0/3109697901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9410aa20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009ca0 tx=0x7f1d8c02a950 comp rx=0 tx=0).stop 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 -- 172.21.15.137:0/3109697901 shutdown_connections 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 --2- 172.21.15.137:0/3109697901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9410aa20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 --2- 172.21.15.137:0/3109697901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d941036e0 0x7f1d94103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 --2- 172.21.15.137:0/3109697901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d94102650 0x7f1d94102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 -- 172.21.15.137:0/3109697901 >> 172.21.15.137:0/3109697901 conn(0x7f1d940fdfa0 msgr2=0x7f1d94100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 -- 172.21.15.137:0/3109697901 shutdown_connections 2024-09-21T01:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.240+0000 7f1d9a410640 1 -- 172.21.15.137:0/3109697901 wait complete. 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 Processor -- start 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 -- start start 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d94102650 0x7f1d94198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d941036e0 0x7f1d94199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9410e2a0 con 0x7f1d941036e0 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9410e120 con 0x7f1d94104080 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d9a410640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9410e420 con 0x7f1d94102650 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9419a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34262/0 (socket says 172.21.15.137:34262) 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 -- 172.21.15.137:0/2416104403 learned_addr learned my addr 172.21.15.137:0/2416104403 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d8bfff640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d941036e0 0x7f1d94199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d93fff640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d94102650 0x7f1d94198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 -- 172.21.15.137:0/2416104403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d94102650 msgr2=0x7f1d94198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d94102650 0x7f1d94198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 -- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d941036e0 msgr2=0x7f1d94199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d941036e0 0x7f1d94199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 -- 172.21.15.137:0/2416104403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d9419a8c0 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.241+0000 7f1d989ad640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9419a0a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c006010 tx=0x7f1d8c02fc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.242+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c034040 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.242+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d8c0308f0 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.242+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9419ab50 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.242+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c039450 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.242+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d941a10e0 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.243+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d94109830 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.244+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1d8c037020 con 0x7f1d94104080 2024-09-21T01:09:33.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.245+0000 7f1d91ffb640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1d800b6510 0x7f1d800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:33.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.245+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f1d8c107340 con 0x7f1d94104080 2024-09-21T01:09:33.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.245+0000 7f1d93fff640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1d800b6510 0x7f1d800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:33.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.246+0000 7f1d93fff640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1d800b6510 0x7f1d800b8a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d84005fd0 tx=0x7f1d84005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:33.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.248+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d8c0cedd0 con 0x7f1d94104080 2024-09-21T01:09:33.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:33.434+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1d94063800 con 0x7f1d800b6510 2024-09-21T01:09:34.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:09:34.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:09:34.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi037 2024-09-21T01:09:34.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi037 to 8546M 2024-09-21T01:09:34.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:34.116 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] boot 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:34.117 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:33 smithi137 ceph-mon[34607]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T01:09:34.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:09:34.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi037 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi037 to 8546M 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] boot 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:34.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:33 smithi144 ceph-mon[34818]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T01:09:34.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:09:34.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:09:34.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi037 2024-09-21T01:09:34.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi037 to 8546M 2024-09-21T01:09:34.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: osd.3 [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] boot 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:34.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:34.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:33 smithi037 ceph-mon[31105]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T01:09:36.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:36.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:09:36.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/2596783873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"} : dispatch 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"} : dispatch 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"}]': finished 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/2596783873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"} : dispatch 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"} : dispatch 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"}]': finished 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T01:09:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:36.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:09:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/2596783873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"} : dispatch 2024-09-21T01:09:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"} : dispatch 2024-09-21T01:09:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "365b5737-c951-435b-b661-abdfcdc9a3dd"}]': finished 2024-09-21T01:09:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T01:09:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:37.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:36 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/1035425702' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:36 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/1035425702' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:37.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:36 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/1035425702' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:09:38.150 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:37 smithi037 ceph-mon[31105]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:38.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:37 smithi137 ceph-mon[34607]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:38.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:37 smithi144 ceph-mon[34818]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:40.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:39 smithi137 ceph-mon[34607]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T01:09:40.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:39 smithi144 ceph-mon[34818]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T01:09:40.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:39 smithi037 ceph-mon[31105]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T01:09:42.002 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:41 smithi137 ceph-mon[34607]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:09:42.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:41 smithi144 ceph-mon[34818]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:09:42.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:41 smithi037 ceph-mon[31105]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:09:43.983 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:43 smithi137 ceph-mon[34607]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:44.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:43 smithi144 ceph-mon[34818]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:44.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:43 smithi037 ceph-mon[31105]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:09:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:44 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:09:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:44 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:45.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:44 smithi137 ceph-mon[34607]: Deploying daemon osd.4 on smithi137 2024-09-21T01:09:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:44 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:09:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:44 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:44 smithi144 ceph-mon[34818]: Deploying daemon osd.4 on smithi137 2024-09-21T01:09:45.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:44 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:09:45.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:44 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:45.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:44 smithi037 ceph-mon[31105]: Deploying daemon osd.4 on smithi137 2024-09-21T01:09:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:45 smithi137 ceph-mon[34607]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:09:46.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:45 smithi144 ceph-mon[34818]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:09:46.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:45 smithi037 ceph-mon[31105]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:09:48.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:47 smithi144 ceph-mon[34818]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T01:09:48.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:47 smithi137 ceph-mon[34607]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T01:09:48.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:47 smithi037 ceph-mon[31105]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T01:09:50.165 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:49 smithi137 ceph-mon[34607]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:50.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:49 smithi144 ceph-mon[34818]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:50.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:49 smithi037 ceph-mon[31105]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:09:51.093 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:51.093 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:51.093 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:51.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:51.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:51.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:51.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:51.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:51.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:52 smithi137 ceph-mon[34607]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:52.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:52 smithi037 ceph-mon[31105]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:52.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:52 smithi144 ceph-mon[34818]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:54.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:54 smithi137 ceph-mon[34607]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:54.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:54 smithi144 ceph-mon[34818]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.466+0000 7f1d91ffb640 1 -- 172.21.15.137:0/2416104403 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d94063800 con 0x7f1d800b6510 2024-09-21T01:09:54.467 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 4 on host 'smithi137' 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1d800b6510 msgr2=0x7f1d800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1d800b6510 0x7f1d800b8a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d84005fd0 tx=0x7f1d84005850 comp rx=0 tx=0).stop 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 msgr2=0x7f1d9419a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9419a0a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c006010 tx=0x7f1d8c02fc20 comp rx=0 tx=0).stop 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 shutdown_connections 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1d800b6510 0x7f1d800b8a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1d94104080 0x7f1d9419a0a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d941036e0 0x7f1d94199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 --2- 172.21.15.137:0/2416104403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d94102650 0x7f1d94198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 >> 172.21.15.137:0/2416104403 conn(0x7f1d940fdfa0 msgr2=0x7f1d94106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 shutdown_connections 2024-09-21T01:09:54.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:09:54.469+0000 7f1d9a410640 1 -- 172.21.15.137:0/2416104403 wait complete. 2024-09-21T01:09:54.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:54 smithi037 ceph-mon[31105]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:54.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:54.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:54.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:54.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:55.088 DEBUG:teuthology.orchestra.run.smithi137:osd.4> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T01:09:55.090 INFO:tasks.cephadm:Deploying osd.5 on smithi144 with /dev/vg_nvme/lv_3... 2024-09-21T01:09:55.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:09:55.320 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:55 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:55.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:55 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:55.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:55 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:09:55.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:55 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:55.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:55 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:55.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:55 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:55.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:55 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:09:55.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:55 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:55.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:55 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:56.566 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:56 smithi137 ceph-mon[34607]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:56.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:56 smithi037 ceph-mon[31105]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:56.780 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:56 smithi144 ceph-mon[34818]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:56.821 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:09:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4[44792]: 2024-09-21T01:09:56.724+0000 7f3a5ecaf640 -1 osd.4 0 log_to_monitors true 2024-09-21T01:09:57.616 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:57 smithi137 ceph-mon[34607]: from='osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:09:57.616 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:57 smithi137 ceph-mon[34607]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:09:57.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:57 smithi037 ceph-mon[31105]: from='osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:09:57.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:57 smithi037 ceph-mon[31105]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:09:57.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:57 smithi144 ceph-mon[34818]: from='osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:09:57.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:57 smithi144 ceph-mon[34818]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:09:57.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:09:57.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_3 2024-09-21T01:09:58.206 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:09:58.631 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:58.631 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:09:58.631 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:09:58.631 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:09:58.631 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:58.632 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:58.633 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 -- 172.21.15.144:0/2247270752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c1047e0 msgr2=0x7f738c104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 --2- 172.21.15.144:0/2247270752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c1047e0 0x7f738c104bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7380009900 tx=0x7f738002a480 comp rx=0 tx=0).stop 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 -- 172.21.15.144:0/2247270752 shutdown_connections 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 --2- 172.21.15.144:0/2247270752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c105180 0x7f738c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 --2- 172.21.15.144:0/2247270752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c1047e0 0x7f738c104bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 --2- 172.21.15.144:0/2247270752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c103750 0x7f738c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 -- 172.21.15.144:0/2247270752 >> 172.21.15.144:0/2247270752 conn(0x7f738c0ff0c0 msgr2=0x7f738c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 -- 172.21.15.144:0/2247270752 shutdown_connections 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.648+0000 7f7394541640 1 -- 172.21.15.144:0/2247270752 wait complete. 2024-09-21T01:09:58.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 Processor -- start 2024-09-21T01:09:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 -- start start 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 0x7f738c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c1047e0 0x7f738c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c105180 0x7f738c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f738c10f3a0 con 0x7f738c1047e0 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f738c10f220 con 0x7f738c105180 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7394541640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f738c10f520 con 0x7f738c103750 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f73922dd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 0x7f738c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:58.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f73922dd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 0x7f738c199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38422/0 (socket says 172.21.15.144:38422) 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f73922dd640 1 -- 172.21.15.144:0/719830842 learned_addr learned my addr 172.21.15.144:0/719830842 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7392ade640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c105180 0x7f738c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.649+0000 7f7391adc640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c1047e0 0x7f738c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f73922dd640 1 -- 172.21.15.144:0/719830842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c105180 msgr2=0x7f738c19b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f73922dd640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c105180 0x7f738c19b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f73922dd640 1 -- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c1047e0 msgr2=0x7f738c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f73922dd640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c1047e0 0x7f738c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f73922dd640 1 -- 172.21.15.144:0/719830842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c19ba00 con 0x7f738c103750 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f7392ade640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c105180 0x7f738c19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f73922dd640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 0x7f738c199fd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f737c00eb90 tx=0x7f737c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c004d20 con 0x7f738c103750 2024-09-21T01:09:58.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f737c00ee90 con 0x7f738c103750 2024-09-21T01:09:58.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c19bcf0 con 0x7f738c103750 2024-09-21T01:09:58.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c010670 con 0x7f738c103750 2024-09-21T01:09:58.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.650+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1a23f0 con 0x7f738c103750 2024-09-21T01:09:58.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.651+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c10a930 con 0x7f738c103750 2024-09-21T01:09:58.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.653+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f737c010850 con 0x7f738c103750 2024-09-21T01:09:58.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.654+0000 7f738b7fe640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f73740b6510 0x7f73740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:09:58.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.654+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f737c0e69a0 con 0x7f738c103750 2024-09-21T01:09:58.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.654+0000 7f7391adc640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f73740b6510 0x7f73740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:09:58.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.654+0000 7f7391adc640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f73740b6510 0x7f73740b8a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7380000c00 tx=0x7f7380031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:09:58.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.657+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f737c056710 con 0x7f738c103750 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:58.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:09:58.842+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f738c063800 con 0x7f73740b6510 2024-09-21T01:09:58.920 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4[44792]: 2024-09-21T01:09:58.483+0000 7f3a5ac31640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T01:09:58.920 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4[44792]: 2024-09-21T01:09:58.488+0000 7f3a56a2f640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:58.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:09:58.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:58.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:58.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:09:58.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi137 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi137 to 8544M 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:59.811 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:59.812 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:59.812 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:09:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi137 2024-09-21T01:09:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi137 to 8544M 2024-09-21T01:09:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:09:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:09:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi137 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi137 to 8544M 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:00.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:00.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:09:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] boot 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:00 smithi144 ceph-mon[34818]: overall HEALTH_OK 2024-09-21T01:10:00.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:10:00.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:10:00.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:10:00.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:00.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] boot 2024-09-21T01:10:00.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T01:10:00.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:00.823 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:00 smithi137 ceph-mon[34607]: overall HEALTH_OK 2024-09-21T01:10:00.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:10:00.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:10:01.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:10:01.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:01.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: osd.4 [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] boot 2024-09-21T01:10:01.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T01:10:01.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:10:01.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:00 smithi037 ceph-mon[31105]: overall HEALTH_OK 2024-09-21T01:10:01.700 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:01 smithi144 ceph-mon[34818]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:10:01.700 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:01 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/933667471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"} : dispatch 2024-09-21T01:10:01.700 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:01 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"} : dispatch 2024-09-21T01:10:01.701 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:01 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"}]': finished 2024-09-21T01:10:01.701 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:01 smithi144 ceph-mon[34818]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T01:10:01.701 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:01 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:01.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:01 smithi137 ceph-mon[34607]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:10:01.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:01 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/933667471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"} : dispatch 2024-09-21T01:10:01.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:01 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"} : dispatch 2024-09-21T01:10:01.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:01 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"}]': finished 2024-09-21T01:10:01.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:01 smithi137 ceph-mon[34607]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T01:10:01.838 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:01 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:01.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:01 smithi037 ceph-mon[31105]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:10:02.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:01 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/933667471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"} : dispatch 2024-09-21T01:10:02.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:01 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"} : dispatch 2024-09-21T01:10:02.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:01 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "020d2837-a187-4fe7-8f77-52d15b00ae13"}]': finished 2024-09-21T01:10:02.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:01 smithi037 ceph-mon[31105]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T01:10:02.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:01 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:02.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:02 smithi144 ceph-mon[34818]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:02.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:02 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/469033728' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:02 smithi137 ceph-mon[34607]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:02 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/469033728' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:02 smithi037 ceph-mon[31105]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:02 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/469033728' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:04 smithi137 ceph-mon[34607]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:04.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:04 smithi144 ceph-mon[34818]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:04.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:04 smithi037 ceph-mon[31105]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:06.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:06 smithi144 ceph-mon[34818]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:06 smithi137 ceph-mon[34607]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:06.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:06 smithi037 ceph-mon[31105]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:08.802 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:08 smithi037 ceph-mon[31105]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:08.824 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:08 smithi144 ceph-mon[34818]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:08 smithi137 ceph-mon[34607]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:10.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:10 smithi144 ceph-mon[34818]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:10:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:10 smithi137 ceph-mon[34607]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:10:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:10 smithi037 ceph-mon[31105]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:10:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:11.651 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:11 smithi144 ceph-mon[34818]: Deploying daemon osd.5 on smithi144 2024-09-21T01:10:11.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:11 smithi137 ceph-mon[34607]: Deploying daemon osd.5 on smithi144 2024-09-21T01:10:11.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:11 smithi037 ceph-mon[31105]: Deploying daemon osd.5 on smithi144 2024-09-21T01:10:12.802 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:12 smithi144 ceph-mon[34818]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:12 smithi137 ceph-mon[34607]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:12.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:12 smithi037 ceph-mon[31105]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:14.793 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:14 smithi144 ceph-mon[34818]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:14.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:14 smithi137 ceph-mon[34607]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:14.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:14 smithi037 ceph-mon[31105]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:16.562 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:16 smithi144 ceph-mon[34818]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:16.562 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:16.563 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:16.563 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:16 smithi137 ceph-mon[34607]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:17.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:16 smithi037 ceph-mon[31105]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:17.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:17.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:17.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:18.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:18 smithi144 ceph-mon[34818]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:18 smithi137 ceph-mon[34607]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:18.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:18 smithi037 ceph-mon[31105]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:19.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:19.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:19.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.961+0000 7f738b7fe640 1 -- 172.21.15.144:0/719830842 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f738c063800 con 0x7f73740b6510 2024-09-21T01:10:19.962 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 5 on host 'smithi144' 2024-09-21T01:10:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f73740b6510 msgr2=0x7f73740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f73740b6510 0x7f73740b8a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7380000c00 tx=0x7f7380031400 comp rx=0 tx=0).stop 2024-09-21T01:10:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 msgr2=0x7f738c199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 0x7f738c199fd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f737c00eb90 tx=0x7f737c00c6a0 comp rx=0 tx=0).stop 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 shutdown_connections 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f73740b6510 0x7f73740b8a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f738c105180 0x7f738c19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f738c1047e0 0x7f738c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 --2- 172.21.15.144:0/719830842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c103750 0x7f738c199fd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 >> 172.21.15.144:0/719830842 conn(0x7f738c0ff0c0 msgr2=0x7f738c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 shutdown_connections 2024-09-21T01:10:19.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:10:19.963+0000 7f7394541640 1 -- 172.21.15.144:0/719830842 wait complete. 2024-09-21T01:10:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:20.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:20.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.765 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:20 smithi144 ceph-mon[34818]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:20.765 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:20 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:20.765 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:20 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.765 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:20 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.793 DEBUG:teuthology.orchestra.run.smithi144:osd.5> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T01:10:20.795 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-09-21T01:10:20.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:10:20.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:20 smithi037 ceph-mon[31105]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:20.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:20 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:20.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:20 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:20 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:20 smithi137 ceph-mon[34607]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:20 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:20 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:20 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:10:22.033 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:10:21 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:10:21.710+0000 7fb7b033d640 -1 osd.5 0 log_to_monitors true 2024-09-21T01:10:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:22 smithi137 ceph-mon[34607]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:22 smithi137 ceph-mon[34607]: from='osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:10:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:22 smithi137 ceph-mon[34607]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:10:22.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:22 smithi144 ceph-mon[34818]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:22.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:22 smithi144 ceph-mon[34818]: from='osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:10:22.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:22 smithi144 ceph-mon[34818]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:10:22.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:22 smithi037 ceph-mon[31105]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:22.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:22 smithi037 ceph-mon[31105]: from='osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:10:22.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:22 smithi037 ceph-mon[31105]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:10:23.670 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:10:23.581+0000 7fb7ac2bf640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T01:10:23.671 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:10:23.589+0000 7fb7a80bd640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:10:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-mon[34818]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:10:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-mon[34818]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:10:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-mon[34818]: from='osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:10:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-mon[34818]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:10:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:23 smithi144 ceph-mon[34818]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:23 smithi037 ceph-mon[31105]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:10:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:23 smithi037 ceph-mon[31105]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:10:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:23 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:23 smithi037 ceph-mon[31105]: from='osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:10:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:23 smithi037 ceph-mon[31105]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:10:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:23 smithi037 ceph-mon[31105]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:23.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:23 smithi137 ceph-mon[34607]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:10:23.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:23 smithi137 ceph-mon[34607]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:10:23.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:23 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:23.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:23 smithi137 ceph-mon[34607]: from='osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:10:23.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:23 smithi137 ceph-mon[34607]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:10:23.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:23 smithi137 ceph-mon[34607]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:10:24.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:10:24.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-09-21T01:10:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi144 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] boot 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T01:10:24.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/3292174321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc1040a0 msgr2=0x7fc9bc10aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/3292174321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc10aa40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009ca0 tx=0x7fc9b402a950 comp rx=0 tx=0).stop 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/3292174321 shutdown_connections 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/3292174321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc10aa40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/3292174321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc103700 0x7fc9bc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/3292174321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 0x7fc9bc102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/3292174321 >> 172.21.15.37:0/3292174321 conn(0x7fc9bc0fdfe0 msgr2=0x7fc9bc100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/3292174321 shutdown_connections 2024-09-21T01:10:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.888+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/3292174321 wait complete. 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 Processor -- start 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 -- start start 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 0x7fc9bc06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 0x7fc9bc19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc1a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc10e2c0 con 0x7fc9bc103700 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc10e140 con 0x7fc9bc102670 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9c0bcb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc10e440 con 0x7fc9bc1040a0 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 0x7fc9bc19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 0x7fc9bc19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33934/0 (socket says 172.21.15.37:33934) 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 -- 172.21.15.37:0/2592742731 learned_addr learned my addr 172.21.15.37:0/2592742731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9ba59c640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 0x7fc9bc06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9bad9d640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc1a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 -- 172.21.15.37:0/2592742731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc1040a0 msgr2=0x7fc9bc1a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc1a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 -- 172.21.15.37:0/2592742731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 msgr2=0x7fc9bc06c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 0x7fc9bc06c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.889+0000 7fc9b3fff640 1 -- 172.21.15.37:0/2592742731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc1a1a50 con 0x7fc9bc103700 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9ba59c640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 0x7fc9bc06c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9bad9d640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc1a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9b3fff640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 0x7fc9bc19ed00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e9f0 tx=0x7fc9a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400cd80 con 0x7fc9bc103700 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a40054d0 con 0x7fc9bc103700 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4010690 con 0x7fc9bc103700 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc1a1d40 con 0x7fc9bc103700 2024-09-21T01:10:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.890+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc1a2170 con 0x7fc9bc103700 2024-09-21T01:10:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.892+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc109830 con 0x7fc9bc103700 2024-09-21T01:10:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.893+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc9a4004e50 con 0x7fc9bc103700 2024-09-21T01:10:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.894+0000 7fc9b37fe640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9a80b6590 0x7fc9a80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.894+0000 7fc9ba59c640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9a80b6590 0x7fc9a80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.894+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4566+0+0 (secure 0 0 0) 0x7fc9a40e6ae0 con 0x7fc9bc103700 2024-09-21T01:10:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.895+0000 7fc9ba59c640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9a80b6590 0x7fc9a80b8aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005d00 tx=0x7fc9ac005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:24.897+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9a4056710 con 0x7fc9bc103700 2024-09-21T01:10:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi144 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] boot 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi144 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:24.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:24.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:24.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: osd.5 [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] boot 2024-09-21T01:10:24.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T01:10:24.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:10:25.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:25.095+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc9bc063800 con 0x7fc9a80b6590 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:25.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:25 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:10:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:10:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T01:10:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:25 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:25.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:25.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:25 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:27.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:26 smithi037 ceph-mon[31105]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:10:27.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:26 smithi137 ceph-mon[34607]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:10:27.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:26 smithi144 ceph-mon[34818]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:10:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:27 smithi037 ceph-mon[31105]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:27 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/835626145' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d35918e8-efad-4939-a7c3-5fdf10f4a93b"} : dispatch 2024-09-21T01:10:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:27 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/835626145' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d35918e8-efad-4939-a7c3-5fdf10f4a93b"}]': finished 2024-09-21T01:10:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:27 smithi037 ceph-mon[31105]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T01:10:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:28.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:28 smithi137 ceph-mon[34607]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:28.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:28 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/835626145' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d35918e8-efad-4939-a7c3-5fdf10f4a93b"} : dispatch 2024-09-21T01:10:28.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:28 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/835626145' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d35918e8-efad-4939-a7c3-5fdf10f4a93b"}]': finished 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:28 smithi137 ceph-mon[34607]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:27 smithi144 ceph-mon[34818]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:27 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/835626145' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d35918e8-efad-4939-a7c3-5fdf10f4a93b"} : dispatch 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:27 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/835626145' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d35918e8-efad-4939-a7c3-5fdf10f4a93b"}]': finished 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:27 smithi144 ceph-mon[34818]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T01:10:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:29 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/167179520' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:29 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/167179520' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:29.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:29 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/167179520' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:30.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:30 smithi137 ceph-mon[34607]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T01:10:30.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:30 smithi144 ceph-mon[34818]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T01:10:30.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:30 smithi037 ceph-mon[31105]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T01:10:32.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:32 smithi037 ceph-mon[31105]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:10:32.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:32 smithi144 ceph-mon[34818]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:10:32.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:32 smithi137 ceph-mon[34607]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:10:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:34 smithi137 ceph-mon[34607]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T01:10:34.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:34 smithi144 ceph-mon[34818]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T01:10:34.458 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:34 smithi037 ceph-mon[31105]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T01:10:36.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:36 smithi037 ceph-mon[31105]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T01:10:36.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:10:36.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:36 smithi137 ceph-mon[34607]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T01:10:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:10:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:36 smithi144 ceph-mon[34818]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T01:10:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:10:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:37.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:37 smithi037 ceph-mon[31105]: Deploying daemon osd.6 on smithi037 2024-09-21T01:10:37.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:37 smithi137 ceph-mon[34607]: Deploying daemon osd.6 on smithi037 2024-09-21T01:10:37.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:37 smithi144 ceph-mon[34818]: Deploying daemon osd.6 on smithi037 2024-09-21T01:10:38.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:38 smithi037 ceph-mon[31105]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:10:38.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:38 smithi137 ceph-mon[34607]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:10:38.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:38 smithi144 ceph-mon[34818]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:10:40.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:40 smithi137 ceph-mon[34607]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:40.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:40 smithi144 ceph-mon[34818]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:40.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:40 smithi037 ceph-mon[31105]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:42.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:42 smithi037 ceph-mon[31105]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:42.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:42 smithi144 ceph-mon[34818]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:42.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:42 smithi137 ceph-mon[34607]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:43.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:43.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:43.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:43.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:43.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:43.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:43.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:43.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:43.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:44.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:44 smithi037 ceph-mon[31105]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:44 smithi137 ceph-mon[34607]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:44 smithi144 ceph-mon[34818]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:46.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:46 smithi037 ceph-mon[31105]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:46.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:46 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:46 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:46 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:46.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:46 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:46.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:46 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.476+0000 7fc9b37fe640 1 -- 172.21.15.37:0/2592742731 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9bc063800 con 0x7fc9a80b6590 2024-09-21T01:10:46.477 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9a80b6590 msgr2=0x7fc9a80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9a80b6590 0x7fc9a80b8aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005d00 tx=0x7fc9ac005c70 comp rx=0 tx=0).stop 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 msgr2=0x7fc9bc19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 0x7fc9bc19ed00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e9f0 tx=0x7fc9a400edf0 comp rx=0 tx=0).stop 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 shutdown_connections 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9a80b6590 0x7fc9a80b8aa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9bc1040a0 0x7fc9bc1a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9bc103700 0x7fc9bc19ed00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 --2- 172.21.15.37:0/2592742731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9bc102670 0x7fc9bc06c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 >> 172.21.15.37:0/2592742731 conn(0x7fc9bc0fdfe0 msgr2=0x7fc9bc106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 shutdown_connections 2024-09-21T01:10:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:10:46.478+0000 7fc9c0bcb640 1 -- 172.21.15.37:0/2592742731 wait complete. 2024-09-21T01:10:46.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:46 smithi137 ceph-mon[34607]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:46 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:46 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:46 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:46 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:46 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:46 smithi144 ceph-mon[34818]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:46 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:46 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:46.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:46 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:46.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:46 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:46.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:46 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:47.199 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T01:10:47.201 INFO:tasks.cephadm:Deploying osd.7 on smithi137 with /dev/vg_nvme/lv_2... 2024-09-21T01:10:47.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:10:47.456 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:10:47.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:47.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:47.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:47.578 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:47.578 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:47.578 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:47.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:10:47.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:47.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:48.373 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:10:48 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:10:48.043+0000 7f862a603640 -1 osd.6 0 log_to_monitors true 2024-09-21T01:10:48.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:48 smithi037 ceph-mon[31105]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:48.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:48 smithi037 ceph-mon[31105]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:10:48.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:48 smithi137 ceph-mon[34607]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:48.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:48 smithi137 ceph-mon[34607]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:10:48.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:48 smithi144 ceph-mon[34818]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:48.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:48 smithi144 ceph-mon[34818]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:10:49.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-mon[31105]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:10:49.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-mon[31105]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:10:49.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-mon[31105]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:10:49.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:49.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-mon[31105]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:10:49.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-mon[31105]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:10:49.757 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:49 smithi137 ceph-mon[34607]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:10:49.757 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:49 smithi137 ceph-mon[34607]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:10:49.757 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:49 smithi137 ceph-mon[34607]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:10:49.758 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:49 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:49.758 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:49 smithi137 ceph-mon[34607]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:10:49.758 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:49 smithi137 ceph-mon[34607]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:10:49.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:49 smithi144 ceph-mon[34818]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:10:49.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:49 smithi144 ceph-mon[34818]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:10:49.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:49 smithi144 ceph-mon[34818]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:10:49.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:49 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:49.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:49 smithi144 ceph-mon[34818]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:10:49.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:49 smithi144 ceph-mon[34818]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:10:50.130 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:10:49.985+0000 7f8626585640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T01:10:50.130 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:10:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:10:49.995+0000 7f861e37b640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:10:50.431 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:10:50.459 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi137:vg_nvme/lv_2 2024-09-21T01:10:50.714 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.835 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:50.835 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.835 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.836 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253]' entity='osd.6' 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:10:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 -- 172.21.15.137:0/2151771316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3108103780 msgr2=0x7f3108103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 --2- 172.21.15.137:0/2151771316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3108103780 0x7f3108103bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009900 tx=0x7f30fc02a480 comp rx=0 tx=0).stop 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 -- 172.21.15.137:0/2151771316 shutdown_connections 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 --2- 172.21.15.137:0/2151771316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31081051b0 0x7f310810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 --2- 172.21.15.137:0/2151771316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3108104810 0x7f3108104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 --2- 172.21.15.137:0/2151771316 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3108103780 0x7f3108103bf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 -- 172.21.15.137:0/2151771316 >> 172.21.15.137:0/2151771316 conn(0x7f31080ff0f0 msgr2=0x7f31081015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 -- 172.21.15.137:0/2151771316 shutdown_connections 2024-09-21T01:10:51.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 -- 172.21.15.137:0/2151771316 wait complete. 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 Processor -- start 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.193+0000 7f310ef25640 1 -- start start 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ef25640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103780 0x7f310819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ef25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3108104810 0x7f310819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ef25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 0x7f310819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ef25640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f310810f3c0 con 0x7f3108104810 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ef25640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f310810f240 con 0x7f31081051b0 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ef25640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f310810f540 con 0x7f3108103780 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 0x7f310819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 0x7f310819b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:37882/0 (socket says 172.21.15.137:37882) 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 -- 172.21.15.137:0/2586755976 learned_addr learned my addr 172.21.15.137:0/2586755976 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f3107fff640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3108104810 0x7f310819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310ccc1640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103780 0x7f310819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 -- 172.21.15.137:0/2586755976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103780 msgr2=0x7f310819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:51.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103780 0x7f310819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 -- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3108104810 msgr2=0x7f310819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:10:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3108104810 0x7f310819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:10:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 -- 172.21.15.137:0/2586755976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310819ba50 con 0x7f31081051b0 2024-09-21T01:10:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f310d4c2640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 0x7f310819b230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f310000cad0 tx=0x7f310000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.194+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310000ae20 con 0x7f31081051b0 2024-09-21T01:10:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.195+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3100005020 con 0x7f31081051b0 2024-09-21T01:10:51.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.195+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310819bd40 con 0x7f31081051b0 2024-09-21T01:10:51.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.195+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310000f6b0 con 0x7f31081051b0 2024-09-21T01:10:51.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.195+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31081a2440 con 0x7f31081051b0 2024-09-21T01:10:51.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.196+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310810a960 con 0x7f31081051b0 2024-09-21T01:10:51.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.198+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f31000051d0 con 0x7f31081051b0 2024-09-21T01:10:51.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.199+0000 7f3105ffb640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f30f80b6510 0x7f30f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:10:51.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.199+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4965+0+0 (secure 0 0 0) 0x7f31000e6600 con 0x7f31081051b0 2024-09-21T01:10:51.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.199+0000 7f310ccc1640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f30f80b6510 0x7f30f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:10:51.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.200+0000 7f310ccc1640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f30f80b6510 0x7f30f80b8a20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f30fc031440 tx=0x7f30fc009610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:10:51.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.208+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3100014030 con 0x7f31081051b0 2024-09-21T01:10:51.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:10:51.401+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3108063800 con 0x7f30f80b6510 2024-09-21T01:10:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:10:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:10:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi037 2024-09-21T01:10:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi037 to 5697M 2024-09-21T01:10:51.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] boot 2024-09-21T01:10:51.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T01:10:51.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:51.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:51.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:51.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:51 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:51.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:10:51.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:10:51.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi037 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi037 to 5697M 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] boot 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:51.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:51 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:51.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:10:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:10:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi037 2024-09-21T01:10:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi037 to 5697M 2024-09-21T01:10:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: osd.6 [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] boot 2024-09-21T01:10:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T01:10:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:10:51.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:10:51.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:10:51.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:51 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:10:52.738 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:52 smithi137 ceph-mon[34607]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:52.739 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:52 smithi137 ceph-mon[34607]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:52.739 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:52 smithi137 ceph-mon[34607]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:10:52.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:52 smithi144 ceph-mon[34818]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:52.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:52 smithi144 ceph-mon[34818]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:52.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:52 smithi144 ceph-mon[34818]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:10:52.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:52 smithi037 ceph-mon[31105]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:10:53.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:52 smithi037 ceph-mon[31105]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:10:53.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:52 smithi037 ceph-mon[31105]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/1999591896' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"} : dispatch 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"} : dispatch 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"}]': finished 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:10:54.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:54 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/666975234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:54.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:54.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/1999591896' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"} : dispatch 2024-09-21T01:10:54.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"} : dispatch 2024-09-21T01:10:54.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"}]': finished 2024-09-21T01:10:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:10:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:10:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/666975234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:54.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:54.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/1999591896' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"} : dispatch 2024-09-21T01:10:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"} : dispatch 2024-09-21T01:10:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28fefcbb-3ceb-434b-8919-9c47207921ff"}]': finished 2024-09-21T01:10:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:10:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:10:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:54 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/666975234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:10:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:56 smithi137 ceph-mon[34607]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:56.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:56 smithi144 ceph-mon[34818]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:56.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:56 smithi037 ceph-mon[31105]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:58.814 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:10:58 smithi137 ceph-mon[34607]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:58.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:10:58 smithi144 ceph-mon[34818]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:10:58.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:10:58 smithi037 ceph-mon[31105]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:00.734 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:00 smithi137 ceph-mon[34607]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:00.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:00 smithi144 ceph-mon[34818]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:00.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:00 smithi037 ceph-mon[31105]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:02 smithi137 ceph-mon[34607]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:02 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:11:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:02 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:02 smithi144 ceph-mon[34818]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:02 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:11:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:02 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:02 smithi037 ceph-mon[31105]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:02 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:11:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:02 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:03.780 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:03 smithi137 ceph-mon[34607]: Deploying daemon osd.7 on smithi137 2024-09-21T01:11:03.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:03 smithi144 ceph-mon[34818]: Deploying daemon osd.7 on smithi137 2024-09-21T01:11:03.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:03 smithi037 ceph-mon[31105]: Deploying daemon osd.7 on smithi137 2024-09-21T01:11:04.791 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:04 smithi137 ceph-mon[34607]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:04.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:04 smithi144 ceph-mon[34818]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:04.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:04 smithi037 ceph-mon[31105]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:06 smithi137 ceph-mon[34607]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:06.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:06 smithi144 ceph-mon[34818]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:06.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:06 smithi037 ceph-mon[31105]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:08.709 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:08 smithi137 ceph-mon[34607]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:08.710 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:08.710 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:08.710 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:08.802 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:08 smithi037 ceph-mon[31105]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:08.802 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:08.802 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:08.802 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:08.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:08 smithi144 ceph-mon[34818]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:08.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:10 smithi137 ceph-mon[34607]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:10 smithi144 ceph-mon[34818]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:10.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:10 smithi037 ceph-mon[31105]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:11.874 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:11.875 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:11.875 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:11.875 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:11.875 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:11.875 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:11 smithi137 ceph-mon[34607]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:11.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.923+0000 7f3105ffb640 1 -- 172.21.15.137:0/2586755976 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3108063800 con 0x7f30f80b6510 2024-09-21T01:11:11.924 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 7 on host 'smithi137' 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f30f80b6510 msgr2=0x7f30f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f30f80b6510 0x7f30f80b8a20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f30fc031440 tx=0x7f30fc009610 comp rx=0 tx=0).stop 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 msgr2=0x7f310819b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 0x7f310819b230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f310000cad0 tx=0x7f310000cf90 comp rx=0 tx=0).stop 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 shutdown_connections 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f30f80b6510 0x7f30f80b8a20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31081051b0 0x7f310819b230 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3108104810 0x7f310819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 --2- 172.21.15.137:0/2586755976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3108103780 0x7f310819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:11.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 >> 172.21.15.137:0/2586755976 conn(0x7f31080ff0f0 msgr2=0x7f3108107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:11.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 shutdown_connections 2024-09-21T01:11:11.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:11:11.927+0000 7f310ef25640 1 -- 172.21.15.137:0/2586755976 wait complete. 2024-09-21T01:11:12.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:12.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:12.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:11 smithi144 ceph-mon[34818]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:11 smithi037 ceph-mon[31105]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:12.521 DEBUG:teuthology.orchestra.run.smithi137:osd.7> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T01:11:12.523 INFO:tasks.cephadm:Deploying osd.8 on smithi144 with /dev/vg_nvme/lv_2... 2024-09-21T01:11:12.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:11:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:11:12.900 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:12.900 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:12.900 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:13.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:13.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:13.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:13.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:13.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:13.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:13.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:13 smithi137 ceph-mon[34607]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:13.920 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:11:13 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:11:13.828+0000 7fd240dd2640 -1 osd.7 0 log_to_monitors true 2024-09-21T01:11:14.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:13 smithi144 ceph-mon[34818]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:14.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:13 smithi037 ceph-mon[31105]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:15.040 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:14 smithi144 ceph-mon[34818]: from='osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:11:15.040 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:14 smithi144 ceph-mon[34818]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:11:15.135 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:14 smithi137 ceph-mon[34607]: from='osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:11:15.135 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:14 smithi137 ceph-mon[34607]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:11:15.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:14 smithi037 ceph-mon[31105]: from='osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:11:15.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:14 smithi037 ceph-mon[31105]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:11:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:11:15.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_2 2024-09-21T01:11:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:11:15.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:11:15.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:11:15.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:11:15.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:15.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:11:15.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi137 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi137 to 5696M 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:15.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 -- 172.21.15.144:0/623142324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 msgr2=0x7f5184102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 --2- 172.21.15.144:0/623142324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f5184102270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f518000aa10 tx=0x7f518002b7b0 comp rx=0 tx=0).stop 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 -- 172.21.15.144:0/623142324 shutdown_connections 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 --2- 172.21.15.144:0/623142324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184103830 0x7f518410a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 --2- 172.21.15.144:0/623142324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5184102e90 0x7f51841032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 --2- 172.21.15.144:0/623142324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f5184102270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 -- 172.21.15.144:0/623142324 >> 172.21.15.144:0/623142324 conn(0x7f51840fd770 msgr2=0x7f51840ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 -- 172.21.15.144:0/623142324 shutdown_connections 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.050+0000 7f518af38640 1 -- 172.21.15.144:0/623142324 wait complete. 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 Processor -- start 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 -- start start 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f518419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5184102e90 0x7f518419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:16.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184103830 0x7f518419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f518410d1d0 con 0x7f5184103830 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f518410d050 con 0x7f5184102e90 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f518af38640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f518410d350 con 0x7f5184101e00 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f5188cd4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f518419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f5188cd4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f518419a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60866/0 (socket says 172.21.15.144:60866) 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.051+0000 7f5188cd4640 1 -- 172.21.15.144:0/4221415679 learned_addr learned my addr 172.21.15.144:0/4221415679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f517bfff640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5184102e90 0x7f518419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f51894d5640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184103830 0x7f518419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5188cd4640 1 -- 172.21.15.144:0/4221415679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5184102e90 msgr2=0x7f518419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5188cd4640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5184102e90 0x7f518419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5188cd4640 1 -- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184103830 msgr2=0x7f518419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5188cd4640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184103830 0x7f518419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5188cd4640 1 -- 172.21.15.144:0/4221415679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518419b9e0 con 0x7f5184101e00 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5188cd4640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f518419a040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f518002c010 tx=0x7f5180004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:16.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518003f070 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180032400 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180036040 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518419bc70 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.052+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841a2290 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.054+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5184102270 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.055+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5180042070 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.056+0000 7f5179ffb640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f516c0b6510 0x7f516c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.056+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f51801070c0 con 0x7f5184101e00 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.056+0000 7f517bfff640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f516c0b6510 0x7f516c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.057+0000 7f517bfff640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f516c0b6510 0x7f516c0b8a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5174009bd0 tx=0x7f5174005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.060+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51800ce530 con 0x7f5184101e00 2024-09-21T01:11:16.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:11:15.801+0000 7fd23cd54640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T01:11:16.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:11:15.809+0000 7fd238b52640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi137 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi137 to 5696M 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:16.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi137 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi137 to 5696M 2024-09-21T01:11:16.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:16.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:16.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:16.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:16.271+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5184109ae0 con 0x7f516c0b6510 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:11:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:11:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:11:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:11:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:11:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:17.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:11:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:18.021 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:17 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:11:18.112 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:17 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:11:18.112 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:17 smithi144 ceph-mon[34818]: osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] boot 2024-09-21T01:11:18.112 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:17 smithi144 ceph-mon[34818]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:11:18.112 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:18.112 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:17 smithi144 ceph-mon[34818]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:18.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:17 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:11:18.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:17 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:11:18.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:17 smithi137 ceph-mon[34607]: osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] boot 2024-09-21T01:11:18.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:17 smithi137 ceph-mon[34607]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:11:18.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:18.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:17 smithi137 ceph-mon[34607]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:18.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:17 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:11:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:17 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:11:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:17 smithi037 ceph-mon[31105]: osd.7 [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] boot 2024-09-21T01:11:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:17 smithi037 ceph-mon[31105]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:11:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:11:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:17 smithi037 ceph-mon[31105]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:11:19.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:18 smithi144 ceph-mon[34818]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:11:19.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:18 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/959753448' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"} : dispatch 2024-09-21T01:11:19.101 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:18 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"} : dispatch 2024-09-21T01:11:19.102 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:18 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"}]': finished 2024-09-21T01:11:19.102 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:18 smithi144 ceph-mon[34818]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T01:11:19.102 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:18 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:18 smithi137 ceph-mon[34607]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:11:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:18 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/959753448' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"} : dispatch 2024-09-21T01:11:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:18 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"} : dispatch 2024-09-21T01:11:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:18 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"}]': finished 2024-09-21T01:11:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:18 smithi137 ceph-mon[34607]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T01:11:19.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:18 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:19.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:18 smithi037 ceph-mon[31105]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:11:19.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:18 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/959753448' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"} : dispatch 2024-09-21T01:11:19.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:18 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"} : dispatch 2024-09-21T01:11:19.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:18 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2931d04-84ea-4aa9-811f-b8dcee437c33"}]': finished 2024-09-21T01:11:19.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:18 smithi037 ceph-mon[31105]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T01:11:19.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:18 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:19 smithi037 ceph-mon[31105]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/3319516446' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:20.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:19 smithi144 ceph-mon[34818]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:20.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/3319516446' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:20.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:19 smithi137 ceph-mon[34607]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:20.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/3319516446' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:22.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:21 smithi137 ceph-mon[34607]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:22.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:21 smithi144 ceph-mon[34818]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:22.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:21 smithi037 ceph-mon[31105]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:23.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:23 smithi144 ceph-mon[34818]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:11:24.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:23 smithi137 ceph-mon[34607]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:11:24.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:23 smithi037 ceph-mon[31105]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:11:25.979 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:25 smithi144 ceph-mon[34818]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:11:26.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:25 smithi137 ceph-mon[34607]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:11:26.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:25 smithi037 ceph-mon[31105]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:11:27.990 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:27 smithi144 ceph-mon[34818]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:11:27.990 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:11:27.990 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:27.990 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:27 smithi144 ceph-mon[34818]: Deploying daemon osd.8 on smithi144 2024-09-21T01:11:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:27 smithi137 ceph-mon[34607]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:11:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:11:28.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:28.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:27 smithi137 ceph-mon[34607]: Deploying daemon osd.8 on smithi144 2024-09-21T01:11:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:27 smithi037 ceph-mon[31105]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:11:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:11:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:28.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:27 smithi037 ceph-mon[31105]: Deploying daemon osd.8 on smithi144 2024-09-21T01:11:30.067 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:29 smithi144 ceph-mon[34818]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:11:30.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:29 smithi137 ceph-mon[34607]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:11:30.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:29 smithi037 ceph-mon[31105]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:11:32.152 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:31 smithi144 ceph-mon[34818]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:32.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:31 smithi137 ceph-mon[34607]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:32.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:31 smithi037 ceph-mon[31105]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:34.143 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:33 smithi144 ceph-mon[34818]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:34.143 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:34.143 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:34.143 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:34.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:33 smithi137 ceph-mon[34607]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:34.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:34.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:34.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:34.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:33 smithi037 ceph-mon[31105]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:34.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:34.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:34.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:36.147 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:35 smithi144 ceph-mon[34818]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:36.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:35 smithi137 ceph-mon[34607]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:36.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:35 smithi037 ceph-mon[31105]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:37.383 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 8 on host 'smithi144' 2024-09-21T01:11:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.383+0000 7f5179ffb640 1 -- 172.21.15.144:0/4221415679 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5184109ae0 con 0x7f516c0b6510 2024-09-21T01:11:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f516c0b6510 msgr2=0x7f516c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f516c0b6510 0x7f516c0b8a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5174009bd0 tx=0x7f5174005f90 comp rx=0 tx=0).stop 2024-09-21T01:11:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 msgr2=0x7f518419a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f518419a040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f518002c010 tx=0x7f5180004430 comp rx=0 tx=0).stop 2024-09-21T01:11:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 shutdown_connections 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f516c0b6510 0x7f516c0b8a20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184103830 0x7f518419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5184102e90 0x7f518419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 --2- 172.21.15.144:0/4221415679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5184101e00 0x7f518419a040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 >> 172.21.15.144:0/4221415679 conn(0x7f51840fd770 msgr2=0x7f51841083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 shutdown_connections 2024-09-21T01:11:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:11:37.386+0000 7f518af38640 1 -- 172.21.15.144:0/4221415679 wait complete. 2024-09-21T01:11:37.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:37.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:37.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:38.007 DEBUG:teuthology.orchestra.run.smithi144:osd.8> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T01:11:38.009 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-09-21T01:11:38.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:11:38.281 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:38.559 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:38 smithi144 ceph-mon[34818]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:38.559 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:38.559 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:38.559 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:38.623 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:38 smithi037 ceph-mon[31105]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:38.623 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:38.623 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:38.624 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:38 smithi137 ceph-mon[34607]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:11:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:39.920 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:11:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:11:39.546+0000 7f61fd43e640 -1 osd.8 0 log_to_monitors true 2024-09-21T01:11:40.520 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:40 smithi144 ceph-mon[34818]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:40.520 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:40 smithi144 ceph-mon[34818]: from='osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:11:40.520 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:40 smithi144 ceph-mon[34818]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:11:40.619 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:40 smithi037 ceph-mon[31105]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:40.619 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:40 smithi037 ceph-mon[31105]: from='osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:11:40.619 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:40 smithi037 ceph-mon[31105]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:11:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:40 smithi137 ceph-mon[34607]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:40 smithi137 ceph-mon[34607]: from='osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:11:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:40 smithi137 ceph-mon[34607]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:11:40.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:11:41.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-09-21T01:11:41.271 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:11:41.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:41.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:41.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:11:41.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:41.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:11:41.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:11:41.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 -- 172.21.15.37:0/2521060462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b006b920 msgr2=0x7fa3b01063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:41.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 --2- 172.21.15.37:0/2521060462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b006b920 0x7fa3b01063f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009900 tx=0x7fa3a802a410 comp rx=0 tx=0).stop 2024-09-21T01:11:41.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 -- 172.21.15.37:0/2521060462 shutdown_connections 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 --2- 172.21.15.37:0/2521060462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3b0109470 0x7fa3b010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 --2- 172.21.15.37:0/2521060462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b0106930 0x7fa3b0108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 --2- 172.21.15.37:0/2521060462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b006b920 0x7fa3b01063f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 -- 172.21.15.37:0/2521060462 >> 172.21.15.37:0/2521060462 conn(0x7fa3b00fdfb0 msgr2=0x7fa3b0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 -- 172.21.15.37:0/2521060462 shutdown_connections 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.794+0000 7fa3b7811640 1 -- 172.21.15.37:0/2521060462 wait complete. 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 Processor -- start 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 -- start start 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b006b920 0x7fa3b0199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 0x7fa3b019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3b0109470 0x7fa3b019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010f350 con 0x7fa3b0106930 2024-09-21T01:11:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010f1d0 con 0x7fa3b0109470 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b7811640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010f4d0 con 0x7fa3b006b920 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b4dac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 0x7fa3b019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b55ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b006b920 0x7fa3b0199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b4dac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 0x7fa3b019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51516/0 (socket says 172.21.15.37:51516) 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b4dac640 1 -- 172.21.15.37:0/180806994 learned_addr learned my addr 172.21.15.37:0/180806994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.795+0000 7fa3b5dae640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3b0109470 0x7fa3b019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b4dac640 1 -- 172.21.15.37:0/180806994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b006b920 msgr2=0x7fa3b0199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b4dac640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b006b920 0x7fa3b0199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b4dac640 1 -- 172.21.15.37:0/180806994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3b0109470 msgr2=0x7fa3b019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b4dac640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3b0109470 0x7fa3b019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b4dac640 1 -- 172.21.15.37:0/180806994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b019b9d0 con 0x7fa3b0106930 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b4dac640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 0x7fa3b019a610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d950 tx=0x7fa3a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4017030 con 0x7fa3b0106930 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3a4004020 con 0x7fa3b0106930 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b019bcc0 con 0x7fa3b0106930 2024-09-21T01:11:41.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40047a0 con 0x7fa3b0106930 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.796+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a23c0 con 0x7fa3b0106930 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.797+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b00ffad0 con 0x7fa3b0106930 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.799+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa3a4009a30 con 0x7fa3b0106930 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.799+0000 7fa3ae7fc640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa3980b6510 0x7fa3980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.800+0000 7fa3b55ad640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa3980b6510 0x7fa3980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.800+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7fa3a40e6280 con 0x7fa3b0106930 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.800+0000 7fa3b55ad640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa3980b6510 0x7fa3980b8a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8000c00 tx=0x7fa3a8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:11:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:41.804+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3a40ad5e0 con 0x7fa3b0106930 2024-09-21T01:11:42.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:11:42.003+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa3b0063800 con 0x7fa3980b6510 2024-09-21T01:11:42.170 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:11:41.800+0000 7f61f93c0640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T01:11:42.170 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:11:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:11:41.813+0000 7f61f11b6640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:11:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi144 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='osd.8 ' entity='osd.8' 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:42 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:42.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi144 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='osd.8 ' entity='osd.8' 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:11:42.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:42 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi144 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='osd.8 ' entity='osd.8' 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:11:42.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:11:42.695 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:42 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:43.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:11:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:11:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] boot 2024-09-21T01:11:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T01:11:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:11:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:11:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] boot 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:11:43.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: osd.8 [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] boot 2024-09-21T01:11:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T01:11:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:11:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:44 smithi137 ceph-mon[34607]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:44 smithi137 ceph-mon[34607]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:11:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:44 smithi144 ceph-mon[34818]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:44 smithi144 ceph-mon[34818]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:11:44.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:44 smithi037 ceph-mon[31105]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:11:44.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:44 smithi037 ceph-mon[31105]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:11:45.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:45 smithi137 ceph-mon[34607]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:11:45.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:45 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1716397262' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "01ba8830-71d3-4ca1-9c59-caf80641e235"} : dispatch 2024-09-21T01:11:45.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:45 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1716397262' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01ba8830-71d3-4ca1-9c59-caf80641e235"}]': finished 2024-09-21T01:11:45.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:45 smithi137 ceph-mon[34607]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:45 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3279629579' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:45 smithi144 ceph-mon[34818]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:45 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1716397262' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "01ba8830-71d3-4ca1-9c59-caf80641e235"} : dispatch 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:45 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1716397262' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01ba8830-71d3-4ca1-9c59-caf80641e235"}]': finished 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:45 smithi144 ceph-mon[34818]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:11:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:45 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3279629579' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:45.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:45 smithi037 ceph-mon[31105]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:11:45.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:45 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1716397262' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "01ba8830-71d3-4ca1-9c59-caf80641e235"} : dispatch 2024-09-21T01:11:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:45 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1716397262' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01ba8830-71d3-4ca1-9c59-caf80641e235"}]': finished 2024-09-21T01:11:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:45 smithi037 ceph-mon[31105]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T01:11:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:11:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:45 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3279629579' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:11:46.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:46 smithi137 ceph-mon[34607]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:11:46.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:46 smithi144 ceph-mon[34818]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:11:46.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:46 smithi037 ceph-mon[31105]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:11:48.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:48 smithi137 ceph-mon[34607]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:11:48.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:48 smithi144 ceph-mon[34818]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:11:48.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:48 smithi037 ceph-mon[31105]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:11:50.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:50 smithi137 ceph-mon[34607]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:11:50.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:50 smithi144 ceph-mon[34818]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:11:50.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:50 smithi037 ceph-mon[31105]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:11:52.634 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:52 smithi037 ceph-mon[31105]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T01:11:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:52 smithi137 ceph-mon[34607]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T01:11:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:52 smithi144 ceph-mon[34818]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T01:11:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:54 smithi137 ceph-mon[34607]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T01:11:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:11:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:54 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:54 smithi144 ceph-mon[34818]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T01:11:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:11:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:54 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:54.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:54 smithi037 ceph-mon[31105]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T01:11:54.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:11:54.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:54 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:11:55.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:55 smithi137 ceph-mon[34607]: Deploying daemon osd.9 on smithi037 2024-09-21T01:11:55.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:55 smithi144 ceph-mon[34818]: Deploying daemon osd.9 on smithi037 2024-09-21T01:11:55.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:55 smithi037 ceph-mon[31105]: Deploying daemon osd.9 on smithi037 2024-09-21T01:11:56.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:56 smithi137 ceph-mon[34607]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:11:56.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:56 smithi144 ceph-mon[34818]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:11:56.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:56 smithi037 ceph-mon[31105]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:11:58.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:11:58 smithi137 ceph-mon[34607]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:11:58 smithi144 ceph-mon[34818]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:11:58.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:11:58 smithi037 ceph-mon[31105]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:00.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:00 smithi037 ceph-mon[31105]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:00 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:00 smithi137 ceph-mon[34607]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:00 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:00 smithi144 ceph-mon[34818]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:00 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:02.723 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:02 smithi144 ceph-mon[34818]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:02.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:02 smithi037 ceph-mon[31105]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:02 smithi137 ceph-mon[34607]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.231+0000 7fa3ae7fc640 1 -- 172.21.15.37:0/180806994 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa3b0063800 con 0x7fa3980b6510 2024-09-21T01:12:03.233 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-09-21T01:12:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.234+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa3980b6510 msgr2=0x7fa3980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.234+0000 7fa3b7811640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa3980b6510 0x7fa3980b8a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8000c00 tx=0x7fa3a8031400 comp rx=0 tx=0).stop 2024-09-21T01:12:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 msgr2=0x7fa3b019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 0x7fa3b019a610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d950 tx=0x7fa3a400de10 comp rx=0 tx=0).stop 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 shutdown_connections 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa3980b6510 0x7fa3980b8a20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3b0109470 0x7fa3b019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3b0106930 0x7fa3b019a610 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 --2- 172.21.15.37:0/180806994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b006b920 0x7fa3b0199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 >> 172.21.15.37:0/180806994 conn(0x7fa3b00fdfb0 msgr2=0x7fa3b0104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 shutdown_connections 2024-09-21T01:12:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:03.235+0000 7fa3b7811640 1 -- 172.21.15.37:0/180806994 wait complete. 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:03 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.888 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T01:12:03.890 INFO:tasks.cephadm:Deploying osd.10 on smithi137 with /dev/vg_nvme/lv_1... 2024-09-21T01:12:03.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.918 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:03 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:03 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:12:04.908 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:04 smithi037 ceph-mon[31105]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:04 smithi137 ceph-mon[34607]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:04.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:04 smithi144 ceph-mon[34818]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:05.500 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:12:05 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:12:05.454+0000 7fb9a5478640 -1 osd.9 0 log_to_monitors true 2024-09-21T01:12:05.909 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:05 smithi137 ceph-mon[34607]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:12:05.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:05 smithi144 ceph-mon[34818]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:12:05.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:05 smithi037 ceph-mon[31105]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:12:06.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:06 smithi037 ceph-mon[31105]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:06.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:06 smithi037 ceph-mon[31105]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:12:06.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:06 smithi037 ceph-mon[31105]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:12:06.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:06 smithi037 ceph-mon[31105]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:12:06.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:06 smithi137 ceph-mon[34607]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:06 smithi137 ceph-mon[34607]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:12:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:06 smithi137 ceph-mon[34607]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:12:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:06 smithi137 ceph-mon[34607]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:12:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:06.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-21T01:12:06.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi137:vg_nvme/lv_1 2024-09-21T01:12:06.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:06 smithi144 ceph-mon[34818]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:06.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:06 smithi144 ceph-mon[34818]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:12:06.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:06 smithi144 ceph-mon[34818]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:12:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:06 smithi144 ceph-mon[34818]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-09-21T01:12:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:07.023 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:12:07.499 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:12:07.027+0000 7fb9a13fa640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T01:12:07.499 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:12:07.039+0000 7fb9991f0640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 -- 172.21.15.137:0/4271858045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 msgr2=0x7f6d90103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 --2- 172.21.15.137:0/4271858045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d90103ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009900 tx=0x7f6d7802a480 comp rx=0 tx=0).stop 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 -- 172.21.15.137:0/4271858045 shutdown_connections 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 --2- 172.21.15.137:0/4271858045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90104070 0x7f6d9010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 --2- 172.21.15.137:0/4271858045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d90103ae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 --2- 172.21.15.137:0/4271858045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d90102640 0x7f6d90102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 -- 172.21.15.137:0/4271858045 >> 172.21.15.137:0/4271858045 conn(0x7f6d900fdfb0 msgr2=0x7f6d90100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 -- 172.21.15.137:0/4271858045 shutdown_connections 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.504+0000 7f6d952cb640 1 -- 172.21.15.137:0/4271858045 wait complete. 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.505+0000 7f6d952cb640 1 Processor -- start 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.505+0000 7f6d952cb640 1 -- start start 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.505+0000 7f6d952cb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90102640 0x7f6d90198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.505+0000 7f6d952cb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d901994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.505+0000 7f6d952cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d90104070 0x7f6d9019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d952cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9010e290 con 0x7f6d90104070 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d952cb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9010e110 con 0x7f6d901036d0 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d952cb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9010e410 con 0x7f6d90102640 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d901994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d901994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36860/0 (socket says 172.21.15.137:36860) 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 -- 172.21.15.137:0/851275160 learned_addr learned my addr 172.21.15.137:0/851275160 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d8f7fe640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d90104070 0x7f6d9019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d8effd640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90102640 0x7f6d90198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 -- 172.21.15.137:0/851275160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90102640 msgr2=0x7f6d90198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90102640 0x7f6d90198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 -- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d90104070 msgr2=0x7f6d9019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d90104070 0x7f6d9019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 -- 172.21.15.137:0/851275160 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9019a8b0 con 0x7f6d901036d0 2024-09-21T01:12:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d8effd640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90102640 0x7f6d90198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d867fc640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d901994f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d78006010 tx=0x7f6d78031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7803f030 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d78003aa0 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9019ab40 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78035070 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.506+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9006ae60 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.507+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9006b8e0 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.509+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6d78042030 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.510+0000 7f6d8cff9640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d7c0b6510 0x7f6d7c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.510+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5981+0+0 (secure 0 0 0) 0x7f6d78107690 con 0x7f6d901036d0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.510+0000 7f6d8effd640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d7c0b6510 0x7f6d7c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.510+0000 7f6d8effd640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d7c0b6510 0x7f6d7c0b8a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009b50 tx=0x7f6d80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.513+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d780ce840 con 0x7f6d901036d0 2024-09-21T01:12:07.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:12:07.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:12:07.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:07 smithi137 ceph-mon[34607]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' 2024-09-21T01:12:07.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:07.704+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6d90109380 con 0x7f6d7c0b6510 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:07 smithi144 ceph-mon[34818]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:08.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:08.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:08.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:07 smithi037 ceph-mon[31105]: from='osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573]' entity='osd.9' 2024-09-21T01:12:08.761 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:12:08.761 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:12:08.761 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi037 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] boot 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T01:12:08.762 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:08.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi037 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] boot 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T01:12:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:08.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:12:08.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi037 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: osd.9 [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] boot 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T01:12:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:12:09.623 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:09 smithi137 ceph-mon[34607]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:09.623 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:09 smithi137 ceph-mon[34607]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:12:09.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:09 smithi144 ceph-mon[34818]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:09.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:09 smithi144 ceph-mon[34818]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:12:09.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:09 smithi037 ceph-mon[31105]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:09.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:09 smithi037 ceph-mon[31105]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:12:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:10 smithi137 ceph-mon[34607]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:10 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/3550940043' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"} : dispatch 2024-09-21T01:12:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:10 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"} : dispatch 2024-09-21T01:12:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:10 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"}]': finished 2024-09-21T01:12:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:10 smithi137 ceph-mon[34607]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T01:12:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:10.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:10 smithi144 ceph-mon[34818]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:10 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/3550940043' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"} : dispatch 2024-09-21T01:12:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:10 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"} : dispatch 2024-09-21T01:12:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:10 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"}]': finished 2024-09-21T01:12:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:10 smithi144 ceph-mon[34818]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T01:12:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:10.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:10 smithi037 ceph-mon[31105]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:10.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:10 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/3550940043' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"} : dispatch 2024-09-21T01:12:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:10 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"} : dispatch 2024-09-21T01:12:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:10 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75ec1bb2-7dfc-404e-857e-214123b35827"}]': finished 2024-09-21T01:12:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:10 smithi037 ceph-mon[31105]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T01:12:11.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:11.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:11 smithi137 ceph-mon[34607]: from='client.? 172.21.15.137:0/1530290082' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:12:11.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:11 smithi144 ceph-mon[34818]: from='client.? 172.21.15.137:0/1530290082' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:12:11.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:11 smithi037 ceph-mon[31105]: from='client.? 172.21.15.137:0/1530290082' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:12:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:12 smithi137 ceph-mon[34607]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:12.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:12 smithi144 ceph-mon[34818]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:12.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:12 smithi037 ceph-mon[31105]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:14.864 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:14 smithi137 ceph-mon[34607]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:14.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:14 smithi144 ceph-mon[34818]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:14.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:14 smithi037 ceph-mon[31105]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:16.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:16 smithi137 ceph-mon[34607]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:16.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:16 smithi144 ceph-mon[34818]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:16.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:16 smithi037 ceph-mon[31105]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:18 smithi137 ceph-mon[34607]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:18.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:18 smithi144 ceph-mon[34818]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:18.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:18 smithi037 ceph-mon[31105]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:12:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:19 smithi137 ceph-mon[34607]: Deploying daemon osd.10 on smithi137 2024-09-21T01:12:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:12:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:19.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:19 smithi144 ceph-mon[34818]: Deploying daemon osd.10 on smithi137 2024-09-21T01:12:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:12:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:19 smithi037 ceph-mon[31105]: Deploying daemon osd.10 on smithi137 2024-09-21T01:12:20.665 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:20 smithi137 ceph-mon[34607]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:20.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:20 smithi037 ceph-mon[31105]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:20.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:20 smithi144 ceph-mon[34818]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:22.674 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:22 smithi137 ceph-mon[34607]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:22.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:22 smithi144 ceph-mon[34818]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:22.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:22 smithi037 ceph-mon[31105]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:24 smithi137 ceph-mon[34607]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:24.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:24 smithi144 ceph-mon[34818]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:24.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:24.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:24.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:24.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:24 smithi037 ceph-mon[31105]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:24.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:25.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:25.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:26.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:26 smithi137 ceph-mon[34607]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:26.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:26 smithi144 ceph-mon[34818]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:26.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:26 smithi037 ceph-mon[31105]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:27.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:27 smithi144 ceph-mon[34818]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:27 smithi137 ceph-mon[34607]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:27.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:27 smithi037 ceph-mon[31105]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:28.009 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 10 on host 'smithi137' 2024-09-21T01:12:28.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.008+0000 7f6d8cff9640 1 -- 172.21.15.137:0/851275160 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6d90109380 con 0x7f6d7c0b6510 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d7c0b6510 msgr2=0x7f6d7c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d7c0b6510 0x7f6d7c0b8a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009b50 tx=0x7f6d80005f90 comp rx=0 tx=0).stop 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 msgr2=0x7f6d901994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d901994f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d78006010 tx=0x7f6d78031a50 comp rx=0 tx=0).stop 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 shutdown_connections 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d7c0b6510 0x7f6d7c0b8a20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d90104070 0x7f6d9019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d901036d0 0x7f6d901994f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 --2- 172.21.15.137:0/851275160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d90102640 0x7f6d90198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:28.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 >> 172.21.15.137:0/851275160 conn(0x7f6d900fdfb0 msgr2=0x7f6d901069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:28.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 shutdown_connections 2024-09-21T01:12:28.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-21T01:12:28.011+0000 7f6d952cb640 1 -- 172.21.15.137:0/851275160 wait complete. 2024-09-21T01:12:28.718 DEBUG:teuthology.orchestra.run.smithi137:osd.10> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T01:12:28.722 INFO:tasks.cephadm:Deploying osd.11 on smithi144 with /dev/vg_nvme/lv_1... 2024-09-21T01:12:28.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:12:28.981 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:12:29.315 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.315 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.315 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.315 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.342 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.342 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.343 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.343 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:29.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:30.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:30 smithi144 ceph-mon[34818]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:30.342 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:30 smithi137 ceph-mon[34607]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:30.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:30 smithi037 ceph-mon[31105]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:30.602 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:12:30 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:12:30.399+0000 7fb506f25640 -1 osd.10 0 log_to_monitors true 2024-09-21T01:12:31.391 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:31 smithi144 ceph-mon[34818]: from='osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:12:31.391 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:31 smithi144 ceph-mon[34818]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:12:31.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:31 smithi137 ceph-mon[34607]: from='osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:12:31.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:31 smithi137 ceph-mon[34607]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:12:31.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:31 smithi037 ceph-mon[31105]: from='osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:12:31.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:31 smithi037 ceph-mon[31105]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:12:31.721 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T01:12:31.748 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_1 2024-09-21T01:12:32.014 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:12:32.170 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:12:32.024+0000 7fb502ea7640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T01:12:32.170 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:12:32.041+0000 7fb4feca5640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:32.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.276 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:32.276 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:12:32.276 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:12:32.276 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:12:32.276 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:32.276 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:32.277 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]} : dispatch 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:32.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 -- 172.21.15.144:0/3586307862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58103750 msgr2=0x7f9b58103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3586307862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58103750 0x7f9b58103bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009900 tx=0x7f9b5402a480 comp rx=0 tx=0).stop 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 -- 172.21.15.144:0/3586307862 shutdown_connections 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3586307862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b58105180 0x7f9b5810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3586307862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 0x7f9b58104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3586307862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58103750 0x7f9b58103bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 -- 172.21.15.144:0/3586307862 >> 172.21.15.144:0/3586307862 conn(0x7f9b580ff0c0 msgr2=0x7f9b58101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 -- 172.21.15.144:0/3586307862 shutdown_connections 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 -- 172.21.15.144:0/3586307862 wait complete. 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 Processor -- start 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.491+0000 7f9b5f735640 1 -- start start 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b58103750 0x7f9b5819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 0x7f9b5819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 0x7f9b5819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5810f390 con 0x7f9b58103750 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5810f210 con 0x7f9b581047e0 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5810f510 con 0x7f9b58105180 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 0x7f9b5819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 0x7f9b5819d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55720/0 (socket says 172.21.15.144:55720) 2024-09-21T01:12:32.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 -- 172.21.15.144:0/3247528246 learned_addr learned my addr 172.21.15.144:0/3247528246 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5d4d1640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b58103750 0x7f9b5819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5ccd0640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 0x7f9b5819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 -- 172.21.15.144:0/3247528246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 msgr2=0x7f9b5819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 0x7f9b5819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 -- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b58103750 msgr2=0x7f9b5819c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b58103750 0x7f9b5819c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 -- 172.21.15.144:0/3247528246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5819dc20 con 0x7f9b58105180 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5ccd0640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 0x7f9b5819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5dcd2640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 0x7f9b5819d400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000eaa0 tx=0x7f9b5000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000cdb0 con 0x7f9b58105180 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5819df10 con 0x7f9b58105180 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b50005020 con 0x7f9b58105180 2024-09-21T01:12:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.492+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500116d0 con 0x7f9b58105180 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.493+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b581a4610 con 0x7f9b58105180 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.493+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b581a47e0 con 0x7f9b58105180 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.496+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9b500051d0 con 0x7f9b58105180 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.497+0000 7f9b4e7fc640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9b440b6510 0x7f9b440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.497+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6414+0+0 (secure 0 0 0) 0x7f9b500e71a0 con 0x7f9b58105180 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.497+0000 7f9b5d4d1640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9b440b6510 0x7f9b440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.498+0000 7f9b5d4d1640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9b440b6510 0x7f9b440b8a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b54000c00 tx=0x7f9b54031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:32.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.500+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b50016030 con 0x7f9b58105180 2024-09-21T01:12:32.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:32.688+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9b58076d10 con 0x7f9b440b6510 2024-09-21T01:12:33.285 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi137 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi137 to 4272M 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:12:33.286 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:12:33.287 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi137 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi137 to 4272M 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:12:33.309 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:33.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi137 2024-09-21T01:12:33.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi137 to 4272M 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:12:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:34.408 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:12:34.408 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:12:34.408 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:34.408 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:34.408 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] boot 2024-09-21T01:12:34.409 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T01:12:34.409 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:34.409 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:34 smithi144 ceph-mon[34818]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] boot 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:34.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:34 smithi137 ceph-mon[34607]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:12:34.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:12:34.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:12:34.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:12:34.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:12:34.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: osd.10 [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] boot 2024-09-21T01:12:34.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T01:12:34.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:12:34.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:34 smithi037 ceph-mon[31105]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:12:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T01:12:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/3458732688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"} : dispatch 2024-09-21T01:12:36.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"} : dispatch 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"}]': finished 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:36 smithi137 ceph-mon[34607]: from='client.? 172.21.15.144:0/2536913867' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/3458732688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"} : dispatch 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"} : dispatch 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"}]': finished 2024-09-21T01:12:36.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:12:36.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:36.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:36 smithi144 ceph-mon[34818]: from='client.? 172.21.15.144:0/2536913867' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:12:36.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/3458732688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"} : dispatch 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"} : dispatch 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b9554ef-fc14-4188-8222-c391333fbf97"}]': finished 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:36.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:36 smithi037 ceph-mon[31105]: from='client.? 172.21.15.144:0/2536913867' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:12:38.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:38 smithi037 ceph-mon[31105]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:38.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:38 smithi137 ceph-mon[34607]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:38.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:38 smithi144 ceph-mon[34818]: pgmap v245: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:40.358 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:40 smithi144 ceph-mon[34818]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T01:12:40.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:40 smithi137 ceph-mon[34607]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T01:12:40.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:40 smithi037 ceph-mon[31105]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T01:12:42.140 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:42 smithi144 ceph-mon[34818]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T01:12:42.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:42 smithi137 ceph-mon[34607]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T01:12:42.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:42 smithi037 ceph-mon[31105]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-21T01:12:44.291 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:44 smithi144 ceph-mon[34818]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:12:44.291 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:44 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:12:44.291 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:44 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:44.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:44 smithi137 ceph-mon[34607]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:12:44.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:44 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:12:44.312 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:44 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:44.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:44 smithi037 ceph-mon[31105]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:12:44.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:44 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:12:44.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:44 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:45.387 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:45 smithi144 ceph-mon[34818]: Deploying daemon osd.11 on smithi144 2024-09-21T01:12:45.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:45 smithi137 ceph-mon[34607]: Deploying daemon osd.11 on smithi144 2024-09-21T01:12:45.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:45 smithi037 ceph-mon[31105]: Deploying daemon osd.11 on smithi144 2024-09-21T01:12:46.415 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:46 smithi144 ceph-mon[34818]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T01:12:46.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:46 smithi137 ceph-mon[34607]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T01:12:46.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:46 smithi037 ceph-mon[31105]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T01:12:48.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:48 smithi137 ceph-mon[34607]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:12:48.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:48 smithi144 ceph-mon[34818]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:12:48.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:48 smithi037 ceph-mon[31105]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:12:50.324 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:50 smithi144 ceph-mon[34818]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:50.324 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:50.324 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:50.325 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:50 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:50.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:50 smithi137 ceph-mon[34607]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:50.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:50.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:50.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:50 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:50.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:50 smithi037 ceph-mon[31105]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:12:50.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:50.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:50.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:50 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:52.333 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:52 smithi144 ceph-mon[34818]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:52.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:52 smithi137 ceph-mon[34607]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:52.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:52 smithi037 ceph-mon[31105]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:53.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.252+0000 7f9b4e7fc640 1 -- 172.21.15.144:0/3247528246 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9b58076d10 con 0x7f9b440b6510 2024-09-21T01:12:53.254 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 11 on host 'smithi144' 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9b440b6510 msgr2=0x7f9b440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9b440b6510 0x7f9b440b8a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b54000c00 tx=0x7f9b54031400 comp rx=0 tx=0).stop 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 msgr2=0x7f9b5819d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 0x7f9b5819d400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000eaa0 tx=0x7f9b5000ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 shutdown_connections 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9b440b6510 0x7f9b440b8a20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b58105180 0x7f9b5819d400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b581047e0 0x7f9b5819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 --2- 172.21.15.144:0/3247528246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b58103750 0x7f9b5819c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 >> 172.21.15.144:0/3247528246 conn(0x7f9b580ff0c0 msgr2=0x7f9b580755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:53.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 shutdown_connections 2024-09-21T01:12:53.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:12:53.255+0000 7f9b5f735640 1 -- 172.21.15.144:0/3247528246 wait complete. 2024-09-21T01:12:53.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:53 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:53 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:12:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:53 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:53.987 DEBUG:teuthology.orchestra.run.smithi144:osd.11> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T01:12:53.989 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T01:12:53.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:12:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:54.652 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:54 smithi037 ceph-mon[31105]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 -- 172.21.15.37:0/665753783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c102640 msgr2=0x7fef4c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 --2- 172.21.15.37:0/665753783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c102640 0x7fef4c102ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fef48009900 tx=0x7fef4802a480 comp rx=0 tx=0).stop 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 -- 172.21.15.37:0/665753783 shutdown_connections 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 --2- 172.21.15.37:0/665753783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef4c104070 0x7fef4c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 --2- 172.21.15.37:0/665753783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4c1036d0 0x7fef4c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 --2- 172.21.15.37:0/665753783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c102640 0x7fef4c102ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 -- 172.21.15.37:0/665753783 >> 172.21.15.37:0/665753783 conn(0x7fef4c0fdfb0 msgr2=0x7fef4c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 -- 172.21.15.37:0/665753783 shutdown_connections 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.746+0000 7fef536d8640 1 -- 172.21.15.37:0/665753783 wait complete. 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.747+0000 7fef536d8640 1 Processor -- start 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.747+0000 7fef536d8640 1 -- start start 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.747+0000 7fef536d8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4c102640 0x7fef4c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.747+0000 7fef536d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 0x7fef4c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef536d8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef4c104070 0x7fef4c1a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef536d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c10e280 con 0x7fef4c1036d0 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef536d8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c10e100 con 0x7fef4c102640 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef536d8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c10e400 con 0x7fef4c104070 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 0x7fef4c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 0x7fef4c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58232/0 (socket says 172.21.15.37:58232) 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 -- 172.21.15.37:0/2946771496 learned_addr learned my addr 172.21.15.37:0/2946771496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef51c75640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef4c104070 0x7fef4c1a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef51474640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4c102640 0x7fef4c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 -- 172.21.15.37:0/2946771496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef4c104070 msgr2=0x7fef4c1a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef4c104070 0x7fef4c1a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 -- 172.21.15.37:0/2946771496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4c102640 msgr2=0x7fef4c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4c102640 0x7fef4c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 -- 172.21.15.37:0/2946771496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c1a1a80 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef50c73640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 0x7fef4c19ed30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d950 tx=0x7fef4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40017070 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef40009c30 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c1a1d70 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.748+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4000f620 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.749+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c1a21f0 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.750+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c109820 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.752+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fef40010460 con 0x7fef4c1036d0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.753+0000 7fef3e7fc640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef380b6510 0x7fef380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.753+0000 7fef51474640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef380b6510 0x7fef380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:54.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.753+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7fef400e6940 con 0x7fef4c1036d0 2024-09-21T01:12:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.754+0000 7fef51474640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef380b6510 0x7fef380b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef48031440 tx=0x7fef480314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:54.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.757+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef400ad7b0 con 0x7fef4c1036d0 2024-09-21T01:12:54.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:54 smithi137 ceph-mon[34607]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:54.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:54 smithi144 ceph-mon[34818]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.946+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fef4c063ff0 con 0x7fef4c1036d0 2024-09-21T01:12:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.947+0000 7fef3e7fc640 1 -- 172.21.15.37:0/2946771496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7fef40009de0 con 0x7fef4c1036d0 2024-09-21T01:12:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef380b6510 msgr2=0x7fef380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef380b6510 0x7fef380b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fef48031440 tx=0x7fef480314a0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 msgr2=0x7fef4c19ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 0x7fef4c19ed30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d950 tx=0x7fef4000de10 comp rx=0 tx=0).stop 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 shutdown_connections 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef380b6510 0x7fef380b8a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef4c104070 0x7fef4c1a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c1036d0 0x7fef4c19ed30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 --2- 172.21.15.37:0/2946771496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef4c102640 0x7fef4c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 >> 172.21.15.37:0/2946771496 conn(0x7fef4c0fdfb0 msgr2=0x7fef4c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 shutdown_connections 2024-09-21T01:12:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:54.949+0000 7fef536d8640 1 -- 172.21.15.37:0/2946771496 wait complete. 2024-09-21T01:12:55.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:55 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2946771496' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:12:55.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:55 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2946771496' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:12:55.701 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726881153,"num_in_osds":12,"osd_in_since":1726881155,"num_remapped_pgs":0} 2024-09-21T01:12:55.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:55 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2946771496' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:12:56.144 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:12:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:12:55.768+0000 7f52acb94640 -1 osd.11 0 log_to_monitors true 2024-09-21T01:12:56.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:12:56.803 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:56 smithi144 ceph-mon[34818]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:56.804 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:56 smithi144 ceph-mon[34818]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:12:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:56 smithi137 ceph-mon[34607]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:56 smithi137 ceph-mon[34607]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:12:56.974 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:56.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:56 smithi037 ceph-mon[31105]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:56.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:56 smithi037 ceph-mon[31105]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:12:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 -- 172.21.15.37:0/3099344203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0103750 msgr2=0x7fd1d0103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/3099344203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0103750 0x7fd1d0103bc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009900 tx=0x7fd1c002a480 comp rx=0 tx=0).stop 2024-09-21T01:12:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 -- 172.21.15.37:0/3099344203 shutdown_connections 2024-09-21T01:12:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/3099344203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1d0105180 0x7fd1d010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/3099344203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d01047e0 0x7fd1d0104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/3099344203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0103750 0x7fd1d0103bc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 -- 172.21.15.37:0/3099344203 >> 172.21.15.37:0/3099344203 conn(0x7fd1d00ff0c0 msgr2=0x7fd1d0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 -- 172.21.15.37:0/3099344203 shutdown_connections 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.452+0000 7fd1d50f5640 1 -- 172.21.15.37:0/3099344203 wait complete. 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.453+0000 7fd1d50f5640 1 Processor -- start 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 -- start start 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d0103750 0x7fd1d019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1d01047e0 0x7fd1d019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 0x7fd1d019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d010f390 con 0x7fd1d0105180 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d010f210 con 0x7fd1d0103750 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1d50f5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d010f510 con 0x7fd1d01047e0 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 0x7fd1d019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 0x7fd1d019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40814/0 (socket says 172.21.15.37:40814) 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 -- 172.21.15.37:0/2786264685 learned_addr learned my addr 172.21.15.37:0/2786264685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:12:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1ced9d640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d0103750 0x7fd1d019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1ce59c640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1d01047e0 0x7fd1d019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 -- 172.21.15.37:0/2786264685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1d01047e0 msgr2=0x7fd1d019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1d01047e0 0x7fd1d019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 -- 172.21.15.37:0/2786264685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d0103750 msgr2=0x7fd1d019a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d0103750 0x7fd1d019a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 -- 172.21.15.37:0/2786264685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d019b9d0 con 0x7fd1d0105180 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.454+0000 7fd1cf59e640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 0x7fd1d019b1b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800eaa0 tx=0x7fd1c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.455+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800cdb0 con 0x7fd1d0105180 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.455+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d019bcc0 con 0x7fd1d0105180 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.455+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1c8005020 con 0x7fd1d0105180 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.455+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80116d0 con 0x7fd1d0105180 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.455+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d01a23c0 con 0x7fd1d0105180 2024-09-21T01:12:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.456+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d010a930 con 0x7fd1d0105180 2024-09-21T01:12:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.458+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd1c80054a0 con 0x7fd1d0105180 2024-09-21T01:12:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.459+0000 7fd1b7fff640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd1b80b6510 0x7fd1b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:12:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.459+0000 7fd1ced9d640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd1b80b6510 0x7fd1b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:12:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.459+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6831+0+0 (secure 0 0 0) 0x7fd1c80e7350 con 0x7fd1d0105180 2024-09-21T01:12:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.460+0000 7fd1ced9d640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd1b80b6510 0x7fd1b80b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0000c00 tx=0x7fd1c0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:12:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.463+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1c8016030 con 0x7fd1d0105180 2024-09-21T01:12:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.653+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd1d0063fc0 con 0x7fd1d0105180 2024-09-21T01:12:57.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:12:57.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:12:57.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:12:57.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:57.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.654+0000 7fd1b7fff640 1 -- 172.21.15.37:0/2786264685 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7fd1c80ae110 con 0x7fd1d0105180 2024-09-21T01:12:57.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd1b80b6510 msgr2=0x7fd1b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd1b80b6510 0x7fd1b80b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0000c00 tx=0x7fd1c0031400 comp rx=0 tx=0).stop 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 msgr2=0x7fd1d019b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 0x7fd1d019b1b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800eaa0 tx=0x7fd1c800ef60 comp rx=0 tx=0).stop 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 shutdown_connections 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd1b80b6510 0x7fd1b80b8a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d0105180 0x7fd1d019b1b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1d01047e0 0x7fd1d019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 --2- 172.21.15.37:0/2786264685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1d0103750 0x7fd1d019a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 >> 172.21.15.37:0/2786264685 conn(0x7fd1d00ff0c0 msgr2=0x7fd1d0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 shutdown_connections 2024-09-21T01:12:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:12:57.656+0000 7fd1d50f5640 1 -- 172.21.15.37:0/2786264685 wait complete. 2024-09-21T01:12:57.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:12:57.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:12:57.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:12:57.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:12:57.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:12:58.420 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:12:57.973+0000 7f52a8b16640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T01:12:58.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:12:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:12:57.986+0000 7f52a090c640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:12:58.545 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726881153,"num_in_osds":12,"osd_in_since":1726881155,"num_remapped_pgs":0} 2024-09-21T01:12:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: Detected new or changed devices on smithi144 2024-09-21T01:12:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2786264685' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:58 smithi137 ceph-mon[34607]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' 2024-09-21T01:12:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: Detected new or changed devices on smithi144 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2786264685' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:12:58.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:58 smithi144 ceph-mon[34818]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: Detected new or changed devices on smithi144 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2786264685' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:12:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:58 smithi037 ceph-mon[31105]: from='osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163]' entity='osd.11' 2024-09-21T01:12:59.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:12:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:12:59.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:59 smithi144 ceph-mon[34818]: purged_snaps scrub starts 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:59 smithi144 ceph-mon[34818]: purged_snaps scrub ok 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:59 smithi144 ceph-mon[34818]: osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] boot 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:59 smithi144 ceph-mon[34818]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:12:59 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:59 smithi137 ceph-mon[34607]: purged_snaps scrub starts 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:59 smithi137 ceph-mon[34607]: purged_snaps scrub ok 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:59 smithi137 ceph-mon[34607]: osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] boot 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:59 smithi137 ceph-mon[34607]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:12:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:12:59 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.936 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:59 smithi037 ceph-mon[31105]: purged_snaps scrub starts 2024-09-21T01:12:59.936 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:59 smithi037 ceph-mon[31105]: purged_snaps scrub ok 2024-09-21T01:12:59.936 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:12:59.936 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:59 smithi037 ceph-mon[31105]: osd.11 [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] boot 2024-09-21T01:12:59.936 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:59 smithi037 ceph-mon[31105]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:12:59.936 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:12:59 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/3397933118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74104070 msgr2=0x7f7d7410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/3397933118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74104070 0x7f7d7410aa10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009ca0 tx=0x7f7d6c02a950 comp rx=0 tx=0).stop 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/3397933118 shutdown_connections 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/3397933118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74104070 0x7f7d7410aa10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/3397933118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d741036d0 0x7f7d74103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/3397933118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d74102640 0x7f7d74102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/3397933118 >> 172.21.15.37:0/3397933118 conn(0x7f7d740fdfb0 msgr2=0x7f7d74100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/3397933118 shutdown_connections 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.286+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/3397933118 wait complete. 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 Processor -- start 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 -- start start 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 0x7f7d7406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d741036d0 0x7f7d7419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d74104070 0x7f7d741a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410e290 con 0x7f7d74102640 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410e110 con 0x7f7d741036d0 2024-09-21T01:13:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7bfd6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410e410 con 0x7f7d74104070 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d79d72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 0x7f7d7406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d79d72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 0x7f7d7406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40840/0 (socket says 172.21.15.37:40840) 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d79d72640 1 -- 172.21.15.37:0/1707188436 learned_addr learned my addr 172.21.15.37:0/1707188436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.287+0000 7f7d7a573640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d74104070 0x7f7d741a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79571640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d741036d0 0x7f7d7419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79d72640 1 -- 172.21.15.37:0/1707188436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d74104070 msgr2=0x7f7d741a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79d72640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d74104070 0x7f7d741a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79d72640 1 -- 172.21.15.37:0/1707188436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d741036d0 msgr2=0x7f7d7419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79d72640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d741036d0 0x7f7d7419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79d72640 1 -- 172.21.15.37:0/1707188436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d741a1a50 con 0x7f7d74102640 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d7a573640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d74104070 0x7f7d741a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79571640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d741036d0 0x7f7d7419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d79d72640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 0x7f7d7406b6c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000d950 tx=0x7f7d7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70017070 con 0x7f7d74102640 2024-09-21T01:13:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d70009c30 con 0x7f7d74102640 2024-09-21T01:13:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d741a1d40 con 0x7f7d74102640 2024-09-21T01:13:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000f620 con 0x7f7d74102640 2024-09-21T01:13:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.288+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741a2210 con 0x7f7d74102640 2024-09-21T01:13:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.289+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d74109800 con 0x7f7d74102640 2024-09-21T01:13:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.291+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7d70010460 con 0x7f7d74102640 2024-09-21T01:13:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.291+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7d600b6590 0x7f7d600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.291+0000 7f7d79571640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7d600b6590 0x7f7d600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.292+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f7d700e6ab0 con 0x7f7d74102640 2024-09-21T01:13:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.292+0000 7f7d79571640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7d600b6590 0x7f7d600b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d680058c0 tx=0x7f7d68005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.295+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d700ad860 con 0x7f7d74102640 2024-09-21T01:13:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.484+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7d74064060 con 0x7f7d74102640 2024-09-21T01:13:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.485+0000 7f7d66ffd640 1 -- 172.21.15.37:0/1707188436 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f7d70009de0 con 0x7f7d74102640 2024-09-21T01:13:00.486 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7d600b6590 msgr2=0x7f7d600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7d600b6590 0x7f7d600b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d680058c0 tx=0x7f7d68005d30 comp rx=0 tx=0).stop 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 msgr2=0x7f7d7406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 0x7f7d7406b6c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000d950 tx=0x7f7d7000de10 comp rx=0 tx=0).stop 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 shutdown_connections 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7d600b6590 0x7f7d600b8aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d74104070 0x7f7d741a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d741036d0 0x7f7d7419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 --2- 172.21.15.37:0/1707188436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d74102640 0x7f7d7406b6c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 >> 172.21.15.37:0/1707188436 conn(0x7f7d740fdfb0 msgr2=0x7f7d741069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 shutdown_connections 2024-09-21T01:13:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:00.487+0000 7f7d7bfd6640 1 -- 172.21.15.37:0/1707188436 wait complete. 2024-09-21T01:13:00.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:00 smithi037 ceph-mon[31105]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:13:00.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:00 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1707188436' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:13:00.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:00 smithi137 ceph-mon[34607]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:13:00.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:00 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1707188436' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:13:00.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:00 smithi144 ceph-mon[34818]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:13:00.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:00 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1707188436' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:13:01.325 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726881178,"num_in_osds":12,"osd_in_since":1726881155,"num_remapped_pgs":0} 2024-09-21T01:13:01.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:13:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:01.821 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:01 smithi137 ceph-mon[34607]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:13:01.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:01 smithi037 ceph-mon[31105]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:13:01.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:01 smithi144 ceph-mon[34818]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 -- 172.21.15.37:0/2151235438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 msgr2=0x7eff101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 --2- 172.21.15.37:0/2151235438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff101087b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff04009900 tx=0x7eff0402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 -- 172.21.15.37:0/2151235438 shutdown_connections 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 --2- 172.21.15.37:0/2151235438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff10108cf0 0x7eff1010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 --2- 172.21.15.37:0/2151235438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff101087b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 --2- 172.21.15.37:0/2151235438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff10102a60 0x7eff10102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 -- 172.21.15.37:0/2151235438 >> 172.21.15.37:0/2151235438 conn(0x7eff10079730 msgr2=0x7eff10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 -- 172.21.15.37:0/2151235438 shutdown_connections 2024-09-21T01:13:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.085+0000 7eff156d6640 1 -- 172.21.15.37:0/2151235438 wait complete. 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 Processor -- start 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 -- start start 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff10102a60 0x7eff1019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff1019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff10108cf0 0x7eff1019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff10113aa0 con 0x7eff101083a0 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff10113920 con 0x7eff10108cf0 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff156d6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff10113c20 con 0x7eff10102a60 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff0e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff1019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff0e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff1019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40858/0 (socket says 172.21.15.37:40858) 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff0e7fc640 1 -- 172.21.15.37:0/2057560289 learned_addr learned my addr 172.21.15.37:0/2057560289 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff0effd640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff10102a60 0x7eff1019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff0f7fe640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff10108cf0 0x7eff1019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.086+0000 7eff0e7fc640 1 -- 172.21.15.37:0/2057560289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff10102a60 msgr2=0x7eff1019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff0e7fc640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff10102a60 0x7eff1019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff0e7fc640 1 -- 172.21.15.37:0/2057560289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff10108cf0 msgr2=0x7eff1019fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff0e7fc640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff10108cf0 0x7eff1019fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff0e7fc640 1 -- 172.21.15.37:0/2057560289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff101a0420 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff0e7fc640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff1019ab10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff04031a90 tx=0x7eff04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0403f030 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101a06b0 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff04003cb0 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04035070 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.087+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff101a0be0 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.088+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10102e70 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.090+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7eff04042030 con 0x7eff101083a0 2024-09-21T01:13:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.091+0000 7efef7fff640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7efef80b6540 0x7efef80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.091+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7eff04107750 con 0x7eff101083a0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.091+0000 7eff0effd640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7efef80b6540 0x7efef80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.092+0000 7eff0effd640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7efef80b6540 0x7efef80b8a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff0000a400 tx=0x7eff0000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.094+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff101a0be0 con 0x7eff101083a0 2024-09-21T01:13:02.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.284+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1019b6a0 con 0x7eff101083a0 2024-09-21T01:13:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.285+0000 7efef7fff640 1 -- 172.21.15.37:0/2057560289 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18481 (secure 0 0 0) 0x7eff040d2840 con 0x7eff101083a0 2024-09-21T01:13:02.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:02.286 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:13:00.531485+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7efef80b6540 msgr2=0x7efef80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7efef80b6540 0x7efef80b8a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff0000a400 tx=0x7eff0000d040 comp rx=0 tx=0).stop 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 msgr2=0x7eff1019ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff1019ab10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff04031a90 tx=0x7eff04004270 comp rx=0 tx=0).stop 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 shutdown_connections 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7efef80b6540 0x7efef80b8a50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff10108cf0 0x7eff1019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff101083a0 0x7eff1019ab10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 --2- 172.21.15.37:0/2057560289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff10102a60 0x7eff1019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 >> 172.21.15.37:0/2057560289 conn(0x7eff10079730 msgr2=0x7eff10105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 shutdown_connections 2024-09-21T01:13:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:02.287+0000 7eff156d6640 1 -- 172.21.15.37:0/2057560289 wait complete. 2024-09-21T01:13:02.822 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:02 smithi144 ceph-mon[34818]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:02.822 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:02 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2057560289' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:02 smithi137 ceph-mon[34607]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:02 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2057560289' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:02 smithi037 ceph-mon[31105]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:02 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2057560289' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:03.057 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:09:09.226836+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:13:03.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T01:13:03.319 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 -- 172.21.15.37:0/521413646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 msgr2=0x7f64601087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 --2- 172.21.15.37:0/521413646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f64601087e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6448009900 tx=0x7f644802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 -- 172.21.15.37:0/521413646 shutdown_connections 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 --2- 172.21.15.37:0/521413646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 0x7f646010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 --2- 172.21.15.37:0/521413646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f64601087e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 --2- 172.21.15.37:0/521413646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6460102ae0 0x7f6460102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 -- 172.21.15.37:0/521413646 >> 172.21.15.37:0/521413646 conn(0x7f6460079760 msgr2=0x7f6460079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 -- 172.21.15.37:0/521413646 shutdown_connections 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 -- 172.21.15.37:0/521413646 wait complete. 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.824+0000 7f6465137640 1 Processor -- start 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 -- start start 2024-09-21T01:13:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6460102ae0 0x7f646019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f646019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 0x7f646019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6460113ab0 con 0x7f64601083d0 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6460113930 con 0x7f6460102ae0 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f6465137640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6460113c30 con 0x7f6460108d20 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f645e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f646019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f645e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f646019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40872/0 (socket says 172.21.15.37:40872) 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f645e59c640 1 -- 172.21.15.37:0/2635202268 learned_addr learned my addr 172.21.15.37:0/2635202268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f645f59e640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 0x7f646019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.825+0000 7f645ed9d640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6460102ae0 0x7f646019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645f59e640 1 -- 172.21.15.37:0/2635202268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6460102ae0 msgr2=0x7f646019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645f59e640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6460102ae0 0x7f646019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645f59e640 1 -- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 msgr2=0x7f646019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645f59e640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f646019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645f59e640 1 -- 172.21.15.37:0/2635202268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64601a03f0 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645e59c640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f646019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f645f59e640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 0x7f646019fcc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6458009fd0 tx=0x7f645800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645800ce20 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64601a06e0 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6458005020 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458010690 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.826+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64601a6e40 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.827+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6460103d10 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.829+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f64580054d0 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.829+0000 7f6457fff640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f644c0b6510 0x7f644c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.830+0000 7f645ed9d640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f644c0b6510 0x7f644c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.830+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f64580e74d0 con 0x7f6460108d20 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.830+0000 7f645ed9d640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f644c0b6510 0x7f644c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f645000bbe0 tx=0x7f645000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:03.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:03.832+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64580ae200 con 0x7f6460108d20 2024-09-21T01:13:04.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.019+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f646019b5b0 con 0x7f6460108d20 2024-09-21T01:13:04.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.019+0000 7f6457fff640 1 -- 172.21.15.37:0/2635202268 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f64580b25e0 con 0x7f6460108d20 2024-09-21T01:13:04.021 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-21T01:13:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f644c0b6510 msgr2=0x7f644c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f644c0b6510 0x7f644c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f645000bbe0 tx=0x7f645000b390 comp rx=0 tx=0).stop 2024-09-21T01:13:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 msgr2=0x7f646019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 0x7f646019fcc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6458009fd0 tx=0x7f645800ef10 comp rx=0 tx=0).stop 2024-09-21T01:13:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 shutdown_connections 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f644c0b6510 0x7f644c0b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6460108d20 0x7f646019fcc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64601083d0 0x7f646019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 --2- 172.21.15.37:0/2635202268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6460102ae0 0x7f646019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 >> 172.21.15.37:0/2635202268 conn(0x7f6460079760 msgr2=0x7f64601052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 shutdown_connections 2024-09-21T01:13:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:04.022+0000 7f6465137640 1 -- 172.21.15.37:0/2635202268 wait complete. 2024-09-21T01:13:04.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:04 smithi037 ceph-mon[31105]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:04.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:04 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2635202268' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:13:04.807 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-09-21T01:13:04.807 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-09-21T01:13:04.807 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.b on smithi137 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.e on smithi137 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.h on smithi137 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.k on smithi137 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.c on smithi144 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.f on smithi144 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.i on smithi144 2024-09-21T01:13:04.808 INFO:tasks.cephadm:Adding mds.l on smithi144 2024-09-21T01:13:04.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l' 2024-09-21T01:13:04.837 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:04 smithi144 ceph-mon[34818]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:04.837 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:04 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2635202268' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:13:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:04 smithi137 ceph-mon[34607]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:04 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2635202268' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:13:05.066 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:13:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 -- 172.21.15.144:0/3835424041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8101e00 msgr2=0x7f4fa8102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 --2- 172.21.15.144:0/3835424041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8101e00 0x7f4fa8102270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800aa10 tx=0x7f4f9802b7b0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 -- 172.21.15.144:0/3835424041 shutdown_connections 2024-09-21T01:13:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 --2- 172.21.15.144:0/3835424041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa8103830 0x7f4fa810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 --2- 172.21.15.144:0/3835424041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa8102e90 0x7f4fa81032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 --2- 172.21.15.144:0/3835424041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8101e00 0x7f4fa8102270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 -- 172.21.15.144:0/3835424041 >> 172.21.15.144:0/3835424041 conn(0x7f4fa80fd770 msgr2=0x7f4fa80ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 -- 172.21.15.144:0/3835424041 shutdown_connections 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 -- 172.21.15.144:0/3835424041 wait complete. 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.535+0000 7f4fad100640 1 Processor -- start 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 -- start start 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa8101e00 0x7f4fa81059f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa8102e90 0x7f4fa81042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 0x7f4fa8104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa810d220 con 0x7f4fa8102e90 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa810d0a0 con 0x7f4fa8101e00 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fad100640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa810d3a0 con 0x7f4fa8103830 2024-09-21T01:13:05.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 0x7f4fa8104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 0x7f4fa8104800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45190/0 (socket says 172.21.15.144:45190) 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 -- 172.21.15.144:0/4021691076 learned_addr learned my addr 172.21.15.144:0/4021691076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa659c640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa8102e90 0x7f4fa81042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa6d9d640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa8101e00 0x7f4fa81059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 -- 172.21.15.144:0/4021691076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa8101e00 msgr2=0x7f4fa81059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa8101e00 0x7f4fa81059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 -- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa8102e90 msgr2=0x7f4fa81042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa8102e90 0x7f4fa81042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.536+0000 7f4fa759e640 1 -- 172.21.15.144:0/4021691076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa8104f00 con 0x7f4fa8103830 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.537+0000 7f4fa759e640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 0x7f4fa8104800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b970 tx=0x7f4fa000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.537+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0019070 con 0x7f4fa8103830 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.537+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa81a40e0 con 0x7f4fa8103830 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.537+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa0014440 con 0x7f4fa8103830 2024-09-21T01:13:05.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.537+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00075d0 con 0x7f4fa8103830 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.537+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa81a45c0 con 0x7f4fa8103830 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.538+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa81a4850 con 0x7f4fa8103830 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.540+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4fa001c070 con 0x7f4fa8103830 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.541+0000 7f4f8ffff640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4f900b6510 0x7f4f900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.541+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f4fa00e67b0 con 0x7f4fa8103830 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.541+0000 7f4fa6d9d640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4f900b6510 0x7f4f900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.542+0000 7f4fa6d9d640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4f900b6510 0x7f4f900b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f98000c00 tx=0x7f4f98030510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:05.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.544+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fa00b18c0 con 0x7f4fa8103830 2024-09-21T01:13:05.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.733+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}) -- 0x7f4fa8109ae0 con 0x7f4f900b6510 2024-09-21T01:13:05.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.743+0000 7f4f8ffff640 1 -- 172.21.15.144:0/4021691076 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f4fa8109ae0 con 0x7f4f900b6510 2024-09-21T01:13:05.744 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mds.all update... 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4f900b6510 msgr2=0x7f4f900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4f900b6510 0x7f4f900b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f98000c00 tx=0x7f4f98030510 comp rx=0 tx=0).stop 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 msgr2=0x7f4fa8104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 0x7f4fa8104800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b970 tx=0x7f4fa000be30 comp rx=0 tx=0).stop 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 shutdown_connections 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4f900b6510 0x7f4f900b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa8103830 0x7f4fa8104800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa8102e90 0x7f4fa81042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 --2- 172.21.15.144:0/4021691076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fa8101e00 0x7f4fa81059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:05.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 >> 172.21.15.144:0/4021691076 conn(0x7f4fa80fd770 msgr2=0x7f4fa81083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:05.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 shutdown_connections 2024-09-21T01:13:05.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T01:13:05.746+0000 7f4fad100640 1 -- 172.21.15.144:0/4021691076 wait complete. 2024-09-21T01:13:06.398 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T01:13:06.401 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T01:13:06.444 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T01:13:06.487 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T01:13:06.530 DEBUG:teuthology.orchestra.run.smithi137:mds.b> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T01:13:06.533 DEBUG:teuthology.orchestra.run.smithi137:mds.e> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T01:13:06.575 DEBUG:teuthology.orchestra.run.smithi137:mds.h> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T01:13:06.618 DEBUG:teuthology.orchestra.run.smithi137:mds.k> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T01:13:06.661 DEBUG:teuthology.orchestra.run.smithi144:mds.c> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T01:13:06.664 DEBUG:teuthology.orchestra.run.smithi144:mds.f> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T01:13:06.708 DEBUG:teuthology.orchestra.run.smithi144:mds.i> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T01:13:06.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:06 smithi037 ceph-mon[31105]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:06.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:06.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:06 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:06.751 DEBUG:teuthology.orchestra.run.smithi144:mds.l> sudo journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T01:13:06.793 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T01:13:06.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:06.813 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:06 smithi144 ceph-mon[34818]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:06.813 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:06.814 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:06 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:06 smithi137 ceph-mon[34607]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:06 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:07.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 -- 172.21.15.37:0/943767170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f0103b60 msgr2=0x7f75f0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 --2- 172.21.15.37:0/943767170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f0103b60 0x7f75f0103f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009900 tx=0x7f75ec02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 -- 172.21.15.37:0/943767170 shutdown_connections 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 --2- 172.21.15.37:0/943767170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f0109df0 0x7f75f0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 --2- 172.21.15.37:0/943767170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75f01094a0 0x7f75f01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 --2- 172.21.15.37:0/943767170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f0103b60 0x7f75f0103f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.536+0000 7f75f7795640 1 -- 172.21.15.37:0/943767170 >> 172.21.15.37:0/943767170 conn(0x7f75f007b850 msgr2=0x7f75f007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 -- 172.21.15.37:0/943767170 shutdown_connections 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 -- 172.21.15.37:0/943767170 wait complete. 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 Processor -- start 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 -- start start 2024-09-21T01:13:07.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f0103b60 0x7f75f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 0x7f75f0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75f0109df0 0x7f75f0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0113ab0 con 0x7f75f01094a0 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0113930 con 0x7f75f0103b60 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.537+0000 7f75f7795640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0113c30 con 0x7f75f0109df0 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 0x7f75f0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 0x7f75f0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47972/0 (socket says 172.21.15.37:47972) 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 -- 172.21.15.37:0/2262876648 learned_addr learned my addr 172.21.15.37:0/2262876648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f5531640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f0103b60 0x7f75f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f5d32640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75f0109df0 0x7f75f0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 -- 172.21.15.37:0/2262876648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75f0109df0 msgr2=0x7f75f0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75f0109df0 0x7f75f0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 -- 172.21.15.37:0/2262876648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f0103b60 msgr2=0x7f75f0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f0103b60 0x7f75f0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 -- 172.21.15.37:0/2262876648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f01a8730 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f4d30640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 0x7f75f0075c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f75e000e9c0 tx=0x7f75e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e000ccc0 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f01a8a20 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75e00054d0 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0010430 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.538+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f01a8f10 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.539+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f0103f70 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.541+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f75e0005000 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.542+0000 7f75e67fc640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f75dc0b6510 0x7f75dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.542+0000 7f75f5531640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f75dc0b6510 0x7f75dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.542+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f75e00e74c0 con 0x7f75f01094a0 2024-09-21T01:13:07.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.542+0000 7f75f5531640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f75dc0b6510 0x7f75dc0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:07.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.545+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75e0056710 con 0x7f75f01094a0 2024-09-21T01:13:07.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:07.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T01:13:07.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:07.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:07.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:07.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:07.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:07.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:07 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:07.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.772+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75f0076a10 con 0x7f75f01094a0 2024-09-21T01:13:07.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.772+0000 7f75e67fc640 1 -- 172.21.15.37:0/2262876648 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f75e00052f0 con 0x7f75f01094a0 2024-09-21T01:13:07.774 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:07.774 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"btime":"2024-09-21T01:05:18:978125+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T01:13:07.774 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-09-21T01:13:07.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f75dc0b6510 msgr2=0x7f75dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f75dc0b6510 0x7f75dc0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec031400 comp rx=0 tx=0).stop 2024-09-21T01:13:07.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 msgr2=0x7f75f0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:07.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 0x7f75f0075c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f75e000e9c0 tx=0x7f75e000ee80 comp rx=0 tx=0).stop 2024-09-21T01:13:07.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 shutdown_connections 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f75dc0b6510 0x7f75dc0b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75f0109df0 0x7f75f0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75f01094a0 0x7f75f0075c50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 --2- 172.21.15.37:0/2262876648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f0103b60 0x7f75f0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 >> 172.21.15.37:0/2262876648 conn(0x7f75f007b850 msgr2=0x7f75f01075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 shutdown_connections 2024-09-21T01:13:07.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:07.775+0000 7f75f7795640 1 -- 172.21.15.37:0/2262876648 wait complete. 2024-09-21T01:13:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T01:13:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:07 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='client.24553 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:07.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:07 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:08.554 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 systemd[1]: Starting Ceph mds.l for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:08.807 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:08 smithi144 ceph-mon[34818]: Deploying daemon mds.l on smithi144 2024-09-21T01:13:08.807 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:08 smithi144 ceph-mon[34818]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:08.807 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:08 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2262876648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:08.807 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 podman[63232]: 2024-09-21 01:13:08.576341489 +0000 UTC m=+0.016203078 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:08.807 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 podman[63232]: 2024-09-21 01:13:08.692590945 +0000 UTC m=+0.132452571 container create d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:13:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:08 smithi137 ceph-mon[34607]: Deploying daemon mds.l on smithi144 2024-09-21T01:13:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:08 smithi137 ceph-mon[34607]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:08 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2262876648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:08.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:08 smithi037 ceph-mon[31105]: Deploying daemon mds.l on smithi144 2024-09-21T01:13:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:08 smithi037 ceph-mon[31105]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:08 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2262876648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:09.170 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 podman[63232]: 2024-09-21 01:13:08.936839847 +0000 UTC m=+0.376701424 container init d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:13:09.171 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 podman[63232]: 2024-09-21 01:13:08.939734976 +0000 UTC m=+0.379596556 container start d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:13:09.171 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 ceph-mds[63251]: -- 172.21.15.144:0/582819017 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a74371860 con 0x557a78519180 2024-09-21T01:13:09.171 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l[63247]: starting mds.l at 2024-09-21T01:13:09.171 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:09 smithi144 bash[63232]: d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 2024-09-21T01:13:09.171 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:13:09 smithi144 systemd[1]: Started Ceph mds.l for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6832/299841905,v1:172.21.15.144:6833/299841905] up:boot 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: fsmap 1 up:standby 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:10.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:10.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:09 smithi137 ceph-mon[34607]: Deploying daemon mds.k on smithi137 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6832/299841905,v1:172.21.15.144:6833/299841905] up:boot 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: fsmap 1 up:standby 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:10.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:10.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:10.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:09 smithi037 ceph-mon[31105]: Deploying daemon mds.k on smithi137 2024-09-21T01:13:10.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6832/299841905,v1:172.21.15.144:6833/299841905] up:boot 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: fsmap 1 up:standby 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:09 smithi144 ceph-mon[34818]: Deploying daemon mds.k on smithi137 2024-09-21T01:13:10.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:11.170 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 systemd[1]: Starting Ceph mds.k for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 -- 172.21.15.37:0/3610477356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a10108600 msgr2=0x7f2a10108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 --2- 172.21.15.37:0/3610477356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a10108600 0x7f2a10108a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009900 tx=0x7f2a0002a410 comp rx=0 tx=0).stop 2024-09-21T01:13:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 -- 172.21.15.37:0/3610477356 shutdown_connections 2024-09-21T01:13:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 --2- 172.21.15.37:0/3610477356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 0x7f2a1010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 --2- 172.21.15.37:0/3610477356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a101072f0 0x7f2a10107700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 --2- 172.21.15.37:0/3610477356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a10108600 0x7f2a10108a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 -- 172.21.15.37:0/3610477356 >> 172.21.15.37:0/3610477356 conn(0x7f2a10077800 msgr2=0x7f2a10077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 -- 172.21.15.37:0/3610477356 shutdown_connections 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.362+0000 7f2a15104640 1 -- 172.21.15.37:0/3610477356 wait complete. 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.363+0000 7f2a15104640 1 Processor -- start 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 -- start start 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 0x7f2a10199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 0x7f2a10199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a10108600 0x7f2a1019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10112a10 con 0x7f2a101072f0 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10112890 con 0x7f2a10108600 2024-09-21T01:13:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a15104640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a10112b90 con 0x7f2a10107c40 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a0ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 0x7f2a10199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a0ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 0x7f2a10199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47988/0 (socket says 172.21.15.37:47988) 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a0ed9d640 1 -- 172.21.15.37:0/1221949187 learned_addr learned my addr 172.21.15.37:0/1221949187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a0f59e640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a10108600 0x7f2a1019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.364+0000 7f2a0e59c640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 0x7f2a10199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0ed9d640 1 -- 172.21.15.37:0/1221949187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 msgr2=0x7f2a10199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0ed9d640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 0x7f2a10199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0ed9d640 1 -- 172.21.15.37:0/1221949187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a10108600 msgr2=0x7f2a1019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0ed9d640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a10108600 0x7f2a1019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0ed9d640 1 -- 172.21.15.37:0/1221949187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1019f3f0 con 0x7f2a101072f0 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0e59c640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 0x7f2a10199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a0ed9d640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 0x7f2a10199480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005940 tx=0x7f2a000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0003f030 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a00003cb0 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1019f680 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00035070 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.365+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a101a5e40 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.366+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a10101be0 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.368+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2a00042030 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.369+0000 7f29f7fff640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29f80b6590 0x7f29f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.369+0000 7f2a0e59c640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29f80b6590 0x7f29f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.369+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f2a001078f0 con 0x7f2a101072f0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.369+0000 7f2a0e59c640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29f80b6590 0x7f29f80b8aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a040058c0 tx=0x7f2a04005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.372+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a000ce620 con 0x7f2a101072f0 2024-09-21T01:13:11.488 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 podman[62354]: 2024-09-21 01:13:11.123771932 +0000 UTC m=+0.015702326 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:11.489 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 podman[62354]: 2024-09-21 01:13:11.231858208 +0000 UTC m=+0.123788596 container create 8748a8fb991474cf84e41bcca93d80bf1a62317c7f8380967f75e9031bfc35b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:11.489 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 podman[62354]: 2024-09-21 01:13:11.45155414 +0000 UTC m=+0.343484528 container init 8748a8fb991474cf84e41bcca93d80bf1a62317c7f8380967f75e9031bfc35b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:11.489 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 podman[62354]: 2024-09-21 01:13:11.454327688 +0000 UTC m=+0.346258077 container start 8748a8fb991474cf84e41bcca93d80bf1a62317c7f8380967f75e9031bfc35b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T01:13:11.489 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mds[62373]: -- 172.21.15.137:0/1823900754 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581ebee3860 con 0x5581f008b600 2024-09-21T01:13:11.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.599+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a10107700 con 0x7f2a101072f0 2024-09-21T01:13:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.601+0000 7f29f7fff640 1 -- 172.21.15.37:0/1221949187 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f2a10107700 con 0x7f2a101072f0 2024-09-21T01:13:11.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:11.603 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"btime":"2024-09-21T01:13:08:977720+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:13:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-09-21T01:13:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29f80b6590 msgr2=0x7f29f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29f80b6590 0x7f29f80b8aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a040058c0 tx=0x7f2a04005850 comp rx=0 tx=0).stop 2024-09-21T01:13:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 msgr2=0x7f2a10199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 0x7f2a10199480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005940 tx=0x7f2a000042f0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 shutdown_connections 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f29f80b6590 0x7f29f80b8aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a10108600 0x7f2a1019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a10107c40 0x7f2a10199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 --2- 172.21.15.37:0/1221949187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101072f0 0x7f2a10199480 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 >> 172.21.15.37:0/1221949187 conn(0x7f2a10077800 msgr2=0x7f2a101004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 shutdown_connections 2024-09-21T01:13:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:11.604+0000 7f2a15104640 1 -- 172.21.15.37:0/1221949187 wait complete. 2024-09-21T01:13:11.920 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k[62369]: starting mds.k at 2024-09-21T01:13:11.920 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 bash[62354]: 8748a8fb991474cf84e41bcca93d80bf1a62317c7f8380967f75e9031bfc35b8 2024-09-21T01:13:11.920 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:13:11 smithi137 systemd[1]: Started Ceph mds.k for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:12.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1221949187' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:12.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1221949187' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1221949187' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:12.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:12.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:13.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:12 smithi037 ceph-mon[31105]: Deploying daemon mds.j on smithi037 2024-09-21T01:13:13.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:12 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6832/1167918014,v1:172.21.15.137:6833/1167918014] up:boot 2024-09-21T01:13:13.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:12 smithi037 ceph-mon[31105]: fsmap 2 up:standby 2024-09-21T01:13:13.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:12 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:13:13.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:12 smithi137 ceph-mon[34607]: Deploying daemon mds.j on smithi037 2024-09-21T01:13:13.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:12 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6832/1167918014,v1:172.21.15.137:6833/1167918014] up:boot 2024-09-21T01:13:13.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:12 smithi137 ceph-mon[34607]: fsmap 2 up:standby 2024-09-21T01:13:13.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:12 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:13:13.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:12 smithi144 ceph-mon[34818]: Deploying daemon mds.j on smithi037 2024-09-21T01:13:13.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:12 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6832/1167918014,v1:172.21.15.137:6833/1167918014] up:boot 2024-09-21T01:13:13.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:12 smithi144 ceph-mon[34818]: fsmap 2 up:standby 2024-09-21T01:13:13.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:12 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:13:14.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:14 smithi137 ceph-mon[34607]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:14.411 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:14 smithi037 ceph-mon[31105]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:14.411 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 systemd[1]: Starting Ceph mds.j for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:14.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:14 smithi144 ceph-mon[34818]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:14.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:14.682 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 podman[71480]: 2024-09-21 01:13:14.313600602 +0000 UTC m=+0.016824965 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:14.682 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 podman[71480]: 2024-09-21 01:13:14.421360377 +0000 UTC m=+0.124584740 container create 3542e55098d456a0d6d4afb5798b7483e28f27ddc06d7c5ea7c3ff52be2f6186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:13:14.683 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 podman[71480]: 2024-09-21 01:13:14.682649406 +0000 UTC m=+0.385873775 container init 3542e55098d456a0d6d4afb5798b7483e28f27ddc06d7c5ea7c3ff52be2f6186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:14.999 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 podman[71480]: 2024-09-21 01:13:14.68593796 +0000 UTC m=+0.389162323 container start 3542e55098d456a0d6d4afb5798b7483e28f27ddc06d7c5ea7c3ff52be2f6186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:13:14.999 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 ceph-mds[71530]: -- 172.21.15.37:0/3468965394 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5603c550b860 con 0x5603c96b3a80 2024-09-21T01:13:15.000 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j[71513]: starting mds.j at 2024-09-21T01:13:15.000 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 bash[71480]: 3542e55098d456a0d6d4afb5798b7483e28f27ddc06d7c5ea7c3ff52be2f6186 2024-09-21T01:13:15.000 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:13:14 smithi037 systemd[1]: Started Ceph mds.j for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.429+0000 7f13468a0640 1 -- 172.21.15.37:0/2817985662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13401094a0 msgr2=0x7f13401098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.429+0000 7f13468a0640 1 --2- 172.21.15.37:0/2817985662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13401094a0 0x7f13401098b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1334009900 tx=0x7f133402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 -- 172.21.15.37:0/2817985662 shutdown_connections 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 --2- 172.21.15.37:0/2817985662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1340109df0 0x7f1340110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 --2- 172.21.15.37:0/2817985662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13401094a0 0x7f13401098b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 --2- 172.21.15.37:0/2817985662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1340103b60 0x7f1340103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 -- 172.21.15.37:0/2817985662 >> 172.21.15.37:0/2817985662 conn(0x7f134007b850 msgr2=0x7f134007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 -- 172.21.15.37:0/2817985662 shutdown_connections 2024-09-21T01:13:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 -- 172.21.15.37:0/2817985662 wait complete. 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 Processor -- start 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.430+0000 7f13468a0640 1 -- start start 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f13468a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 0x7f134019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f13468a0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13401094a0 0x7f134019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f13468a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1340109df0 0x7f134019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f13468a0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1340113ab0 con 0x7f1340103b60 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f13468a0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1340113930 con 0x7f1340109df0 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f13468a0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1340113c30 con 0x7f13401094a0 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 0x7f134019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 0x7f134019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48030/0 (socket says 172.21.15.37:48030) 2024-09-21T01:13:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 -- 172.21.15.37:0/2178062590 learned_addr learned my addr 172.21.15.37:0/2178062590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133f7fe640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13401094a0 0x7f134019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f1344e3d640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1340109df0 0x7f134019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 -- 172.21.15.37:0/2178062590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13401094a0 msgr2=0x7f134019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13401094a0 0x7f134019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 -- 172.21.15.37:0/2178062590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1340109df0 msgr2=0x7f134019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1340109df0 0x7f134019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133ffff640 1 -- 172.21.15.37:0/2178062590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13401a0330 con 0x7f1340103b60 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.431+0000 7f133f7fe640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13401094a0 0x7f134019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.432+0000 7f133ffff640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 0x7f134019a480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f133000c920 tx=0x7f133000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.432+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330007c70 con 0x7f1340103b60 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.432+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1330007e10 con 0x7f1340103b60 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.432+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13401a0620 con 0x7f1340103b60 2024-09-21T01:13:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.432+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330018820 con 0x7f1340103b60 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.432+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13401a6e40 con 0x7f1340103b60 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.433+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1340103f70 con 0x7f1340103b60 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.435+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f133000f450 con 0x7f1340103b60 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.436+0000 7f133d7fa640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13280b6540 0x7f13280b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.436+0000 7f133f7fe640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13280b6540 0x7f13280b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.436+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f13300e7350 con 0x7f1340103b60 2024-09-21T01:13:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.437+0000 7f133f7fe640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13280b6540 0x7f13280b8a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1334009230 tx=0x7f1334000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:15.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.440+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1330014030 con 0x7f1340103b60 2024-09-21T01:13:15.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.672+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f134019b5b0 con 0x7f1340103b60 2024-09-21T01:13:15.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.673+0000 7f133d7fa640 1 -- 172.21.15.37:0/2178062590 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f134019b5b0 con 0x7f1340103b60 2024-09-21T01:13:15.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:15.675 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"btime":"2024-09-21T01:13:15:000490+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:13:15.675 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-09-21T01:13:15.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13280b6540 msgr2=0x7f13280b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13280b6540 0x7f13280b8a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1334009230 tx=0x7f1334000bc0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 msgr2=0x7f134019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 0x7f134019a480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f133000c920 tx=0x7f133000cde0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 shutdown_connections 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13280b6540 0x7f13280b8a50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1340109df0 0x7f134019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13401094a0 0x7f134019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 --2- 172.21.15.37:0/2178062590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1340103b60 0x7f134019a480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 >> 172.21.15.37:0/2178062590 conn(0x7f134007b850 msgr2=0x7f1340107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 shutdown_connections 2024-09-21T01:13:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:15.675+0000 7f13468a0640 1 -- 172.21.15.37:0/2178062590 wait complete. 2024-09-21T01:13:15.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:15.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: Deploying daemon mds.d on smithi037 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.37:6834/417404458,v1:172.21.15.37:6835/417404458] up:boot 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: fsmap 3 up:standby 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:13:16.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:15 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2178062590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: Deploying daemon mds.d on smithi037 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.37:6834/417404458,v1:172.21.15.37:6835/417404458] up:boot 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: fsmap 3 up:standby 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:13:16.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:15 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2178062590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: Deploying daemon mds.d on smithi037 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.37:6834/417404458,v1:172.21.15.37:6835/417404458] up:boot 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: fsmap 3 up:standby 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:13:16.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:15 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2178062590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:18.169 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:17 smithi037 ceph-mon[31105]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:18.170 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:17 smithi037 systemd[1]: Starting Ceph mds.d for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:18.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:17 smithi144 ceph-mon[34818]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:18.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:17 smithi137 ceph-mon[34607]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:18.448 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 podman[71865]: 2024-09-21 01:13:18.071876957 +0000 UTC m=+0.016653857 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:18.448 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 podman[71865]: 2024-09-21 01:13:18.195390148 +0000 UTC m=+0.140167032 container create c9a7e8a873d5e80de34cabfcd5e4d06e8b5e1cb9dc6263ed45895a0e69f38433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:13:18.448 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 podman[71865]: 2024-09-21 01:13:18.44810225 +0000 UTC m=+0.392879142 container init c9a7e8a873d5e80de34cabfcd5e4d06e8b5e1cb9dc6263ed45895a0e69f38433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:13:18.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:18.749 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 podman[71865]: 2024-09-21 01:13:18.451168392 +0000 UTC m=+0.395945284 container start c9a7e8a873d5e80de34cabfcd5e4d06e8b5e1cb9dc6263ed45895a0e69f38433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T01:13:18.750 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 ceph-mds[71884]: -- 172.21.15.37:0/2958204707 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568fb917860 con 0x5568ffabf600 2024-09-21T01:13:18.750 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d[71880]: starting mds.d at 2024-09-21T01:13:18.750 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 bash[71865]: c9a7e8a873d5e80de34cabfcd5e4d06e8b5e1cb9dc6263ed45895a0e69f38433 2024-09-21T01:13:18.750 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:13:18 smithi037 systemd[1]: Started Ceph mds.d for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:18.796 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 -- 172.21.15.37:0/827816859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c102ae0 msgr2=0x7fa79c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/827816859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c102ae0 0x7fa79c102ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa798009900 tx=0x7fa79802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 -- 172.21.15.37:0/827816859 shutdown_connections 2024-09-21T01:13:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/827816859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa79c108d20 0x7fa79c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/827816859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa79c1083d0 0x7fa79c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/827816859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c102ae0 0x7fa79c102ef0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 -- 172.21.15.37:0/827816859 >> 172.21.15.37:0/827816859 conn(0x7fa79c079760 msgr2=0x7fa79c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 -- 172.21.15.37:0/827816859 shutdown_connections 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.294+0000 7fa7a3f66640 1 -- 172.21.15.37:0/827816859 wait complete. 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 Processor -- start 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 -- start start 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa79c102ae0 0x7fa79c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 0x7fa79c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa79c108d20 0x7fa79c19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112990 con 0x7fa79c1083d0 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112810 con 0x7fa79c108d20 2024-09-21T01:13:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a3f66640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112b10 con 0x7fa79c102ae0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.295+0000 7fa7a1501640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 0x7fa79c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 0x7fa79c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53430/0 (socket says 172.21.15.37:53430) 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 -- 172.21.15.37:0/975703829 learned_addr learned my addr 172.21.15.37:0/975703829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1d02640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa79c102ae0 0x7fa79c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a2503640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa79c108d20 0x7fa79c19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 -- 172.21.15.37:0/975703829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa79c102ae0 msgr2=0x7fa79c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa79c102ae0 0x7fa79c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 -- 172.21.15.37:0/975703829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa79c108d20 msgr2=0x7fa79c19eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa79c108d20 0x7fa79c19eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 -- 172.21.15.37:0/975703829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c19f210 con 0x7fa79c1083d0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a1501640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 0x7fa79c199900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa78c007b50 tx=0x7fa78c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c01a070 con 0x7fa79c1083d0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78c007c40 con 0x7fa79c1083d0 2024-09-21T01:13:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c19f500 con 0x7fa79c1083d0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c003850 con 0x7fa79c1083d0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.296+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c06bb40 con 0x7fa79c1083d0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.297+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c103d10 con 0x7fa79c1083d0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.299+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa78c00eb30 con 0x7fa79c1083d0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.300+0000 7fa792ffd640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa7880b65c0 0x7fa7880b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.300+0000 7fa7a1d02640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa7880b65c0 0x7fa7880b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.300+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fa78c0e7e20 con 0x7fa79c1083d0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.300+0000 7fa7a1d02640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa7880b65c0 0x7fa7880b8ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa798031440 tx=0x7fa798009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.303+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa78c023080 con 0x7fa79c1083d0 2024-09-21T01:13:19.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.532+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa79c102ef0 con 0x7fa79c1083d0 2024-09-21T01:13:19.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.533+0000 7fa792ffd640 1 -- 172.21.15.37:0/975703829 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fa78c00ee20 con 0x7fa79c1083d0 2024-09-21T01:13:19.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:19.534 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"btime":"2024-09-21T01:13:18:850209+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:13:19.535 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 5 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa7880b65c0 msgr2=0x7fa7880b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa7880b65c0 0x7fa7880b8ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa798031440 tx=0x7fa798009560 comp rx=0 tx=0).stop 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 msgr2=0x7fa79c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 0x7fa79c199900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa78c007b50 tx=0x7fa78c00e420 comp rx=0 tx=0).stop 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 shutdown_connections 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa7880b65c0 0x7fa7880b8ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa79c108d20 0x7fa79c19eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa79c1083d0 0x7fa79c199900 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 --2- 172.21.15.37:0/975703829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa79c102ae0 0x7fa79c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 >> 172.21.15.37:0/975703829 conn(0x7fa79c079760 msgr2=0x7fa79c101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 shutdown_connections 2024-09-21T01:13:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:19.535+0000 7fa7a3f66640 1 -- 172.21.15.37:0/975703829 wait complete. 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: Deploying daemon mds.e on smithi137 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:19.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.37:6836/2567414723,v1:172.21.15.37:6837/2567414723] up:boot 2024-09-21T01:13:19.899 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: fsmap 4 up:standby 2024-09-21T01:13:19.899 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:13:19.899 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:19 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/975703829' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: Deploying daemon mds.e on smithi137 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.37:6836/2567414723,v1:172.21.15.37:6837/2567414723] up:boot 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: fsmap 4 up:standby 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:13:19.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:19 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/975703829' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:19.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: Deploying daemon mds.e on smithi137 2024-09-21T01:13:19.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:19.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.37:6836/2567414723,v1:172.21.15.37:6837/2567414723] up:boot 2024-09-21T01:13:19.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: fsmap 4 up:standby 2024-09-21T01:13:19.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:13:19.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:19 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/975703829' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:20.920 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:20 smithi137 systemd[1]: Starting Ceph mds.e for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:21.274 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 podman[62633]: 2024-09-21 01:13:20.903424014 +0000 UTC m=+0.016379321 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:21.274 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 podman[62633]: 2024-09-21 01:13:21.021529481 +0000 UTC m=+0.134484819 container create f72a4e880f505e9d6b04012814b48f8e1c32140306f2ca42e501337d09679826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:13:21.670 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 podman[62633]: 2024-09-21 01:13:21.274092047 +0000 UTC m=+0.387047343 container init f72a4e880f505e9d6b04012814b48f8e1c32140306f2ca42e501337d09679826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:13:21.671 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 podman[62633]: 2024-09-21 01:13:21.277106836 +0000 UTC m=+0.390062139 container start f72a4e880f505e9d6b04012814b48f8e1c32140306f2ca42e501337d09679826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T01:13:21.671 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 ceph-mds[62653]: -- 172.21.15.137:0/3624078807 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591b853b860 con 0x5591bc6e3180 2024-09-21T01:13:21.671 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e[62649]: starting mds.e at 2024-09-21T01:13:21.671 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 bash[62633]: f72a4e880f505e9d6b04012814b48f8e1c32140306f2ca42e501337d09679826 2024-09-21T01:13:21.671 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:13:21 smithi137 systemd[1]: Started Ceph mds.e for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:22.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:22.534 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:22.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:22.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: Deploying daemon mds.f on smithi144 2024-09-21T01:13:22.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6834/2865149890,v1:172.21.15.137:6835/2865149890] up:boot 2024-09-21T01:13:22.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: fsmap 5 up:standby 2024-09-21T01:13:22.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: Deploying daemon mds.f on smithi144 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6834/2865149890,v1:172.21.15.137:6835/2865149890] up:boot 2024-09-21T01:13:22.878 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: fsmap 5 up:standby 2024-09-21T01:13:22.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:13:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: Deploying daemon mds.f on smithi144 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6834/2865149890,v1:172.21.15.137:6835/2865149890] up:boot 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: fsmap 5 up:standby 2024-09-21T01:13:22.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:13:23.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 -- 172.21.15.37:0/524803400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f81094a0 msgr2=0x7f68f81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/524803400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f81094a0 0x7f68f81098b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009900 tx=0x7f68e802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 -- 172.21.15.37:0/524803400 shutdown_connections 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/524803400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f8109df0 0x7f68f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/524803400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f81094a0 0x7f68f81098b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/524803400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68f8103b60 0x7f68f8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 -- 172.21.15.37:0/524803400 >> 172.21.15.37:0/524803400 conn(0x7f68f807b850 msgr2=0x7f68f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 -- 172.21.15.37:0/524803400 shutdown_connections 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.051+0000 7f68ff4e9640 1 -- 172.21.15.37:0/524803400 wait complete. 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 Processor -- start 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 -- start start 2024-09-21T01:13:23.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f8103b60 0x7f68f819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68f81094a0 0x7f68f819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 0x7f68f819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8113ab0 con 0x7f68f8109df0 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8113930 con 0x7f68f8103b60 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68ff4e9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8113c30 con 0x7f68f81094a0 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68fda86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 0x7f68f819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68fda86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 0x7f68f819fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53444/0 (socket says 172.21.15.37:53444) 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68fda86640 1 -- 172.21.15.37:0/656774308 learned_addr learned my addr 172.21.15.37:0/656774308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68fd285640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f8103b60 0x7f68f819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68fca84640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68f81094a0 0x7f68f819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.052+0000 7f68fda86640 1 -- 172.21.15.37:0/656774308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68f81094a0 msgr2=0x7f68f819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68fda86640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68f81094a0 0x7f68f819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68fda86640 1 -- 172.21.15.37:0/656774308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f8103b60 msgr2=0x7f68f819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68fda86640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f8103b60 0x7f68f819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68fda86640 1 -- 172.21.15.37:0/656774308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f81a04f0 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68fda86640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 0x7f68f819fdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f68f000eaa0 tx=0x7f68f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f000cdb0 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68f0005020 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f81a07e0 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f00116d0 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.053+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f81a6f40 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.054+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f8103f70 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.056+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f68f00051d0 con 0x7f68f8109df0 2024-09-21T01:13:23.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.057+0000 7f68ee7fc640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68e40b6510 0x7f68e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:23.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.057+0000 7f68fd285640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68e40b6510 0x7f68e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:23.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.057+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f68f00e7290 con 0x7f68f8109df0 2024-09-21T01:13:23.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.058+0000 7f68fd285640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68e40b6510 0x7f68e40b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68f4005fd0 tx=0x7f68f400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:23.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.060+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68f0016030 con 0x7f68f8109df0 2024-09-21T01:13:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.286+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68f819b6b0 con 0x7f68f8109df0 2024-09-21T01:13:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.287+0000 7f68ee7fc640 1 -- 172.21.15.37:0/656774308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f68f819b6b0 con 0x7f68f8109df0 2024-09-21T01:13:23.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:23.288 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"btime":"2024-09-21T01:13:21:893605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T01:13:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2024-09-21T01:13:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68e40b6510 msgr2=0x7f68e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68e40b6510 0x7f68e40b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68f4005fd0 tx=0x7f68f400b390 comp rx=0 tx=0).stop 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 msgr2=0x7f68f819fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 0x7f68f819fdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f68f000eaa0 tx=0x7f68f000ef60 comp rx=0 tx=0).stop 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 shutdown_connections 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68e40b6510 0x7f68e40b8a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f8109df0 0x7f68f819fdc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68f81094a0 0x7f68f819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 --2- 172.21.15.37:0/656774308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f8103b60 0x7f68f819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 >> 172.21.15.37:0/656774308 conn(0x7f68f807b850 msgr2=0x7f68f8105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 shutdown_connections 2024-09-21T01:13:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:23.289+0000 7f68ff4e9640 1 -- 172.21.15.37:0/656774308 wait complete. 2024-09-21T01:13:23.420 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 systemd[1]: Starting Ceph mds.f for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:23.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:23 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/656774308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:23.693 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:23 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/656774308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:23.693 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 podman[63499]: 2024-09-21 01:13:23.460569226 +0000 UTC m=+0.016046741 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:23.693 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 podman[63499]: 2024-09-21 01:13:23.572089143 +0000 UTC m=+0.127566648 container create 7d8ea037f972add8203108908c518f937e0316ce362c0fe092c4737c98aadef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:13:23.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:23 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/656774308' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:24.171 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 podman[63499]: 2024-09-21 01:13:23.799890276 +0000 UTC m=+0.355367776 container init 7d8ea037f972add8203108908c518f937e0316ce362c0fe092c4737c98aadef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:13:24.171 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 podman[63499]: 2024-09-21 01:13:23.802779682 +0000 UTC m=+0.358257183 container start 7d8ea037f972add8203108908c518f937e0316ce362c0fe092c4737c98aadef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T01:13:24.172 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 ceph-mds[63519]: -- 172.21.15.144:0/2058191666 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55592081d860 con 0x5559249c5a80 2024-09-21T01:13:24.172 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f[63515]: starting mds.f at 2024-09-21T01:13:24.172 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 bash[63499]: 7d8ea037f972add8203108908c518f937e0316ce362c0fe092c4737c98aadef6 2024-09-21T01:13:24.172 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:13:23 smithi144 systemd[1]: Started Ceph mds.f for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:24.593 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:24.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:24.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:25.633 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:25 smithi144 ceph-mon[34818]: Deploying daemon mds.c on smithi144 2024-09-21T01:13:25.633 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:25 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] up:boot 2024-09-21T01:13:25.633 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:25 smithi144 ceph-mon[34818]: fsmap 6 up:standby 2024-09-21T01:13:25.633 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:25 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:13:25.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:25 smithi037 ceph-mon[31105]: Deploying daemon mds.c on smithi144 2024-09-21T01:13:25.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:25 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] up:boot 2024-09-21T01:13:25.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:25 smithi037 ceph-mon[31105]: fsmap 6 up:standby 2024-09-21T01:13:25.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:25 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:13:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:25 smithi137 ceph-mon[34607]: Deploying daemon mds.c on smithi144 2024-09-21T01:13:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:25 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] up:boot 2024-09-21T01:13:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:25 smithi137 ceph-mon[34607]: fsmap 6 up:standby 2024-09-21T01:13:25.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:25 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:13:25.921 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:25 smithi144 systemd[1]: Starting Ceph mds.c for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:26.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:26.339 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 podman[63771]: 2024-09-21 01:13:25.926495029 +0000 UTC m=+0.016033958 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:26.339 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 podman[63771]: 2024-09-21 01:13:26.044321362 +0000 UTC m=+0.133860324 container create 1fba584d2053551498a22069cf5ffa708e03cfb9b191ac76b0550cb646659ea8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:13:26.339 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 podman[63771]: 2024-09-21 01:13:26.339105929 +0000 UTC m=+0.428644859 container init 1fba584d2053551498a22069cf5ffa708e03cfb9b191ac76b0550cb646659ea8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:13:26.385 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:26.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:26 smithi144 ceph-mon[34818]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:26.671 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 podman[63771]: 2024-09-21 01:13:26.342068798 +0000 UTC m=+0.431607726 container start 1fba584d2053551498a22069cf5ffa708e03cfb9b191ac76b0550cb646659ea8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:13:26.671 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 ceph-mds[63790]: -- 172.21.15.144:0/1107434935 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56113c9fb860 con 0x561140ba3a80 2024-09-21T01:13:26.671 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c[63786]: starting mds.c at 2024-09-21T01:13:26.671 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 bash[63771]: 1fba584d2053551498a22069cf5ffa708e03cfb9b191ac76b0550cb646659ea8 2024-09-21T01:13:26.671 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:13:26 smithi144 systemd[1]: Started Ceph mds.c for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:26.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:26 smithi037 ceph-mon[31105]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:26.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 -- 172.21.15.37:0/1962388392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d241094c0 msgr2=0x7f6d241098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 --2- 172.21.15.37:0/1962388392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d241094c0 0x7f6d241098d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009860 tx=0x7f6d1802a340 comp rx=0 tx=0).stop 2024-09-21T01:13:26.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 -- 172.21.15.37:0/1962388392 shutdown_connections 2024-09-21T01:13:26.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 --2- 172.21.15.37:0/1962388392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d24110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 --2- 172.21.15.37:0/1962388392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d241094c0 0x7f6d241098d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 --2- 172.21.15.37:0/1962388392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d24103b80 0x7f6d24103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 -- 172.21.15.37:0/1962388392 >> 172.21.15.37:0/1962388392 conn(0x7f6d240ff610 msgr2=0x7f6d24101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 -- 172.21.15.37:0/1962388392 shutdown_connections 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 -- 172.21.15.37:0/1962388392 wait complete. 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 Processor -- start 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.864+0000 7f6d2c631640 1 -- start start 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2c631640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d24103b80 0x7f6d2419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2c631640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d241094c0 0x7f6d2419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2c631640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d2419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2c631640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24113ad0 con 0x7f6d24109e10 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2c631640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24113950 con 0x7f6d241094c0 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2c631640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24113c50 con 0x7f6d24103b80 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d2419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d2419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46074/0 (socket says 172.21.15.37:46074) 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 -- 172.21.15.37:0/3597724951 learned_addr learned my addr 172.21.15.37:0/3597724951 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2a3cd640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d24103b80 0x7f6d2419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d29bcc640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d241094c0 0x7f6d2419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 -- 172.21.15.37:0/3597724951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d24103b80 msgr2=0x7f6d2419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d24103b80 0x7f6d2419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 -- 172.21.15.37:0/3597724951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d241094c0 msgr2=0x7f6d2419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d241094c0 0x7f6d2419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2abce640 1 -- 172.21.15.37:0/3597724951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d241a0470 con 0x7f6d24109e10 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.865+0000 7f6d2a3cd640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d24103b80 0x7f6d2419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.866+0000 7f6d2abce640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d2419fd40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00e940 tx=0x7f6d1c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.866+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00cd80 con 0x7f6d24109e10 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.866+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d1c0035f0 con 0x7f6d24109e10 2024-09-21T01:13:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.866+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d241a0760 con 0x7f6d24109e10 2024-09-21T01:13:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.866+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c010670 con 0x7f6d24109e10 2024-09-21T01:13:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.866+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d241a6ec0 con 0x7f6d24109e10 2024-09-21T01:13:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.867+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d24104e00 con 0x7f6d24109e10 2024-09-21T01:13:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.870+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6d1c003ac0 con 0x7f6d24109e10 2024-09-21T01:13:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.871+0000 7f6d177fe640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d100b6510 0x7f6d100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:26.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.871+0000 7f6d2a3cd640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d100b6510 0x7f6d100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:26.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.871+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f6d1c0e72b0 con 0x7f6d24109e10 2024-09-21T01:13:26.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.872+0000 7f6d2a3cd640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d100b6510 0x7f6d100b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d20005fd0 tx=0x7f6d20009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:26.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:26.873+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d1c0adfd0 con 0x7f6d24109e10 2024-09-21T01:13:26.901 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:26 smithi137 ceph-mon[34607]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.102+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d24103f90 con 0x7f6d24109e10 2024-09-21T01:13:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.102+0000 7f6d177fe640 1 -- 172.21.15.37:0/3597724951 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f6d24103f90 con 0x7f6d24109e10 2024-09-21T01:13:27.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:27.103 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"btime":"2024-09-21T01:13:26:445917+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T01:13:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-09-21T01:13:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d100b6510 msgr2=0x7f6d100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d100b6510 0x7f6d100b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d20005fd0 tx=0x7f6d20009500 comp rx=0 tx=0).stop 2024-09-21T01:13:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 msgr2=0x7f6d2419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d2419fd40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00e940 tx=0x7f6d1c00ee00 comp rx=0 tx=0).stop 2024-09-21T01:13:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 shutdown_connections 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6d100b6510 0x7f6d100b8a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d24109e10 0x7f6d2419fd40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d241094c0 0x7f6d2419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 --2- 172.21.15.37:0/3597724951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d24103b80 0x7f6d2419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 >> 172.21.15.37:0/3597724951 conn(0x7f6d240ff610 msgr2=0x7f6d24101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 shutdown_connections 2024-09-21T01:13:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:27.105+0000 7f6d2c631640 1 -- 172.21.15.37:0/3597724951 wait complete. 2024-09-21T01:13:27.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] up:boot 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: fsmap 7 up:standby 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: Deploying daemon mds.h on smithi137 2024-09-21T01:13:27.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:27 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3597724951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:27.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] up:boot 2024-09-21T01:13:27.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: fsmap 7 up:standby 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: Deploying daemon mds.h on smithi137 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:27 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3597724951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:27.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] up:boot 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: fsmap 7 up:standby 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: Deploying daemon mds.h on smithi137 2024-09-21T01:13:27.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:27 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3597724951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:28.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:28 smithi137 ceph-mon[34607]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:28.671 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:28 smithi137 systemd[1]: Starting Ceph mds.h for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:28.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:28 smithi144 ceph-mon[34818]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:28.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:28 smithi037 ceph-mon[31105]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:29.025 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:28 smithi137 podman[62901]: 2024-09-21 01:13:28.650522941 +0000 UTC m=+0.015729745 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:29.025 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:28 smithi137 podman[62901]: 2024-09-21 01:13:28.76054767 +0000 UTC m=+0.125754465 container create 457d3d215bf6ac90664e47bb8e33e2d691688465c7a304f22257ff0a00c43e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:13:29.025 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:28 smithi137 podman[62901]: 2024-09-21 01:13:28.988028745 +0000 UTC m=+0.353235540 container init 457d3d215bf6ac90664e47bb8e33e2d691688465c7a304f22257ff0a00c43e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T01:13:29.025 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:28 smithi137 podman[62901]: 2024-09-21 01:13:28.990906166 +0000 UTC m=+0.356112970 container start 457d3d215bf6ac90664e47bb8e33e2d691688465c7a304f22257ff0a00c43e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:13:29.025 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:29 smithi137 ceph-mds[62920]: -- 172.21.15.137:0/1860622561 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561558cbfc20 con 0x56155ce67a80 2024-09-21T01:13:29.420 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:29 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h[62916]: starting mds.h at 2024-09-21T01:13:29.420 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:29 smithi137 bash[62901]: 457d3d215bf6ac90664e47bb8e33e2d691688465c7a304f22257ff0a00c43e74 2024-09-21T01:13:29.420 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:13:29 smithi137 systemd[1]: Started Ceph mds.h for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:29.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: Deploying daemon mds.i on smithi144 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] up:boot 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: fsmap 8 up:standby 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: Deploying daemon mds.i on smithi144 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] up:boot 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: fsmap 8 up:standby 2024-09-21T01:13:30.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:13:30.485 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: Deploying daemon mds.i on smithi144 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] up:boot 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: fsmap 8 up:standby 2024-09-21T01:13:30.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:13:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 -- 172.21.15.37:0/208565171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea0103b60 msgr2=0x7f5ea0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/208565171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea0103b60 0x7f5ea0103f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009900 tx=0x7f5e9802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 -- 172.21.15.37:0/208565171 shutdown_connections 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/208565171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea0109df0 0x7f5ea0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/208565171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea01094a0 0x7f5ea01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/208565171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea0103b60 0x7f5ea0103f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 -- 172.21.15.37:0/208565171 >> 172.21.15.37:0/208565171 conn(0x7f5ea007b850 msgr2=0x7f5ea007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 -- 172.21.15.37:0/208565171 shutdown_connections 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.578+0000 7f5ea59eb640 1 -- 172.21.15.37:0/208565171 wait complete. 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 Processor -- start 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 -- start start 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea0103b60 0x7f5ea019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 0x7f5ea019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea0109df0 0x7f5ea019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0113ab0 con 0x7f5ea01094a0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0113930 con 0x7f5ea0103b60 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5ea59eb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0113c30 con 0x7f5ea0109df0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5e9e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 0x7f5ea019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5e9e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 0x7f5ea019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46084/0 (socket says 172.21.15.37:46084) 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5e9e7fc640 1 -- 172.21.15.37:0/1451836349 learned_addr learned my addr 172.21.15.37:0/1451836349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5e9effd640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea0103b60 0x7f5ea019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.579+0000 7f5e9f7fe640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea0109df0 0x7f5ea019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5e9e7fc640 1 -- 172.21.15.37:0/1451836349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea0109df0 msgr2=0x7f5ea019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5e9e7fc640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea0109df0 0x7f5ea019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5e9e7fc640 1 -- 172.21.15.37:0/1451836349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea0103b60 msgr2=0x7f5ea019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5e9e7fc640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea0103b60 0x7f5ea019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5e9e7fc640 1 -- 172.21.15.37:0/1451836349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea01a03d0 con 0x7f5ea01094a0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5e9e7fc640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 0x7f5ea019aac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d750 tx=0x7f5e8800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88017070 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e880054d0 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea01a06c0 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88004c30 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.580+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea01a6ee0 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.581+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea0104de0 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.583+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5e88004dd0 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.583+0000 7f5ea49e9640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e8c0b65c0 0x7f5e8c0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.583+0000 7f5e9effd640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e8c0b65c0 0x7f5e8c0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.584+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f5e880e6c40 con 0x7f5ea01094a0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.584+0000 7f5e9effd640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e8c0b65c0 0x7f5e8c0b8ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e98031440 tx=0x7f5e98005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.587+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e880ad9f0 con 0x7f5ea01094a0 2024-09-21T01:13:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.815+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ea010bbc0 con 0x7f5ea01094a0 2024-09-21T01:13:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.815+0000 7f5ea49e9640 1 -- 172.21.15.37:0/1451836349 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7f5e880b1dd0 con 0x7f5ea01094a0 2024-09-21T01:13:30.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:30.816 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"btime":"2024-09-21T01:13:29:510838+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T01:13:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.817+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e8c0b65c0 msgr2=0x7f5e8c0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.817+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e8c0b65c0 0x7f5e8c0b8ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e98031440 tx=0x7f5e98005d50 comp rx=0 tx=0).stop 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.817+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 msgr2=0x7f5ea019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.817+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 0x7f5ea019aac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d750 tx=0x7f5e8800dc10 comp rx=0 tx=0).stop 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 shutdown_connections 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e8c0b65c0 0x7f5e8c0b8ad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ea0109df0 0x7f5ea019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ea01094a0 0x7f5ea019aac0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 --2- 172.21.15.37:0/1451836349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ea0103b60 0x7f5ea019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 >> 172.21.15.37:0/1451836349 conn(0x7f5ea007b850 msgr2=0x7f5ea01075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 shutdown_connections 2024-09-21T01:13:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:30.818+0000 7f5ea59eb640 1 -- 172.21.15.37:0/1451836349 wait complete. 2024-09-21T01:13:31.154 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 systemd[1]: Starting Ceph mds.i for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:31.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:31 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1451836349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:31.421 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 podman[64043]: 2024-09-21 01:13:31.13943383 +0000 UTC m=+0.016143721 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:31.421 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 podman[64043]: 2024-09-21 01:13:31.300164613 +0000 UTC m=+0.176874495 container create 20efc98198f176961a019023e6d0953da9416ce9028aa865306d4914e1b95b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:13:31.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:31 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1451836349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:31.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:31 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1451836349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:31.921 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 podman[64043]: 2024-09-21 01:13:31.553103952 +0000 UTC m=+0.429813834 container init 20efc98198f176961a019023e6d0953da9416ce9028aa865306d4914e1b95b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:13:31.921 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 podman[64043]: 2024-09-21 01:13:31.555886705 +0000 UTC m=+0.432596587 container start 20efc98198f176961a019023e6d0953da9416ce9028aa865306d4914e1b95b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T01:13:31.921 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 ceph-mds[64062]: -- 172.21.15.144:0/1930833762 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c76da5d860 con 0x55c771c05a80 2024-09-21T01:13:31.921 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i[64058]: starting mds.i at 2024-09-21T01:13:31.921 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 bash[64043]: 20efc98198f176961a019023e6d0953da9416ce9028aa865306d4914e1b95b15 2024-09-21T01:13:31.921 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:13:31 smithi144 systemd[1]: Started Ceph mds.i for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:32.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:32.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.394 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:32.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:32.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:32 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:32.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:32 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:32.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:32.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:32.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:32.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:32 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:33.436 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:33 smithi144 ceph-mon[34818]: Deploying daemon mds.g on smithi037 2024-09-21T01:13:33.436 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:33 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] up:boot 2024-09-21T01:13:33.436 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:33 smithi144 ceph-mon[34818]: fsmap 9 up:standby 2024-09-21T01:13:33.436 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:33 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:13:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:33 smithi037 ceph-mon[31105]: Deploying daemon mds.g on smithi037 2024-09-21T01:13:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:33 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] up:boot 2024-09-21T01:13:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:33 smithi037 ceph-mon[31105]: fsmap 9 up:standby 2024-09-21T01:13:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:33 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:13:33.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:33.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:33 smithi137 ceph-mon[34607]: Deploying daemon mds.g on smithi037 2024-09-21T01:13:33.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:33 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] up:boot 2024-09-21T01:13:33.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:33 smithi137 ceph-mon[34607]: fsmap 9 up:standby 2024-09-21T01:13:33.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:33 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:13:33.826 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:33 smithi037 podman[72622]: 2024-09-21 01:13:33.693495391 +0000 UTC m=+0.017896554 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:33.826 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:33 smithi037 podman[72622]: 2024-09-21 01:13:33.826200681 +0000 UTC m=+0.150601823 container create 70a929329e5798c34beed350838164d2cfa53f34a5c42898d265438f04914137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:13:34.108 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:34 smithi037 podman[72622]: 2024-09-21 01:13:34.071014354 +0000 UTC m=+0.395415515 container init 70a929329e5798c34beed350838164d2cfa53f34a5c42898d265438f04914137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:13:34.108 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:34 smithi037 podman[72622]: 2024-09-21 01:13:34.074406876 +0000 UTC m=+0.398808020 container start 70a929329e5798c34beed350838164d2cfa53f34a5c42898d265438f04914137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:13:34.242 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:34.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:34 smithi037 ceph-mon[31105]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:34.365 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:34 smithi037 ceph-mds[72666]: -- 172.21.15.37:0/1099248314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c44ea3860 con 0x558c4904b180 2024-09-21T01:13:34.365 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g[72650]: starting mds.g at 2024-09-21T01:13:34.365 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:34 smithi037 bash[72622]: 70a929329e5798c34beed350838164d2cfa53f34a5c42898d265438f04914137 2024-09-21T01:13:34.365 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:13:34 smithi037 systemd[1]: Started Ceph mds.g for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:34.648 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:34 smithi144 ceph-mon[34818]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:34 smithi137 ceph-mon[34607]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 -- 172.21.15.37:0/3799406914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12881084c0 msgr2=0x7f128810ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 --2- 172.21.15.37:0/3799406914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12881084c0 0x7f128810ecf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1280009ca0 tx=0x7f128002a8e0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 -- 172.21.15.37:0/3799406914 shutdown_connections 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 --2- 172.21.15.37:0/3799406914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12881084c0 0x7f128810ecf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 --2- 172.21.15.37:0/3799406914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1288107b70 0x7f1288107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 --2- 172.21.15.37:0/3799406914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1288102230 0x7f1288102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 -- 172.21.15.37:0/3799406914 >> 172.21.15.37:0/3799406914 conn(0x7f1288079e40 msgr2=0x7f128807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 -- 172.21.15.37:0/3799406914 shutdown_connections 2024-09-21T01:13:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.884+0000 7f128e3b7640 1 -- 172.21.15.37:0/3799406914 wait complete. 2024-09-21T01:13:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 Processor -- start 2024-09-21T01:13:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 -- start start 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 0x7f128819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1288107b70 0x7f128819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12881084c0 0x7f128819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1288113b50 con 0x7f1288102230 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12881139d0 con 0x7f12881084c0 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f128e3b7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1288113cd0 con 0x7f1288107b70 2024-09-21T01:13:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f1287fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 0x7f128819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f1287fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 0x7f128819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46106/0 (socket says 172.21.15.37:46106) 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f1287fff640 1 -- 172.21.15.37:0/721002683 learned_addr learned my addr 172.21.15.37:0/721002683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.885+0000 7f12877fe640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1288107b70 0x7f128819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f128c954640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12881084c0 0x7f128819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f1287fff640 1 -- 172.21.15.37:0/721002683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1288107b70 msgr2=0x7f128819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f1287fff640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1288107b70 0x7f128819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f1287fff640 1 -- 172.21.15.37:0/721002683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12881084c0 msgr2=0x7f128819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f1287fff640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12881084c0 0x7f128819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f1287fff640 1 -- 172.21.15.37:0/721002683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12881a0410 con 0x7f1288102230 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f128c954640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12881084c0 0x7f128819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f1287fff640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 0x7f128819a4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f127800d950 tx=0x7f127800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278017070 con 0x7f1288102230 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f127800de80 con 0x7f1288102230 2024-09-21T01:13:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12881a0700 con 0x7f1288102230 2024-09-21T01:13:34.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127800f620 con 0x7f1288102230 2024-09-21T01:13:34.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.886+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12881a6ee0 con 0x7f1288102230 2024-09-21T01:13:34.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.887+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1288102640 con 0x7f1288102230 2024-09-21T01:13:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.890+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1278009c30 con 0x7f1288102230 2024-09-21T01:13:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.891+0000 7f12857fa640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12700b6590 0x7f12700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.891+0000 7f12877fe640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12700b6590 0x7f12700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.891+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f12780e6a30 con 0x7f1288102230 2024-09-21T01:13:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.891+0000 7f12877fe640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12700b6590 0x7f12700b8aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1288107810 tx=0x7f127c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:34.894+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12780ad740 con 0x7f1288102230 2024-09-21T01:13:35.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.127+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f128810a310 con 0x7f1288102230 2024-09-21T01:13:35.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.128+0000 7f12857fa640 1 -- 172.21.15.37:0/721002683 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f12780b1b20 con 0x7f1288102230 2024-09-21T01:13:35.129 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:35.129 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"btime":"2024-09-21T01:13:35:035653+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T01:13:35.129 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.130+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12700b6590 msgr2=0x7f12700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.130+0000 7f128e3b7640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12700b6590 0x7f12700b8aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1288107810 tx=0x7f127c009110 comp rx=0 tx=0).stop 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 msgr2=0x7f128819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 0x7f128819a4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f127800d950 tx=0x7f127800dd50 comp rx=0 tx=0).stop 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 shutdown_connections 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12700b6590 0x7f12700b8aa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12881084c0 0x7f128819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1288107b70 0x7f128819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 --2- 172.21.15.37:0/721002683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1288102230 0x7f128819a4a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 >> 172.21.15.37:0/721002683 conn(0x7f1288079e40 msgr2=0x7f1288105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 shutdown_connections 2024-09-21T01:13:35.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:35.131+0000 7f128e3b7640 1 -- 172.21.15.37:0/721002683 wait complete. 2024-09-21T01:13:35.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: Deploying daemon mds.a on smithi037 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.37:6838/3638461031,v1:172.21.15.37:6839/3638461031] up:boot 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: fsmap 10 up:standby 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:13:35.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:35 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/721002683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:35.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: Deploying daemon mds.a on smithi037 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.37:6838/3638461031,v1:172.21.15.37:6839/3638461031] up:boot 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: fsmap 10 up:standby 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:13:35.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:35 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/721002683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: Deploying daemon mds.a on smithi037 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.37:6838/3638461031,v1:172.21.15.37:6839/3638461031] up:boot 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: fsmap 10 up:standby 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:13:35.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:35 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/721002683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:36 smithi144 ceph-mon[34818]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:36.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:36 smithi137 ceph-mon[34607]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:36.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:36 smithi037 ceph-mon[31105]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:37.500 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 systemd[1]: Starting Ceph mds.a for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:37.817 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 podman[72992]: 2024-09-21 01:13:37.453491282 +0000 UTC m=+0.016669901 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:37.817 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 podman[72992]: 2024-09-21 01:13:37.559473883 +0000 UTC m=+0.122652479 container create 8cf5976f2e6ce5bbf3eacf5c44a371b24ce09788a6f18a4c3f7087bd29b6d74f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:13:37.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:38.129 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 podman[72992]: 2024-09-21 01:13:37.817211692 +0000 UTC m=+0.380390308 container init 8cf5976f2e6ce5bbf3eacf5c44a371b24ce09788a6f18a4c3f7087bd29b6d74f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T01:13:38.129 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 podman[72992]: 2024-09-21 01:13:37.820211712 +0000 UTC m=+0.383390306 container start 8cf5976f2e6ce5bbf3eacf5c44a371b24ce09788a6f18a4c3f7087bd29b6d74f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T01:13:38.129 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 ceph-mds[73011]: -- 172.21.15.37:0/895664764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c25c39860 con 0x558c29de1600 2024-09-21T01:13:38.129 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a[73007]: starting mds.a at 2024-09-21T01:13:38.130 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 bash[72992]: 8cf5976f2e6ce5bbf3eacf5c44a371b24ce09788a6f18a4c3f7087bd29b6d74f 2024-09-21T01:13:38.130 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:13:37 smithi037 systemd[1]: Started Ceph mds.a for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:38.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:38.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:38 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:38.555 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:38 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:38.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:38.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:13:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:13:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:38 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 -- 172.21.15.37:0/3813563469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4850108d10 msgr2=0x7f485010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 --2- 172.21.15.37:0/3813563469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4850108d10 0x7f485010f540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4848009900 tx=0x7f484802a410 comp rx=0 tx=0).stop 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 -- 172.21.15.37:0/3813563469 shutdown_connections 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 --2- 172.21.15.37:0/3813563469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4850108d10 0x7f485010f540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 --2- 172.21.15.37:0/3813563469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48501083c0 0x7f48501087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 --2- 172.21.15.37:0/3813563469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4850102a80 0x7f4850102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 -- 172.21.15.37:0/3813563469 >> 172.21.15.37:0/3813563469 conn(0x7f4850079740 msgr2=0x7f4850079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 -- 172.21.15.37:0/3813563469 shutdown_connections 2024-09-21T01:13:38.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.683+0000 7f4854f11640 1 -- 172.21.15.37:0/3813563469 wait complete. 2024-09-21T01:13:38.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.684+0000 7f4854f11640 1 Processor -- start 2024-09-21T01:13:38.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.684+0000 7f4854f11640 1 -- start start 2024-09-21T01:13:38.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.684+0000 7f4854f11640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4850102a80 0x7f485019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.684+0000 7f4854f11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 0x7f485019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f4854f11640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4850108d10 0x7f485019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f4854f11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4850113aa0 con 0x7f48501083c0 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f4854f11640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4850113920 con 0x7f4850108d10 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f4854f11640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4850113c20 con 0x7f4850102a80 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 0x7f485019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 0x7f485019a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35778/0 (socket says 172.21.15.37:35778) 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 -- 172.21.15.37:0/1417577647 learned_addr learned my addr 172.21.15.37:0/1417577647 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484ed9d640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4850108d10 0x7f485019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484e59c640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4850102a80 0x7f485019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 -- 172.21.15.37:0/1417577647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4850102a80 msgr2=0x7f485019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4850102a80 0x7f485019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 -- 172.21.15.37:0/1417577647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4850108d10 msgr2=0x7f485019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4850108d10 0x7f485019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 -- 172.21.15.37:0/1417577647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48501a0360 con 0x7f48501083c0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.685+0000 7f484dd9b640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 0x7f485019a990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9c0 tx=0x7f484400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.686+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484400cd80 con 0x7f48501083c0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.686+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48501a0650 con 0x7f48501083c0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.686+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48440054d0 con 0x7f48501083c0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.686+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844010430 con 0x7f48501083c0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.686+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48501a6db0 con 0x7f48501083c0 2024-09-21T01:13:38.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.687+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4850102e90 con 0x7f48501083c0 2024-09-21T01:13:38.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.690+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4844004fb0 con 0x7f48501083c0 2024-09-21T01:13:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.690+0000 7f483f7fe640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f48380b6590 0x7f48380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.691+0000 7f484e59c640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f48380b6590 0x7f48380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.691+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f48440e73c0 con 0x7f48501083c0 2024-09-21T01:13:38.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.691+0000 7f484e59c640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f48380b6590 0x7f48380b8aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4840005fd0 tx=0x7f4840009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:38.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.694+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4844056710 con 0x7f48501083c0 2024-09-21T01:13:38.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.921+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f485019b520 con 0x7f48501083c0 2024-09-21T01:13:38.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.921+0000 7f483f7fe640 1 -- 172.21.15.37:0/1417577647 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f485019b520 con 0x7f48501083c0 2024-09-21T01:13:38.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:38.922 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"btime":"2024-09-21T01:13:38:257496+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T01:13:38.923 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-09-21T01:13:38.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f48380b6590 msgr2=0x7f48380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f48380b6590 0x7f48380b8aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4840005fd0 tx=0x7f4840009500 comp rx=0 tx=0).stop 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 msgr2=0x7f485019a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 0x7f485019a990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9c0 tx=0x7f484400ee80 comp rx=0 tx=0).stop 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 shutdown_connections 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f48380b6590 0x7f48380b8aa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4850108d10 0x7f485019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48501083c0 0x7f485019a990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 --2- 172.21.15.37:0/1417577647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4850102a80 0x7f485019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 >> 172.21.15.37:0/1417577647 conn(0x7f4850079740 msgr2=0x7f4850105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 shutdown_connections 2024-09-21T01:13:38.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:38.924+0000 7f4854f11640 1 -- 172.21.15.37:0/1417577647 wait complete. 2024-09-21T01:13:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:39 smithi137 ceph-mon[34607]: Deploying daemon mds.b on smithi137 2024-09-21T01:13:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:39 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.37:6840/3072910125,v1:172.21.15.37:6841/3072910125] up:boot 2024-09-21T01:13:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:39 smithi137 ceph-mon[34607]: fsmap 11 up:standby 2024-09-21T01:13:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:39 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:13:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:39 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1417577647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:39.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:39 smithi037 ceph-mon[31105]: Deploying daemon mds.b on smithi137 2024-09-21T01:13:39.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:39 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.37:6840/3072910125,v1:172.21.15.37:6841/3072910125] up:boot 2024-09-21T01:13:39.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:39 smithi037 ceph-mon[31105]: fsmap 11 up:standby 2024-09-21T01:13:39.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:39 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:13:39.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:39 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1417577647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:39.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:39 smithi144 ceph-mon[34818]: Deploying daemon mds.b on smithi137 2024-09-21T01:13:39.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:39 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.37:6840/3072910125,v1:172.21.15.37:6841/3072910125] up:boot 2024-09-21T01:13:39.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:39 smithi144 ceph-mon[34818]: fsmap 11 up:standby 2024-09-21T01:13:39.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:39 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:13:39.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:39 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1417577647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:40.170 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 systemd[1]: Starting Ceph mds.b for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:13:40.518 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 podman[63184]: 2024-09-21 01:13:40.134411851 +0000 UTC m=+0.015894368 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:13:40.518 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 podman[63184]: 2024-09-21 01:13:40.256879957 +0000 UTC m=+0.138362510 container create 8b6428249525b0f7d743104212a8cd0fa976fad48db682cada3d3ba70bb600b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:13:40.518 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:40 smithi137 ceph-mon[34607]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:40.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:40 smithi144 ceph-mon[34818]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:40.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:40 smithi037 ceph-mon[31105]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:40.920 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 podman[63184]: 2024-09-21 01:13:40.518164447 +0000 UTC m=+0.399646952 container init 8b6428249525b0f7d743104212a8cd0fa976fad48db682cada3d3ba70bb600b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:13:40.920 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 podman[63184]: 2024-09-21 01:13:40.521152698 +0000 UTC m=+0.402635206 container start 8b6428249525b0f7d743104212a8cd0fa976fad48db682cada3d3ba70bb600b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:13:40.920 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 ceph-mds[63203]: -- 172.21.15.137:0/1370104943 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb98397860 con 0x55bb9c53fa80 2024-09-21T01:13:40.921 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: starting mds.b at 2024-09-21T01:13:40.921 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 bash[63184]: 8b6428249525b0f7d743104212a8cd0fa976fad48db682cada3d3ba70bb600b3 2024-09-21T01:13:40.921 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:40 smithi137 systemd[1]: Started Ceph mds.b for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:13:41.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:13:41.889 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:41.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] up:boot 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: fsmap 12 up:standby 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:41.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] up:boot 2024-09-21T01:13:41.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: fsmap 12 up:standby 2024-09-21T01:13:41.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:13:41.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:41.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] up:boot 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: fsmap 12 up:standby 2024-09-21T01:13:42.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:13:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 -- 172.21.15.37:0/4275748088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78108480 msgr2=0x7f0f78108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/4275748088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78108480 0x7f0f78108890 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009900 tx=0x7f0f6c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 -- 172.21.15.37:0/4275748088 shutdown_connections 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/4275748088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108dd0 0x7f0f7810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/4275748088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78108480 0x7f0f78108890 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/4275748088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f78102b40 0x7f0f78102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 -- 172.21.15.37:0/4275748088 >> 172.21.15.37:0/4275748088 conn(0x7f0f78079750 msgr2=0x7f0f78079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 -- 172.21.15.37:0/4275748088 shutdown_connections 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 -- 172.21.15.37:0/4275748088 wait complete. 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.435+0000 7f0f7fc34640 1 Processor -- start 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 -- start start 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 0x7f0f780ff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108480 0x7f0f780ffbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f78108dd0 0x7f0f78100120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f781129a0 con 0x7f0f78102b40 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f78112820 con 0x7f0f78108480 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7fc34640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f78112b20 con 0x7f0f78108dd0 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 0x7f0f780ff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 0x7f0f780ff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35790/0 (socket says 172.21.15.37:35790) 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 -- 172.21.15.37:0/1268676256 learned_addr learned my addr 172.21.15.37:0/1268676256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7e1d1640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f78108dd0 0x7f0f78100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d1cf640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108480 0x7f0f780ffbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 -- 172.21.15.37:0/1268676256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f78108dd0 msgr2=0x7f0f78100120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f78108dd0 0x7f0f78100120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 -- 172.21.15.37:0/1268676256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108480 msgr2=0x7f0f780ffbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108480 0x7f0f780ffbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 -- 172.21.15.37:0/1268676256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f781a8750 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d1cf640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108480 0x7f0f780ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.436+0000 7f0f7d9d0640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 0x7f0f780ff6a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400e9f0 tx=0x7f0f7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.437+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400cd80 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.437+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f740054d0 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.437+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f781a8a40 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.437+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74010690 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.437+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f781a8f50 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.438+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f78103dc0 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.439+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0f74004e90 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.440+0000 7f0f6affd640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0f640b6590 0x7f0f640b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.440+0000 7f0f7d1cf640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0f640b6590 0x7f0f640b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.440+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f0f740e72a0 con 0x7f0f78102b40 2024-09-21T01:13:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.441+0000 7f0f7d1cf640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0f640b6590 0x7f0f640b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c000c00 tx=0x7f0f6c032da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.445+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f740adfd0 con 0x7f0f78102b40 2024-09-21T01:13:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.684+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f781009a0 con 0x7f0f78102b40 2024-09-21T01:13:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.684+0000 7f0f6affd640 1 -- 172.21.15.37:0/1268676256 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f0f740b23b0 con 0x7f0f78102b40 2024-09-21T01:13:42.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:42.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"btime":"2024-09-21T01:13:41:273685+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24554,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24604,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T01:13:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-09-21T01:13:42.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0f640b6590 msgr2=0x7f0f640b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:42.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0f640b6590 0x7f0f640b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c000c00 tx=0x7f0f6c032da0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 msgr2=0x7f0f780ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 0x7f0f780ff6a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400e9f0 tx=0x7f0f7400edf0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 shutdown_connections 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0f640b6590 0x7f0f640b8aa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f78108dd0 0x7f0f78100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f78108480 0x7f0f780ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 --2- 172.21.15.37:0/1268676256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f78102b40 0x7f0f780ff6a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 >> 172.21.15.37:0/1268676256 conn(0x7f0f78079750 msgr2=0x7f0f78101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 shutdown_connections 2024-09-21T01:13:42.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:42.687+0000 7f0f7fc34640 1 -- 172.21.15.37:0/1268676256 wait complete. 2024-09-21T01:13:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1268676256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:43 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:43.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T01:13:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1268676256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:43 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1268676256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:43.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:43 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:13:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:44.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:44 smithi137 ceph-mon[34607]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:44.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:44 smithi144 ceph-mon[34818]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:44.452 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:44 smithi037 ceph-mon[31105]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 -- 172.21.15.37:0/2506545423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 msgr2=0x7f704410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 --2- 172.21.15.37:0/2506545423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f704410d850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f702c009900 tx=0x7f702c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 -- 172.21.15.37:0/2506545423 shutdown_connections 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 --2- 172.21.15.37:0/2506545423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f704410de10 0x7f7044110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 --2- 172.21.15.37:0/2506545423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f704410d850 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 --2- 172.21.15.37:0/2506545423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70441049b0 0x7f7044104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 -- 172.21.15.37:0/2506545423 >> 172.21.15.37:0/2506545423 conn(0x7f7044079730 msgr2=0x7f7044079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 -- 172.21.15.37:0/2506545423 shutdown_connections 2024-09-21T01:13:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.815+0000 7f7049491640 1 -- 172.21.15.37:0/2506545423 wait complete. 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 Processor -- start 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 -- start start 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70441049b0 0x7f70441026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f7044102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704410de10 0x7f7044103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7044113a70 con 0x7f7044105300 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70441138f0 con 0x7f70441049b0 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7049491640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7044113bf0 con 0x7f704410de10 2024-09-21T01:13:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f70427fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f7044102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f70427fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f7044102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35812/0 (socket says 172.21.15.37:35812) 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f70427fc640 1 -- 172.21.15.37:0/4026826014 learned_addr learned my addr 172.21.15.37:0/4026826014 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f70437fe640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704410de10 0x7f7044103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.816+0000 7f7042ffd640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70441049b0 0x7f70441026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f70427fc640 1 -- 172.21.15.37:0/4026826014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704410de10 msgr2=0x7f7044103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f70427fc640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704410de10 0x7f7044103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f70427fc640 1 -- 172.21.15.37:0/4026826014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70441049b0 msgr2=0x7f70441026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f70427fc640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70441049b0 0x7f70441026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f70427fc640 1 -- 172.21.15.37:0/4026826014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70441a87c0 con 0x7f7044105300 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f7042ffd640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70441049b0 0x7f70441026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f70427fc640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f7044102c30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f702c02a930 tx=0x7f702c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c03f030 con 0x7f7044105300 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70441a8a50 con 0x7f7044105300 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f702c003aa0 con 0x7f7044105300 2024-09-21T01:13:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c035070 con 0x7f7044105300 2024-09-21T01:13:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.817+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70441a8f80 con 0x7f7044105300 2024-09-21T01:13:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.818+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7044104dc0 con 0x7f7044105300 2024-09-21T01:13:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.820+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f702c042030 con 0x7f7044105300 2024-09-21T01:13:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.820+0000 7f703bfff640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70300b6510 0x7f70300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.821+0000 7f7042ffd640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70300b6510 0x7f70300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.821+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f702c107920 con 0x7f7044105300 2024-09-21T01:13:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.821+0000 7f7042ffd640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70300b6510 0x7f70300b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f703c005fd0 tx=0x7f703c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:44.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:44.824+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f702c0ce650 con 0x7f7044105300 2024-09-21T01:13:45.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.065+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f70441039f0 con 0x7f7044105300 2024-09-21T01:13:45.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.065+0000 7f703bfff640 1 -- 172.21.15.37:0/4026826014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f70441039f0 con 0x7f7044105300 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:13:45.066 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-09-21T01:13:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70300b6510 msgr2=0x7f70300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70300b6510 0x7f70300b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f703c005fd0 tx=0x7f703c005850 comp rx=0 tx=0).stop 2024-09-21T01:13:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 msgr2=0x7f7044102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f7044102c30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f702c02a930 tx=0x7f702c004270 comp rx=0 tx=0).stop 2024-09-21T01:13:45.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 shutdown_connections 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70300b6510 0x7f70300b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f704410de10 0x7f7044103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7044105300 0x7f7044102c30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 --2- 172.21.15.37:0/4026826014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70441049b0 0x7f70441026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 >> 172.21.15.37:0/4026826014 conn(0x7f7044079730 msgr2=0x7f70440ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 shutdown_connections 2024-09-21T01:13:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:45.068+0000 7f7049491640 1 -- 172.21.15.37:0/4026826014 wait complete. 2024-09-21T01:13:45.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4026826014' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:45.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:45 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T01:13:45.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T01:13:45.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/4026826014' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:45 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/4026826014' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:13:45.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:45 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:13:46.081 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 -- 172.21.15.37:0/1517784268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d80108cf0 msgr2=0x7f0d8010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1517784268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d80108cf0 0x7f0d8010f520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009ca0 tx=0x7f0d7802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 -- 172.21.15.37:0/1517784268 shutdown_connections 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1517784268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d80108cf0 0x7f0d8010f520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1517784268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d801083a0 0x7f0d801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1517784268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d80102a60 0x7f0d80102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 -- 172.21.15.37:0/1517784268 >> 172.21.15.37:0/1517784268 conn(0x7f0d80079730 msgr2=0x7f0d80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 -- 172.21.15.37:0/1517784268 shutdown_connections 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.579+0000 7f0d880ac640 1 -- 172.21.15.37:0/1517784268 wait complete. 2024-09-21T01:13:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 Processor -- start 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 -- start start 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d80102a60 0x7f0d8019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 0x7f0d8019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d80108cf0 0x7f0d8019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80112a40 con 0x7f0d801083a0 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d801128c0 con 0x7f0d80108cf0 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.580+0000 7f0d880ac640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80112bc0 con 0x7f0d80102a60 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 0x7f0d8019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 0x7f0d8019b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56472/0 (socket says 172.21.15.37:56472) 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 -- 172.21.15.37:0/1096532711 learned_addr learned my addr 172.21.15.37:0/1096532711 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85e48640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d80102a60 0x7f0d8019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d86649640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d80108cf0 0x7f0d8019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 -- 172.21.15.37:0/1096532711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d80102a60 msgr2=0x7f0d8019b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d80102a60 0x7f0d8019b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 -- 172.21.15.37:0/1096532711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d80108cf0 msgr2=0x7f0d8019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d80108cf0 0x7f0d8019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 -- 172.21.15.37:0/1096532711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d801a6630 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d85647640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 0x7f0d8019b8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000b450 tx=0x7f0d7000b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70015020 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d70011ce0 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70010dc0 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d801a6920 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.581+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d801a6e90 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.582+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d80102ef0 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.584+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0d70018020 con 0x7f0d801083a0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.585+0000 7f0d76ffd640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d6c0b6510 0x7f0d6c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.585+0000 7f0d85e48640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d6c0b6510 0x7f0d6c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:46.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.585+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f0d700e6c60 con 0x7f0d801083a0 2024-09-21T01:13:46.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.585+0000 7f0d85e48640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d6c0b6510 0x7f0d6c0b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d8006b9e0 tx=0x7f0d7c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:46.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.588+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d7001f020 con 0x7f0d801083a0 2024-09-21T01:13:46.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:46 smithi037 ceph-mon[31105]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:46.780+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0d8002e640 con 0x7f0d801083a0 2024-09-21T01:13:46.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:46 smithi137 ceph-mon[34607]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:46.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:46 smithi144 ceph-mon[34818]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.520+0000 7f0d76ffd640 1 -- 172.21.15.37:0/1096532711 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f0d700ad8f0 con 0x7f0d801083a0 2024-09-21T01:13:47.520 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d6c0b6510 msgr2=0x7f0d6c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d6c0b6510 0x7f0d6c0b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d8006b9e0 tx=0x7f0d7c009110 comp rx=0 tx=0).stop 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 msgr2=0x7f0d8019b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 0x7f0d8019b8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000b450 tx=0x7f0d7000b850 comp rx=0 tx=0).stop 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 shutdown_connections 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d6c0b6510 0x7f0d6c0b8a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d80108cf0 0x7f0d8019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d801083a0 0x7f0d8019b8b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 --2- 172.21.15.37:0/1096532711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d80102a60 0x7f0d8019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 >> 172.21.15.37:0/1096532711 conn(0x7f0d80079730 msgr2=0x7f0d801052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 shutdown_connections 2024-09-21T01:13:47.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:47.524+0000 7f0d880ac640 1 -- 172.21.15.37:0/1096532711 wait complete. 2024-09-21T01:13:47.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:47 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1096532711' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:13:47.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:47 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1096532711' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:13:47.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:47 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1096532711' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:13:48.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T01:13:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:48.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:48 smithi037 ceph-mon[31105]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:48.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:48 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1096532711' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:13:48.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:48 smithi037 ceph-mon[31105]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:13:48.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:48 smithi137 ceph-mon[34607]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:48.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:48 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1096532711' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:13:48.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:48 smithi137 ceph-mon[34607]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:13:48.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:48 smithi144 ceph-mon[34818]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:48.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:48 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1096532711' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:13:48.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:48 smithi144 ceph-mon[34818]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 -- 172.21.15.37:0/1330788267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238105270 msgr2=0x7f123810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 --2- 172.21.15.37:0/1330788267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238105270 0x7f123810d8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1228009900 tx=0x7f122802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 -- 172.21.15.37:0/1330788267 shutdown_connections 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 --2- 172.21.15.37:0/1330788267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123810ddf0 0x7f1238110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 --2- 172.21.15.37:0/1330788267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238105270 0x7f123810d8b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 --2- 172.21.15.37:0/1330788267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1238104840 0x7f1238104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 -- 172.21.15.37:0/1330788267 >> 172.21.15.37:0/1330788267 conn(0x7f1238079730 msgr2=0x7f1238079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 -- 172.21.15.37:0/1330788267 shutdown_connections 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.949+0000 7f124035c640 1 -- 172.21.15.37:0/1330788267 wait complete. 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 Processor -- start 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 -- start start 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 0x7f123819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1238105270 0x7f123819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123810ddf0 0x7f123819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1238113a70 con 0x7f1238104840 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12381138f0 con 0x7f123810ddf0 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f124035c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1238113bf0 con 0x7f1238105270 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f123e0f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 0x7f123819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f123e0f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 0x7f123819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56500/0 (socket says 172.21.15.37:56500) 2024-09-21T01:13:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.950+0000 7f123e0f8640 1 -- 172.21.15.37:0/3658993632 learned_addr learned my addr 172.21.15.37:0/3658993632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123d8f7640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1238105270 0x7f123819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e0f8640 1 -- 172.21.15.37:0/3658993632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1238105270 msgr2=0x7f123819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e8f9640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123810ddf0 0x7f123819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e0f8640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1238105270 0x7f123819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e0f8640 1 -- 172.21.15.37:0/3658993632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123810ddf0 msgr2=0x7f123819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e0f8640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123810ddf0 0x7f123819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e0f8640 1 -- 172.21.15.37:0/3658993632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12381a0330 con 0x7f1238104840 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f123e0f8640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 0x7f123819a480 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f123400c970 tx=0x7f123400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234007c10 con 0x7f1238104840 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1234007db0 con 0x7f1238104840 2024-09-21T01:13:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12381a0620 con 0x7f1238104840 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123400f870 con 0x7f1238104840 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.951+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381a6e40 con 0x7f1238104840 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.952+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1238104c50 con 0x7f1238104840 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.954+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f123400fa10 con 0x7f1238104840 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.955+0000 7f122f7fe640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12240b65c0 0x7f12240b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.955+0000 7f123d8f7640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12240b65c0 0x7f12240b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.955+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7f12340e75a0 con 0x7f1238104840 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.956+0000 7f123d8f7640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12240b65c0 0x7f12240b8ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1228009230 tx=0x7f1228031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:48.958+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12340ae1e0 con 0x7f1238104840 2024-09-21T01:13:49.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.148+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f123819b5b0 con 0x7f1238104840 2024-09-21T01:13:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.529+0000 7f122f7fe640 1 -- 172.21.15.37:0/3658993632 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7f12340b25c0 con 0x7f1238104840 2024-09-21T01:13:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12240b65c0 msgr2=0x7f12240b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12240b65c0 0x7f12240b8ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1228009230 tx=0x7f1228031400 comp rx=0 tx=0).stop 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 msgr2=0x7f123819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 0x7f123819a480 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f123400c970 tx=0x7f123400ce30 comp rx=0 tx=0).stop 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 shutdown_connections 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12240b65c0 0x7f12240b8ad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123810ddf0 0x7f123819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1238105270 0x7f123819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 --2- 172.21.15.37:0/3658993632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1238104840 0x7f123819a480 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.532+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 >> 172.21.15.37:0/3658993632 conn(0x7f1238079730 msgr2=0x7f12381008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.533+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 shutdown_connections 2024-09-21T01:13:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:49.533+0000 7f124035c640 1 -- 172.21.15.37:0/3658993632 wait complete. 2024-09-21T01:13:49.905 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:49 smithi037 ceph-mon[31105]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:13:49.905 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:49 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3658993632' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:13:49.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:49 smithi137 ceph-mon[34607]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:13:49.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:49 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3658993632' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:13:49.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:49 smithi144 ceph-mon[34818]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:13:49.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:49 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3658993632' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:13:50.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T01:13:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:50.805 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:50 smithi037 ceph-mon[31105]: pgmap v287: 33 pgs: 2 creating+activating, 14 creating+peering, 5 active+clean, 12 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:50.806 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:50 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3658993632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:13:50.806 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:50 smithi037 ceph-mon[31105]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:13:50.806 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:50 smithi037 ceph-mon[31105]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:13:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:50 smithi137 ceph-mon[34607]: pgmap v287: 33 pgs: 2 creating+activating, 14 creating+peering, 5 active+clean, 12 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:50 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3658993632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:13:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:50 smithi137 ceph-mon[34607]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:13:50.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:50 smithi137 ceph-mon[34607]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:13:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:50 smithi144 ceph-mon[34818]: pgmap v287: 33 pgs: 2 creating+activating, 14 creating+peering, 5 active+clean, 12 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:50 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3658993632' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:13:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:50 smithi144 ceph-mon[34818]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:13:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:50 smithi144 ceph-mon[34818]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:13:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 -- 172.21.15.37:0/2608200139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c103bc0 msgr2=0x7f951c103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 --2- 172.21.15.37:0/2608200139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c103bc0 0x7f951c103fd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f950c009900 tx=0x7f950c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 -- 172.21.15.37:0/2608200139 shutdown_connections 2024-09-21T01:13:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 --2- 172.21.15.37:0/2608200139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f951c109e00 0x7f951c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 --2- 172.21.15.37:0/2608200139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951c1094b0 0x7f951c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 --2- 172.21.15.37:0/2608200139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c103bc0 0x7f951c103fd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 -- 172.21.15.37:0/2608200139 >> 172.21.15.37:0/2608200139 conn(0x7f951c07b910 msgr2=0x7f951c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 -- 172.21.15.37:0/2608200139 shutdown_connections 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.024+0000 7f9520f74640 1 -- 172.21.15.37:0/2608200139 wait complete. 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 Processor -- start 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 -- start start 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951c103bc0 0x7f951c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f951c1094b0 0x7f951c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 0x7f951c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f951c113ac0 con 0x7f951c109e00 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f951c113940 con 0x7f951c1094b0 2024-09-21T01:13:51.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.025+0000 7f9520f74640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f951c113c40 con 0x7f951c103bc0 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 0x7f951c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 0x7f951c19fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56518/0 (socket says 172.21.15.37:56518) 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 -- 172.21.15.37:0/600992447 learned_addr learned my addr 172.21.15.37:0/600992447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951a59c640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951c103bc0 0x7f951c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f9519d9b640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f951c1094b0 0x7f951c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 -- 172.21.15.37:0/600992447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951c103bc0 msgr2=0x7f951c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951c103bc0 0x7f951c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 -- 172.21.15.37:0/600992447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f951c1094b0 msgr2=0x7f951c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f951c1094b0 0x7f951c19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 -- 172.21.15.37:0/600992447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c1a03a0 con 0x7f951c109e00 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f951ad9d640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 0x7f951c19fd30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f951400cce0 tx=0x7f951400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951400f450 con 0x7f951c109e00 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951c1a0690 con 0x7f951c109e00 2024-09-21T01:13:51.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f951400faa0 con 0x7f951c109e00 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514018b70 con 0x7f951c109e00 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.026+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951c1a6eb0 con 0x7f951c109e00 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.027+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951c103fd0 con 0x7f951c109e00 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.029+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9514018d10 con 0x7f951c109e00 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.030+0000 7f950b7fe640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f95040b6540 0x7f95040b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.030+0000 7f951a59c640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f95040b6540 0x7f95040b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.030+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7879+0+0 (secure 0 0 0) 0x7f95140e76c0 con 0x7f951c109e00 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.030+0000 7f951a59c640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f95040b6540 0x7f95040b8a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f950c031440 tx=0x7f950c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.033+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9514014030 con 0x7f951c109e00 2024-09-21T01:13:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.264+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f951c19b620 con 0x7f951c109e00 2024-09-21T01:13:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.556+0000 7f950b7fe640 1 -- 172.21.15.37:0/600992447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f951c19b620 con 0x7f951c109e00 2024-09-21T01:13:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T01:13:51.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f95040b6540 msgr2=0x7f95040b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f95040b6540 0x7f95040b8a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f950c031440 tx=0x7f950c005e80 comp rx=0 tx=0).stop 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 msgr2=0x7f951c19fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 0x7f951c19fd30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f951400cce0 tx=0x7f951400a620 comp rx=0 tx=0).stop 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 shutdown_connections 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f95040b6540 0x7f95040b8a50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951c109e00 0x7f951c19fd30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f951c1094b0 0x7f951c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 --2- 172.21.15.37:0/600992447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951c103bc0 0x7f951c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 >> 172.21.15.37:0/600992447 conn(0x7f951c07b910 msgr2=0x7f951c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 shutdown_connections 2024-09-21T01:13:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:51.558+0000 7f9520f74640 1 -- 172.21.15.37:0/600992447 wait complete. 2024-09-21T01:13:51.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:51 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/600992447' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:13:51.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:51 smithi137 ceph-mon[34607]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:13:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:51 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/600992447' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:13:51.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:51 smithi144 ceph-mon[34818]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:13:51.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:51 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/600992447' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:13:51.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:51 smithi037 ceph-mon[31105]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:13:52.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:13:52.552 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:52.805 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:52 smithi037 ceph-mon[31105]: pgmap v290: 97 pgs: 2 creating+activating, 21 creating+peering, 13 active+clean, 61 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:52.805 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:52 smithi037 ceph-mon[31105]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:13:52.805 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:52 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/600992447' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:13:52.806 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:52 smithi037 ceph-mon[31105]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:13:52.806 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:52 smithi037 ceph-mon[31105]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:13:52.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:52 smithi137 ceph-mon[34607]: pgmap v290: 97 pgs: 2 creating+activating, 21 creating+peering, 13 active+clean, 61 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:52.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:52 smithi137 ceph-mon[34607]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:13:52.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:52 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/600992447' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:13:52.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:52 smithi137 ceph-mon[34607]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:13:52.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:52 smithi137 ceph-mon[34607]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:13:52.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:52 smithi144 ceph-mon[34818]: pgmap v290: 97 pgs: 2 creating+activating, 21 creating+peering, 13 active+clean, 61 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:52.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:52 smithi144 ceph-mon[34818]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:13:52.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:52 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/600992447' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:13:52.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:52 smithi144 ceph-mon[34818]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:13:52.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:52 smithi144 ceph-mon[34818]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:13:53.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/882234655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4103bc0 msgr2=0x7f1bb4103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/882234655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4103bc0 0x7f1bb4103fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009ca0 tx=0x7f1ba402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/882234655 shutdown_connections 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/882234655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb4109e00 0x7f1bb4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/882234655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bb41094b0 0x7f1bb41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/882234655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4103bc0 0x7f1bb4103fd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/882234655 >> 172.21.15.37:0/882234655 conn(0x7f1bb407b910 msgr2=0x7f1bb407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/882234655 shutdown_connections 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.062+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/882234655 wait complete. 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 Processor -- start 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 -- start start 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bb4103bc0 0x7f1bb419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb41094b0 0x7f1bb419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 0x7f1bb419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4113b20 con 0x7f1bb4109e00 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41139a0 con 0x7f1bb4103bc0 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.063+0000 7f1bb9bd0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4113ca0 con 0x7f1bb41094b0 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 0x7f1bb419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 0x7f1bb419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56522/0 (socket says 172.21.15.37:56522) 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 -- 172.21.15.37:0/1496849327 learned_addr learned my addr 172.21.15.37:0/1496849327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb2ffd640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb41094b0 0x7f1bb419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb37fe640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bb4103bc0 0x7f1bb419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 -- 172.21.15.37:0/1496849327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb41094b0 msgr2=0x7f1bb419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb41094b0 0x7f1bb419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 -- 172.21.15.37:0/1496849327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bb4103bc0 msgr2=0x7f1bb419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bb4103bc0 0x7f1bb419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 -- 172.21.15.37:0/1496849327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb41a0500 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb3fff640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 0x7f1bb419fdd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009fd0 tx=0x7f1bac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac011830 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bac016070 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb41a07f0 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac010de0 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.064+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb41a6f50 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.066+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb4103fd0 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.067+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1bac0119d0 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.068+0000 7f1bb0ff9640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ba00b6510 0x7f1ba00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.068+0000 7f1bb37fe640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ba00b6510 0x7f1ba00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.068+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f1bac0e6750 con 0x7f1bb4109e00 2024-09-21T01:13:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.068+0000 7f1bb37fe640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ba00b6510 0x7f1ba00b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4000f80 tx=0x7f1ba4009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:53.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.072+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bac0ad130 con 0x7f1bb4109e00 2024-09-21T01:13:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.264+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bb410bc30 con 0x7f1bb4109e00 2024-09-21T01:13:53.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.265+0000 7f1bb0ff9640 1 -- 172.21.15.37:0/1496849327 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22292 (secure 0 0 0) 0x7f1bac0ce7e0 con 0x7f1bb4109e00 2024-09-21T01:13:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:53.266 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:13:51.265614+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ba00b6510 msgr2=0x7f1ba00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ba00b6510 0x7f1ba00b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4000f80 tx=0x7f1ba4009360 comp rx=0 tx=0).stop 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 msgr2=0x7f1bb419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 0x7f1bb419fdd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009fd0 tx=0x7f1bac00b8e0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 shutdown_connections 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ba00b6510 0x7f1ba00b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4109e00 0x7f1bb419fdd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1bb41094b0 0x7f1bb419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 --2- 172.21.15.37:0/1496849327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1bb4103bc0 0x7f1bb419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 >> 172.21.15.37:0/1496849327 conn(0x7f1bb407b910 msgr2=0x7f1bb41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.267+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 shutdown_connections 2024-09-21T01:13:53.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:53.268+0000 7f1bb9bd0640 1 -- 172.21.15.37:0/1496849327 wait complete. 2024-09-21T01:13:53.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:53 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] up:active 2024-09-21T01:13:53.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:53 smithi037 ceph-mon[31105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:53.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:53 smithi037 ceph-mon[31105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:53.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1496849327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:53 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] up:active 2024-09-21T01:13:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:53 smithi137 ceph-mon[34607]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:53 smithi137 ceph-mon[34607]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:53.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:53 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1496849327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:53 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] up:active 2024-09-21T01:13:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:53 smithi144 ceph-mon[34818]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:53 smithi144 ceph-mon[34818]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:53.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:53 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1496849327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:53.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:13:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 -- 172.21.15.37:0/1636658102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09481094a0 msgr2=0x7f09481098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 --2- 172.21.15.37:0/1636658102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09481094a0 0x7f09481098b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0934009900 tx=0x7f093402a410 comp rx=0 tx=0).stop 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 -- 172.21.15.37:0/1636658102 shutdown_connections 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 --2- 172.21.15.37:0/1636658102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0948109df0 0x7f0948110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 --2- 172.21.15.37:0/1636658102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09481094a0 0x7f09481098b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 --2- 172.21.15.37:0/1636658102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0948103b60 0x7f0948103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 -- 172.21.15.37:0/1636658102 >> 172.21.15.37:0/1636658102 conn(0x7f094807b850 msgr2=0x7f094807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 -- 172.21.15.37:0/1636658102 shutdown_connections 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.689+0000 7f094f1b1640 1 -- 172.21.15.37:0/1636658102 wait complete. 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 Processor -- start 2024-09-21T01:13:54.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 -- start start 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 0x7f0948075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09481094a0 0x7f0948075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0948109df0 0x7f0948076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0948113ab0 con 0x7f0948103b60 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0948113930 con 0x7f09481094a0 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094f1b1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0948113c30 con 0x7f0948109df0 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.690+0000 7f094cf4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 0x7f0948075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 0x7f0948075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56534/0 (socket says 172.21.15.37:56534) 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 -- 172.21.15.37:0/2615647091 learned_addr learned my addr 172.21.15.37:0/2615647091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f0947fff640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09481094a0 0x7f0948075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094d74e640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0948109df0 0x7f0948076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 -- 172.21.15.37:0/2615647091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0948109df0 msgr2=0x7f0948076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0948109df0 0x7f0948076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 -- 172.21.15.37:0/2615647091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09481094a0 msgr2=0x7f0948075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09481094a0 0x7f0948075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 -- 172.21.15.37:0/2615647091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09481a8740 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094cf4d640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 0x7f0948075710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d770 tx=0x7f093c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c017070 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093c0054d0 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09481a8a30 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.691+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c004c30 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.692+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09481a8f40 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.693+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0948103f70 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.694+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f093c004e10 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.695+0000 7f0945ffb640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09380b6590 0x7f09380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.695+0000 7f0947fff640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09380b6590 0x7f09380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.695+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f093c0e6b70 con 0x7f0948103b60 2024-09-21T01:13:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.695+0000 7f0947fff640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09380b6590 0x7f09380b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0934009230 tx=0x7f0934031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.699+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f093c0b1930 con 0x7f0948103b60 2024-09-21T01:13:54.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.885+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f094810b630 con 0x7f0948103b60 2024-09-21T01:13:54.886 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:54 smithi037 ceph-mon[31105]: pgmap v292: 97 pgs: 2 creating+activating, 18 creating+peering, 48 active+clean, 29 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:54.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.886+0000 7f0945ffb640 1 -- 172.21.15.37:0/2615647091 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22292 (secure 0 0 0) 0x7f093c0b6870 con 0x7f0948103b60 2024-09-21T01:13:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:13:54.887 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:13:51.265614+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:13:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09380b6590 msgr2=0x7f09380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09380b6590 0x7f09380b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0934009230 tx=0x7f0934031400 comp rx=0 tx=0).stop 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 msgr2=0x7f0948075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 0x7f0948075710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d770 tx=0x7f093c00dc30 comp rx=0 tx=0).stop 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 shutdown_connections 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09380b6590 0x7f09380b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0948109df0 0x7f0948076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09481094a0 0x7f0948075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 --2- 172.21.15.37:0/2615647091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0948103b60 0x7f0948075710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 >> 172.21.15.37:0/2615647091 conn(0x7f094807b850 msgr2=0x7f0948105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 shutdown_connections 2024-09-21T01:13:54.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:54.889+0000 7f094f1b1640 1 -- 172.21.15.37:0/2615647091 wait complete. 2024-09-21T01:13:54.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:54 smithi137 ceph-mon[34607]: pgmap v292: 97 pgs: 2 creating+activating, 18 creating+peering, 48 active+clean, 29 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:54.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:54 smithi144 ceph-mon[34818]: pgmap v292: 97 pgs: 2 creating+activating, 18 creating+peering, 48 active+clean, 29 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:13:55.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T01:13:55.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:55 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2615647091' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:55.821 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:55.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:55 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2615647091' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:55.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:55 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2615647091' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.330+0000 7f965a68f640 1 -- 172.21.15.37:0/266515773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 msgr2=0x7f96541066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.330+0000 7f965a68f640 1 --2- 172.21.15.37:0/266515773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f96541066e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f963c009900 tx=0x7f963c02a410 comp rx=0 tx=0).stop 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.330+0000 7f965a68f640 1 -- 172.21.15.37:0/266515773 shutdown_connections 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 --2- 172.21.15.37:0/266515773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654106c20 0x7f9654110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 --2- 172.21.15.37:0/266515773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f96541066e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 --2- 172.21.15.37:0/266515773 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9654101ff0 0x7f9654102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 -- 172.21.15.37:0/266515773 >> 172.21.15.37:0/266515773 conn(0x7f9654077cc0 msgr2=0x7f9654078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 -- 172.21.15.37:0/266515773 shutdown_connections 2024-09-21T01:13:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 -- 172.21.15.37:0/266515773 wait complete. 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 Processor -- start 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.331+0000 7f965a68f640 1 -- start start 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f965a68f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654101ff0 0x7f965419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f965a68f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f965419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f965a68f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9654106c20 0x7f965419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f965a68f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9654113ac0 con 0x7f96541062d0 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f965a68f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9654113940 con 0x7f9654106c20 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f965a68f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9654113c40 con 0x7f9654101ff0 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f965419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f965419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33346/0 (socket says 172.21.15.37:33346) 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 -- 172.21.15.37:0/3382741085 learned_addr learned my addr 172.21.15.37:0/3382741085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f9653fff640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654101ff0 0x7f965419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f9658c2c640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9654106c20 0x7f965419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 -- 172.21.15.37:0/3382741085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654101ff0 msgr2=0x7f965419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654101ff0 0x7f965419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 -- 172.21.15.37:0/3382741085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9654106c20 msgr2=0x7f965419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9654106c20 0x7f965419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 -- 172.21.15.37:0/3382741085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96541a0440 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.332+0000 7f964bfff640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f965419aa70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f963c006010 tx=0x7f963c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.333+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c03f030 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.333+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f963c003aa0 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.333+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96541a06d0 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.333+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c035070 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.333+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96541a6e90 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.334+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965406b910 con 0x7f96541062d0 2024-09-21T01:13:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.336+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f963c042030 con 0x7f96541062d0 2024-09-21T01:13:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.337+0000 7f9651ffb640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f96400b6510 0x7f96400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.337+0000 7f9653fff640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f96400b6510 0x7f96400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.337+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f963c107970 con 0x7f96541062d0 2024-09-21T01:13:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.337+0000 7f9653fff640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f96400b6510 0x7f96400b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9644005d00 tx=0x7f964400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.340+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f963c0d2730 con 0x7f96541062d0 2024-09-21T01:13:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.570+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9654102400 con 0x7f96541062d0 2024-09-21T01:13:56.577 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:13:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: 2024-09-21T01:13:56.282+0000 7ff919c2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T01:13:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.583+0000 7f9651ffb640 1 -- 172.21.15.37:0/3382741085 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9654102400 con 0x7f96541062d0 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.585+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f96400b6510 msgr2=0x7f96400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.585+0000 7f965a68f640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f96400b6510 0x7f96400b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9644005d00 tx=0x7f964400b410 comp rx=0 tx=0).stop 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.585+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 msgr2=0x7f965419aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.585+0000 7f965a68f640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f965419aa70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f963c006010 tx=0x7f963c004060 comp rx=0 tx=0).stop 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 shutdown_connections 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f96400b6510 0x7f96400b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9654106c20 0x7f965419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96541062d0 0x7f965419aa70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 --2- 172.21.15.37:0/3382741085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654101ff0 0x7f965419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 >> 172.21.15.37:0/3382741085 conn(0x7f9654077cc0 msgr2=0x7f9654107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 shutdown_connections 2024-09-21T01:13:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:56.586+0000 7f965a68f640 1 -- 172.21.15.37:0/3382741085 wait complete. 2024-09-21T01:13:56.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:56 smithi037 ceph-mon[31105]: pgmap v293: 97 pgs: 2 creating+peering, 95 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T01:13:56.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:56 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3382741085' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:13:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:56 smithi137 ceph-mon[34607]: pgmap v293: 97 pgs: 2 creating+peering, 95 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T01:13:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:56 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3382741085' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:13:56.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:56 smithi144 ceph-mon[34818]: pgmap v293: 97 pgs: 2 creating+peering, 95 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T01:13:56.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:56 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3382741085' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:13:57.218 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T01:13:57.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T01:13:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:57.773 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:57 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3382741085' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:13:57.774 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:57 smithi037 ceph-mon[31105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:57.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:57 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3382741085' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:13:57.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:57 smithi137 ceph-mon[34607]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:57.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:57 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3382741085' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:13:57.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:57 smithi144 ceph-mon[34818]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 -- 172.21.15.37:0/1393908379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7510109df0 msgr2=0x7f7510110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 --2- 172.21.15.37:0/1393908379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7510109df0 0x7f7510110620 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7508009ca0 tx=0x7f750802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 -- 172.21.15.37:0/1393908379 shutdown_connections 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 --2- 172.21.15.37:0/1393908379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7510109df0 0x7f7510110620 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 --2- 172.21.15.37:0/1393908379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75101094a0 0x7f75101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 --2- 172.21.15.37:0/1393908379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510103b60 0x7f7510103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 -- 172.21.15.37:0/1393908379 >> 172.21.15.37:0/1393908379 conn(0x7f751007b850 msgr2=0x7f751007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 -- 172.21.15.37:0/1393908379 shutdown_connections 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.013+0000 7f75167d9640 1 -- 172.21.15.37:0/1393908379 wait complete. 2024-09-21T01:13:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 Processor -- start 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 -- start start 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7510103b60 0x7f751019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 0x7f751019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510109df0 0x7f751019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7510113ab0 con 0x7f75101094a0 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7510113930 con 0x7f7510109df0 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f75167d9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7510113c30 con 0x7f7510103b60 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 0x7f751019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 0x7f751019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33370/0 (socket says 172.21.15.37:33370) 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.014+0000 7f750f7fe640 1 -- 172.21.15.37:0/576810384 learned_addr learned my addr 172.21.15.37:0/576810384 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f7514d76640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510109df0 0x7f751019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750ffff640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7510103b60 0x7f751019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750f7fe640 1 -- 172.21.15.37:0/576810384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7510103b60 msgr2=0x7f751019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750f7fe640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7510103b60 0x7f751019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750f7fe640 1 -- 172.21.15.37:0/576810384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510109df0 msgr2=0x7f751019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750f7fe640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510109df0 0x7f751019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750f7fe640 1 -- 172.21.15.37:0/576810384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75101a03b0 con 0x7f75101094a0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750ffff640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7510103b60 0x7f751019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f7514d76640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510109df0 0x7f751019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750f7fe640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 0x7f751019a9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f750400d950 tx=0x7f750400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504017070 con 0x7f75101094a0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75101a06a0 con 0x7f75101094a0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7504009c30 con 0x7f75101094a0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040047a0 con 0x7f75101094a0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.015+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75101a6e00 con 0x7f75101094a0 2024-09-21T01:13:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.016+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7510103f70 con 0x7f75101094a0 2024-09-21T01:13:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.018+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7504004020 con 0x7f75101094a0 2024-09-21T01:13:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.018+0000 7f750d7fa640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74f80b6510 0x7f74f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:13:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.019+0000 7f750ffff640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74f80b6510 0x7f74f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:13:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.019+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f75040e7330 con 0x7f75101094a0 2024-09-21T01:13:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.019+0000 7f750ffff640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74f80b6510 0x7f74f80b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7500009b40 tx=0x7f7500005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:13:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.021+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7504020020 con 0x7f75101094a0 2024-09-21T01:13:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.250+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f751002e640 con 0x7f75101094a0 2024-09-21T01:13:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.599+0000 7f750d7fa640 1 -- 172.21.15.37:0/576810384 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f75040add10 con 0x7f75101094a0 2024-09-21T01:13:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74f80b6510 msgr2=0x7f74f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74f80b6510 0x7f74f80b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7500009b40 tx=0x7f7500005e50 comp rx=0 tx=0).stop 2024-09-21T01:13:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 msgr2=0x7f751019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:13:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 0x7f751019a9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f750400d950 tx=0x7f750400de10 comp rx=0 tx=0).stop 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 shutdown_connections 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74f80b6510 0x7f74f80b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7510109df0 0x7f751019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75101094a0 0x7f751019a9e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 --2- 172.21.15.37:0/576810384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7510103b60 0x7f751019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 >> 172.21.15.37:0/576810384 conn(0x7f751007b850 msgr2=0x7f7510105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 shutdown_connections 2024-09-21T01:13:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:13:58.601+0000 7f75167d9640 1 -- 172.21.15.37:0/576810384 wait complete. 2024-09-21T01:13:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:58 smithi137 ceph-mon[34607]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T01:13:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:58 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/576810384' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T01:13:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:58 smithi144 ceph-mon[34818]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T01:13:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:58 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/576810384' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T01:13:58.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:58 smithi037 ceph-mon[31105]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T01:13:58.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:58 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/576810384' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T01:13:59.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T01:13:59.539 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:13:59.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:59 smithi037 ceph-mon[31105]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T01:13:59.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:59 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/576810384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T01:13:59.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:59 smithi037 ceph-mon[31105]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T01:13:59.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:59 smithi037 ceph-mon[31105]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:59.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:59 smithi037 ceph-mon[31105]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T01:13:59.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:13:59 smithi037 ceph-mon[31105]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T01:13:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:59 smithi137 ceph-mon[34607]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T01:13:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:59 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/576810384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T01:13:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:59 smithi137 ceph-mon[34607]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:59 smithi137 ceph-mon[34607]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:59 smithi137 ceph-mon[34607]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:13:59 smithi137 ceph-mon[34607]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:59 smithi144 ceph-mon[34818]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:59 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/576810384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:59 smithi144 ceph-mon[34818]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:59 smithi144 ceph-mon[34818]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:59 smithi144 ceph-mon[34818]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T01:13:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:13:59 smithi144 ceph-mon[34818]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T01:14:00.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 -- 172.21.15.37:0/3051639740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb4108cf0 msgr2=0x7fddb410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:00.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/3051639740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb4108cf0 0x7fddb410f520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fddac009ca0 tx=0x7fddac02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 -- 172.21.15.37:0/3051639740 shutdown_connections 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/3051639740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb4108cf0 0x7fddb410f520 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/3051639740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb41083a0 0x7fddb41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/3051639740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddb4102a60 0x7fddb4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 -- 172.21.15.37:0/3051639740 >> 172.21.15.37:0/3051639740 conn(0x7fddb4079730 msgr2=0x7fddb4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 -- 172.21.15.37:0/3051639740 shutdown_connections 2024-09-21T01:14:00.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.099+0000 7fddb8d2c640 1 -- 172.21.15.37:0/3051639740 wait complete. 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 Processor -- start 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 -- start start 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddb4102a60 0x7fddb419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 0x7fddb419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb4108cf0 0x7fddb41a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4113a80 con 0x7fddb41083a0 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4113900 con 0x7fddb4102a60 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb8d2c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4113c00 con 0x7fddb4108cf0 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 0x7fddb419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 0x7fddb419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33388/0 (socket says 172.21.15.37:33388) 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb1d9b640 1 -- 172.21.15.37:0/1404902884 learned_addr learned my addr 172.21.15.37:0/1404902884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.100+0000 7fddb259c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddb4102a60 0x7fddb419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb2d9d640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb4108cf0 0x7fddb41a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb1d9b640 1 -- 172.21.15.37:0/1404902884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb4108cf0 msgr2=0x7fddb41a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb1d9b640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb4108cf0 0x7fddb41a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb1d9b640 1 -- 172.21.15.37:0/1404902884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddb4102a60 msgr2=0x7fddb419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb1d9b640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddb4102a60 0x7fddb419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb1d9b640 1 -- 172.21.15.37:0/1404902884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb41a2780 con 0x7fddb41083a0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb2d9d640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb4108cf0 0x7fddb41a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb1d9b640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 0x7fddb419cdb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdda800d740 tx=0x7fdda800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8017070 con 0x7fddb41083a0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdda800de50 con 0x7fddb41083a0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb41a2a70 con 0x7fddb41083a0 2024-09-21T01:14:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8004ce0 con 0x7fddb41083a0 2024-09-21T01:14:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.101+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb41a91d0 con 0x7fddb41083a0 2024-09-21T01:14:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.102+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb4103ce0 con 0x7fddb41083a0 2024-09-21T01:14:00.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.104+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdda8004e80 con 0x7fddb41083a0 2024-09-21T01:14:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.105+0000 7fdda37fe640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdd9c0b6590 0x7fdd9c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.105+0000 7fddb259c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdd9c0b6590 0x7fdd9c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.105+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fdda80e6f70 con 0x7fddb41083a0 2024-09-21T01:14:00.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.105+0000 7fddb259c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdd9c0b6590 0x7fdd9c0b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005fd0 tx=0x7fdda400b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:00.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.108+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdda80ad930 con 0x7fddb41083a0 2024-09-21T01:14:00.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.342+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fddb41a9460 con 0x7fddb41083a0 2024-09-21T01:14:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.619+0000 7fdda37fe640 1 -- 172.21.15.37:0/1404902884 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fdda80b1d10 con 0x7fddb41083a0 2024-09-21T01:14:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdd9c0b6590 msgr2=0x7fdd9c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdd9c0b6590 0x7fdd9c0b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005fd0 tx=0x7fdda400b590 comp rx=0 tx=0).stop 2024-09-21T01:14:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 msgr2=0x7fddb419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 0x7fddb419cdb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdda800d740 tx=0x7fdda800dc00 comp rx=0 tx=0).stop 2024-09-21T01:14:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 shutdown_connections 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdd9c0b6590 0x7fdd9c0b8aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddb4108cf0 0x7fddb41a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb41083a0 0x7fddb419cdb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 --2- 172.21.15.37:0/1404902884 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddb4102a60 0x7fddb419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.622+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 >> 172.21.15.37:0/1404902884 conn(0x7fddb4079730 msgr2=0x7fddb410ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.623+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 shutdown_connections 2024-09-21T01:14:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:00.623+0000 7fddb8d2c640 1 -- 172.21.15.37:0/1404902884 wait complete. 2024-09-21T01:14:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:14:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] up:active 2024-09-21T01:14:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:00 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1404902884' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] up:active 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T01:14:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T01:14:00.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T01:14:00.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:00 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1404902884' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:14:00.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T01:14:00.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] up:active 2024-09-21T01:14:00.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T01:14:00.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T01:14:00.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T01:14:00.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T01:14:00.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:00 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1404902884' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:14:01.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T01:14:01.571 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:01.622 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: 2024-09-21T01:14:01.282+0000 7ff919c2b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T01:14:01.622 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: 2024-09-21T01:14:01.282+0000 7ff919c2b640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T01:14:01.884 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1404902884' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:14:01.884 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] up:active 2024-09-21T01:14:01.884 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T01:14:01.884 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T01:14:01.884 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-21T01:14:01.885 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-21T01:14:01.885 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:01 smithi137 ceph-mon[34607]: pgmap v296: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 5 op/s 2024-09-21T01:14:01.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1404902884' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:14:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] up:active 2024-09-21T01:14:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T01:14:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T01:14:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-21T01:14:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-21T01:14:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:01 smithi144 ceph-mon[34818]: pgmap v296: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 5 op/s 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1404902884' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] up:active 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-21T01:14:01.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:01 smithi037 ceph-mon[31105]: pgmap v296: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 5 op/s 2024-09-21T01:14:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 -- 172.21.15.37:0/3998579285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 msgr2=0x7fdcc4110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 --2- 172.21.15.37:0/3998579285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4110660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009900 tx=0x7fdcbc02a410 comp rx=0 tx=0).stop 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 -- 172.21.15.37:0/3998579285 shutdown_connections 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 --2- 172.21.15.37:0/3998579285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4110660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 --2- 172.21.15.37:0/3998579285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc41094e0 0x7fdcc41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 --2- 172.21.15.37:0/3998579285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcc4102090 0x7fdcc41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 -- 172.21.15.37:0/3998579285 >> 172.21.15.37:0/3998579285 conn(0x7fdcc4079e30 msgr2=0x7fdcc407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 -- 172.21.15.37:0/3998579285 shutdown_connections 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.072+0000 7fdcca17d640 1 -- 172.21.15.37:0/3998579285 wait complete. 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 Processor -- start 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 -- start start 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc4102090 0x7fdcc4103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcc41094e0 0x7fdcc4103570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4103ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4113af0 con 0x7fdcc4109e30 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4113970 con 0x7fdcc41094e0 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcca17d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4113c70 con 0x7fdcc4102090 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcc3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4103ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcc3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4103ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33406/0 (socket says 172.21.15.37:33406) 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1402633352 learned_addr learned my addr 172.21.15.37:0/1402633352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcc2ffd640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcc41094e0 0x7fdcc4103570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.073+0000 7fdcc37fe640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc4102090 0x7fdcc4103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1402633352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc4102090 msgr2=0x7fdcc4103030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc3fff640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc4102090 0x7fdcc4103030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1402633352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcc41094e0 msgr2=0x7fdcc4103570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc3fff640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcc41094e0 0x7fdcc4103570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc3fff640 1 -- 172.21.15.37:0/1402633352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc41a8720 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc37fe640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc4102090 0x7fdcc4103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc3fff640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4103ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004770 tx=0x7fdcbc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc03f030 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcbc003aa0 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41a89b0 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc035070 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.074+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41a8e90 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.075+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc41024a0 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.077+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdcbc042030 con 0x7fdcc4109e30 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.077+0000 7fdcc0ff9640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdcac0b6510 0x7fdcac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.077+0000 7fdcc37fe640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdcac0b6510 0x7fdcac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.077+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fdcbc107bc0 con 0x7fdcc4109e30 2024-09-21T01:14:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.079+0000 7fdcc37fe640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdcac0b6510 0x7fdcac0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4104a80 tx=0x7fdcb4009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.081+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcbc0ce5a0 con 0x7fdcc4109e30 2024-09-21T01:14:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.309+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fdcc402e640 con 0x7fdcc4109e30 2024-09-21T01:14:02.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.641+0000 7fdcc0ff9640 1 -- 172.21.15.37:0/1402633352 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fdcbc0d2980 con 0x7fdcc4109e30 2024-09-21T01:14:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdcac0b6510 msgr2=0x7fdcac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdcac0b6510 0x7fdcac0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4104a80 tx=0x7fdcb4009600 comp rx=0 tx=0).stop 2024-09-21T01:14:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 msgr2=0x7fdcc4103ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4103ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004770 tx=0x7fdcbc004270 comp rx=0 tx=0).stop 2024-09-21T01:14:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 shutdown_connections 2024-09-21T01:14:02.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdcac0b6510 0x7fdcac0b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4109e30 0x7fdcc4103ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcc41094e0 0x7fdcc4103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 --2- 172.21.15.37:0/1402633352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcc4102090 0x7fdcc4103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 >> 172.21.15.37:0/1402633352 conn(0x7fdcc4079e30 msgr2=0x7fdcc41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 shutdown_connections 2024-09-21T01:14:02.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:02.644+0000 7fdcca17d640 1 -- 172.21.15.37:0/1402633352 wait complete. 2024-09-21T01:14:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] up:active 2024-09-21T01:14:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T01:14:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T01:14:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: Cluster is now healthy 2024-09-21T01:14:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-21T01:14:02.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T01:14:02.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T01:14:02.922 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:02 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1402633352' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:14:02.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] up:active 2024-09-21T01:14:02.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T01:14:02.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T01:14:02.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: Cluster is now healthy 2024-09-21T01:14:02.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-21T01:14:02.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T01:14:02.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T01:14:02.923 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:02 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1402633352' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:14:02.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] up:active 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: Cluster is now healthy 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T01:14:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:02 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1402633352' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:14:03.453 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T01:14:03.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T01:14:03.720 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:03.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:03 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1402633352' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:14:03.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:03 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] up:active 2024-09-21T01:14:03.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:03 smithi037 ceph-mon[31105]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T01:14:03.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:03 smithi037 ceph-mon[31105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:14:03.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:03 smithi037 ceph-mon[31105]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 90 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T01:14:03.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:03 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1402633352' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:03 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] up:active 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:03 smithi137 ceph-mon[34607]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:03 smithi137 ceph-mon[34607]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:03 smithi137 ceph-mon[34607]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 90 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:03 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1402633352' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:03 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] up:active 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:03 smithi144 ceph-mon[34818]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:03 smithi144 ceph-mon[34818]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:14:03.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:03 smithi144 ceph-mon[34818]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 90 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 -- 172.21.15.37:0/3584723800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214109e20 msgr2=0x7f0214110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 --2- 172.21.15.37:0/3584723800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214109e20 0x7f0214110650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f020c009ca0 tx=0x7f020c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 -- 172.21.15.37:0/3584723800 shutdown_connections 2024-09-21T01:14:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 --2- 172.21.15.37:0/3584723800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214109e20 0x7f0214110650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 --2- 172.21.15.37:0/3584723800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02141094d0 0x7f02141098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 --2- 172.21.15.37:0/3584723800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214103b90 0x7f0214103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 -- 172.21.15.37:0/3584723800 >> 172.21.15.37:0/3584723800 conn(0x7f02140ff600 msgr2=0x7f0214101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 -- 172.21.15.37:0/3584723800 shutdown_connections 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 -- 172.21.15.37:0/3584723800 wait complete. 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 Processor -- start 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.249+0000 7f021b15e640 1 -- start start 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f021b15e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 0x7f0214075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f021b15e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02141094d0 0x7f0214075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f021b15e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214109e20 0x7f0214076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f021b15e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0214113ae0 con 0x7f0214103b90 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f021b15e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0214113960 con 0x7f02141094d0 2024-09-21T01:14:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f021b15e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0214113c60 con 0x7f0214109e20 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 0x7f0214075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 0x7f0214075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33424/0 (socket says 172.21.15.37:33424) 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 -- 172.21.15.37:0/3939260852 learned_addr learned my addr 172.21.15.37:0/3939260852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f02196fb640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214109e20 0x7f0214076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0213fff640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02141094d0 0x7f0214075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 -- 172.21.15.37:0/3939260852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214109e20 msgr2=0x7f0214076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214109e20 0x7f0214076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 -- 172.21.15.37:0/3939260852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02141094d0 msgr2=0x7f0214075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02141094d0 0x7f0214075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 -- 172.21.15.37:0/3939260852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02141a8680 con 0x7f0214103b90 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f02196fb640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214109e20 0x7f0214076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.250+0000 7f0218efa640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 0x7f0214075710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f020800e9f0 tx=0x7f020800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.251+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020800ccc0 con 0x7f0214103b90 2024-09-21T01:14:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.251+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02141a8970 con 0x7f0214103b90 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.251+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f020800ce60 con 0x7f0214103b90 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.251+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208010430 con 0x7f0214103b90 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.251+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02141a8eb0 con 0x7f0214103b90 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.252+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0214103fa0 con 0x7f0214103b90 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.253+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f02080046c0 con 0x7f0214103b90 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.254+0000 7f0211ffb640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f02040b6510 0x7f02040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.254+0000 7f0213fff640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f02040b6510 0x7f02040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.254+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f02080e7550 con 0x7f0214103b90 2024-09-21T01:14:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.255+0000 7f0213fff640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f02040b6510 0x7f02040b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0214102e50 tx=0x7f020000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:04.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.259+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02080adf30 con 0x7f0214103b90 2024-09-21T01:14:04.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.475+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0214063800 con 0x7f02040b6510 2024-09-21T01:14:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.505+0000 7f0211ffb640 1 -- 172.21.15.37:0/3939260852 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0214063800 con 0x7f02040b6510 2024-09-21T01:14:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f02040b6510 msgr2=0x7f02040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f02040b6510 0x7f02040b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0214102e50 tx=0x7f020000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 msgr2=0x7f0214075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 0x7f0214075710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f020800e9f0 tx=0x7f020800edf0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 shutdown_connections 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f02040b6510 0x7f02040b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0214109e20 0x7f0214076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02141094d0 0x7f0214075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 --2- 172.21.15.37:0/3939260852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0214103b90 0x7f0214075710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 >> 172.21.15.37:0/3939260852 conn(0x7f02140ff600 msgr2=0x7f0214106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 shutdown_connections 2024-09-21T01:14:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:04.507+0000 7f021b15e640 1 -- 172.21.15.37:0/3939260852 wait complete. 2024-09-21T01:14:04.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:04 smithi037 ceph-mon[31105]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:04.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:14:04 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:14:04.481+0000 7f81c6572640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:14:04.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:14:04 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:14:04.481+0000 7f81c6572640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:14:04.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:14:04 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:14:04.481+0000 7f81c6572640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:14:04.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:14:04 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:14:04.481+0000 7f81c6572640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:14:04.750 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:14:04 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:14:04.481+0000 7f81c6572640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:14:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:04 smithi137 ceph-mon[34607]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:04.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:04 smithi144 ceph-mon[34818]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:05.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T01:14:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:05.896 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:05 smithi037 ceph-mon[31105]: pgmap v298: 97 pgs: 97 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 18 op/s 2024-09-21T01:14:05.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:05 smithi137 ceph-mon[34607]: pgmap v298: 97 pgs: 97 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 18 op/s 2024-09-21T01:14:05.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:05 smithi144 ceph-mon[34818]: pgmap v298: 97 pgs: 97 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 18 op/s 2024-09-21T01:14:05.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1788210548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f18102ae0 msgr2=0x7f6f18102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:05.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1788210548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f18102ae0 0x7f6f18102ef0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009900 tx=0x7f6f1002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:05.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1788210548 shutdown_connections 2024-09-21T01:14:05.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1788210548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f18108d20 0x7f6f1810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1788210548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f181083d0 0x7f6f181087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1788210548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f18102ae0 0x7f6f18102ef0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1788210548 >> 172.21.15.37:0/1788210548 conn(0x7f6f18079790 msgr2=0x7f6f18079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1788210548 shutdown_connections 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.994+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1788210548 wait complete. 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.995+0000 7f6f1c8f1640 1 Processor -- start 2024-09-21T01:14:06.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.995+0000 7f6f1c8f1640 1 -- start start 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.995+0000 7f6f1c8f1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f18102ae0 0x7f6f1819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.995+0000 7f6f1c8f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 0x7f6f1819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.995+0000 7f6f1c8f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f18108d20 0x7f6f1819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f1c8f1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f181129e0 con 0x7f6f181083d0 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f1c8f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f18112860 con 0x7f6f18108d20 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f1c8f1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f18112b60 con 0x7f6f18102ae0 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 0x7f6f1819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:06.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 0x7f6f1819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45790/0 (socket says 172.21.15.37:45790) 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 -- 172.21.15.37:0/1590136479 learned_addr learned my addr 172.21.15.37:0/1590136479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f1659c640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f18102ae0 0x7f6f1819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f16d9d640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f18108d20 0x7f6f1819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 -- 172.21.15.37:0/1590136479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f18102ae0 msgr2=0x7f6f1819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f18102ae0 0x7f6f1819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 -- 172.21.15.37:0/1590136479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f18108d20 msgr2=0x7f6f1819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f18108d20 0x7f6f1819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 -- 172.21.15.37:0/1590136479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f181a6550 con 0x7f6f181083d0 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.996+0000 7f6f15d9b640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 0x7f6f1819b7d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000aea0 tx=0x7f6f0000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.997+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004220 con 0x7f6f181083d0 2024-09-21T01:14:06.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.997+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f000043c0 con 0x7f6f181083d0 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.997+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004a00 con 0x7f6f181083d0 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.997+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f181990e0 con 0x7f6f181083d0 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.997+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f181995d0 con 0x7f6f181083d0 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:05.998+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f18102ef0 con 0x7f6f181083d0 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.000+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6f000079b0 con 0x7f6f181083d0 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.001+0000 7f6f0f7fe640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f040bee30 0x7f6f040c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.001+0000 7f6f1659c640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f040bee30 0x7f6f040c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:06.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.001+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f6f000e7370 con 0x7f6f181083d0 2024-09-21T01:14:06.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.001+0000 7f6f1659c640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f040bee30 0x7f6f040c1340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f10000c00 tx=0x7f6f10031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:06.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.004+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f000adc50 con 0x7f6f181083d0 2024-09-21T01:14:06.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.219+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6f18063800 con 0x7f6f040bee30 2024-09-21T01:14:06.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.247+0000 7f6f0f7fe640 1 -- 172.21.15.37:0/1590136479 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6f18063800 con 0x7f6f040bee30 2024-09-21T01:14:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f040bee30 msgr2=0x7f6f040c1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f040bee30 0x7f6f040c1340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f10000c00 tx=0x7f6f10031400 comp rx=0 tx=0).stop 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 msgr2=0x7f6f1819b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 0x7f6f1819b7d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000aea0 tx=0x7f6f0000af90 comp rx=0 tx=0).stop 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 shutdown_connections 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f040bee30 0x7f6f040c1340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f18108d20 0x7f6f1819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f181083d0 0x7f6f1819b7d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 --2- 172.21.15.37:0/1590136479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f18102ae0 0x7f6f1819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 >> 172.21.15.37:0/1590136479 conn(0x7f6f18079790 msgr2=0x7f6f18106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 shutdown_connections 2024-09-21T01:14:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:06.250+0000 7f6f1c8f1640 1 -- 172.21.15.37:0/1590136479 wait complete. 2024-09-21T01:14:06.660 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:14:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: 2024-09-21T01:14:06.283+0000 7ff919c2b640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T01:14:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:06 smithi137 ceph-mon[34607]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T01:14:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:06 smithi137 ceph-mon[34607]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:06 smithi144 ceph-mon[34818]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T01:14:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:06 smithi144 ceph-mon[34818]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:06.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:06 smithi037 ceph-mon[31105]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T01:14:07.089 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:06 smithi037 ceph-mon[31105]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:07.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T01:14:07.348 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:07.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:07 smithi037 ceph-mon[31105]: pgmap v299: 97 pgs: 97 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-21T01:14:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 -- 172.21.15.37:0/3762018168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 msgr2=0x7f1e44102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 --2- 172.21.15.37:0/3762018168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44102ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009900 tx=0x7f1e4002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 -- 172.21.15.37:0/3762018168 shutdown_connections 2024-09-21T01:14:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 --2- 172.21.15.37:0/3762018168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e44108d20 0x7f1e4410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 --2- 172.21.15.37:0/3762018168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e441083d0 0x7f1e441087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 --2- 172.21.15.37:0/3762018168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44102ef0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 -- 172.21.15.37:0/3762018168 >> 172.21.15.37:0/3762018168 conn(0x7f1e44079760 msgr2=0x7f1e44079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 -- 172.21.15.37:0/3762018168 shutdown_connections 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.876+0000 7f1e4be30640 1 -- 172.21.15.37:0/3762018168 wait complete. 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 Processor -- start 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 -- start start 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e441083d0 0x7f1e441047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e44108d20 0x7f1e44104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44112990 con 0x7f1e44102ae0 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44112810 con 0x7f1e441083d0 2024-09-21T01:14:07.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e4be30640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e44112b10 con 0x7f1e44108d20 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e49bcc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e49bcc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45816/0 (socket says 172.21.15.37:45816) 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e49bcc640 1 -- 172.21.15.37:0/2853320642 learned_addr learned my addr 172.21.15.37:0/2853320642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.877+0000 7f1e493cb640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e441083d0 0x7f1e441047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e4a3cd640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e44108d20 0x7f1e44104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e49bcc640 1 -- 172.21.15.37:0/2853320642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e44108d20 msgr2=0x7f1e44104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e49bcc640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e44108d20 0x7f1e44104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e49bcc640 1 -- 172.21.15.37:0/2853320642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e441083d0 msgr2=0x7f1e441047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e49bcc640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e441083d0 0x7f1e441047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e49bcc640 1 -- 172.21.15.37:0/2853320642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e441a8680 con 0x7f1e44102ae0 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e4a3cd640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e44108d20 0x7f1e44104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e49bcc640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44104280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e40005940 tx=0x7f1e400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4003f030 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e40003cb0 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e441a8910 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40035070 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.878+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e441a8df0 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.879+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e44103d10 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.881+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1e40042030 con 0x7f1e44102ae0 2024-09-21T01:14:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.881+0000 7f1e3affd640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e300b65a0 0x7f1e300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.882+0000 7f1e493cb640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e300b65a0 0x7f1e300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.882+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f1e40107e30 con 0x7f1e44102ae0 2024-09-21T01:14:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.882+0000 7f1e493cb640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e300b65a0 0x7f1e300b8ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e44100d20 tx=0x7f1e3400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:07.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:07.885+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e400ce710 con 0x7f1e44102ae0 2024-09-21T01:14:08.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.102+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1e4406bb70 con 0x7f1e300b65a0 2024-09-21T01:14:08.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.109+0000 7f1e3affd640 1 -- 172.21.15.37:0/2853320642 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1e4406bb70 con 0x7f1e300b65a0 2024-09-21T01:14:08.111 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/cb918126-c7eb-4526-9502-ac93718b8efa 2024-09-21T01:14:08.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.111+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e300b65a0 msgr2=0x7f1e300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.111+0000 7f1e4be30640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e300b65a0 0x7f1e300b8ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e44100d20 tx=0x7f1e3400a2d0 comp rx=0 tx=0).stop 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.111+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 msgr2=0x7f1e44104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.111+0000 7f1e4be30640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44104280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e40005940 tx=0x7f1e400042f0 comp rx=0 tx=0).stop 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.111+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 shutdown_connections 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e300b65a0 0x7f1e300b8ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e44108d20 0x7f1e44104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e441083d0 0x7f1e441047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:08.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 --2- 172.21.15.37:0/2853320642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e44102ae0 0x7f1e44104280 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:08.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 >> 172.21.15.37:0/2853320642 conn(0x7f1e44079760 msgr2=0x7f1e44101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:08.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 shutdown_connections 2024-09-21T01:14:08.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:08.112+0000 7f1e4be30640 1 -- 172.21.15.37:0/2853320642 wait complete. 2024-09-21T01:14:08.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:07 smithi137 ceph-mon[34607]: pgmap v299: 97 pgs: 97 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-21T01:14:08.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:07 smithi144 ceph-mon[34818]: pgmap v299: 97 pgs: 97 active+clean; 585 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-21T01:14:08.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T01:14:08.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:08 smithi037 ceph-mon[31105]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:09.122 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:09.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:08 smithi137 ceph-mon[34607]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:09.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:08 smithi144 ceph-mon[34818]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/3405322437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 msgr2=0x7f4ae40761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/3405322437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae40761e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009900 tx=0x7f4ad402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/3405322437 shutdown_connections 2024-09-21T01:14:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/3405322437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae4114440 0x7f4ae4116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/3405322437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae40761e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/3405322437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae4077380 0x7f4ae40757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/3405322437 >> 172.21.15.37:0/3405322437 conn(0x7f4ae40ff5e0 msgr2=0x7f4ae4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/3405322437 shutdown_connections 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.654+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/3405322437 wait complete. 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 Processor -- start 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 -- start start 2024-09-21T01:14:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae41a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae4077380 0x7f4ae41a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae4114440 0x7f4ae41a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae411a060 con 0x7f4ae4075dd0 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae4119ee0 con 0x7f4ae4077380 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4aeb4e8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae411a1e0 con 0x7f4ae4114440 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae41a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:09.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae41a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45834/0 (socket says 172.21.15.37:45834) 2024-09-21T01:14:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 -- 172.21.15.37:0/1928705508 learned_addr learned my addr 172.21.15.37:0/1928705508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae8a83640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae4077380 0x7f4ae41a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9a85640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae4114440 0x7f4ae41a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 -- 172.21.15.37:0/1928705508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae4114440 msgr2=0x7f4ae41a63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae4114440 0x7f4ae41a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 -- 172.21.15.37:0/1928705508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae4077380 msgr2=0x7f4ae41a1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae4077380 0x7f4ae41a1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.655+0000 7f4ae9284640 1 -- 172.21.15.37:0/1928705508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae41a6ae0 con 0x7f4ae4075dd0 2024-09-21T01:14:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.656+0000 7f4ae9284640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae41a0b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000e9f0 tx=0x7f4ae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.656+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000cd80 con 0x7f4ae4075dd0 2024-09-21T01:14:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.656+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae00054d0 con 0x7f4ae4075dd0 2024-09-21T01:14:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.656+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae41a6dd0 con 0x7f4ae4075dd0 2024-09-21T01:14:09.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.656+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0010690 con 0x7f4ae4075dd0 2024-09-21T01:14:09.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.656+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae41ad530 con 0x7f4ae4075dd0 2024-09-21T01:14:09.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.657+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae40761e0 con 0x7f4ae4075dd0 2024-09-21T01:14:09.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.659+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4ae0004e30 con 0x7f4ae4075dd0 2024-09-21T01:14:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.659+0000 7f4ada7fc640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4ad00b6620 0x7f4ad00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.660+0000 7f4ae8a83640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4ad00b6620 0x7f4ad00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.660+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f4ae00e78d0 con 0x7f4ae4075dd0 2024-09-21T01:14:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.660+0000 7f4ae8a83640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4ad00b6620 0x7f4ad00b8b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.663+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ae0056710 con 0x7f4ae4075dd0 2024-09-21T01:14:09.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.880+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4ae4063800 con 0x7f4ad00b6620 2024-09-21T01:14:09.881 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:09 smithi037 ceph-mon[31105]: pgmap v300: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.5 KiB/s wr, 21 op/s 2024-09-21T01:14:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.911+0000 7f4ada7fc640 1 -- 172.21.15.37:0/1928705508 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ae4063800 con 0x7f4ad00b6620 2024-09-21T01:14:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4ad00b6620 msgr2=0x7f4ad00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4ad00b6620 0x7f4ad00b8b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad4031400 comp rx=0 tx=0).stop 2024-09-21T01:14:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 msgr2=0x7f4ae41a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae41a0b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000e9f0 tx=0x7f4ae000edf0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 shutdown_connections 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4ad00b6620 0x7f4ad00b8b30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae4114440 0x7f4ae41a63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ae4077380 0x7f4ae41a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 --2- 172.21.15.37:0/1928705508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ae4075dd0 0x7f4ae41a0b70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 >> 172.21.15.37:0/1928705508 conn(0x7f4ae40ff5e0 msgr2=0x7f4ae4110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 shutdown_connections 2024-09-21T01:14:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:09.914+0000 7f4aeb4e8640 1 -- 172.21.15.37:0/1928705508 wait complete. 2024-09-21T01:14:10.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:09 smithi137 ceph-mon[34607]: pgmap v300: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.5 KiB/s wr, 21 op/s 2024-09-21T01:14:10.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:09 smithi144 ceph-mon[34818]: pgmap v300: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.5 KiB/s wr, 21 op/s 2024-09-21T01:14:10.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T01:14:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:10.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:10 smithi037 ceph-mon[31105]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:11.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:10 smithi137 ceph-mon[34607]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:11.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:10 smithi144 ceph-mon[34818]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1826631210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 msgr2=0x7f3ea41029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1826631210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea41029e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009900 tx=0x7f3ea002a480 comp rx=0 tx=0).stop 2024-09-21T01:14:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1826631210 shutdown_connections 2024-09-21T01:14:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1826631210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4110180 0x7f3ea41125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1826631210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea4102f20 0x7f3ea410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1826631210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea41029e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.437+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1826631210 >> 172.21.15.37:0/1826631210 conn(0x7f3ea4079730 msgr2=0x7f3ea4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.438+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1826631210 shutdown_connections 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.438+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1826631210 wait complete. 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.438+0000 7f3eabb1d640 1 Processor -- start 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.438+0000 7f3eabb1d640 1 -- start start 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.438+0000 7f3eabb1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eabb1d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4102f20 0x7f3ea419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eabb1d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea4110180 0x7f3ea41a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eabb1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4115c70 con 0x7f3ea41025d0 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eabb1d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4115af0 con 0x7f3ea4110180 2024-09-21T01:14:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eabb1d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4115df0 con 0x7f3ea4102f20 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea419c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45854/0 (socket says 172.21.15.37:45854) 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 -- 172.21.15.37:0/1399933553 learned_addr learned my addr 172.21.15.37:0/1399933553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eaa0ba640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea4110180 0x7f3ea41a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea90b8640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4102f20 0x7f3ea419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 -- 172.21.15.37:0/1399933553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4102f20 msgr2=0x7f3ea419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4102f20 0x7f3ea419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 -- 172.21.15.37:0/1399933553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea4110180 msgr2=0x7f3ea41a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea4110180 0x7f3ea41a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 -- 172.21.15.37:0/1399933553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea41a2590 con 0x7f3ea41025d0 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea90b8640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4102f20 0x7f3ea419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3ea98b9640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea419c6e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0005940 tx=0x7f3ea00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea003f030 con 0x7f3ea41025d0 2024-09-21T01:14:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ea0003cb0 con 0x7f3ea41025d0 2024-09-21T01:14:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea41a2820 con 0x7f3ea41025d0 2024-09-21T01:14:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.439+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0035070 con 0x7f3ea41025d0 2024-09-21T01:14:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.440+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a2d00 con 0x7f3ea41025d0 2024-09-21T01:14:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.440+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea41029e0 con 0x7f3ea41025d0 2024-09-21T01:14:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.442+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3ea0042030 con 0x7f3ea41025d0 2024-09-21T01:14:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.443+0000 7f3e9affd640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e900b65d0 0x7f3e900b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:11.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.443+0000 7f3ea90b8640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e900b65d0 0x7f3e900b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:11.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.443+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f3ea0107b50 con 0x7f3ea41025d0 2024-09-21T01:14:11.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.444+0000 7f3ea90b8640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e900b65d0 0x7f3e900b8ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4104030 tx=0x7f3e94005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:11.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.446+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ea00ce430 con 0x7f3ea41025d0 2024-09-21T01:14:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.664+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3ea4109390 con 0x7f3e900b65d0 2024-09-21T01:14:11.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.670+0000 7f3e9affd640 1 -- 172.21.15.37:0/1399933553 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3ea4109390 con 0x7f3e900b65d0 2024-09-21T01:14:11.671 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/b1d22a8f-7fd5-4fd3-9d6d-b69ea0b2bfdf 2024-09-21T01:14:11.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e900b65d0 msgr2=0x7f3e900b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:11.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e900b65d0 0x7f3e900b8ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4104030 tx=0x7f3e94005e50 comp rx=0 tx=0).stop 2024-09-21T01:14:11.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 msgr2=0x7f3ea419c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea419c6e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0005940 tx=0x7f3ea00042f0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 shutdown_connections 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e900b65d0 0x7f3e900b8ae0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea4110180 0x7f3ea41a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ea4102f20 0x7f3ea419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 --2- 172.21.15.37:0/1399933553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea41025d0 0x7f3ea419c6e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 >> 172.21.15.37:0/1399933553 conn(0x7f3ea4079730 msgr2=0x7f3ea4108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 shutdown_connections 2024-09-21T01:14:11.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:11.672+0000 7f3eabb1d640 1 -- 172.21.15.37:0/1399933553 wait complete. 2024-09-21T01:14:11.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:11 smithi037 ceph-mon[31105]: pgmap v301: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-21T01:14:12.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:11 smithi137 ceph-mon[34607]: pgmap v301: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-21T01:14:12.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:11 smithi144 ceph-mon[34818]: pgmap v301: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 KiB/s wr, 22 op/s 2024-09-21T01:14:12.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:14:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:12.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:12 smithi037 ceph-mon[31105]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3308071177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f8103b60 msgr2=0x7fa8f8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3308071177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f8103b60 0x7fa8f8103f70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009900 tx=0x7fa8f002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3308071177 shutdown_connections 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3308071177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8f8109df0 0x7fa8f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3308071177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f81094a0 0x7fa8f81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3308071177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f8103b60 0x7fa8f8103f70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3308071177 >> 172.21.15.37:0/3308071177 conn(0x7fa8f807b850 msgr2=0x7fa8f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3308071177 shutdown_connections 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.141+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3308071177 wait complete. 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 Processor -- start 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 -- start start 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f8103b60 0x7fa8f819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 0x7fa8f819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8f8109df0 0x7fa8f819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f8113ab0 con 0x7fa8f81094a0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f8113930 con 0x7fa8f8109df0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8fcdd1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f8113c30 con 0x7fa8f8103b60 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 0x7fa8f819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 0x7fa8f819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45884/0 (socket says 172.21.15.37:45884) 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.142+0000 7fa8f5d9b640 1 -- 172.21.15.37:0/3117078186 learned_addr learned my addr 172.21.15.37:0/3117078186 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f659c640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f8103b60 0x7fa8f819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f6d9d640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8f8109df0 0x7fa8f819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f5d9b640 1 -- 172.21.15.37:0/3117078186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f8103b60 msgr2=0x7fa8f819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f5d9b640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f8103b60 0x7fa8f819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f5d9b640 1 -- 172.21.15.37:0/3117078186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8f8109df0 msgr2=0x7fa8f819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f5d9b640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8f8109df0 0x7fa8f819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f5d9b640 1 -- 172.21.15.37:0/3117078186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f81a03d0 con 0x7fa8f81094a0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8f5d9b640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 0x7fa8f819aac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000d750 tx=0x7fa8e000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0017070 con 0x7fa8f81094a0 2024-09-21T01:14:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8e00054d0 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f81a06c0 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0004c30 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.143+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f81a0bb0 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.144+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f8103f70 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.146+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa8e0004dd0 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.147+0000 7fa8ef7fe640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa8e40b65d0 0x7fa8e40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.147+0000 7fa8f659c640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa8e40b65d0 0x7fa8e40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.147+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fa8e00e71a0 con 0x7fa8f81094a0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.147+0000 7fa8f659c640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa8e40b65d0 0x7fa8e40b8ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0031440 tx=0x7fa8f0009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.150+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8f81a0bb0 con 0x7fa8f81094a0 2024-09-21T01:14:13.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:12 smithi137 ceph-mon[34607]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:13.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:12 smithi144 ceph-mon[34818]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:14:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.375+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8f819b650 con 0x7fa8f81094a0 2024-09-21T01:14:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.376+0000 7fa8ef7fe640 1 -- 172.21.15.37:0/3117078186 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11976 (secure 0 0 0) 0x7fa8f819b650 con 0x7fa8f81094a0 2024-09-21T01:14:13.378 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:13.378 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:14:02.645763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:14:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:14:13.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa8e40b65d0 msgr2=0x7fa8e40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:13.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa8e40b65d0 0x7fa8e40b8ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0031440 tx=0x7fa8f0009560 comp rx=0 tx=0).stop 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 msgr2=0x7fa8f819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 0x7fa8f819aac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000d750 tx=0x7fa8e000dc10 comp rx=0 tx=0).stop 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 shutdown_connections 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa8e40b65d0 0x7fa8e40b8ae0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8f8109df0 0x7fa8f819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f81094a0 0x7fa8f819aac0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 --2- 172.21.15.37:0/3117078186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8f8103b60 0x7fa8f819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 >> 172.21.15.37:0/3117078186 conn(0x7fa8f807b850 msgr2=0x7fa8f81075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 shutdown_connections 2024-09-21T01:14:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:13.379+0000 7fa8fcdd1640 1 -- 172.21.15.37:0/3117078186 wait complete. 2024-09-21T01:14:13.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:13 smithi037 ceph-mon[31105]: pgmap v302: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 KiB/s wr, 22 op/s 2024-09-21T01:14:14.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:13 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3117078186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:14.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:14:14.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:13 smithi137 ceph-mon[34607]: pgmap v302: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 KiB/s wr, 22 op/s 2024-09-21T01:14:14.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:13 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3117078186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:14.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:13 smithi144 ceph-mon[34818]: pgmap v302: 97 pgs: 97 active+clean; 608 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.7 KiB/s wr, 22 op/s 2024-09-21T01:14:14.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:13 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3117078186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:14:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.841+0000 7fe7e23cf640 1 -- 172.21.15.37:0/199713262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 msgr2=0x7fe7dc108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.841+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/199713262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc108890 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009900 tx=0x7fe7c402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.841+0000 7fe7e23cf640 1 -- 172.21.15.37:0/199713262 shutdown_connections 2024-09-21T01:14:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/199713262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 0x7fe7dc10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/199713262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc108890 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/199713262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7dc102b40 0x7fe7dc102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 -- 172.21.15.37:0/199713262 >> 172.21.15.37:0/199713262 conn(0x7fe7dc079750 msgr2=0x7fe7dc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 -- 172.21.15.37:0/199713262 shutdown_connections 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 -- 172.21.15.37:0/199713262 wait complete. 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 Processor -- start 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.842+0000 7fe7e23cf640 1 -- start start 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e23cf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7dc102b40 0x7fe7dc1051c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e23cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc105700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e23cf640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 0x7fe7dc105c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e23cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc112a00 con 0x7fe7dc108480 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e23cf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc112880 con 0x7fe7dc102b40 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e23cf640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc112b80 con 0x7fe7dc108dd0 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc105700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:14.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc105700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45910/0 (socket says 172.21.15.37:45910) 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 -- 172.21.15.37:0/314604538 learned_addr learned my addr 172.21.15.37:0/314604538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e096c640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 0x7fe7dc105c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 -- 172.21.15.37:0/314604538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 msgr2=0x7fe7dc105c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 0x7fe7dc105c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7dbfff640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7dc102b40 0x7fe7dc1051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 -- 172.21.15.37:0/314604538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7dc102b40 msgr2=0x7fe7dc1051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7dc102b40 0x7fe7dc1051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 -- 172.21.15.37:0/314604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc1a8770 con 0x7fe7dc108480 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7e096c640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 0x7fe7dc105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d3fff640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc105700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4032fd0 tx=0x7fe7c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c403f030 con 0x7fe7dc108480 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c4004490 con 0x7fe7dc108480 2024-09-21T01:14:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.843+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4035070 con 0x7fe7dc108480 2024-09-21T01:14:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.844+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7dc1a8a00 con 0x7fe7dc108480 2024-09-21T01:14:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.844+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7dc1a8f10 con 0x7fe7dc108480 2024-09-21T01:14:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.845+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7dc103dc0 con 0x7fe7dc108480 2024-09-21T01:14:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.846+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe7c4042030 con 0x7fe7dc108480 2024-09-21T01:14:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.847+0000 7fe7d9ffb640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7c80b65a0 0x7fe7c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.847+0000 7fe7dbfff640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7c80b65a0 0x7fe7c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.848+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fe7c41079b0 con 0x7fe7dc108480 2024-09-21T01:14:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.848+0000 7fe7dbfff640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7c80b65a0 0x7fe7c80b8ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc106c10 tx=0x7fe7cc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:14.852+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7c40ce190 con 0x7fe7dc108480 2024-09-21T01:14:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.042+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7dc1064c0 con 0x7fe7dc108480 2024-09-21T01:14:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.044+0000 7fe7d9ffb640 1 -- 172.21.15.37:0/314604538 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22292 (secure 0 0 0) 0x7fe7c40ef840 con 0x7fe7dc108480 2024-09-21T01:14:15.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:15.046 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:13:51.265614+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:14:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7c80b65a0 msgr2=0x7fe7c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7c80b65a0 0x7fe7c80b8ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc106c10 tx=0x7fe7cc008040 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 msgr2=0x7fe7dc105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc105700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4032fd0 tx=0x7fe7c4004270 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 shutdown_connections 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7c80b65a0 0x7fe7c80b8ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7dc108dd0 0x7fe7dc105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7dc108480 0x7fe7dc105700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 --2- 172.21.15.37:0/314604538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7dc102b40 0x7fe7dc1051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 >> 172.21.15.37:0/314604538 conn(0x7fe7dc079750 msgr2=0x7fe7dc06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 shutdown_connections 2024-09-21T01:14:15.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:15.047+0000 7fe7e23cf640 1 -- 172.21.15.37:0/314604538 wait complete. 2024-09-21T01:14:15.875 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:14:15.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:14:16.141 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:16.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:15 smithi137 ceph-mon[34607]: pgmap v303: 97 pgs: 97 active+clean; 634 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-09-21T01:14:16.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:15 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/314604538' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:16.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:15 smithi144 ceph-mon[34818]: pgmap v303: 97 pgs: 97 active+clean; 634 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-09-21T01:14:16.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:15 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/314604538' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:16.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:15 smithi037 ceph-mon[31105]: pgmap v303: 97 pgs: 97 active+clean; 634 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 24 op/s 2024-09-21T01:14:16.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:15 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/314604538' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 -- 172.21.15.37:0/1335347344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb414102a70 msgr2=0x7fb414102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/1335347344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb414102a70 0x7fb414102e80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb404009900 tx=0x7fb40402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 -- 172.21.15.37:0/1335347344 shutdown_connections 2024-09-21T01:14:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/1335347344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb414108d00 0x7fb41410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/1335347344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4141083b0 0x7fb4141087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/1335347344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb414102a70 0x7fb414102e80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 -- 172.21.15.37:0/1335347344 >> 172.21.15.37:0/1335347344 conn(0x7fb414079710 msgr2=0x7fb414079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 -- 172.21.15.37:0/1335347344 shutdown_connections 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.626+0000 7fb41a4cb640 1 -- 172.21.15.37:0/1335347344 wait complete. 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 Processor -- start 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 -- start start 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb414102a70 0x7fb41419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 0x7fb41419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb414108d00 0x7fb41419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141129c0 con 0x7fb4141083b0 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb414112840 con 0x7fb414102a70 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb41a4cb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb414112b40 con 0x7fb414108d00 2024-09-21T01:14:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb40bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 0x7fb41419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb40bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 0x7fb41419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38874/0 (socket says 172.21.15.37:38874) 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb40bfff640 1 -- 172.21.15.37:0/2850516673 learned_addr learned my addr 172.21.15.37:0/2850516673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb413fff640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb414102a70 0x7fb41419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.627+0000 7fb418a68640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb414108d00 0x7fb41419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb40bfff640 1 -- 172.21.15.37:0/2850516673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb414108d00 msgr2=0x7fb41419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb40bfff640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb414108d00 0x7fb41419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb40bfff640 1 -- 172.21.15.37:0/2850516673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb414102a70 msgr2=0x7fb41419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb40bfff640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb414102a70 0x7fb41419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb40bfff640 1 -- 172.21.15.37:0/2850516673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4141a0350 con 0x7fb4141083b0 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb418a68640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb414108d00 0x7fb41419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb40bfff640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 0x7fb41419aa40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00c8c0 tx=0x7fb3fc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc007bb0 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4141a0640 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3fc007d50 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0187c0 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.628+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4140ff4d0 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.629+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb414103cf0 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.631+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb3fc00fa20 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.631+0000 7fb411ffb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb4000b65d0 0x7fb4000b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.631+0000 7fb413fff640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb4000b65d0 0x7fb4000b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.632+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fb3fc0e7600 con 0x7fb4141083b0 2024-09-21T01:14:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.632+0000 7fb413fff640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb4000b65d0 0x7fb4000b8ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb404031440 tx=0x7fb404005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.635+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3fc014030 con 0x7fb4141083b0 2024-09-21T01:14:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.823+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb414063800 con 0x7fb4000b65d0 2024-09-21T01:14:16.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.829+0000 7fb411ffb640 1 -- 172.21.15.37:0/2850516673 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258960 (secure 0 0 0) 0x7fb414063800 con 0x7fb4000b65d0 2024-09-21T01:14:16.832 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:16.833 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb4000b65d0 msgr2=0x7fb4000b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb4000b65d0 0x7fb4000b8ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb404031440 tx=0x7fb404005e80 comp rx=0 tx=0).stop 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 msgr2=0x7fb41419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 0x7fb41419aa40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00c8c0 tx=0x7fb3fc00cd80 comp rx=0 tx=0).stop 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 shutdown_connections 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb4000b65d0 0x7fb4000b8ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb414108d00 0x7fb41419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4141083b0 0x7fb41419aa40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 --2- 172.21.15.37:0/2850516673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb414102a70 0x7fb41419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 >> 172.21.15.37:0/2850516673 conn(0x7fb414079710 msgr2=0x7fb414101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 shutdown_connections 2024-09-21T01:14:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:16.833+0000 7fb41a4cb640 1 -- 172.21.15.37:0/2850516673 wait complete. 2024-09-21T01:14:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-21T01:14:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:14:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T01:14:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-21T01:14:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T01:14:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-21T01:14:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-09-21T01:14:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T01:14:17.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T01:14:17.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-09-21T01:14:17.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T01:14:17.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-09-21T01:14:17.605 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-21T01:14:14.853943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648746,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":219,"num_read_kb":200,"num_write":354,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371676,"kb_used_data":9948,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570148,"statfs":{"total":1151940427776,"available":1151559831552,"internally_reserved":0,"allocated":10186752,"data_stored":6534942,"data_compressed":113349,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53464,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":141,"num_read_kb":135,"num_write":148,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003575"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552352+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:13:51.552352+0000","last_peered":"2024-09-21T01:13:51.552352+0000","last_clean":"2024-09-21T01:13:51.552352+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:13:51.552352+0000","last_undegraded":"2024-09-21T01:13:51.552352+0000","last_fullsized":"2024-09-21T01:13:51.552352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569419+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:13:51.569419+0000","last_peered":"2024-09-21T01:13:51.569419+0000","last_clean":"2024-09-21T01:13:51.569419+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:13:51.569419+0000","last_undegraded":"2024-09-21T01:13:51.569419+0000","last_fullsized":"2024-09-21T01:13:51.569419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568780+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:13:51.568780+0000","last_peered":"2024-09-21T01:13:51.568780+0000","last_clean":"2024-09-21T01:13:51.568780+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:13:51.568780+0000","last_undegraded":"2024-09-21T01:13:51.568780+0000","last_fullsized":"2024-09-21T01:13:51.568780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565974+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:13:51.565974+0000","last_peered":"2024-09-21T01:13:51.565974+0000","last_clean":"2024-09-21T01:13:51.565974+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:13:51.565974+0000","last_undegraded":"2024-09-21T01:13:51.565974+0000","last_fullsized":"2024-09-21T01:13:51.565974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566120+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:13:51.566120+0000","last_peered":"2024-09-21T01:13:51.566120+0000","last_clean":"2024-09-21T01:13:51.566120+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:13:51.566120+0000","last_undegraded":"2024-09-21T01:13:51.566120+0000","last_fullsized":"2024-09-21T01:13:51.566120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565247+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:13:51.565247+0000","last_peered":"2024-09-21T01:13:51.565247+0000","last_clean":"2024-09-21T01:13:51.565247+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:13:51.565247+0000","last_undegraded":"2024-09-21T01:13:51.565247+0000","last_fullsized":"2024-09-21T01:13:51.565247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551849+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:13:51.551849+0000","last_peered":"2024-09-21T01:13:51.551849+0000","last_clean":"2024-09-21T01:13:51.551849+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:13:51.551849+0000","last_undegraded":"2024-09-21T01:13:51.551849+0000","last_fullsized":"2024-09-21T01:13:51.551849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567749+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:13:51.567749+0000","last_peered":"2024-09-21T01:13:51.567749+0000","last_clean":"2024-09-21T01:13:51.567749+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:13:51.567749+0000","last_undegraded":"2024-09-21T01:13:51.567749+0000","last_fullsized":"2024-09-21T01:13:51.567749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569800+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:13:51.569800+0000","last_peered":"2024-09-21T01:13:51.569800+0000","last_clean":"2024-09-21T01:13:51.569800+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:13:51.569800+0000","last_undegraded":"2024-09-21T01:13:51.569800+0000","last_fullsized":"2024-09-21T01:13:51.569800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567061+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:13:51.567061+0000","last_peered":"2024-09-21T01:13:51.567061+0000","last_clean":"2024-09-21T01:13:51.567061+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:13:51.567061+0000","last_undegraded":"2024-09-21T01:13:51.567061+0000","last_fullsized":"2024-09-21T01:13:51.567061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552199+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:13:51.552199+0000","last_peered":"2024-09-21T01:13:51.552199+0000","last_clean":"2024-09-21T01:13:51.552199+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:13:51.552199+0000","last_undegraded":"2024-09-21T01:13:51.552199+0000","last_fullsized":"2024-09-21T01:13:51.552199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565925+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:13:51.565925+0000","last_peered":"2024-09-21T01:13:51.565925+0000","last_clean":"2024-09-21T01:13:51.565925+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:13:51.565925+0000","last_undegraded":"2024-09-21T01:13:51.565925+0000","last_fullsized":"2024-09-21T01:13:51.565925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.570978+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:13:51.570978+0000","last_peered":"2024-09-21T01:13:51.570978+0000","last_clean":"2024-09-21T01:13:51.570978+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:13:51.570978+0000","last_undegraded":"2024-09-21T01:13:51.570978+0000","last_fullsized":"2024-09-21T01:13:51.570978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568013+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:13:51.568013+0000","last_peered":"2024-09-21T01:13:51.568013+0000","last_clean":"2024-09-21T01:13:51.568013+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:13:51.568013+0000","last_undegraded":"2024-09-21T01:13:51.568013+0000","last_fullsized":"2024-09-21T01:13:51.568013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568716+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:13:51.568716+0000","last_peered":"2024-09-21T01:13:51.568716+0000","last_clean":"2024-09-21T01:13:51.568716+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:13:51.568716+0000","last_undegraded":"2024-09-21T01:13:51.568716+0000","last_fullsized":"2024-09-21T01:13:51.568716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569082+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:13:51.569082+0000","last_peered":"2024-09-21T01:13:51.569082+0000","last_clean":"2024-09-21T01:13:51.569082+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:13:51.569082+0000","last_undegraded":"2024-09-21T01:13:51.569082+0000","last_fullsized":"2024-09-21T01:13:51.569082+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552669+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:13:51.552669+0000","last_peered":"2024-09-21T01:13:51.552669+0000","last_clean":"2024-09-21T01:13:51.552669+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:13:51.552669+0000","last_undegraded":"2024-09-21T01:13:51.552669+0000","last_fullsized":"2024-09-21T01:13:51.552669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566061+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:13:51.566061+0000","last_peered":"2024-09-21T01:13:51.566061+0000","last_clean":"2024-09-21T01:13:51.566061+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:13:51.566061+0000","last_undegraded":"2024-09-21T01:13:51.566061+0000","last_fullsized":"2024-09-21T01:13:51.566061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568371+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:13:51.568371+0000","last_peered":"2024-09-21T01:13:51.568371+0000","last_clean":"2024-09-21T01:13:51.568371+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:13:51.568371+0000","last_undegraded":"2024-09-21T01:13:51.568371+0000","last_fullsized":"2024-09-21T01:13:51.568371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551721+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:13:51.551721+0000","last_peered":"2024-09-21T01:13:51.551721+0000","last_clean":"2024-09-21T01:13:51.551721+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:13:51.551721+0000","last_undegraded":"2024-09-21T01:13:51.551721+0000","last_fullsized":"2024-09-21T01:13:51.551721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571084+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:13:51.571084+0000","last_peered":"2024-09-21T01:13:51.571084+0000","last_clean":"2024-09-21T01:13:51.571084+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:13:51.571084+0000","last_undegraded":"2024-09-21T01:13:51.571084+0000","last_fullsized":"2024-09-21T01:13:51.571084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569983+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:13:51.569983+0000","last_peered":"2024-09-21T01:13:51.569983+0000","last_clean":"2024-09-21T01:13:51.569983+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:13:51.569983+0000","last_undegraded":"2024-09-21T01:13:51.569983+0000","last_fullsized":"2024-09-21T01:13:51.569983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566273+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:13:51.566273+0000","last_peered":"2024-09-21T01:13:51.566273+0000","last_clean":"2024-09-21T01:13:51.566273+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:13:51.566273+0000","last_undegraded":"2024-09-21T01:13:51.566273+0000","last_fullsized":"2024-09-21T01:13:51.566273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552725+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:13:51.552725+0000","last_peered":"2024-09-21T01:13:51.552725+0000","last_clean":"2024-09-21T01:13:51.552725+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:13:51.552725+0000","last_undegraded":"2024-09-21T01:13:51.552725+0000","last_fullsized":"2024-09-21T01:13:51.552725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568126+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:13:51.568126+0000","last_peered":"2024-09-21T01:13:51.568126+0000","last_clean":"2024-09-21T01:13:51.568126+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:13:51.568126+0000","last_undegraded":"2024-09-21T01:13:51.568126+0000","last_fullsized":"2024-09-21T01:13:51.568126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569625+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:13:51.569625+0000","last_peered":"2024-09-21T01:13:51.569625+0000","last_clean":"2024-09-21T01:13:51.569625+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:13:51.569625+0000","last_undegraded":"2024-09-21T01:13:51.569625+0000","last_fullsized":"2024-09-21T01:13:51.569625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552100+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:13:51.552100+0000","last_peered":"2024-09-21T01:13:51.552100+0000","last_clean":"2024-09-21T01:13:51.552100+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:13:51.552100+0000","last_undegraded":"2024-09-21T01:13:51.552100+0000","last_fullsized":"2024-09-21T01:13:51.552100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571046+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:13:51.571046+0000","last_peered":"2024-09-21T01:13:51.571046+0000","last_clean":"2024-09-21T01:13:51.571046+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:13:51.571046+0000","last_undegraded":"2024-09-21T01:13:51.571046+0000","last_fullsized":"2024-09-21T01:13:51.571046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.570353+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:13:51.570353+0000","last_peered":"2024-09-21T01:13:51.570353+0000","last_clean":"2024-09-21T01:13:51.570353+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:13:51.570353+0000","last_undegraded":"2024-09-21T01:13:51.570353+0000","last_fullsized":"2024-09-21T01:13:51.570353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566157+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:13:51.566157+0000","last_peered":"2024-09-21T01:13:51.566157+0000","last_clean":"2024-09-21T01:13:51.566157+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:13:51.566157+0000","last_undegraded":"2024-09-21T01:13:51.566157+0000","last_fullsized":"2024-09-21T01:13:51.566157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569141+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:13:51.569141+0000","last_peered":"2024-09-21T01:13:51.569141+0000","last_clean":"2024-09-21T01:13:51.569141+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:13:51.569141+0000","last_undegraded":"2024-09-21T01:13:51.569141+0000","last_fullsized":"2024-09-21T01:13:51.569141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552024+0000","last_change":"2024-09-21T01:13:50.556354+0000","last_active":"2024-09-21T01:13:51.552024+0000","last_peered":"2024-09-21T01:13:51.552024+0000","last_clean":"2024-09-21T01:13:51.552024+0000","last_became_active":"2024-09-21T01:13:50.555988+0000","last_became_peered":"2024-09-21T01:13:50.555988+0000","last_unstale":"2024-09-21T01:13:51.552024+0000","last_undegraded":"2024-09-21T01:13:51.552024+0000","last_fullsized":"2024-09-21T01:13:51.552024+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:32.352495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566358+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:13:51.566358+0000","last_peered":"2024-09-21T01:13:51.566358+0000","last_clean":"2024-09-21T01:13:51.566358+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:13:51.566358+0000","last_undegraded":"2024-09-21T01:13:51.566358+0000","last_fullsized":"2024-09-21T01:13:51.566358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.675143+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:14:12.675143+0000","last_peered":"2024-09-21T01:14:12.675143+0000","last_clean":"2024-09-21T01:14:12.675143+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:14:12.675143+0000","last_undegraded":"2024-09-21T01:14:12.675143+0000","last_fullsized":"2024-09-21T01:14:12.675143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552792+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:13:51.552792+0000","last_peered":"2024-09-21T01:13:51.552792+0000","last_clean":"2024-09-21T01:13:51.552792+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:13:51.552792+0000","last_undegraded":"2024-09-21T01:13:51.552792+0000","last_fullsized":"2024-09-21T01:13:51.552792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636850+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:00.636850+0000","last_peered":"2024-09-21T01:14:00.636850+0000","last_clean":"2024-09-21T01:14:00.636850+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:00.636850+0000","last_undegraded":"2024-09-21T01:14:00.636850+0000","last_fullsized":"2024-09-21T01:14:00.636850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:59.627873+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:13:59.627873+0000","last_peered":"2024-09-21T01:13:59.627873+0000","last_clean":"2024-09-21T01:13:59.627873+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:13:59.627873+0000","last_undegraded":"2024-09-21T01:13:59.627873+0000","last_fullsized":"2024-09-21T01:13:59.627873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566994+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:13:51.566994+0000","last_peered":"2024-09-21T01:13:51.566994+0000","last_clean":"2024-09-21T01:13:51.566994+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:13:51.566994+0000","last_undegraded":"2024-09-21T01:13:51.566994+0000","last_fullsized":"2024-09-21T01:13:51.566994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651509+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:01.651509+0000","last_peered":"2024-09-21T01:14:01.651509+0000","last_clean":"2024-09-21T01:14:01.651509+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:01.651509+0000","last_undegraded":"2024-09-21T01:14:01.651509+0000","last_fullsized":"2024-09-21T01:14:01.651509+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565274+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:13:51.565274+0000","last_peered":"2024-09-21T01:13:51.565274+0000","last_clean":"2024-09-21T01:13:51.565274+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:13:51.565274+0000","last_undegraded":"2024-09-21T01:13:51.565274+0000","last_fullsized":"2024-09-21T01:13:51.565274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.674393+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:14:12.674393+0000","last_peered":"2024-09-21T01:14:12.674393+0000","last_clean":"2024-09-21T01:14:12.674393+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:14:12.674393+0000","last_undegraded":"2024-09-21T01:14:12.674393+0000","last_fullsized":"2024-09-21T01:14:12.674393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.570719+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:13:51.570719+0000","last_peered":"2024-09-21T01:13:51.570719+0000","last_clean":"2024-09-21T01:13:51.570719+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:13:51.570719+0000","last_undegraded":"2024-09-21T01:13:51.570719+0000","last_fullsized":"2024-09-21T01:13:51.570719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650647+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:01.650647+0000","last_peered":"2024-09-21T01:14:01.650647+0000","last_clean":"2024-09-21T01:14:01.650647+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:01.650647+0000","last_undegraded":"2024-09-21T01:14:01.650647+0000","last_fullsized":"2024-09-21T01:14:01.650647+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567629+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:13:51.567629+0000","last_peered":"2024-09-21T01:13:51.567629+0000","last_clean":"2024-09-21T01:13:51.567629+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:13:51.567629+0000","last_undegraded":"2024-09-21T01:13:51.567629+0000","last_fullsized":"2024-09-21T01:13:51.567629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636518+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:00.636518+0000","last_peered":"2024-09-21T01:14:00.636518+0000","last_clean":"2024-09-21T01:14:00.636518+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:00.636518+0000","last_undegraded":"2024-09-21T01:14:00.636518+0000","last_fullsized":"2024-09-21T01:14:00.636518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569234+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:13:51.569234+0000","last_peered":"2024-09-21T01:13:51.569234+0000","last_clean":"2024-09-21T01:13:51.569234+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:13:51.569234+0000","last_undegraded":"2024-09-21T01:13:51.569234+0000","last_fullsized":"2024-09-21T01:13:51.569234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'24","reported_seq":70,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.675905+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:14:12.675905+0000","last_peered":"2024-09-21T01:14:12.675905+0000","last_clean":"2024-09-21T01:14:12.675905+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:14:12.675905+0000","last_undegraded":"2024-09-21T01:14:12.675905+0000","last_fullsized":"2024-09-21T01:14:12.675905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":62,"num_write":26,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566409+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:13:51.566409+0000","last_peered":"2024-09-21T01:13:51.566409+0000","last_clean":"2024-09-21T01:13:51.566409+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:13:51.566409+0000","last_undegraded":"2024-09-21T01:13:51.566409+0000","last_fullsized":"2024-09-21T01:13:51.566409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.655590+0000","last_change":"2024-09-21T01:13:48.548344+0000","last_active":"2024-09-21T01:14:02.655590+0000","last_peered":"2024-09-21T01:14:02.655590+0000","last_clean":"2024-09-21T01:14:02.655590+0000","last_became_active":"2024-09-21T01:13:48.547934+0000","last_became_peered":"2024-09-21T01:13:48.547934+0000","last_unstale":"2024-09-21T01:14:02.655590+0000","last_undegraded":"2024-09-21T01:14:02.655590+0000","last_fullsized":"2024-09-21T01:14:02.655590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:38.318036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566253+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:13:51.566253+0000","last_peered":"2024-09-21T01:13:51.566253+0000","last_clean":"2024-09-21T01:13:51.566253+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:13:51.566253+0000","last_undegraded":"2024-09-21T01:13:51.566253+0000","last_fullsized":"2024-09-21T01:13:51.566253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650922+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:01.650922+0000","last_peered":"2024-09-21T01:14:01.650922+0000","last_clean":"2024-09-21T01:14:01.650922+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:01.650922+0000","last_undegraded":"2024-09-21T01:14:01.650922+0000","last_fullsized":"2024-09-21T01:14:01.650922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551560+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:13:51.551560+0000","last_peered":"2024-09-21T01:13:51.551560+0000","last_clean":"2024-09-21T01:13:51.551560+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:13:51.551560+0000","last_undegraded":"2024-09-21T01:13:51.551560+0000","last_fullsized":"2024-09-21T01:13:51.551560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:08.668096+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:14:08.668096+0000","last_peered":"2024-09-21T01:14:08.668096+0000","last_clean":"2024-09-21T01:14:08.668096+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:14:08.668096+0000","last_undegraded":"2024-09-21T01:14:08.668096+0000","last_fullsized":"2024-09-21T01:14:08.668096+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551438+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:13:51.551438+0000","last_peered":"2024-09-21T01:13:51.551438+0000","last_clean":"2024-09-21T01:13:51.551438+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:13:51.551438+0000","last_undegraded":"2024-09-21T01:13:51.551438+0000","last_fullsized":"2024-09-21T01:13:51.551438+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650881+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:01.650881+0000","last_peered":"2024-09-21T01:14:01.650881+0000","last_clean":"2024-09-21T01:14:01.650881+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:01.650881+0000","last_undegraded":"2024-09-21T01:14:01.650881+0000","last_fullsized":"2024-09-21T01:14:01.650881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552140+0000","last_change":"2024-09-21T01:13:50.554075+0000","last_active":"2024-09-21T01:13:51.552140+0000","last_peered":"2024-09-21T01:13:51.552140+0000","last_clean":"2024-09-21T01:13:51.552140+0000","last_became_active":"2024-09-21T01:13:50.553593+0000","last_became_peered":"2024-09-21T01:13:50.553593+0000","last_unstale":"2024-09-21T01:13:51.552140+0000","last_undegraded":"2024-09-21T01:13:51.552140+0000","last_fullsized":"2024-09-21T01:13:51.552140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:38.947673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.624678+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:01.624678+0000","last_peered":"2024-09-21T01:14:01.624678+0000","last_clean":"2024-09-21T01:14:01.624678+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:01.624678+0000","last_undegraded":"2024-09-21T01:14:01.624678+0000","last_fullsized":"2024-09-21T01:14:01.624678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551820+0000","last_change":"2024-09-21T01:13:50.551199+0000","last_active":"2024-09-21T01:13:51.551820+0000","last_peered":"2024-09-21T01:13:51.551820+0000","last_clean":"2024-09-21T01:13:51.551820+0000","last_became_active":"2024-09-21T01:13:50.550826+0000","last_became_peered":"2024-09-21T01:13:50.550826+0000","last_unstale":"2024-09-21T01:13:51.551820+0000","last_undegraded":"2024-09-21T01:13:51.551820+0000","last_fullsized":"2024-09-21T01:13:51.551820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:35.203713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.649077+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:01.649077+0000","last_peered":"2024-09-21T01:14:01.649077+0000","last_clean":"2024-09-21T01:14:01.649077+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:01.649077+0000","last_undegraded":"2024-09-21T01:14:01.649077+0000","last_fullsized":"2024-09-21T01:14:01.649077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551923+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:13:51.551923+0000","last_peered":"2024-09-21T01:13:51.551923+0000","last_clean":"2024-09-21T01:13:51.551923+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:13:51.551923+0000","last_undegraded":"2024-09-21T01:13:51.551923+0000","last_fullsized":"2024-09-21T01:13:51.551923+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650462+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:01.650462+0000","last_peered":"2024-09-21T01:14:01.650462+0000","last_clean":"2024-09-21T01:14:01.650462+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:01.650462+0000","last_undegraded":"2024-09-21T01:14:01.650462+0000","last_fullsized":"2024-09-21T01:14:01.650462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:52.816711+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:13:52.816711+0000","last_peered":"2024-09-21T01:13:52.816711+0000","last_clean":"2024-09-21T01:13:52.816711+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:13:52.816711+0000","last_undegraded":"2024-09-21T01:13:52.816711+0000","last_fullsized":"2024-09-21T01:13:52.816711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:11.674432+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:14:11.674432+0000","last_peered":"2024-09-21T01:14:11.674432+0000","last_clean":"2024-09-21T01:14:11.674432+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:14:11.674432+0000","last_undegraded":"2024-09-21T01:14:11.674432+0000","last_fullsized":"2024-09-21T01:14:11.674432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552279+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:13:51.552279+0000","last_peered":"2024-09-21T01:13:51.552279+0000","last_clean":"2024-09-21T01:13:51.552279+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:13:51.552279+0000","last_undegraded":"2024-09-21T01:13:51.552279+0000","last_fullsized":"2024-09-21T01:13:51.552279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":92,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551716+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:13:51.551716+0000","last_peered":"2024-09-21T01:13:51.551716+0000","last_clean":"2024-09-21T01:13:51.551716+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:13:51.551716+0000","last_undegraded":"2024-09-21T01:13:51.551716+0000","last_fullsized":"2024-09-21T01:13:51.551716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.655552+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:02.655552+0000","last_peered":"2024-09-21T01:14:02.655552+0000","last_clean":"2024-09-21T01:14:02.655552+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:02.655552+0000","last_undegraded":"2024-09-21T01:14:02.655552+0000","last_fullsized":"2024-09-21T01:14:02.655552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567895+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:13:51.567895+0000","last_peered":"2024-09-21T01:13:51.567895+0000","last_clean":"2024-09-21T01:13:51.567895+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:13:51.567895+0000","last_undegraded":"2024-09-21T01:13:51.567895+0000","last_fullsized":"2024-09-21T01:13:51.567895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:59.629094+0000","last_change":"2024-09-21T01:13:48.545933+0000","last_active":"2024-09-21T01:13:59.629094+0000","last_peered":"2024-09-21T01:13:59.629094+0000","last_clean":"2024-09-21T01:13:59.629094+0000","last_became_active":"2024-09-21T01:13:48.545430+0000","last_became_peered":"2024-09-21T01:13:48.545430+0000","last_unstale":"2024-09-21T01:13:59.629094+0000","last_undegraded":"2024-09-21T01:13:59.629094+0000","last_fullsized":"2024-09-21T01:13:59.629094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:45.737800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565998+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:13:51.565998+0000","last_peered":"2024-09-21T01:13:51.565998+0000","last_clean":"2024-09-21T01:13:51.565998+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:13:51.565998+0000","last_undegraded":"2024-09-21T01:13:51.565998+0000","last_fullsized":"2024-09-21T01:13:51.565998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:09.668891+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:14:09.668891+0000","last_peered":"2024-09-21T01:14:09.668891+0000","last_clean":"2024-09-21T01:14:09.668891+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:14:09.668891+0000","last_undegraded":"2024-09-21T01:14:09.668891+0000","last_fullsized":"2024-09-21T01:14:09.668891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552908+0000","last_change":"2024-09-21T01:13:50.552475+0000","last_active":"2024-09-21T01:13:51.552908+0000","last_peered":"2024-09-21T01:13:51.552908+0000","last_clean":"2024-09-21T01:13:51.552908+0000","last_became_active":"2024-09-21T01:13:50.552007+0000","last_became_peered":"2024-09-21T01:13:50.552007+0000","last_unstale":"2024-09-21T01:13:51.552908+0000","last_undegraded":"2024-09-21T01:13:51.552908+0000","last_fullsized":"2024-09-21T01:13:51.552908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:44.409847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:11.672522+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:14:11.672522+0000","last_peered":"2024-09-21T01:14:11.672522+0000","last_clean":"2024-09-21T01:14:11.672522+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:14:11.672522+0000","last_undegraded":"2024-09-21T01:14:11.672522+0000","last_fullsized":"2024-09-21T01:14:11.672522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565304+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:13:51.565304+0000","last_peered":"2024-09-21T01:13:51.565304+0000","last_clean":"2024-09-21T01:13:51.565304+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:13:51.565304+0000","last_undegraded":"2024-09-21T01:13:51.565304+0000","last_fullsized":"2024-09-21T01:13:51.565304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565507+0000","last_change":"2024-09-21T01:13:48.759671+0000","last_active":"2024-09-21T01:13:51.565507+0000","last_peered":"2024-09-21T01:13:51.565507+0000","last_clean":"2024-09-21T01:13:51.565507+0000","last_became_active":"2024-09-21T01:13:48.759256+0000","last_became_peered":"2024-09-21T01:13:48.759256+0000","last_unstale":"2024-09-21T01:13:51.565507+0000","last_undegraded":"2024-09-21T01:13:51.565507+0000","last_fullsized":"2024-09-21T01:13:51.565507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:25.764178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:53.051935+0000","last_change":"2024-09-21T01:13:50.552124+0000","last_active":"2024-09-21T01:13:53.051935+0000","last_peered":"2024-09-21T01:13:53.051935+0000","last_clean":"2024-09-21T01:13:53.051935+0000","last_became_active":"2024-09-21T01:13:50.551188+0000","last_became_peered":"2024-09-21T01:13:50.551188+0000","last_unstale":"2024-09-21T01:13:53.051935+0000","last_undegraded":"2024-09-21T01:13:53.051935+0000","last_fullsized":"2024-09-21T01:13:53.051935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:25.701944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650579+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:01.650579+0000","last_peered":"2024-09-21T01:14:01.650579+0000","last_clean":"2024-09-21T01:14:01.650579+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:01.650579+0000","last_undegraded":"2024-09-21T01:14:01.650579+0000","last_fullsized":"2024-09-21T01:14:01.650579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571311+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:13:51.571311+0000","last_peered":"2024-09-21T01:13:51.571311+0000","last_clean":"2024-09-21T01:13:51.571311+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:13:51.571311+0000","last_undegraded":"2024-09-21T01:13:51.571311+0000","last_fullsized":"2024-09-21T01:13:51.571311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'11","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:10.565926+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:10.565926+0000","last_peered":"2024-09-21T01:14:10.565926+0000","last_clean":"2024-09-21T01:14:10.565926+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:10.565926+0000","last_undegraded":"2024-09-21T01:14:10.565926+0000","last_fullsized":"2024-09-21T01:14:10.565926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568224+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:13:51.568224+0000","last_peered":"2024-09-21T01:13:51.568224+0000","last_clean":"2024-09-21T01:13:51.568224+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:13:51.568224+0000","last_undegraded":"2024-09-21T01:13:51.568224+0000","last_fullsized":"2024-09-21T01:13:51.568224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651492+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:01.651492+0000","last_peered":"2024-09-21T01:14:01.651492+0000","last_clean":"2024-09-21T01:14:01.651492+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:01.651492+0000","last_undegraded":"2024-09-21T01:14:01.651492+0000","last_fullsized":"2024-09-21T01:14:01.651492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.570479+0000","last_change":"2024-09-21T01:13:50.565095+0000","last_active":"2024-09-21T01:13:51.570479+0000","last_peered":"2024-09-21T01:13:51.570479+0000","last_clean":"2024-09-21T01:13:51.570479+0000","last_became_active":"2024-09-21T01:13:50.564249+0000","last_became_peered":"2024-09-21T01:13:50.564249+0000","last_unstale":"2024-09-21T01:13:51.570479+0000","last_undegraded":"2024-09-21T01:13:51.570479+0000","last_fullsized":"2024-09-21T01:13:51.570479+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:11.767127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:58.616589+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:13:58.616589+0000","last_peered":"2024-09-21T01:13:58.616589+0000","last_clean":"2024-09-21T01:13:58.616589+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:13:58.616589+0000","last_undegraded":"2024-09-21T01:13:58.616589+0000","last_fullsized":"2024-09-21T01:13:58.616589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569373+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:13:51.569373+0000","last_peered":"2024-09-21T01:13:51.569373+0000","last_clean":"2024-09-21T01:13:51.569373+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:13:51.569373+0000","last_undegraded":"2024-09-21T01:13:51.569373+0000","last_fullsized":"2024-09-21T01:13:51.569373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650177+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:01.650177+0000","last_peered":"2024-09-21T01:14:01.650177+0000","last_clean":"2024-09-21T01:14:01.650177+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:01.650177+0000","last_undegraded":"2024-09-21T01:14:01.650177+0000","last_fullsized":"2024-09-21T01:14:01.650177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551529+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:13:51.551529+0000","last_peered":"2024-09-21T01:13:51.551529+0000","last_clean":"2024-09-21T01:13:51.551529+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:13:51.551529+0000","last_undegraded":"2024-09-21T01:13:51.551529+0000","last_fullsized":"2024-09-21T01:13:51.551529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636562+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:00.636562+0000","last_peered":"2024-09-21T01:14:00.636562+0000","last_clean":"2024-09-21T01:14:00.636562+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:00.636562+0000","last_undegraded":"2024-09-21T01:14:00.636562+0000","last_fullsized":"2024-09-21T01:14:00.636562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566213+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:13:51.566213+0000","last_peered":"2024-09-21T01:13:51.566213+0000","last_clean":"2024-09-21T01:13:51.566213+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:13:51.566213+0000","last_undegraded":"2024-09-21T01:13:51.566213+0000","last_fullsized":"2024-09-21T01:13:51.566213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:58.616257+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:13:58.616257+0000","last_peered":"2024-09-21T01:13:58.616257+0000","last_clean":"2024-09-21T01:13:58.616257+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:13:58.616257+0000","last_undegraded":"2024-09-21T01:13:58.616257+0000","last_fullsized":"2024-09-21T01:13:58.616257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551937+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:13:51.551937+0000","last_peered":"2024-09-21T01:13:51.551937+0000","last_clean":"2024-09-21T01:13:51.551937+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:13:51.551937+0000","last_undegraded":"2024-09-21T01:13:51.551937+0000","last_fullsized":"2024-09-21T01:13:51.551937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551897+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:13:51.551897+0000","last_peered":"2024-09-21T01:13:51.551897+0000","last_clean":"2024-09-21T01:13:51.551897+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:13:51.551897+0000","last_undegraded":"2024-09-21T01:13:51.551897+0000","last_fullsized":"2024-09-21T01:13:51.551897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651195+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:01.651195+0000","last_peered":"2024-09-21T01:14:01.651195+0000","last_clean":"2024-09-21T01:14:01.651195+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:01.651195+0000","last_undegraded":"2024-09-21T01:14:01.651195+0000","last_fullsized":"2024-09-21T01:14:01.651195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569589+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:13:51.569589+0000","last_peered":"2024-09-21T01:13:51.569589+0000","last_clean":"2024-09-21T01:13:51.569589+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:13:51.569589+0000","last_undegraded":"2024-09-21T01:13:51.569589+0000","last_fullsized":"2024-09-21T01:13:51.569589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.645596+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:02.645596+0000","last_peered":"2024-09-21T01:14:02.645596+0000","last_clean":"2024-09-21T01:14:02.645596+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:02.645596+0000","last_undegraded":"2024-09-21T01:14:02.645596+0000","last_fullsized":"2024-09-21T01:14:02.645596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567356+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:13:51.567356+0000","last_peered":"2024-09-21T01:13:51.567356+0000","last_clean":"2024-09-21T01:13:51.567356+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:13:51.567356+0000","last_undegraded":"2024-09-21T01:13:51.567356+0000","last_fullsized":"2024-09-21T01:13:51.567356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.572179+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:13:51.572179+0000","last_peered":"2024-09-21T01:13:51.572179+0000","last_clean":"2024-09-21T01:13:51.572179+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:13:51.572179+0000","last_undegraded":"2024-09-21T01:13:51.572179+0000","last_fullsized":"2024-09-21T01:13:51.572179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567111+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:13:51.567111+0000","last_peered":"2024-09-21T01:13:51.567111+0000","last_clean":"2024-09-21T01:13:51.567111+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:13:51.567111+0000","last_undegraded":"2024-09-21T01:13:51.567111+0000","last_fullsized":"2024-09-21T01:13:51.567111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:11.671726+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:14:11.671726+0000","last_peered":"2024-09-21T01:14:11.671726+0000","last_clean":"2024-09-21T01:14:11.671726+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:14:11.671726+0000","last_undegraded":"2024-09-21T01:14:11.671726+0000","last_fullsized":"2024-09-21T01:14:11.671726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58144,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":143,"num_read_kb":136,"num_write":229,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":174432,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776146,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":383975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1025553,"data_compressed":37783,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":383514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":383892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":976410,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":383231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":976088,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":383092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":383056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":436086,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":435084,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":384961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":52692,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":53694,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":52676,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:14:17.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:14:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-09-21T01:14:18.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T01:14:18.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-21T01:14:18.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:17 smithi037 ceph-mon[31105]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:14:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2857376868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108d30 msgr2=0x7fb56810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2857376868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108d30 0x7fb56810f560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb560009ca0 tx=0x7fb56002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2857376868 shutdown_connections 2024-09-21T01:14:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2857376868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108d30 0x7fb56810f560 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2857376868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5681083e0 0x7fb5681087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2857376868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb568103170 0x7fb568103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2857376868 >> 172.21.15.37:0/2857376868 conn(0x7fb568077cc0 msgr2=0x7fb568078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2857376868 shutdown_connections 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.360+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2857376868 wait complete. 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 Processor -- start 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 -- start start 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb568103170 0x7fb56819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 0x7fb56819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb568108d30 0x7fb56819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681129f0 con 0x7fb5681083e0 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112870 con 0x7fb568108d30 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56e8d0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112b70 con 0x7fb568103170 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 0x7fb56819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:18.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 0x7fb56819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38894/0 (socket says 172.21.15.37:38894) 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb55ffff640 1 -- 172.21.15.37:0/2616253457 learned_addr learned my addr 172.21.15.37:0/2616253457 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb567fff640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb568103170 0x7fb56819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.361+0000 7fb56ce6d640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb568108d30 0x7fb56819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb55ffff640 1 -- 172.21.15.37:0/2616253457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb568103170 msgr2=0x7fb56819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb55ffff640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb568103170 0x7fb56819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb55ffff640 1 -- 172.21.15.37:0/2616253457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb568108d30 msgr2=0x7fb56819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb55ffff640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb568108d30 0x7fb56819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb55ffff640 1 -- 172.21.15.37:0/2616253457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5681a03c0 con 0x7fb5681083e0 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb56ce6d640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb568108d30 0x7fb56819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb55ffff640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 0x7fb56819a9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c970 tx=0x7fb55000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550007bb0 con 0x7fb5681083e0 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5681a06b0 con 0x7fb5681083e0 2024-09-21T01:14:18.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb550007d50 con 0x7fb5681083e0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550004e10 con 0x7fb5681083e0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.362+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5681a6e10 con 0x7fb5681083e0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.363+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb568103ef0 con 0x7fb5681083e0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.365+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb550005000 con 0x7fb5681083e0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.365+0000 7fb565ffb640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb5540b65a0 0x7fb5540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.365+0000 7fb567fff640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb5540b65a0 0x7fb5540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.366+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb5500e7620 con 0x7fb5681083e0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.366+0000 7fb567fff640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb5540b65a0 0x7fb5540b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb558005fd0 tx=0x7fb55800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:18.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.369+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb550014030 con 0x7fb5681083e0 2024-09-21T01:14:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-21T01:14:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-21T01:14:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:17 smithi137 ceph-mon[34607]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:18.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: pgmap v304: 97 pgs: 97 active+clean; 634 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 1]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-21T01:14:18.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:17 smithi144 ceph-mon[34818]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:14:18.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.552+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb568101f30 con 0x7fb5540b65a0 2024-09-21T01:14:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.557+0000 7fb565ffb640 1 -- 172.21.15.37:0/2616253457 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258877 (secure 0 0 0) 0x7fb568101f30 con 0x7fb5540b65a0 2024-09-21T01:14:18.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:18.561 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:14:18.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb5540b65a0 msgr2=0x7fb5540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:18.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb5540b65a0 0x7fb5540b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb558005fd0 tx=0x7fb55800b390 comp rx=0 tx=0).stop 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 msgr2=0x7fb56819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 0x7fb56819a9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c970 tx=0x7fb55000ce30 comp rx=0 tx=0).stop 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 shutdown_connections 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb5540b65a0 0x7fb5540b8ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb568108d30 0x7fb56819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5681083e0 0x7fb56819a9f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 --2- 172.21.15.37:0/2616253457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb568103170 0x7fb56819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 >> 172.21.15.37:0/2616253457 conn(0x7fb568077cc0 msgr2=0x7fb5681043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 shutdown_connections 2024-09-21T01:14:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:18.560+0000 7fb56e8d0640 1 -- 172.21.15.37:0/2616253457 wait complete. 2024-09-21T01:14:19.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:18 smithi037 ceph-mon[31105]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:14:19.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:18 smithi037 ceph-mon[31105]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:19.221 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-21T01:14:17.920268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648746,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":234,"num_read_kb":205,"num_write":354,"num_write_kb":2274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371700,"kb_used_data":9968,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570124,"statfs":{"total":1151940427776,"available":1151559806976,"internally_reserved":0,"allocated":10207232,"data_stored":6551286,"data_compressed":116226,"data_compressed_allocated":151552,"data_compressed_original":1802240,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26657,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":57,"num_write":12,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.068121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552352+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:13:51.552352+0000","last_peered":"2024-09-21T01:13:51.552352+0000","last_clean":"2024-09-21T01:13:51.552352+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:13:51.552352+0000","last_undegraded":"2024-09-21T01:13:51.552352+0000","last_fullsized":"2024-09-21T01:13:51.552352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923610+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:14:16.923610+0000","last_peered":"2024-09-21T01:14:16.923610+0000","last_clean":"2024-09-21T01:14:16.923610+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:14:16.923610+0000","last_undegraded":"2024-09-21T01:14:16.923610+0000","last_fullsized":"2024-09-21T01:14:16.923610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923314+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:14:16.923314+0000","last_peered":"2024-09-21T01:14:16.923314+0000","last_clean":"2024-09-21T01:14:16.923314+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:14:16.923314+0000","last_undegraded":"2024-09-21T01:14:16.923314+0000","last_fullsized":"2024-09-21T01:14:16.923314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565974+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:13:51.565974+0000","last_peered":"2024-09-21T01:13:51.565974+0000","last_clean":"2024-09-21T01:13:51.565974+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:13:51.565974+0000","last_undegraded":"2024-09-21T01:13:51.565974+0000","last_fullsized":"2024-09-21T01:13:51.565974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566120+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:13:51.566120+0000","last_peered":"2024-09-21T01:13:51.566120+0000","last_clean":"2024-09-21T01:13:51.566120+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:13:51.566120+0000","last_undegraded":"2024-09-21T01:13:51.566120+0000","last_fullsized":"2024-09-21T01:13:51.566120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565247+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:13:51.565247+0000","last_peered":"2024-09-21T01:13:51.565247+0000","last_clean":"2024-09-21T01:13:51.565247+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:13:51.565247+0000","last_undegraded":"2024-09-21T01:13:51.565247+0000","last_fullsized":"2024-09-21T01:13:51.565247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923157+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:14:16.923157+0000","last_peered":"2024-09-21T01:14:16.923157+0000","last_clean":"2024-09-21T01:14:16.923157+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:14:16.923157+0000","last_undegraded":"2024-09-21T01:14:16.923157+0000","last_fullsized":"2024-09-21T01:14:16.923157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567749+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:13:51.567749+0000","last_peered":"2024-09-21T01:13:51.567749+0000","last_clean":"2024-09-21T01:13:51.567749+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:13:51.567749+0000","last_undegraded":"2024-09-21T01:13:51.567749+0000","last_fullsized":"2024-09-21T01:13:51.567749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.927123+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:14:16.927123+0000","last_peered":"2024-09-21T01:14:16.927123+0000","last_clean":"2024-09-21T01:14:16.927123+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:14:16.927123+0000","last_undegraded":"2024-09-21T01:14:16.927123+0000","last_fullsized":"2024-09-21T01:14:16.927123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567061+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:13:51.567061+0000","last_peered":"2024-09-21T01:13:51.567061+0000","last_clean":"2024-09-21T01:13:51.567061+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:13:51.567061+0000","last_undegraded":"2024-09-21T01:13:51.567061+0000","last_fullsized":"2024-09-21T01:13:51.567061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923661+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:14:16.923661+0000","last_peered":"2024-09-21T01:14:16.923661+0000","last_clean":"2024-09-21T01:14:16.923661+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:14:16.923661+0000","last_undegraded":"2024-09-21T01:14:16.923661+0000","last_fullsized":"2024-09-21T01:14:16.923661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565925+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:13:51.565925+0000","last_peered":"2024-09-21T01:13:51.565925+0000","last_clean":"2024-09-21T01:13:51.565925+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:13:51.565925+0000","last_undegraded":"2024-09-21T01:13:51.565925+0000","last_fullsized":"2024-09-21T01:13:51.565925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.570978+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:13:51.570978+0000","last_peered":"2024-09-21T01:13:51.570978+0000","last_clean":"2024-09-21T01:13:51.570978+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:13:51.570978+0000","last_undegraded":"2024-09-21T01:13:51.570978+0000","last_fullsized":"2024-09-21T01:13:51.570978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.922839+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:14:16.922839+0000","last_peered":"2024-09-21T01:14:16.922839+0000","last_clean":"2024-09-21T01:14:16.922839+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:14:16.922839+0000","last_undegraded":"2024-09-21T01:14:16.922839+0000","last_fullsized":"2024-09-21T01:14:16.922839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.922486+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:14:16.922486+0000","last_peered":"2024-09-21T01:14:16.922486+0000","last_clean":"2024-09-21T01:14:16.922486+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:14:16.922486+0000","last_undegraded":"2024-09-21T01:14:16.922486+0000","last_fullsized":"2024-09-21T01:14:16.922486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925963+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:14:16.925963+0000","last_peered":"2024-09-21T01:14:16.925963+0000","last_clean":"2024-09-21T01:14:16.925963+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:14:16.925963+0000","last_undegraded":"2024-09-21T01:14:16.925963+0000","last_fullsized":"2024-09-21T01:14:16.925963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552669+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:13:51.552669+0000","last_peered":"2024-09-21T01:13:51.552669+0000","last_clean":"2024-09-21T01:13:51.552669+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:13:51.552669+0000","last_undegraded":"2024-09-21T01:13:51.552669+0000","last_fullsized":"2024-09-21T01:13:51.552669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566061+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:13:51.566061+0000","last_peered":"2024-09-21T01:13:51.566061+0000","last_clean":"2024-09-21T01:13:51.566061+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:13:51.566061+0000","last_undegraded":"2024-09-21T01:13:51.566061+0000","last_fullsized":"2024-09-21T01:13:51.566061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568371+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:13:51.568371+0000","last_peered":"2024-09-21T01:13:51.568371+0000","last_clean":"2024-09-21T01:13:51.568371+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:13:51.568371+0000","last_undegraded":"2024-09-21T01:13:51.568371+0000","last_fullsized":"2024-09-21T01:13:51.568371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551721+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:13:51.551721+0000","last_peered":"2024-09-21T01:13:51.551721+0000","last_clean":"2024-09-21T01:13:51.551721+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:13:51.551721+0000","last_undegraded":"2024-09-21T01:13:51.551721+0000","last_fullsized":"2024-09-21T01:13:51.551721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571084+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:13:51.571084+0000","last_peered":"2024-09-21T01:13:51.571084+0000","last_clean":"2024-09-21T01:13:51.571084+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:13:51.571084+0000","last_undegraded":"2024-09-21T01:13:51.571084+0000","last_fullsized":"2024-09-21T01:13:51.571084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926361+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:14:16.926361+0000","last_peered":"2024-09-21T01:14:16.926361+0000","last_clean":"2024-09-21T01:14:16.926361+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:14:16.926361+0000","last_undegraded":"2024-09-21T01:14:16.926361+0000","last_fullsized":"2024-09-21T01:14:16.926361+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566273+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:13:51.566273+0000","last_peered":"2024-09-21T01:13:51.566273+0000","last_clean":"2024-09-21T01:13:51.566273+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:13:51.566273+0000","last_undegraded":"2024-09-21T01:13:51.566273+0000","last_fullsized":"2024-09-21T01:13:51.566273+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552725+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:13:51.552725+0000","last_peered":"2024-09-21T01:13:51.552725+0000","last_clean":"2024-09-21T01:13:51.552725+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:13:51.552725+0000","last_undegraded":"2024-09-21T01:13:51.552725+0000","last_fullsized":"2024-09-21T01:13:51.552725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568126+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:13:51.568126+0000","last_peered":"2024-09-21T01:13:51.568126+0000","last_clean":"2024-09-21T01:13:51.568126+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:13:51.568126+0000","last_undegraded":"2024-09-21T01:13:51.568126+0000","last_fullsized":"2024-09-21T01:13:51.568126+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569625+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:13:51.569625+0000","last_peered":"2024-09-21T01:13:51.569625+0000","last_clean":"2024-09-21T01:13:51.569625+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:13:51.569625+0000","last_undegraded":"2024-09-21T01:13:51.569625+0000","last_fullsized":"2024-09-21T01:13:51.569625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552100+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:13:51.552100+0000","last_peered":"2024-09-21T01:13:51.552100+0000","last_clean":"2024-09-21T01:13:51.552100+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:13:51.552100+0000","last_undegraded":"2024-09-21T01:13:51.552100+0000","last_fullsized":"2024-09-21T01:13:51.552100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571046+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:13:51.571046+0000","last_peered":"2024-09-21T01:13:51.571046+0000","last_clean":"2024-09-21T01:13:51.571046+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:13:51.571046+0000","last_undegraded":"2024-09-21T01:13:51.571046+0000","last_fullsized":"2024-09-21T01:13:51.571046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923237+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:14:16.923237+0000","last_peered":"2024-09-21T01:14:16.923237+0000","last_clean":"2024-09-21T01:14:16.923237+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:14:16.923237+0000","last_undegraded":"2024-09-21T01:14:16.923237+0000","last_fullsized":"2024-09-21T01:14:16.923237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566157+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:13:51.566157+0000","last_peered":"2024-09-21T01:13:51.566157+0000","last_clean":"2024-09-21T01:13:51.566157+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:13:51.566157+0000","last_undegraded":"2024-09-21T01:13:51.566157+0000","last_fullsized":"2024-09-21T01:13:51.566157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569141+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:13:51.569141+0000","last_peered":"2024-09-21T01:13:51.569141+0000","last_clean":"2024-09-21T01:13:51.569141+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:13:51.569141+0000","last_undegraded":"2024-09-21T01:13:51.569141+0000","last_fullsized":"2024-09-21T01:13:51.569141+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552024+0000","last_change":"2024-09-21T01:13:50.556354+0000","last_active":"2024-09-21T01:13:51.552024+0000","last_peered":"2024-09-21T01:13:51.552024+0000","last_clean":"2024-09-21T01:13:51.552024+0000","last_became_active":"2024-09-21T01:13:50.555988+0000","last_became_peered":"2024-09-21T01:13:50.555988+0000","last_unstale":"2024-09-21T01:13:51.552024+0000","last_undegraded":"2024-09-21T01:13:51.552024+0000","last_fullsized":"2024-09-21T01:13:51.552024+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:32.352495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566358+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:13:51.566358+0000","last_peered":"2024-09-21T01:13:51.566358+0000","last_clean":"2024-09-21T01:13:51.566358+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:13:51.566358+0000","last_undegraded":"2024-09-21T01:13:51.566358+0000","last_fullsized":"2024-09-21T01:13:51.566358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.675143+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:14:12.675143+0000","last_peered":"2024-09-21T01:14:12.675143+0000","last_clean":"2024-09-21T01:14:12.675143+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:14:12.675143+0000","last_undegraded":"2024-09-21T01:14:12.675143+0000","last_fullsized":"2024-09-21T01:14:12.675143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552792+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:13:51.552792+0000","last_peered":"2024-09-21T01:13:51.552792+0000","last_clean":"2024-09-21T01:13:51.552792+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:13:51.552792+0000","last_undegraded":"2024-09-21T01:13:51.552792+0000","last_fullsized":"2024-09-21T01:13:51.552792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636850+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:00.636850+0000","last_peered":"2024-09-21T01:14:00.636850+0000","last_clean":"2024-09-21T01:14:00.636850+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:00.636850+0000","last_undegraded":"2024-09-21T01:14:00.636850+0000","last_fullsized":"2024-09-21T01:14:00.636850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:59.627873+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:13:59.627873+0000","last_peered":"2024-09-21T01:13:59.627873+0000","last_clean":"2024-09-21T01:13:59.627873+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:13:59.627873+0000","last_undegraded":"2024-09-21T01:13:59.627873+0000","last_fullsized":"2024-09-21T01:13:59.627873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566994+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:13:51.566994+0000","last_peered":"2024-09-21T01:13:51.566994+0000","last_clean":"2024-09-21T01:13:51.566994+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:13:51.566994+0000","last_undegraded":"2024-09-21T01:13:51.566994+0000","last_fullsized":"2024-09-21T01:13:51.566994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651509+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:01.651509+0000","last_peered":"2024-09-21T01:14:01.651509+0000","last_clean":"2024-09-21T01:14:01.651509+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:01.651509+0000","last_undegraded":"2024-09-21T01:14:01.651509+0000","last_fullsized":"2024-09-21T01:14:01.651509+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565274+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:13:51.565274+0000","last_peered":"2024-09-21T01:13:51.565274+0000","last_clean":"2024-09-21T01:13:51.565274+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:13:51.565274+0000","last_undegraded":"2024-09-21T01:13:51.565274+0000","last_fullsized":"2024-09-21T01:13:51.565274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.674393+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:14:12.674393+0000","last_peered":"2024-09-21T01:14:12.674393+0000","last_clean":"2024-09-21T01:14:12.674393+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:14:12.674393+0000","last_undegraded":"2024-09-21T01:14:12.674393+0000","last_fullsized":"2024-09-21T01:14:12.674393+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.927097+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:14:16.927097+0000","last_peered":"2024-09-21T01:14:16.927097+0000","last_clean":"2024-09-21T01:14:16.927097+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:14:16.927097+0000","last_undegraded":"2024-09-21T01:14:16.927097+0000","last_fullsized":"2024-09-21T01:14:16.927097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923773+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:16.923773+0000","last_peered":"2024-09-21T01:14:16.923773+0000","last_clean":"2024-09-21T01:14:16.923773+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:16.923773+0000","last_undegraded":"2024-09-21T01:14:16.923773+0000","last_fullsized":"2024-09-21T01:14:16.923773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.924028+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:14:16.924028+0000","last_peered":"2024-09-21T01:14:16.924028+0000","last_clean":"2024-09-21T01:14:16.924028+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:14:16.924028+0000","last_undegraded":"2024-09-21T01:14:16.924028+0000","last_fullsized":"2024-09-21T01:14:16.924028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636518+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:00.636518+0000","last_peered":"2024-09-21T01:14:00.636518+0000","last_clean":"2024-09-21T01:14:00.636518+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:00.636518+0000","last_undegraded":"2024-09-21T01:14:00.636518+0000","last_fullsized":"2024-09-21T01:14:00.636518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926417+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:14:16.926417+0000","last_peered":"2024-09-21T01:14:16.926417+0000","last_clean":"2024-09-21T01:14:16.926417+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:14:16.926417+0000","last_undegraded":"2024-09-21T01:14:16.926417+0000","last_fullsized":"2024-09-21T01:14:16.926417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'24","reported_seq":70,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.675905+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:14:12.675905+0000","last_peered":"2024-09-21T01:14:12.675905+0000","last_clean":"2024-09-21T01:14:12.675905+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:14:12.675905+0000","last_undegraded":"2024-09-21T01:14:12.675905+0000","last_fullsized":"2024-09-21T01:14:12.675905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":62,"num_write":26,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566409+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:13:51.566409+0000","last_peered":"2024-09-21T01:13:51.566409+0000","last_clean":"2024-09-21T01:13:51.566409+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:13:51.566409+0000","last_undegraded":"2024-09-21T01:13:51.566409+0000","last_fullsized":"2024-09-21T01:13:51.566409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.655590+0000","last_change":"2024-09-21T01:13:48.548344+0000","last_active":"2024-09-21T01:14:02.655590+0000","last_peered":"2024-09-21T01:14:02.655590+0000","last_clean":"2024-09-21T01:14:02.655590+0000","last_became_active":"2024-09-21T01:13:48.547934+0000","last_became_peered":"2024-09-21T01:13:48.547934+0000","last_unstale":"2024-09-21T01:14:02.655590+0000","last_undegraded":"2024-09-21T01:14:02.655590+0000","last_fullsized":"2024-09-21T01:14:02.655590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:38.318036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566253+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:13:51.566253+0000","last_peered":"2024-09-21T01:13:51.566253+0000","last_clean":"2024-09-21T01:13:51.566253+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:13:51.566253+0000","last_undegraded":"2024-09-21T01:13:51.566253+0000","last_fullsized":"2024-09-21T01:13:51.566253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650922+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:01.650922+0000","last_peered":"2024-09-21T01:14:01.650922+0000","last_clean":"2024-09-21T01:14:01.650922+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:01.650922+0000","last_undegraded":"2024-09-21T01:14:01.650922+0000","last_fullsized":"2024-09-21T01:14:01.650922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923451+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:14:16.923451+0000","last_peered":"2024-09-21T01:14:16.923451+0000","last_clean":"2024-09-21T01:14:16.923451+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:14:16.923451+0000","last_undegraded":"2024-09-21T01:14:16.923451+0000","last_fullsized":"2024-09-21T01:14:16.923451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:13.675608+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:14:13.675608+0000","last_peered":"2024-09-21T01:14:13.675608+0000","last_clean":"2024-09-21T01:14:13.675608+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:14:13.675608+0000","last_undegraded":"2024-09-21T01:14:13.675608+0000","last_fullsized":"2024-09-21T01:14:13.675608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923200+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:14:16.923200+0000","last_peered":"2024-09-21T01:14:16.923200+0000","last_clean":"2024-09-21T01:14:16.923200+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:14:16.923200+0000","last_undegraded":"2024-09-21T01:14:16.923200+0000","last_fullsized":"2024-09-21T01:14:16.923200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650881+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:01.650881+0000","last_peered":"2024-09-21T01:14:01.650881+0000","last_clean":"2024-09-21T01:14:01.650881+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:01.650881+0000","last_undegraded":"2024-09-21T01:14:01.650881+0000","last_fullsized":"2024-09-21T01:14:01.650881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552140+0000","last_change":"2024-09-21T01:13:50.554075+0000","last_active":"2024-09-21T01:13:51.552140+0000","last_peered":"2024-09-21T01:13:51.552140+0000","last_clean":"2024-09-21T01:13:51.552140+0000","last_became_active":"2024-09-21T01:13:50.553593+0000","last_became_peered":"2024-09-21T01:13:50.553593+0000","last_unstale":"2024-09-21T01:13:51.552140+0000","last_undegraded":"2024-09-21T01:13:51.552140+0000","last_fullsized":"2024-09-21T01:13:51.552140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:38.947673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.624678+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:01.624678+0000","last_peered":"2024-09-21T01:14:01.624678+0000","last_clean":"2024-09-21T01:14:01.624678+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:01.624678+0000","last_undegraded":"2024-09-21T01:14:01.624678+0000","last_fullsized":"2024-09-21T01:14:01.624678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551820+0000","last_change":"2024-09-21T01:13:50.551199+0000","last_active":"2024-09-21T01:13:51.551820+0000","last_peered":"2024-09-21T01:13:51.551820+0000","last_clean":"2024-09-21T01:13:51.551820+0000","last_became_active":"2024-09-21T01:13:50.550826+0000","last_became_peered":"2024-09-21T01:13:50.550826+0000","last_unstale":"2024-09-21T01:13:51.551820+0000","last_undegraded":"2024-09-21T01:13:51.551820+0000","last_fullsized":"2024-09-21T01:13:51.551820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:35.203713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.649077+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:01.649077+0000","last_peered":"2024-09-21T01:14:01.649077+0000","last_clean":"2024-09-21T01:14:01.649077+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:01.649077+0000","last_undegraded":"2024-09-21T01:14:01.649077+0000","last_fullsized":"2024-09-21T01:14:01.649077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923804+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:14:16.923804+0000","last_peered":"2024-09-21T01:14:16.923804+0000","last_clean":"2024-09-21T01:14:16.923804+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:14:16.923804+0000","last_undegraded":"2024-09-21T01:14:16.923804+0000","last_fullsized":"2024-09-21T01:14:16.923804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650462+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:01.650462+0000","last_peered":"2024-09-21T01:14:01.650462+0000","last_clean":"2024-09-21T01:14:01.650462+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:01.650462+0000","last_undegraded":"2024-09-21T01:14:01.650462+0000","last_fullsized":"2024-09-21T01:14:01.650462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923419+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:14:16.923419+0000","last_peered":"2024-09-21T01:14:16.923419+0000","last_clean":"2024-09-21T01:14:16.923419+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:14:16.923419+0000","last_undegraded":"2024-09-21T01:14:16.923419+0000","last_fullsized":"2024-09-21T01:14:16.923419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:11.674432+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:14:11.674432+0000","last_peered":"2024-09-21T01:14:11.674432+0000","last_clean":"2024-09-21T01:14:11.674432+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:14:11.674432+0000","last_undegraded":"2024-09-21T01:14:11.674432+0000","last_fullsized":"2024-09-21T01:14:11.674432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923675+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:14:16.923675+0000","last_peered":"2024-09-21T01:14:16.923675+0000","last_clean":"2024-09-21T01:14:16.923675+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:14:16.923675+0000","last_undegraded":"2024-09-21T01:14:16.923675+0000","last_fullsized":"2024-09-21T01:14:16.923675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.924396+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:16.924396+0000","last_peered":"2024-09-21T01:14:16.924396+0000","last_clean":"2024-09-21T01:14:16.924396+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:16.924396+0000","last_undegraded":"2024-09-21T01:14:16.924396+0000","last_fullsized":"2024-09-21T01:14:16.924396+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.655552+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:02.655552+0000","last_peered":"2024-09-21T01:14:02.655552+0000","last_clean":"2024-09-21T01:14:02.655552+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:02.655552+0000","last_undegraded":"2024-09-21T01:14:02.655552+0000","last_fullsized":"2024-09-21T01:14:02.655552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567895+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:13:51.567895+0000","last_peered":"2024-09-21T01:13:51.567895+0000","last_clean":"2024-09-21T01:13:51.567895+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:13:51.567895+0000","last_undegraded":"2024-09-21T01:13:51.567895+0000","last_fullsized":"2024-09-21T01:13:51.567895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T01:14:01.650368+0000","last_change":"2024-09-21T01:14:16.923950+0000","last_active":"2024-09-21T01:14:16.923950+0000","last_peered":"2024-09-21T01:14:01.650368+0000","last_clean":"2024-09-21T01:14:01.650368+0000","last_became_active":"2024-09-21T01:13:48.545430+0000","last_became_peered":"2024-09-21T01:13:48.545430+0000","last_unstale":"2024-09-21T01:14:01.650368+0000","last_undegraded":"2024-09-21T01:14:01.650368+0000","last_fullsized":"2024-09-21T01:14:01.650368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5,8],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565998+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:13:51.565998+0000","last_peered":"2024-09-21T01:13:51.565998+0000","last_clean":"2024-09-21T01:13:51.565998+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:13:51.565998+0000","last_undegraded":"2024-09-21T01:13:51.565998+0000","last_fullsized":"2024-09-21T01:13:51.565998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:14.676430+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:14:14.676430+0000","last_peered":"2024-09-21T01:14:14.676430+0000","last_clean":"2024-09-21T01:14:14.676430+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:14:14.676430+0000","last_undegraded":"2024-09-21T01:14:14.676430+0000","last_fullsized":"2024-09-21T01:14:14.676430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552908+0000","last_change":"2024-09-21T01:13:50.552475+0000","last_active":"2024-09-21T01:13:51.552908+0000","last_peered":"2024-09-21T01:13:51.552908+0000","last_clean":"2024-09-21T01:13:51.552908+0000","last_became_active":"2024-09-21T01:13:50.552007+0000","last_became_peered":"2024-09-21T01:13:50.552007+0000","last_unstale":"2024-09-21T01:13:51.552908+0000","last_undegraded":"2024-09-21T01:13:51.552908+0000","last_fullsized":"2024-09-21T01:13:51.552908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:44.409847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923690+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:14:16.923690+0000","last_peered":"2024-09-21T01:14:16.923690+0000","last_clean":"2024-09-21T01:14:16.923690+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:14:16.923690+0000","last_undegraded":"2024-09-21T01:14:16.923690+0000","last_fullsized":"2024-09-21T01:14:16.923690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565304+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:13:51.565304+0000","last_peered":"2024-09-21T01:13:51.565304+0000","last_clean":"2024-09-21T01:13:51.565304+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:13:51.565304+0000","last_undegraded":"2024-09-21T01:13:51.565304+0000","last_fullsized":"2024-09-21T01:13:51.565304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565507+0000","last_change":"2024-09-21T01:13:48.759671+0000","last_active":"2024-09-21T01:13:51.565507+0000","last_peered":"2024-09-21T01:13:51.565507+0000","last_clean":"2024-09-21T01:13:51.565507+0000","last_became_active":"2024-09-21T01:13:48.759256+0000","last_became_peered":"2024-09-21T01:13:48.759256+0000","last_unstale":"2024-09-21T01:13:51.565507+0000","last_undegraded":"2024-09-21T01:13:51.565507+0000","last_fullsized":"2024-09-21T01:13:51.565507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:25.764178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:53.051935+0000","last_change":"2024-09-21T01:13:50.552124+0000","last_active":"2024-09-21T01:13:53.051935+0000","last_peered":"2024-09-21T01:13:53.051935+0000","last_clean":"2024-09-21T01:13:53.051935+0000","last_became_active":"2024-09-21T01:13:50.551188+0000","last_became_peered":"2024-09-21T01:13:50.551188+0000","last_unstale":"2024-09-21T01:13:53.051935+0000","last_undegraded":"2024-09-21T01:13:53.051935+0000","last_fullsized":"2024-09-21T01:13:53.051935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:25.701944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650579+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:01.650579+0000","last_peered":"2024-09-21T01:14:01.650579+0000","last_clean":"2024-09-21T01:14:01.650579+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:01.650579+0000","last_undegraded":"2024-09-21T01:14:01.650579+0000","last_fullsized":"2024-09-21T01:14:01.650579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571311+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:13:51.571311+0000","last_peered":"2024-09-21T01:13:51.571311+0000","last_clean":"2024-09-21T01:13:51.571311+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:13:51.571311+0000","last_undegraded":"2024-09-21T01:13:51.571311+0000","last_fullsized":"2024-09-21T01:13:51.571311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'11","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:10.565926+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:10.565926+0000","last_peered":"2024-09-21T01:14:10.565926+0000","last_clean":"2024-09-21T01:14:10.565926+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:10.565926+0000","last_undegraded":"2024-09-21T01:14:10.565926+0000","last_fullsized":"2024-09-21T01:14:10.565926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.568224+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:13:51.568224+0000","last_peered":"2024-09-21T01:13:51.568224+0000","last_clean":"2024-09-21T01:13:51.568224+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:13:51.568224+0000","last_undegraded":"2024-09-21T01:13:51.568224+0000","last_fullsized":"2024-09-21T01:13:51.568224+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651492+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:01.651492+0000","last_peered":"2024-09-21T01:14:01.651492+0000","last_clean":"2024-09-21T01:14:01.651492+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:01.651492+0000","last_undegraded":"2024-09-21T01:14:01.651492+0000","last_fullsized":"2024-09-21T01:14:01.651492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T01:13:52.066612+0000","last_change":"2024-09-21T01:14:16.924650+0000","last_active":"2024-09-21T01:14:16.924650+0000","last_peered":"2024-09-21T01:13:52.066612+0000","last_clean":"2024-09-21T01:13:52.066612+0000","last_became_active":"2024-09-21T01:13:50.564249+0000","last_became_peered":"2024-09-21T01:13:50.564249+0000","last_unstale":"2024-09-21T01:13:52.066612+0000","last_undegraded":"2024-09-21T01:13:52.066612+0000","last_fullsized":"2024-09-21T01:13:52.066612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926132+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:16.926132+0000","last_peered":"2024-09-21T01:14:16.926132+0000","last_clean":"2024-09-21T01:14:16.926132+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:16.926132+0000","last_undegraded":"2024-09-21T01:14:16.926132+0000","last_fullsized":"2024-09-21T01:14:16.926132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.569373+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:13:51.569373+0000","last_peered":"2024-09-21T01:13:51.569373+0000","last_clean":"2024-09-21T01:13:51.569373+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:13:51.569373+0000","last_undegraded":"2024-09-21T01:13:51.569373+0000","last_fullsized":"2024-09-21T01:13:51.569373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650177+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:01.650177+0000","last_peered":"2024-09-21T01:14:01.650177+0000","last_clean":"2024-09-21T01:14:01.650177+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:01.650177+0000","last_undegraded":"2024-09-21T01:14:01.650177+0000","last_fullsized":"2024-09-21T01:14:01.650177+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551529+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:13:51.551529+0000","last_peered":"2024-09-21T01:13:51.551529+0000","last_clean":"2024-09-21T01:13:51.551529+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:13:51.551529+0000","last_undegraded":"2024-09-21T01:13:51.551529+0000","last_fullsized":"2024-09-21T01:13:51.551529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636562+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:00.636562+0000","last_peered":"2024-09-21T01:14:00.636562+0000","last_clean":"2024-09-21T01:14:00.636562+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:00.636562+0000","last_undegraded":"2024-09-21T01:14:00.636562+0000","last_fullsized":"2024-09-21T01:14:00.636562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566213+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:13:51.566213+0000","last_peered":"2024-09-21T01:13:51.566213+0000","last_clean":"2024-09-21T01:13:51.566213+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:13:51.566213+0000","last_undegraded":"2024-09-21T01:13:51.566213+0000","last_fullsized":"2024-09-21T01:13:51.566213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:58.616257+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:13:58.616257+0000","last_peered":"2024-09-21T01:13:58.616257+0000","last_clean":"2024-09-21T01:13:58.616257+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:13:58.616257+0000","last_undegraded":"2024-09-21T01:13:58.616257+0000","last_fullsized":"2024-09-21T01:13:58.616257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923349+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:14:16.923349+0000","last_peered":"2024-09-21T01:14:16.923349+0000","last_clean":"2024-09-21T01:14:16.923349+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:14:16.923349+0000","last_undegraded":"2024-09-21T01:14:16.923349+0000","last_fullsized":"2024-09-21T01:14:16.923349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551897+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:13:51.551897+0000","last_peered":"2024-09-21T01:13:51.551897+0000","last_clean":"2024-09-21T01:13:51.551897+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:13:51.551897+0000","last_undegraded":"2024-09-21T01:13:51.551897+0000","last_fullsized":"2024-09-21T01:13:51.551897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651195+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:01.651195+0000","last_peered":"2024-09-21T01:14:01.651195+0000","last_clean":"2024-09-21T01:14:01.651195+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:01.651195+0000","last_undegraded":"2024-09-21T01:14:01.651195+0000","last_fullsized":"2024-09-21T01:14:01.651195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926378+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:14:16.926378+0000","last_peered":"2024-09-21T01:14:16.926378+0000","last_clean":"2024-09-21T01:14:16.926378+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:14:16.926378+0000","last_undegraded":"2024-09-21T01:14:16.926378+0000","last_fullsized":"2024-09-21T01:14:16.926378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.645596+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:02.645596+0000","last_peered":"2024-09-21T01:14:02.645596+0000","last_clean":"2024-09-21T01:14:02.645596+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:02.645596+0000","last_undegraded":"2024-09-21T01:14:02.645596+0000","last_fullsized":"2024-09-21T01:14:02.645596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923907+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:14:16.923907+0000","last_peered":"2024-09-21T01:14:16.923907+0000","last_clean":"2024-09-21T01:14:16.923907+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:14:16.923907+0000","last_undegraded":"2024-09-21T01:14:16.923907+0000","last_fullsized":"2024-09-21T01:14:16.923907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.572179+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:13:51.572179+0000","last_peered":"2024-09-21T01:13:51.572179+0000","last_clean":"2024-09-21T01:13:51.572179+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:13:51.572179+0000","last_undegraded":"2024-09-21T01:13:51.572179+0000","last_fullsized":"2024-09-21T01:13:51.572179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.567111+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:13:51.567111+0000","last_peered":"2024-09-21T01:13:51.567111+0000","last_clean":"2024-09-21T01:13:51.567111+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:13:51.567111+0000","last_undegraded":"2024-09-21T01:13:51.567111+0000","last_fullsized":"2024-09-21T01:13:51.567111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":44,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:11.671726+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:14:11.671726+0000","last_peered":"2024-09-21T01:14:11.671726+0000","last_clean":"2024-09-21T01:14:11.671726+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:14:11.671726+0000","last_undegraded":"2024-09-21T01:14:11.671726+0000","last_fullsized":"2024-09-21T01:14:11.671726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58144,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":158,"num_read_kb":141,"num_write":229,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":182075,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776146,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":383975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1025553,"data_compressed":37783,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":383514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":383892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495655,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":985111,"data_compressed":38758,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":383231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":976088,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":383092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":383056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":436086,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":442727,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":384961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":60335,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":53694,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":52676,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:14:19.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:14:19.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:18 smithi137 ceph-mon[34607]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:14:19.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:18 smithi137 ceph-mon[34607]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:19.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:18 smithi144 ceph-mon[34818]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:14:19.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:18 smithi144 ceph-mon[34818]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 -- 172.21.15.37:0/783097943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 msgr2=0x7fc478110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 --2- 172.21.15.37:0/783097943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc478110330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc470009ca0 tx=0x7fc47002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 -- 172.21.15.37:0/783097943 shutdown_connections 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 --2- 172.21.15.37:0/783097943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc478110330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 --2- 172.21.15.37:0/783097943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc478105330 0x7fc47810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 --2- 172.21.15.37:0/783097943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4781049e0 0x7fc478104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 -- 172.21.15.37:0/783097943 >> 172.21.15.37:0/783097943 conn(0x7fc478079750 msgr2=0x7fc478079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 -- 172.21.15.37:0/783097943 shutdown_connections 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.961+0000 7fc47d08e640 1 -- 172.21.15.37:0/783097943 wait complete. 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.962+0000 7fc47d08e640 1 Processor -- start 2024-09-21T01:14:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.962+0000 7fc47d08e640 1 -- start start 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47d08e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4781049e0 0x7fc47819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47d08e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc478105330 0x7fc47819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47d08e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc47819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47d08e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc478113aa0 con 0x7fc47810de40 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47d08e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc478113920 con 0x7fc478105330 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47d08e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc478113c20 con 0x7fc4781049e0 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc47819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc47819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38908/0 (socket says 172.21.15.37:38908) 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 -- 172.21.15.37:0/42030815 learned_addr learned my addr 172.21.15.37:0/42030815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47659c640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc478105330 0x7fc47819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc476d9d640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4781049e0 0x7fc47819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 -- 172.21.15.37:0/42030815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4781049e0 msgr2=0x7fc47819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4781049e0 0x7fc47819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 -- 172.21.15.37:0/42030815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc478105330 msgr2=0x7fc47819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc478105330 0x7fc47819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.963+0000 7fc47759e640 1 -- 172.21.15.37:0/42030815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4781a02c0 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.964+0000 7fc47759e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc47819fc50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc470005cc0 tx=0x7fc47002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.964+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470003bf0 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.964+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4781a0550 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.964+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc470003d90 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.964+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47002fb20 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.964+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4781a6dd0 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.965+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47806c280 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.967+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc470004580 con 0x7fc47810de40 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.967+0000 7fc45ffff640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4600b65d0 0x7fc4600b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.968+0000 7fc476d9d640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4600b65d0 0x7fc4600b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.968+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc4701088d0 con 0x7fc47810de40 2024-09-21T01:14:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.968+0000 7fc476d9d640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4600b65d0 0x7fc4600b8ae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc47806c980 tx=0x7fc46800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:19.971+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4700098b0 con 0x7fc47810de40 2024-09-21T01:14:19.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:19 smithi037 ceph-mon[31105]: pgmap v307: 97 pgs: 1 activating, 2 peering, 94 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 14 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T01:14:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.157+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc478106f40 con 0x7fc4600b65d0 2024-09-21T01:14:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.162+0000 7fc45ffff640 1 -- 172.21.15.37:0/42030815 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258849 (secure 0 0 0) 0x7fc478106f40 con 0x7fc4600b65d0 2024-09-21T01:14:20.165 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4600b65d0 msgr2=0x7fc4600b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4600b65d0 0x7fc4600b8ae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc47806c980 tx=0x7fc46800b390 comp rx=0 tx=0).stop 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 msgr2=0x7fc47819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc47819fc50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc470005cc0 tx=0x7fc47002f380 comp rx=0 tx=0).stop 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 shutdown_connections 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4600b65d0 0x7fc4600b8ae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc47810de40 0x7fc47819fc50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc478105330 0x7fc47819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 --2- 172.21.15.37:0/42030815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4781049e0 0x7fc47819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 >> 172.21.15.37:0/42030815 conn(0x7fc478079750 msgr2=0x7fc478105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 shutdown_connections 2024-09-21T01:14:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:20.165+0000 7fc47d08e640 1 -- 172.21.15.37:0/42030815 wait complete. 2024-09-21T01:14:20.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:19 smithi137 ceph-mon[34607]: pgmap v307: 97 pgs: 1 activating, 2 peering, 94 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 14 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T01:14:20.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:19 smithi144 ceph-mon[34818]: pgmap v307: 97 pgs: 1 activating, 2 peering, 94 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 14 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T01:14:20.961 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-21T01:14:18.854935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656389,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":265,"num_read_kb":233,"num_write":363,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371800,"kb_used_data":10048,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124570024,"statfs":{"total":1151940427776,"available":1151559704576,"internally_reserved":0,"allocated":10289152,"data_stored":6618497,"data_compressed":133495,"data_compressed_allocated":176128,"data_compressed_original":1851392,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34300,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":84,"num_write":21,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002087"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552352+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:13:51.552352+0000","last_peered":"2024-09-21T01:13:51.552352+0000","last_clean":"2024-09-21T01:13:51.552352+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:13:51.552352+0000","last_undegraded":"2024-09-21T01:13:51.552352+0000","last_fullsized":"2024-09-21T01:13:51.552352+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923610+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:14:16.923610+0000","last_peered":"2024-09-21T01:14:16.923610+0000","last_clean":"2024-09-21T01:14:16.923610+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:14:16.923610+0000","last_undegraded":"2024-09-21T01:14:16.923610+0000","last_fullsized":"2024-09-21T01:14:16.923610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923314+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:14:16.923314+0000","last_peered":"2024-09-21T01:14:16.923314+0000","last_clean":"2024-09-21T01:14:16.923314+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:14:16.923314+0000","last_undegraded":"2024-09-21T01:14:16.923314+0000","last_fullsized":"2024-09-21T01:14:16.923314+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565974+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:13:51.565974+0000","last_peered":"2024-09-21T01:13:51.565974+0000","last_clean":"2024-09-21T01:13:51.565974+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:13:51.565974+0000","last_undegraded":"2024-09-21T01:13:51.565974+0000","last_fullsized":"2024-09-21T01:13:51.565974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930927+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:14:17.930927+0000","last_peered":"2024-09-21T01:14:17.930927+0000","last_clean":"2024-09-21T01:14:17.930927+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:14:17.930927+0000","last_undegraded":"2024-09-21T01:14:17.930927+0000","last_fullsized":"2024-09-21T01:14:17.930927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924410+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:14:17.924410+0000","last_peered":"2024-09-21T01:14:17.924410+0000","last_clean":"2024-09-21T01:14:17.924410+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:14:17.924410+0000","last_undegraded":"2024-09-21T01:14:17.924410+0000","last_fullsized":"2024-09-21T01:14:17.924410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923157+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:14:16.923157+0000","last_peered":"2024-09-21T01:14:16.923157+0000","last_clean":"2024-09-21T01:14:16.923157+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:14:16.923157+0000","last_undegraded":"2024-09-21T01:14:16.923157+0000","last_fullsized":"2024-09-21T01:14:16.923157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926053+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:14:16.926053+0000","last_peered":"2024-09-21T01:14:16.926053+0000","last_clean":"2024-09-21T01:14:16.926053+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:14:16.926053+0000","last_undegraded":"2024-09-21T01:14:16.926053+0000","last_fullsized":"2024-09-21T01:14:16.926053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.927123+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:14:16.927123+0000","last_peered":"2024-09-21T01:14:16.927123+0000","last_clean":"2024-09-21T01:14:16.927123+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:14:16.927123+0000","last_undegraded":"2024-09-21T01:14:16.927123+0000","last_fullsized":"2024-09-21T01:14:16.927123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925110+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:14:17.925110+0000","last_peered":"2024-09-21T01:14:17.925110+0000","last_clean":"2024-09-21T01:14:17.925110+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:14:17.925110+0000","last_undegraded":"2024-09-21T01:14:17.925110+0000","last_fullsized":"2024-09-21T01:14:17.925110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923661+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:14:16.923661+0000","last_peered":"2024-09-21T01:14:16.923661+0000","last_clean":"2024-09-21T01:14:16.923661+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:14:16.923661+0000","last_undegraded":"2024-09-21T01:14:16.923661+0000","last_fullsized":"2024-09-21T01:14:16.923661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565925+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:13:51.565925+0000","last_peered":"2024-09-21T01:13:51.565925+0000","last_clean":"2024-09-21T01:13:51.565925+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:13:51.565925+0000","last_undegraded":"2024-09-21T01:13:51.565925+0000","last_fullsized":"2024-09-21T01:13:51.565925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.570978+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:13:51.570978+0000","last_peered":"2024-09-21T01:13:51.570978+0000","last_clean":"2024-09-21T01:13:51.570978+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:13:51.570978+0000","last_undegraded":"2024-09-21T01:13:51.570978+0000","last_fullsized":"2024-09-21T01:13:51.570978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.922839+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:14:16.922839+0000","last_peered":"2024-09-21T01:14:16.922839+0000","last_clean":"2024-09-21T01:14:16.922839+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:14:16.922839+0000","last_undegraded":"2024-09-21T01:14:16.922839+0000","last_fullsized":"2024-09-21T01:14:16.922839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.922486+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:14:16.922486+0000","last_peered":"2024-09-21T01:14:16.922486+0000","last_clean":"2024-09-21T01:14:16.922486+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:14:16.922486+0000","last_undegraded":"2024-09-21T01:14:16.922486+0000","last_fullsized":"2024-09-21T01:14:16.922486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925963+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:14:16.925963+0000","last_peered":"2024-09-21T01:14:16.925963+0000","last_clean":"2024-09-21T01:14:16.925963+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:14:16.925963+0000","last_undegraded":"2024-09-21T01:14:16.925963+0000","last_fullsized":"2024-09-21T01:14:16.925963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552669+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:13:51.552669+0000","last_peered":"2024-09-21T01:13:51.552669+0000","last_clean":"2024-09-21T01:13:51.552669+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:13:51.552669+0000","last_undegraded":"2024-09-21T01:13:51.552669+0000","last_fullsized":"2024-09-21T01:13:51.552669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924242+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:14:17.924242+0000","last_peered":"2024-09-21T01:14:17.924242+0000","last_clean":"2024-09-21T01:14:17.924242+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:14:17.924242+0000","last_undegraded":"2024-09-21T01:14:17.924242+0000","last_fullsized":"2024-09-21T01:14:17.924242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922116+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:14:17.922116+0000","last_peered":"2024-09-21T01:14:17.922116+0000","last_clean":"2024-09-21T01:14:17.922116+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:14:17.922116+0000","last_undegraded":"2024-09-21T01:14:17.922116+0000","last_fullsized":"2024-09-21T01:14:17.922116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551721+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:13:51.551721+0000","last_peered":"2024-09-21T01:13:51.551721+0000","last_clean":"2024-09-21T01:13:51.551721+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:13:51.551721+0000","last_undegraded":"2024-09-21T01:13:51.551721+0000","last_fullsized":"2024-09-21T01:13:51.551721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571084+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:13:51.571084+0000","last_peered":"2024-09-21T01:13:51.571084+0000","last_clean":"2024-09-21T01:13:51.571084+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:13:51.571084+0000","last_undegraded":"2024-09-21T01:13:51.571084+0000","last_fullsized":"2024-09-21T01:13:51.571084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926361+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:14:16.926361+0000","last_peered":"2024-09-21T01:14:16.926361+0000","last_clean":"2024-09-21T01:14:16.926361+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:14:16.926361+0000","last_undegraded":"2024-09-21T01:14:16.926361+0000","last_fullsized":"2024-09-21T01:14:16.926361+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925874+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:14:16.925874+0000","last_peered":"2024-09-21T01:14:16.925874+0000","last_clean":"2024-09-21T01:14:16.925874+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:14:16.925874+0000","last_undegraded":"2024-09-21T01:14:16.925874+0000","last_fullsized":"2024-09-21T01:14:16.925874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552725+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:13:51.552725+0000","last_peered":"2024-09-21T01:13:51.552725+0000","last_clean":"2024-09-21T01:13:51.552725+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:13:51.552725+0000","last_undegraded":"2024-09-21T01:13:51.552725+0000","last_fullsized":"2024-09-21T01:13:51.552725+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925512+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:14:16.925512+0000","last_peered":"2024-09-21T01:14:16.925512+0000","last_clean":"2024-09-21T01:14:16.925512+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:14:16.925512+0000","last_undegraded":"2024-09-21T01:14:16.925512+0000","last_fullsized":"2024-09-21T01:14:16.925512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922493+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:14:17.922493+0000","last_peered":"2024-09-21T01:14:17.922493+0000","last_clean":"2024-09-21T01:14:17.922493+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:14:17.922493+0000","last_undegraded":"2024-09-21T01:14:17.922493+0000","last_fullsized":"2024-09-21T01:14:17.922493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552100+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:13:51.552100+0000","last_peered":"2024-09-21T01:13:51.552100+0000","last_clean":"2024-09-21T01:13:51.552100+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:13:51.552100+0000","last_undegraded":"2024-09-21T01:13:51.552100+0000","last_fullsized":"2024-09-21T01:13:51.552100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571046+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:13:51.571046+0000","last_peered":"2024-09-21T01:13:51.571046+0000","last_clean":"2024-09-21T01:13:51.571046+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:13:51.571046+0000","last_undegraded":"2024-09-21T01:13:51.571046+0000","last_fullsized":"2024-09-21T01:13:51.571046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923237+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:14:16.923237+0000","last_peered":"2024-09-21T01:14:16.923237+0000","last_clean":"2024-09-21T01:14:16.923237+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:14:16.923237+0000","last_undegraded":"2024-09-21T01:14:16.923237+0000","last_fullsized":"2024-09-21T01:14:16.923237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922197+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:14:17.922197+0000","last_peered":"2024-09-21T01:14:17.922197+0000","last_clean":"2024-09-21T01:14:17.922197+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:14:17.922197+0000","last_undegraded":"2024-09-21T01:14:17.922197+0000","last_fullsized":"2024-09-21T01:14:17.922197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922060+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:14:17.922060+0000","last_peered":"2024-09-21T01:14:17.922060+0000","last_clean":"2024-09-21T01:14:17.922060+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:14:17.922060+0000","last_undegraded":"2024-09-21T01:14:17.922060+0000","last_fullsized":"2024-09-21T01:14:17.922060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552024+0000","last_change":"2024-09-21T01:13:50.556354+0000","last_active":"2024-09-21T01:13:51.552024+0000","last_peered":"2024-09-21T01:13:51.552024+0000","last_clean":"2024-09-21T01:13:51.552024+0000","last_became_active":"2024-09-21T01:13:50.555988+0000","last_became_peered":"2024-09-21T01:13:50.555988+0000","last_unstale":"2024-09-21T01:13:51.552024+0000","last_undegraded":"2024-09-21T01:13:51.552024+0000","last_fullsized":"2024-09-21T01:13:51.552024+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:32.352495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930735+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:14:17.930735+0000","last_peered":"2024-09-21T01:14:17.930735+0000","last_clean":"2024-09-21T01:14:17.930735+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:14:17.930735+0000","last_undegraded":"2024-09-21T01:14:17.930735+0000","last_fullsized":"2024-09-21T01:14:17.930735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:12.675143+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:14:12.675143+0000","last_peered":"2024-09-21T01:14:12.675143+0000","last_clean":"2024-09-21T01:14:12.675143+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:14:12.675143+0000","last_undegraded":"2024-09-21T01:14:12.675143+0000","last_fullsized":"2024-09-21T01:14:12.675143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552792+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:13:51.552792+0000","last_peered":"2024-09-21T01:13:51.552792+0000","last_clean":"2024-09-21T01:13:51.552792+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:13:51.552792+0000","last_undegraded":"2024-09-21T01:13:51.552792+0000","last_fullsized":"2024-09-21T01:13:51.552792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:59.627873+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:13:59.627873+0000","last_peered":"2024-09-21T01:13:59.627873+0000","last_clean":"2024-09-21T01:13:59.627873+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:13:59.627873+0000","last_undegraded":"2024-09-21T01:13:59.627873+0000","last_fullsized":"2024-09-21T01:13:59.627873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926189+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:14:16.926189+0000","last_peered":"2024-09-21T01:14:16.926189+0000","last_clean":"2024-09-21T01:14:16.926189+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:14:16.926189+0000","last_undegraded":"2024-09-21T01:14:16.926189+0000","last_fullsized":"2024-09-21T01:14:16.926189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651509+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:01.651509+0000","last_peered":"2024-09-21T01:14:01.651509+0000","last_clean":"2024-09-21T01:14:01.651509+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:01.651509+0000","last_undegraded":"2024-09-21T01:14:01.651509+0000","last_fullsized":"2024-09-21T01:14:01.651509+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924654+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:14:17.924654+0000","last_peered":"2024-09-21T01:14:17.924654+0000","last_clean":"2024-09-21T01:14:17.924654+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:14:17.924654+0000","last_undegraded":"2024-09-21T01:14:17.924654+0000","last_fullsized":"2024-09-21T01:14:17.924654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925187+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:14:17.925187+0000","last_peered":"2024-09-21T01:14:17.925187+0000","last_clean":"2024-09-21T01:14:17.925187+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:14:17.925187+0000","last_undegraded":"2024-09-21T01:14:17.925187+0000","last_fullsized":"2024-09-21T01:14:17.925187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.927097+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:14:16.927097+0000","last_peered":"2024-09-21T01:14:16.927097+0000","last_clean":"2024-09-21T01:14:16.927097+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:14:16.927097+0000","last_undegraded":"2024-09-21T01:14:16.927097+0000","last_fullsized":"2024-09-21T01:14:16.927097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923773+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:16.923773+0000","last_peered":"2024-09-21T01:14:16.923773+0000","last_clean":"2024-09-21T01:14:16.923773+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:16.923773+0000","last_undegraded":"2024-09-21T01:14:16.923773+0000","last_fullsized":"2024-09-21T01:14:16.923773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.924028+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:14:16.924028+0000","last_peered":"2024-09-21T01:14:16.924028+0000","last_clean":"2024-09-21T01:14:16.924028+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:14:16.924028+0000","last_undegraded":"2024-09-21T01:14:16.924028+0000","last_fullsized":"2024-09-21T01:14:16.924028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:00.636518+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:00.636518+0000","last_peered":"2024-09-21T01:14:00.636518+0000","last_clean":"2024-09-21T01:14:00.636518+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:00.636518+0000","last_undegraded":"2024-09-21T01:14:00.636518+0000","last_fullsized":"2024-09-21T01:14:00.636518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926417+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:14:16.926417+0000","last_peered":"2024-09-21T01:14:16.926417+0000","last_clean":"2024-09-21T01:14:16.926417+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:14:16.926417+0000","last_undegraded":"2024-09-21T01:14:16.926417+0000","last_fullsized":"2024-09-21T01:14:16.926417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'27","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925214+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:14:17.925214+0000","last_peered":"2024-09-21T01:14:17.925214+0000","last_clean":"2024-09-21T01:14:17.925214+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:14:17.925214+0000","last_undegraded":"2024-09-21T01:14:17.925214+0000","last_fullsized":"2024-09-21T01:14:17.925214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58583,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":75,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931236+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:14:17.931236+0000","last_peered":"2024-09-21T01:14:17.931236+0000","last_clean":"2024-09-21T01:14:17.931236+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:14:17.931236+0000","last_undegraded":"2024-09-21T01:14:17.931236+0000","last_fullsized":"2024-09-21T01:14:17.931236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":30,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.655590+0000","last_change":"2024-09-21T01:13:48.548344+0000","last_active":"2024-09-21T01:14:02.655590+0000","last_peered":"2024-09-21T01:14:02.655590+0000","last_clean":"2024-09-21T01:14:02.655590+0000","last_became_active":"2024-09-21T01:13:48.547934+0000","last_became_peered":"2024-09-21T01:13:48.547934+0000","last_unstale":"2024-09-21T01:14:02.655590+0000","last_undegraded":"2024-09-21T01:14:02.655590+0000","last_fullsized":"2024-09-21T01:14:02.655590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:46:38.318036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.566253+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:13:51.566253+0000","last_peered":"2024-09-21T01:13:51.566253+0000","last_clean":"2024-09-21T01:13:51.566253+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:13:51.566253+0000","last_undegraded":"2024-09-21T01:13:51.566253+0000","last_fullsized":"2024-09-21T01:13:51.566253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650922+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:01.650922+0000","last_peered":"2024-09-21T01:14:01.650922+0000","last_clean":"2024-09-21T01:14:01.650922+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:01.650922+0000","last_undegraded":"2024-09-21T01:14:01.650922+0000","last_fullsized":"2024-09-21T01:14:01.650922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923451+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:14:16.923451+0000","last_peered":"2024-09-21T01:14:16.923451+0000","last_clean":"2024-09-21T01:14:16.923451+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:14:16.923451+0000","last_undegraded":"2024-09-21T01:14:16.923451+0000","last_fullsized":"2024-09-21T01:14:16.923451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:13.675608+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:14:13.675608+0000","last_peered":"2024-09-21T01:14:13.675608+0000","last_clean":"2024-09-21T01:14:13.675608+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:14:13.675608+0000","last_undegraded":"2024-09-21T01:14:13.675608+0000","last_fullsized":"2024-09-21T01:14:13.675608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923200+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:14:16.923200+0000","last_peered":"2024-09-21T01:14:16.923200+0000","last_clean":"2024-09-21T01:14:16.923200+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:14:16.923200+0000","last_undegraded":"2024-09-21T01:14:16.923200+0000","last_fullsized":"2024-09-21T01:14:16.923200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":4,"reported_epoch":76,"state":"activating","last_fresh":"2024-09-21T01:14:17.924325+0000","last_change":"2024-09-21T01:14:17.924325+0000","last_active":"2024-09-21T01:13:49.526947+0000","last_peered":"2024-09-21T01:13:49.526947+0000","last_clean":"2024-09-21T01:13:49.526947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:14:17.924325+0000","last_undegraded":"2024-09-21T01:14:17.924325+0000","last_fullsized":"2024-09-21T01:14:17.924325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":["9","1","4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551820+0000","last_change":"2024-09-21T01:13:50.551199+0000","last_active":"2024-09-21T01:13:51.551820+0000","last_peered":"2024-09-21T01:13:51.551820+0000","last_clean":"2024-09-21T01:13:51.551820+0000","last_became_active":"2024-09-21T01:13:50.550826+0000","last_became_peered":"2024-09-21T01:13:50.550826+0000","last_unstale":"2024-09-21T01:13:51.551820+0000","last_undegraded":"2024-09-21T01:13:51.551820+0000","last_fullsized":"2024-09-21T01:13:51.551820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:35.203713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.649077+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:01.649077+0000","last_peered":"2024-09-21T01:14:01.649077+0000","last_clean":"2024-09-21T01:14:01.649077+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:01.649077+0000","last_undegraded":"2024-09-21T01:14:01.649077+0000","last_fullsized":"2024-09-21T01:14:01.649077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923804+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:14:16.923804+0000","last_peered":"2024-09-21T01:14:16.923804+0000","last_clean":"2024-09-21T01:14:16.923804+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:14:16.923804+0000","last_undegraded":"2024-09-21T01:14:16.923804+0000","last_fullsized":"2024-09-21T01:14:16.923804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.650462+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:01.650462+0000","last_peered":"2024-09-21T01:14:01.650462+0000","last_clean":"2024-09-21T01:14:01.650462+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:01.650462+0000","last_undegraded":"2024-09-21T01:14:01.650462+0000","last_fullsized":"2024-09-21T01:14:01.650462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923419+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:14:16.923419+0000","last_peered":"2024-09-21T01:14:16.923419+0000","last_clean":"2024-09-21T01:14:16.923419+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:14:16.923419+0000","last_undegraded":"2024-09-21T01:14:16.923419+0000","last_fullsized":"2024-09-21T01:14:16.923419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922670+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:14:17.922670+0000","last_peered":"2024-09-21T01:14:17.922670+0000","last_clean":"2024-09-21T01:14:17.922670+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:14:17.922670+0000","last_undegraded":"2024-09-21T01:14:17.922670+0000","last_fullsized":"2024-09-21T01:14:17.922670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923675+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:14:16.923675+0000","last_peered":"2024-09-21T01:14:16.923675+0000","last_clean":"2024-09-21T01:14:16.923675+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:14:16.923675+0000","last_undegraded":"2024-09-21T01:14:16.923675+0000","last_fullsized":"2024-09-21T01:14:16.923675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.924396+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:16.924396+0000","last_peered":"2024-09-21T01:14:16.924396+0000","last_clean":"2024-09-21T01:14:16.924396+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:16.924396+0000","last_undegraded":"2024-09-21T01:14:16.924396+0000","last_fullsized":"2024-09-21T01:14:16.924396+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:02.655552+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:02.655552+0000","last_peered":"2024-09-21T01:14:02.655552+0000","last_clean":"2024-09-21T01:14:02.655552+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:02.655552+0000","last_undegraded":"2024-09-21T01:14:02.655552+0000","last_fullsized":"2024-09-21T01:14:02.655552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926506+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:14:16.926506+0000","last_peered":"2024-09-21T01:14:16.926506+0000","last_clean":"2024-09-21T01:14:16.926506+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:14:16.926506+0000","last_undegraded":"2024-09-21T01:14:16.926506+0000","last_fullsized":"2024-09-21T01:14:16.926506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T01:14:01.650368+0000","last_change":"2024-09-21T01:14:16.923950+0000","last_active":"2024-09-21T01:14:16.923950+0000","last_peered":"2024-09-21T01:14:01.650368+0000","last_clean":"2024-09-21T01:14:01.650368+0000","last_became_active":"2024-09-21T01:13:48.545430+0000","last_became_peered":"2024-09-21T01:13:48.545430+0000","last_unstale":"2024-09-21T01:14:01.650368+0000","last_undegraded":"2024-09-21T01:14:01.650368+0000","last_fullsized":"2024-09-21T01:14:01.650368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5,8],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.565998+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:13:51.565998+0000","last_peered":"2024-09-21T01:13:51.565998+0000","last_clean":"2024-09-21T01:13:51.565998+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:13:51.565998+0000","last_undegraded":"2024-09-21T01:13:51.565998+0000","last_fullsized":"2024-09-21T01:13:51.565998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:14.676430+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:14:14.676430+0000","last_peered":"2024-09-21T01:14:14.676430+0000","last_clean":"2024-09-21T01:14:14.676430+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:14:14.676430+0000","last_undegraded":"2024-09-21T01:14:14.676430+0000","last_fullsized":"2024-09-21T01:14:14.676430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.552908+0000","last_change":"2024-09-21T01:13:50.552475+0000","last_active":"2024-09-21T01:13:51.552908+0000","last_peered":"2024-09-21T01:13:51.552908+0000","last_clean":"2024-09-21T01:13:51.552908+0000","last_became_active":"2024-09-21T01:13:50.552007+0000","last_became_peered":"2024-09-21T01:13:50.552007+0000","last_unstale":"2024-09-21T01:13:51.552908+0000","last_undegraded":"2024-09-21T01:13:51.552908+0000","last_fullsized":"2024-09-21T01:13:51.552908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:44.409847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923690+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:14:16.923690+0000","last_peered":"2024-09-21T01:14:16.923690+0000","last_clean":"2024-09-21T01:14:16.923690+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:14:16.923690+0000","last_undegraded":"2024-09-21T01:14:16.923690+0000","last_fullsized":"2024-09-21T01:14:16.923690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924719+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:14:17.924719+0000","last_peered":"2024-09-21T01:14:17.924719+0000","last_clean":"2024-09-21T01:14:17.924719+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:14:17.924719+0000","last_undegraded":"2024-09-21T01:14:17.924719+0000","last_fullsized":"2024-09-21T01:14:17.924719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928622+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.928622+0000","last_peered":"2024-09-21T01:14:17.928622+0000","last_clean":"2024-09-21T01:14:17.928622+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.928622+0000","last_undegraded":"2024-09-21T01:14:17.928622+0000","last_fullsized":"2024-09-21T01:14:17.928622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.933370+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:14:17.933370+0000","last_peered":"2024-09-21T01:14:17.933370+0000","last_clean":"2024-09-21T01:14:17.933370+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:14:17.933370+0000","last_undegraded":"2024-09-21T01:14:17.933370+0000","last_fullsized":"2024-09-21T01:14:17.933370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931407+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931407+0000","last_peered":"2024-09-21T01:14:17.931407+0000","last_clean":"2024-09-21T01:14:17.931407+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931407+0000","last_undegraded":"2024-09-21T01:14:17.931407+0000","last_fullsized":"2024-09-21T01:14:17.931407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.571311+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:13:51.571311+0000","last_peered":"2024-09-21T01:13:51.571311+0000","last_clean":"2024-09-21T01:13:51.571311+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:13:51.571311+0000","last_undegraded":"2024-09-21T01:13:51.571311+0000","last_fullsized":"2024-09-21T01:13:51.571311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924452+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:17.924452+0000","last_peered":"2024-09-21T01:14:17.924452+0000","last_clean":"2024-09-21T01:14:17.924452+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:17.924452+0000","last_undegraded":"2024-09-21T01:14:17.924452+0000","last_fullsized":"2024-09-21T01:14:17.924452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925672+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:14:16.925672+0000","last_peered":"2024-09-21T01:14:16.925672+0000","last_clean":"2024-09-21T01:14:16.925672+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:14:16.925672+0000","last_undegraded":"2024-09-21T01:14:16.925672+0000","last_fullsized":"2024-09-21T01:14:16.925672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:14:01.651492+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:01.651492+0000","last_peered":"2024-09-21T01:14:01.651492+0000","last_clean":"2024-09-21T01:14:01.651492+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:01.651492+0000","last_undegraded":"2024-09-21T01:14:01.651492+0000","last_fullsized":"2024-09-21T01:14:01.651492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T01:13:52.066612+0000","last_change":"2024-09-21T01:14:16.924650+0000","last_active":"2024-09-21T01:14:16.924650+0000","last_peered":"2024-09-21T01:13:52.066612+0000","last_clean":"2024-09-21T01:13:52.066612+0000","last_became_active":"2024-09-21T01:13:50.564249+0000","last_became_peered":"2024-09-21T01:13:50.564249+0000","last_unstale":"2024-09-21T01:13:52.066612+0000","last_undegraded":"2024-09-21T01:13:52.066612+0000","last_fullsized":"2024-09-21T01:13:52.066612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926132+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:16.926132+0000","last_peered":"2024-09-21T01:14:16.926132+0000","last_clean":"2024-09-21T01:14:16.926132+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:16.926132+0000","last_undegraded":"2024-09-21T01:14:16.926132+0000","last_fullsized":"2024-09-21T01:14:16.926132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930491+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:14:17.930491+0000","last_peered":"2024-09-21T01:14:17.930491+0000","last_clean":"2024-09-21T01:14:17.930491+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:14:17.930491+0000","last_undegraded":"2024-09-21T01:14:17.930491+0000","last_fullsized":"2024-09-21T01:14:17.930491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926002+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:16.926002+0000","last_peered":"2024-09-21T01:14:16.926002+0000","last_clean":"2024-09-21T01:14:16.926002+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:16.926002+0000","last_undegraded":"2024-09-21T01:14:16.926002+0000","last_fullsized":"2024-09-21T01:14:16.926002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551529+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:13:51.551529+0000","last_peered":"2024-09-21T01:13:51.551529+0000","last_clean":"2024-09-21T01:13:51.551529+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:13:51.551529+0000","last_undegraded":"2024-09-21T01:13:51.551529+0000","last_fullsized":"2024-09-21T01:13:51.551529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921967+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.921967+0000","last_peered":"2024-09-21T01:14:17.921967+0000","last_clean":"2024-09-21T01:14:17.921967+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.921967+0000","last_undegraded":"2024-09-21T01:14:17.921967+0000","last_fullsized":"2024-09-21T01:14:17.921967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925943+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:14:16.925943+0000","last_peered":"2024-09-21T01:14:16.925943+0000","last_clean":"2024-09-21T01:14:16.925943+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:14:16.925943+0000","last_undegraded":"2024-09-21T01:14:16.925943+0000","last_fullsized":"2024-09-21T01:14:16.925943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923349+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:14:16.923349+0000","last_peered":"2024-09-21T01:14:16.923349+0000","last_clean":"2024-09-21T01:14:16.923349+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:14:16.923349+0000","last_undegraded":"2024-09-21T01:14:16.923349+0000","last_fullsized":"2024-09-21T01:14:16.923349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T01:13:51.551897+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:13:51.551897+0000","last_peered":"2024-09-21T01:13:51.551897+0000","last_clean":"2024-09-21T01:13:51.551897+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:13:51.551897+0000","last_undegraded":"2024-09-21T01:13:51.551897+0000","last_fullsized":"2024-09-21T01:13:51.551897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926378+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:14:16.926378+0000","last_peered":"2024-09-21T01:14:16.926378+0000","last_clean":"2024-09-21T01:14:16.926378+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:14:16.926378+0000","last_undegraded":"2024-09-21T01:14:16.926378+0000","last_fullsized":"2024-09-21T01:14:16.926378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931252+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931252+0000","last_peered":"2024-09-21T01:14:17.931252+0000","last_clean":"2024-09-21T01:14:17.931252+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931252+0000","last_undegraded":"2024-09-21T01:14:17.931252+0000","last_fullsized":"2024-09-21T01:14:17.931252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.923907+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:14:16.923907+0000","last_peered":"2024-09-21T01:14:16.923907+0000","last_clean":"2024-09-21T01:14:16.923907+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:14:16.923907+0000","last_undegraded":"2024-09-21T01:14:16.923907+0000","last_fullsized":"2024-09-21T01:14:16.923907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926964+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:16.926964+0000","last_peered":"2024-09-21T01:14:16.926964+0000","last_clean":"2024-09-21T01:14:16.926964+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:16.926964+0000","last_undegraded":"2024-09-21T01:14:16.926964+0000","last_fullsized":"2024-09-21T01:14:16.926964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926772+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:14:16.926772+0000","last_peered":"2024-09-21T01:14:16.926772+0000","last_clean":"2024-09-21T01:14:16.926772+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:14:16.926772+0000","last_undegraded":"2024-09-21T01:14:16.926772+0000","last_fullsized":"2024-09-21T01:14:16.926772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924268+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:14:17.924268+0000","last_peered":"2024-09-21T01:14:17.924268+0000","last_clean":"2024-09-21T01:14:17.924268+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:14:17.924268+0000","last_undegraded":"2024-09-21T01:14:17.924268+0000","last_fullsized":"2024-09-21T01:14:17.924268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65787,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":189,"num_read_kb":169,"num_write":238,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":197293,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776146,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":383975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":1041897,"data_compressed":40660,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":839680,"data_stored":392215,"data_compressed":2877,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332130,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":835584,"data_stored":392593,"data_compressed":2877,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495655,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":985111,"data_compressed":38758,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":383231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":976088,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":383092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":391757,"data_compressed":2877,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":460850,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":442727,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":384961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":60335,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61269,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60319,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:14:20.965 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-21T01:14:20.965 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 76, 'state': 'activating', 'last_fresh': '2024-09-21T01:14:17.924325+0000', 'last_change': '2024-09-21T01:14:17.924325+0000', 'last_active': '2024-09-21T01:13:49.526947+0000', 'last_peered': '2024-09-21T01:13:49.526947+0000', 'last_clean': '2024-09-21T01:13:49.526947+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:14:17.924325+0000', 'last_undegraded': '2024-09-21T01:14:17.924325+0000', 'last_fullsized': '2024-09-21T01:14:17.924325+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 73, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:13:49.526947+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:13:49.526947+0000', 'last_clean_scrub_stamp': '2024-09-21T01:13:49.526947+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 4, 1], 'acting': [9, 4, 1], 'avail_no_missing': ['9', '1', '4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-09-21T01:14:20.965 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-21T01:14:20.965 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.0', 'version': "74'4", 'reported_seq': 24, 'reported_epoch': 74, 'state': 'peering', 'last_fresh': '2024-09-21T01:14:01.650368+0000', 'last_change': '2024-09-21T01:14:16.923950+0000', 'last_active': '2024-09-21T01:14:16.923950+0000', 'last_peered': '2024-09-21T01:14:01.650368+0000', 'last_clean': '2024-09-21T01:14:01.650368+0000', 'last_became_active': '2024-09-21T01:13:48.545430+0000', 'last_became_peered': '2024-09-21T01:13:48.545430+0000', 'last_unstale': '2024-09-21T01:14:01.650368+0000', 'last_undegraded': '2024-09-21T01:14:01.650368+0000', 'last_fullsized': '2024-09-21T01:14:01.650368+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 71, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:13:47.513974+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:13:47.513974+0000', 'last_clean_scrub_stamp': '2024-09-21T01:13:47.513974+0000', 'objects_scrubbed': 0, 'log_size': 4, 'log_dups_size': 0, 'ondisk_log_size': 4, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 3, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5, 1], 'acting': [7, 5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 5, 8], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:14:20.965 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-21T01:14:20.965 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 74, 'state': 'peering', 'last_fresh': '2024-09-21T01:13:52.066612+0000', 'last_change': '2024-09-21T01:14:16.924650+0000', 'last_active': '2024-09-21T01:14:16.924650+0000', 'last_peered': '2024-09-21T01:13:52.066612+0000', 'last_clean': '2024-09-21T01:13:52.066612+0000', 'last_became_active': '2024-09-21T01:13:50.564249+0000', 'last_became_peered': '2024-09-21T01:13:50.564249+0000', 'last_unstale': '2024-09-21T01:13:52.066612+0000', 'last_undegraded': '2024-09-21T01:13:52.066612+0000', 'last_fullsized': '2024-09-21T01:13:52.066612+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 73, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:13:49.526947+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:13:49.526947+0000', 'last_clean_scrub_stamp': '2024-09-21T01:13:49.526947+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3, 7], 'acting': [0, 3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 4, 7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T01:14:20.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph status --format=json 2024-09-21T01:14:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:21.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:20 smithi037 ceph-mon[31105]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:21.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:20 smithi137 ceph-mon[34607]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:21.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:20 smithi144 ceph-mon[34818]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:21.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.719+0000 7f1cb2afe640 1 -- 172.21.15.37:0/1136156251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac108d00 msgr2=0x7f1cac10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:21.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.719+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/1136156251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac108d00 0x7f1cac10f530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009ca0 tx=0x7f1ca402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 -- 172.21.15.37:0/1136156251 shutdown_connections 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/1136156251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac108d00 0x7f1cac10f530 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/1136156251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cac1083b0 0x7f1cac1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/1136156251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1cac102ac0 0x7f1cac102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 -- 172.21.15.37:0/1136156251 >> 172.21.15.37:0/1136156251 conn(0x7f1cac079790 msgr2=0x7f1cac079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 -- 172.21.15.37:0/1136156251 shutdown_connections 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 -- 172.21.15.37:0/1136156251 wait complete. 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 Processor -- start 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.720+0000 7f1cb2afe640 1 -- start start 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb2afe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cac102ac0 0x7f1cac19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb2afe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 0x7f1cac19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb2afe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1cac108d00 0x7f1cac19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb2afe640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac112a20 con 0x7f1cac1083b0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb2afe640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1128a0 con 0x7f1cac108d00 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb2afe640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac112ba0 con 0x7f1cac102ac0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 0x7f1cac19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 0x7f1cac19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38924/0 (socket says 172.21.15.37:38924) 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 -- 172.21.15.37:0/3890206987 learned_addr learned my addr 172.21.15.37:0/3890206987 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb089a640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cac102ac0 0x7f1cac19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cb109b640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1cac108d00 0x7f1cac19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 -- 172.21.15.37:0/3890206987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cac102ac0 msgr2=0x7f1cac19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cac102ac0 0x7f1cac19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 -- 172.21.15.37:0/3890206987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1cac108d00 msgr2=0x7f1cac19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1cac108d00 0x7f1cac19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 -- 172.21.15.37:0/3890206987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac1a6570 con 0x7f1cac1083b0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1cabfff640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 0x7f1cac19b8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800c8c0 tx=0x7f1c9800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.721+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98007bb0 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.722+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c98007d50 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.722+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac1a6860 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.722+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980187c0 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.722+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac1a6df0 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.723+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cac102ed0 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.724+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1c9800fa20 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.725+0000 7f1ca9ffb640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1c9c0b6650 0x7f1c9c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.725+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1c980e7590 con 0x7f1cac1083b0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.725+0000 7f1cb089a640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1c9c0b6650 0x7f1c9c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.725+0000 7f1cb089a640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1c9c0b6650 0x7f1c9c0b8b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1cac06c380 tx=0x7f1ca0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.729+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c98014030 con 0x7f1cac1083b0 2024-09-21T01:14:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.995+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1cac02e640 con 0x7f1cac1083b0 2024-09-21T01:14:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.995+0000 7f1ca9ffb640 1 -- 172.21.15.37:0/3890206987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3449 (secure 0 0 0) 0x7f1c980adcc0 con 0x7f1cac1083b0 2024-09-21T01:14:21.997 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:21.997 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":433,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726881178,"num_in_osds":12,"osd_in_since":1726881155,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":94},{"state_name":"peering","count":2},{"state_name":"activating","count":1}],"num_pgs":97,"num_pools":3,"num_objects":102,"data_bytes":656389,"bytes_used":380825600,"bytes_avail":1151559602176,"bytes_total":1151940427776,"inactive_pgs_ratio":0.030927835032343864,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":23,"recovering_keys_per_sec":1,"num_objects_recovered":7,"num_bytes_recovered":185,"num_keys_recovered":10,"read_bytes_sec":10109,"write_bytes_sec":5118,"read_op_per_sec":11,"write_op_per_sec":2},"fsmap":{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","id":1,"up":5,"in":5,"max":5,"by_rank":[{"filesystem_id":1,"rank":4,"name":"g","status":"up:standby-replay","gid":14808},{"filesystem_id":1,"rank":3,"name":"a","status":"up:standby-replay","gid":14820},{"filesystem_id":1,"rank":2,"name":"k","status":"up:standby-replay","gid":24554},{"filesystem_id":1,"rank":1,"name":"l","status":"up:standby-replay","gid":24562},{"filesystem_id":1,"rank":0,"name":"e","status":"up:standby-replay","gid":24575},{"filesystem_id":1,"rank":4,"name":"f","status":"up:active","gid":24604},{"filesystem_id":1,"rank":3,"name":"h","status":"up:active","gid":24605},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24610},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24631},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24635}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.37:8443/"}},"servicemap":{"epoch":20,"modified":"2024-09-21T01:14:20.855777+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T01:14:21.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1c9c0b6650 msgr2=0x7f1c9c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:21.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1c9c0b6650 0x7f1c9c0b8b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1cac06c380 tx=0x7f1ca0008040 comp rx=0 tx=0).stop 2024-09-21T01:14:21.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 msgr2=0x7f1cac19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:21.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 0x7f1cac19b8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800c8c0 tx=0x7f1c9800cd80 comp rx=0 tx=0).stop 2024-09-21T01:14:21.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 shutdown_connections 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1c9c0b6650 0x7f1c9c0b8b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1cac108d00 0x7f1cac19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cac1083b0 0x7f1cac19b8b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 --2- 172.21.15.37:0/3890206987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cac102ac0 0x7f1cac19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 >> 172.21.15.37:0/3890206987 conn(0x7f1cac079790 msgr2=0x7f1cac106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 shutdown_connections 2024-09-21T01:14:22.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:21.998+0000 7f1cb2afe640 1 -- 172.21.15.37:0/3890206987 wait complete. 2024-09-21T01:14:22.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:21 smithi037 ceph-mon[31105]: pgmap v308: 97 pgs: 1 activating, 2 peering, 94 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.0 KiB/s wr, 13 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:22.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:21 smithi137 ceph-mon[34607]: pgmap v308: 97 pgs: 1 activating, 2 peering, 94 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.0 KiB/s wr, 13 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:22.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:21 smithi144 ceph-mon[34818]: pgmap v308: 97 pgs: 1 activating, 2 peering, 94 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.0 KiB/s wr, 13 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:22.684 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-21T01:14:22.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:14:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:22 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3890206987' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T01:14:23.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:22 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3890206987' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T01:14:23.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:22 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3890206987' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T01:14:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 -- 172.21.15.37:0/2009243959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 msgr2=0x7f9d6010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 --2- 172.21.15.37:0/2009243959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d6010f530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009ca0 tx=0x7f9d5802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 -- 172.21.15.37:0/2009243959 shutdown_connections 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 --2- 172.21.15.37:0/2009243959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d6010f530 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 --2- 172.21.15.37:0/2009243959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601083b0 0x7f9d601087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 --2- 172.21.15.37:0/2009243959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d60102a70 0x7f9d60102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 -- 172.21.15.37:0/2009243959 >> 172.21.15.37:0/2009243959 conn(0x7f9d60079710 msgr2=0x7f9d60079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 -- 172.21.15.37:0/2009243959 shutdown_connections 2024-09-21T01:14:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.455+0000 7f9d65e52640 1 -- 172.21.15.37:0/2009243959 wait complete. 2024-09-21T01:14:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 Processor -- start 2024-09-21T01:14:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 -- start start 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d60102a70 0x7f9d601a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d601083b0 0x7f9d601a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d601ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60113ae0 con 0x7f9d60108d00 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60113960 con 0x7f9d601083b0 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d65e52640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60113c60 con 0x7f9d60102a70 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d601ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d601ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38950/0 (socket says 172.21.15.37:38950) 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.456+0000 7f9d5ffff640 1 -- 172.21.15.37:0/1544860825 learned_addr learned my addr 172.21.15.37:0/1544860825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5effd640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d601083b0 0x7f9d601a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5f7fe640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d60102a70 0x7f9d601a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5ffff640 1 -- 172.21.15.37:0/1544860825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d60102a70 msgr2=0x7f9d601a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:23.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5ffff640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d60102a70 0x7f9d601a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5ffff640 1 -- 172.21.15.37:0/1544860825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d601083b0 msgr2=0x7f9d601a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5ffff640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d601083b0 0x7f9d601a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5ffff640 1 -- 172.21.15.37:0/1544860825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d601acd40 con 0x7f9d60108d00 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5ffff640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d601ac800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9d58005cc0 tx=0x7f9d5802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58003bf0 con 0x7f9d60108d00 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d58003d90 con 0x7f9d60108d00 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5802fbc0 con 0x7f9d60108d00 2024-09-21T01:14:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.457+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d601acf10 con 0x7f9d60108d00 2024-09-21T01:14:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.458+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601ad360 con 0x7f9d60108d00 2024-09-21T01:14:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.459+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d60103cf0 con 0x7f9d60108d00 2024-09-21T01:14:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.460+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9d5802fd60 con 0x7f9d60108d00 2024-09-21T01:14:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.461+0000 7f9d5cff9640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d480b65a0 0x7f9d480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.461+0000 7f9d5f7fe640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d480b65a0 0x7f9d480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.461+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9d58108ac0 con 0x7f9d60108d00 2024-09-21T01:14:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.462+0000 7f9d5f7fe640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d480b65a0 0x7f9d480b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d6010f6a0 tx=0x7f9d5000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.464+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d580cf1b0 con 0x7f9d60108d00 2024-09-21T01:14:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.650+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d60106a10 con 0x7f9d480b65a0 2024-09-21T01:14:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.655+0000 7f9d5cff9640 1 -- 172.21.15.37:0/1544860825 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259000 (secure 0 0 0) 0x7f9d60106a10 con 0x7f9d480b65a0 2024-09-21T01:14:23.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d480b65a0 msgr2=0x7f9d480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d480b65a0 0x7f9d480b8ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d6010f6a0 tx=0x7f9d5000b390 comp rx=0 tx=0).stop 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 msgr2=0x7f9d601ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d601ac800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9d58005cc0 tx=0x7f9d5802f380 comp rx=0 tx=0).stop 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 shutdown_connections 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d480b65a0 0x7f9d480b8ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60108d00 0x7f9d601ac800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d601083b0 0x7f9d601a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 --2- 172.21.15.37:0/1544860825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d60102a70 0x7f9d601a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 >> 172.21.15.37:0/1544860825 conn(0x7f9d60079710 msgr2=0x7f9d60106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 shutdown_connections 2024-09-21T01:14:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:23.658+0000 7f9d65e52640 1 -- 172.21.15.37:0/1544860825 wait complete. 2024-09-21T01:14:24.026 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:23 smithi037 ceph-mon[31105]: pgmap v309: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:24.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:23 smithi137 ceph-mon[34607]: pgmap v309: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:24.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:23 smithi144 ceph-mon[34818]: pgmap v309: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:24.463 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-21T01:14:22.856112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656389,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":285,"num_read_kb":238,"num_write":363,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":295,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":371996,"kb_used_data":10216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569828,"statfs":{"total":1151940427776,"available":1151559503872,"internally_reserved":0,"allocated":10461184,"data_stored":6734444,"data_compressed":170945,"data_compressed_allocated":229376,"data_compressed_original":1957888,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7643,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":38,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":185,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002169"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924932+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:14:17.924932+0000","last_peered":"2024-09-21T01:14:17.924932+0000","last_clean":"2024-09-21T01:14:17.924932+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:14:17.924932+0000","last_undegraded":"2024-09-21T01:14:17.924932+0000","last_fullsized":"2024-09-21T01:14:17.924932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923724+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:14:17.923724+0000","last_peered":"2024-09-21T01:14:17.923724+0000","last_clean":"2024-09-21T01:14:17.923724+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:14:17.923724+0000","last_undegraded":"2024-09-21T01:14:17.923724+0000","last_fullsized":"2024-09-21T01:14:17.923724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923391+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:14:17.923391+0000","last_peered":"2024-09-21T01:14:17.923391+0000","last_clean":"2024-09-21T01:14:17.923391+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:14:17.923391+0000","last_undegraded":"2024-09-21T01:14:17.923391+0000","last_fullsized":"2024-09-21T01:14:17.923391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684972+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:14:18.684972+0000","last_peered":"2024-09-21T01:14:18.684972+0000","last_clean":"2024-09-21T01:14:18.684972+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:14:18.684972+0000","last_undegraded":"2024-09-21T01:14:18.684972+0000","last_fullsized":"2024-09-21T01:14:18.684972+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930927+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:14:17.930927+0000","last_peered":"2024-09-21T01:14:17.930927+0000","last_clean":"2024-09-21T01:14:17.930927+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:14:17.930927+0000","last_undegraded":"2024-09-21T01:14:17.930927+0000","last_fullsized":"2024-09-21T01:14:17.930927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924410+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:14:17.924410+0000","last_peered":"2024-09-21T01:14:17.924410+0000","last_clean":"2024-09-21T01:14:17.924410+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:14:17.924410+0000","last_undegraded":"2024-09-21T01:14:17.924410+0000","last_fullsized":"2024-09-21T01:14:17.924410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927191+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:14:17.927191+0000","last_peered":"2024-09-21T01:14:17.927191+0000","last_clean":"2024-09-21T01:14:17.927191+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:14:17.927191+0000","last_undegraded":"2024-09-21T01:14:17.927191+0000","last_fullsized":"2024-09-21T01:14:17.927191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926053+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:14:16.926053+0000","last_peered":"2024-09-21T01:14:16.926053+0000","last_clean":"2024-09-21T01:14:16.926053+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:14:16.926053+0000","last_undegraded":"2024-09-21T01:14:16.926053+0000","last_fullsized":"2024-09-21T01:14:16.926053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747256+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:14:18.747256+0000","last_peered":"2024-09-21T01:14:18.747256+0000","last_clean":"2024-09-21T01:14:18.747256+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:14:18.747256+0000","last_undegraded":"2024-09-21T01:14:18.747256+0000","last_fullsized":"2024-09-21T01:14:18.747256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925110+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:14:17.925110+0000","last_peered":"2024-09-21T01:14:17.925110+0000","last_clean":"2024-09-21T01:14:17.925110+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:14:17.925110+0000","last_undegraded":"2024-09-21T01:14:17.925110+0000","last_fullsized":"2024-09-21T01:14:17.925110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927539+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:14:17.927539+0000","last_peered":"2024-09-21T01:14:17.927539+0000","last_clean":"2024-09-21T01:14:17.927539+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:14:17.927539+0000","last_undegraded":"2024-09-21T01:14:17.927539+0000","last_fullsized":"2024-09-21T01:14:17.927539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685157+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:14:18.685157+0000","last_peered":"2024-09-21T01:14:18.685157+0000","last_clean":"2024-09-21T01:14:18.685157+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:14:18.685157+0000","last_undegraded":"2024-09-21T01:14:18.685157+0000","last_fullsized":"2024-09-21T01:14:18.685157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927255+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:14:17.927255+0000","last_peered":"2024-09-21T01:14:17.927255+0000","last_clean":"2024-09-21T01:14:17.927255+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:14:17.927255+0000","last_undegraded":"2024-09-21T01:14:17.927255+0000","last_fullsized":"2024-09-21T01:14:17.927255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923448+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:14:17.923448+0000","last_peered":"2024-09-21T01:14:17.923448+0000","last_clean":"2024-09-21T01:14:17.923448+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:14:17.923448+0000","last_undegraded":"2024-09-21T01:14:17.923448+0000","last_fullsized":"2024-09-21T01:14:17.923448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923365+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:14:17.923365+0000","last_peered":"2024-09-21T01:14:17.923365+0000","last_clean":"2024-09-21T01:14:17.923365+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:14:17.923365+0000","last_undegraded":"2024-09-21T01:14:17.923365+0000","last_fullsized":"2024-09-21T01:14:17.923365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746958+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:14:18.746958+0000","last_peered":"2024-09-21T01:14:18.746958+0000","last_clean":"2024-09-21T01:14:18.746958+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:14:18.746958+0000","last_undegraded":"2024-09-21T01:14:18.746958+0000","last_fullsized":"2024-09-21T01:14:18.746958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924947+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:14:17.924947+0000","last_peered":"2024-09-21T01:14:17.924947+0000","last_clean":"2024-09-21T01:14:17.924947+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:14:17.924947+0000","last_undegraded":"2024-09-21T01:14:17.924947+0000","last_fullsized":"2024-09-21T01:14:17.924947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924242+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:14:17.924242+0000","last_peered":"2024-09-21T01:14:17.924242+0000","last_clean":"2024-09-21T01:14:17.924242+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:14:17.924242+0000","last_undegraded":"2024-09-21T01:14:17.924242+0000","last_fullsized":"2024-09-21T01:14:17.924242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922116+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:14:17.922116+0000","last_peered":"2024-09-21T01:14:17.922116+0000","last_clean":"2024-09-21T01:14:17.922116+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:14:17.922116+0000","last_undegraded":"2024-09-21T01:14:17.922116+0000","last_fullsized":"2024-09-21T01:14:17.922116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924432+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:14:17.924432+0000","last_peered":"2024-09-21T01:14:17.924432+0000","last_clean":"2024-09-21T01:14:17.924432+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:14:17.924432+0000","last_undegraded":"2024-09-21T01:14:17.924432+0000","last_fullsized":"2024-09-21T01:14:17.924432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927309+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:14:17.927309+0000","last_peered":"2024-09-21T01:14:17.927309+0000","last_clean":"2024-09-21T01:14:17.927309+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:14:17.927309+0000","last_undegraded":"2024-09-21T01:14:17.927309+0000","last_fullsized":"2024-09-21T01:14:17.927309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746708+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:14:18.746708+0000","last_peered":"2024-09-21T01:14:18.746708+0000","last_clean":"2024-09-21T01:14:18.746708+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:14:18.746708+0000","last_undegraded":"2024-09-21T01:14:18.746708+0000","last_fullsized":"2024-09-21T01:14:18.746708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925874+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:14:16.925874+0000","last_peered":"2024-09-21T01:14:16.925874+0000","last_clean":"2024-09-21T01:14:16.925874+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:14:16.925874+0000","last_undegraded":"2024-09-21T01:14:16.925874+0000","last_fullsized":"2024-09-21T01:14:16.925874+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925650+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:14:17.925650+0000","last_peered":"2024-09-21T01:14:17.925650+0000","last_clean":"2024-09-21T01:14:17.925650+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:14:17.925650+0000","last_undegraded":"2024-09-21T01:14:17.925650+0000","last_fullsized":"2024-09-21T01:14:17.925650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925512+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:14:16.925512+0000","last_peered":"2024-09-21T01:14:16.925512+0000","last_clean":"2024-09-21T01:14:16.925512+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:14:16.925512+0000","last_undegraded":"2024-09-21T01:14:16.925512+0000","last_fullsized":"2024-09-21T01:14:16.925512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922493+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:14:17.922493+0000","last_peered":"2024-09-21T01:14:17.922493+0000","last_clean":"2024-09-21T01:14:17.922493+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:14:17.922493+0000","last_undegraded":"2024-09-21T01:14:17.922493+0000","last_fullsized":"2024-09-21T01:14:17.922493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925743+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:14:17.925743+0000","last_peered":"2024-09-21T01:14:17.925743+0000","last_clean":"2024-09-21T01:14:17.925743+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:14:17.925743+0000","last_undegraded":"2024-09-21T01:14:17.925743+0000","last_fullsized":"2024-09-21T01:14:17.925743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927386+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:14:17.927386+0000","last_peered":"2024-09-21T01:14:17.927386+0000","last_clean":"2024-09-21T01:14:17.927386+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:14:17.927386+0000","last_undegraded":"2024-09-21T01:14:17.927386+0000","last_fullsized":"2024-09-21T01:14:17.927386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923527+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:14:17.923527+0000","last_peered":"2024-09-21T01:14:17.923527+0000","last_clean":"2024-09-21T01:14:17.923527+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:14:17.923527+0000","last_undegraded":"2024-09-21T01:14:17.923527+0000","last_fullsized":"2024-09-21T01:14:17.923527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922197+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:14:17.922197+0000","last_peered":"2024-09-21T01:14:17.922197+0000","last_clean":"2024-09-21T01:14:17.922197+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:14:17.922197+0000","last_undegraded":"2024-09-21T01:14:17.922197+0000","last_fullsized":"2024-09-21T01:14:17.922197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922060+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:14:17.922060+0000","last_peered":"2024-09-21T01:14:17.922060+0000","last_clean":"2024-09-21T01:14:17.922060+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:14:17.922060+0000","last_undegraded":"2024-09-21T01:14:17.922060+0000","last_fullsized":"2024-09-21T01:14:17.922060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928744+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:14:17.928744+0000","last_peered":"2024-09-21T01:14:17.928744+0000","last_clean":"2024-09-21T01:14:17.928744+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:14:17.928744+0000","last_undegraded":"2024-09-21T01:14:17.928744+0000","last_fullsized":"2024-09-21T01:14:17.928744+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930735+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:14:17.930735+0000","last_peered":"2024-09-21T01:14:17.930735+0000","last_clean":"2024-09-21T01:14:17.930735+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:14:17.930735+0000","last_undegraded":"2024-09-21T01:14:17.930735+0000","last_fullsized":"2024-09-21T01:14:17.930735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":49,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926215+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:14:17.926215+0000","last_peered":"2024-09-21T01:14:17.926215+0000","last_clean":"2024-09-21T01:14:17.926215+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:14:17.926215+0000","last_undegraded":"2024-09-21T01:14:17.926215+0000","last_fullsized":"2024-09-21T01:14:17.926215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926322+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:14:17.926322+0000","last_peered":"2024-09-21T01:14:17.926322+0000","last_clean":"2024-09-21T01:14:17.926322+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:14:17.926322+0000","last_undegraded":"2024-09-21T01:14:17.926322+0000","last_fullsized":"2024-09-21T01:14:17.926322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926189+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:14:16.926189+0000","last_peered":"2024-09-21T01:14:16.926189+0000","last_clean":"2024-09-21T01:14:16.926189+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:14:16.926189+0000","last_undegraded":"2024-09-21T01:14:16.926189+0000","last_fullsized":"2024-09-21T01:14:16.926189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924654+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:14:17.924654+0000","last_peered":"2024-09-21T01:14:17.924654+0000","last_clean":"2024-09-21T01:14:17.924654+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:14:17.924654+0000","last_undegraded":"2024-09-21T01:14:17.924654+0000","last_fullsized":"2024-09-21T01:14:17.924654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":59,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925187+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:14:17.925187+0000","last_peered":"2024-09-21T01:14:17.925187+0000","last_clean":"2024-09-21T01:14:17.925187+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:14:17.925187+0000","last_undegraded":"2024-09-21T01:14:17.925187+0000","last_fullsized":"2024-09-21T01:14:17.925187+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747031+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:14:18.747031+0000","last_peered":"2024-09-21T01:14:18.747031+0000","last_clean":"2024-09-21T01:14:18.747031+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:14:18.747031+0000","last_undegraded":"2024-09-21T01:14:18.747031+0000","last_fullsized":"2024-09-21T01:14:18.747031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923822+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:14:17.923822+0000","last_peered":"2024-09-21T01:14:17.923822+0000","last_clean":"2024-09-21T01:14:17.923822+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:14:17.923822+0000","last_undegraded":"2024-09-21T01:14:17.923822+0000","last_fullsized":"2024-09-21T01:14:17.923822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746707+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:14:18.746707+0000","last_peered":"2024-09-21T01:14:18.746707+0000","last_clean":"2024-09-21T01:14:18.746707+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:14:18.746707+0000","last_undegraded":"2024-09-21T01:14:18.746707+0000","last_fullsized":"2024-09-21T01:14:18.746707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'27","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925214+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:14:17.925214+0000","last_peered":"2024-09-21T01:14:17.925214+0000","last_clean":"2024-09-21T01:14:17.925214+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:14:17.925214+0000","last_undegraded":"2024-09-21T01:14:17.925214+0000","last_fullsized":"2024-09-21T01:14:17.925214+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58583,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":75,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931236+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:14:17.931236+0000","last_peered":"2024-09-21T01:14:17.931236+0000","last_clean":"2024-09-21T01:14:17.931236+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:14:17.931236+0000","last_undegraded":"2024-09-21T01:14:17.931236+0000","last_fullsized":"2024-09-21T01:14:17.931236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927187+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:14:17.927187+0000","last_peered":"2024-09-21T01:14:17.927187+0000","last_clean":"2024-09-21T01:14:17.927187+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:14:17.927187+0000","last_undegraded":"2024-09-21T01:14:17.927187+0000","last_fullsized":"2024-09-21T01:14:17.927187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927360+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:14:17.927360+0000","last_peered":"2024-09-21T01:14:17.927360+0000","last_clean":"2024-09-21T01:14:17.927360+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:14:17.927360+0000","last_undegraded":"2024-09-21T01:14:17.927360+0000","last_fullsized":"2024-09-21T01:14:17.927360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685481+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:14:18.685481+0000","last_peered":"2024-09-21T01:14:18.685481+0000","last_clean":"2024-09-21T01:14:18.685481+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:14:18.685481+0000","last_undegraded":"2024-09-21T01:14:18.685481+0000","last_fullsized":"2024-09-21T01:14:18.685481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927236+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:14:17.927236+0000","last_peered":"2024-09-21T01:14:17.927236+0000","last_clean":"2024-09-21T01:14:17.927236+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:14:17.927236+0000","last_undegraded":"2024-09-21T01:14:17.927236+0000","last_fullsized":"2024-09-21T01:14:17.927236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":4,"reported_epoch":76,"state":"activating","last_fresh":"2024-09-21T01:14:17.924325+0000","last_change":"2024-09-21T01:14:17.924325+0000","last_active":"2024-09-21T01:13:49.526947+0000","last_peered":"2024-09-21T01:13:49.526947+0000","last_clean":"2024-09-21T01:13:49.526947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:14:17.924325+0000","last_undegraded":"2024-09-21T01:14:17.924325+0000","last_fullsized":"2024-09-21T01:14:17.924325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":["9","1","4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928998+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:14:17.928998+0000","last_peered":"2024-09-21T01:14:17.928998+0000","last_clean":"2024-09-21T01:14:17.928998+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:14:17.928998+0000","last_undegraded":"2024-09-21T01:14:17.928998+0000","last_fullsized":"2024-09-21T01:14:17.928998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928145+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:14:17.928145+0000","last_peered":"2024-09-21T01:14:17.928145+0000","last_clean":"2024-09-21T01:14:17.928145+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:14:17.928145+0000","last_undegraded":"2024-09-21T01:14:17.928145+0000","last_fullsized":"2024-09-21T01:14:17.928145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927446+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:14:17.927446+0000","last_peered":"2024-09-21T01:14:17.927446+0000","last_clean":"2024-09-21T01:14:17.927446+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:14:17.927446+0000","last_undegraded":"2024-09-21T01:14:17.927446+0000","last_fullsized":"2024-09-21T01:14:17.927446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922670+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:14:17.922670+0000","last_peered":"2024-09-21T01:14:17.922670+0000","last_clean":"2024-09-21T01:14:17.922670+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:14:17.922670+0000","last_undegraded":"2024-09-21T01:14:17.922670+0000","last_fullsized":"2024-09-21T01:14:17.922670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928119+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928119+0000","last_peered":"2024-09-21T01:14:17.928119+0000","last_clean":"2024-09-21T01:14:17.928119+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928119+0000","last_undegraded":"2024-09-21T01:14:17.928119+0000","last_fullsized":"2024-09-21T01:14:17.928119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684890+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684890+0000","last_peered":"2024-09-21T01:14:18.684890+0000","last_clean":"2024-09-21T01:14:18.684890+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684890+0000","last_undegraded":"2024-09-21T01:14:18.684890+0000","last_fullsized":"2024-09-21T01:14:18.684890+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926506+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:14:16.926506+0000","last_peered":"2024-09-21T01:14:16.926506+0000","last_clean":"2024-09-21T01:14:16.926506+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:14:16.926506+0000","last_undegraded":"2024-09-21T01:14:16.926506+0000","last_fullsized":"2024-09-21T01:14:16.926506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751427+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751427+0000","last_peered":"2024-09-21T01:14:18.751427+0000","last_clean":"2024-09-21T01:14:18.751427+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751427+0000","last_undegraded":"2024-09-21T01:14:18.751427+0000","last_fullsized":"2024-09-21T01:14:18.751427+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926780+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:14:17.926780+0000","last_peered":"2024-09-21T01:14:17.926780+0000","last_clean":"2024-09-21T01:14:17.926780+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:14:17.926780+0000","last_undegraded":"2024-09-21T01:14:17.926780+0000","last_fullsized":"2024-09-21T01:14:17.926780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:19.686140+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:14:19.686140+0000","last_peered":"2024-09-21T01:14:19.686140+0000","last_clean":"2024-09-21T01:14:19.686140+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:14:19.686140+0000","last_undegraded":"2024-09-21T01:14:19.686140+0000","last_fullsized":"2024-09-21T01:14:19.686140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.934228+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:14:17.934228+0000","last_peered":"2024-09-21T01:14:17.934228+0000","last_clean":"2024-09-21T01:14:17.934228+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:14:17.934228+0000","last_undegraded":"2024-09-21T01:14:17.934228+0000","last_fullsized":"2024-09-21T01:14:17.934228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:21.686286+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:14:21.686286+0000","last_peered":"2024-09-21T01:14:21.686286+0000","last_clean":"2024-09-21T01:14:21.686286+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:14:21.686286+0000","last_undegraded":"2024-09-21T01:14:21.686286+0000","last_fullsized":"2024-09-21T01:14:21.686286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924719+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:14:17.924719+0000","last_peered":"2024-09-21T01:14:17.924719+0000","last_clean":"2024-09-21T01:14:17.924719+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:14:17.924719+0000","last_undegraded":"2024-09-21T01:14:17.924719+0000","last_fullsized":"2024-09-21T01:14:17.924719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928622+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.928622+0000","last_peered":"2024-09-21T01:14:17.928622+0000","last_clean":"2024-09-21T01:14:17.928622+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.928622+0000","last_undegraded":"2024-09-21T01:14:17.928622+0000","last_fullsized":"2024-09-21T01:14:17.928622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.933370+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:14:17.933370+0000","last_peered":"2024-09-21T01:14:17.933370+0000","last_clean":"2024-09-21T01:14:17.933370+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:14:17.933370+0000","last_undegraded":"2024-09-21T01:14:17.933370+0000","last_fullsized":"2024-09-21T01:14:17.933370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931407+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931407+0000","last_peered":"2024-09-21T01:14:17.931407+0000","last_clean":"2024-09-21T01:14:17.931407+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931407+0000","last_undegraded":"2024-09-21T01:14:17.931407+0000","last_fullsized":"2024-09-21T01:14:17.931407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927592+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:14:17.927592+0000","last_peered":"2024-09-21T01:14:17.927592+0000","last_clean":"2024-09-21T01:14:17.927592+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:14:17.927592+0000","last_undegraded":"2024-09-21T01:14:17.927592+0000","last_fullsized":"2024-09-21T01:14:17.927592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924452+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:17.924452+0000","last_peered":"2024-09-21T01:14:17.924452+0000","last_clean":"2024-09-21T01:14:17.924452+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:17.924452+0000","last_undegraded":"2024-09-21T01:14:17.924452+0000","last_fullsized":"2024-09-21T01:14:17.924452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925672+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:14:16.925672+0000","last_peered":"2024-09-21T01:14:16.925672+0000","last_clean":"2024-09-21T01:14:16.925672+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:14:16.925672+0000","last_undegraded":"2024-09-21T01:14:16.925672+0000","last_fullsized":"2024-09-21T01:14:16.925672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930172+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:14:17.930172+0000","last_peered":"2024-09-21T01:14:17.930172+0000","last_clean":"2024-09-21T01:14:17.930172+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:14:17.930172+0000","last_undegraded":"2024-09-21T01:14:17.930172+0000","last_fullsized":"2024-09-21T01:14:17.930172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930491+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:14:17.930491+0000","last_peered":"2024-09-21T01:14:17.930491+0000","last_clean":"2024-09-21T01:14:17.930491+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:14:17.930491+0000","last_undegraded":"2024-09-21T01:14:17.930491+0000","last_fullsized":"2024-09-21T01:14:17.930491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926002+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:16.926002+0000","last_peered":"2024-09-21T01:14:16.926002+0000","last_clean":"2024-09-21T01:14:16.926002+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:16.926002+0000","last_undegraded":"2024-09-21T01:14:16.926002+0000","last_fullsized":"2024-09-21T01:14:16.926002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924751+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:14:17.924751+0000","last_peered":"2024-09-21T01:14:17.924751+0000","last_clean":"2024-09-21T01:14:17.924751+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:14:17.924751+0000","last_undegraded":"2024-09-21T01:14:17.924751+0000","last_fullsized":"2024-09-21T01:14:17.924751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921967+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.921967+0000","last_peered":"2024-09-21T01:14:17.921967+0000","last_clean":"2024-09-21T01:14:17.921967+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.921967+0000","last_undegraded":"2024-09-21T01:14:17.921967+0000","last_fullsized":"2024-09-21T01:14:17.921967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.925943+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:14:16.925943+0000","last_peered":"2024-09-21T01:14:16.925943+0000","last_clean":"2024-09-21T01:14:16.925943+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:14:16.925943+0000","last_undegraded":"2024-09-21T01:14:16.925943+0000","last_fullsized":"2024-09-21T01:14:16.925943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926772+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:14:17.926772+0000","last_peered":"2024-09-21T01:14:17.926772+0000","last_clean":"2024-09-21T01:14:17.926772+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:14:17.926772+0000","last_undegraded":"2024-09-21T01:14:17.926772+0000","last_fullsized":"2024-09-21T01:14:17.926772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746675+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:14:18.746675+0000","last_peered":"2024-09-21T01:14:18.746675+0000","last_clean":"2024-09-21T01:14:18.746675+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:14:18.746675+0000","last_undegraded":"2024-09-21T01:14:18.746675+0000","last_fullsized":"2024-09-21T01:14:18.746675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931252+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931252+0000","last_peered":"2024-09-21T01:14:17.931252+0000","last_clean":"2024-09-21T01:14:17.931252+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931252+0000","last_undegraded":"2024-09-21T01:14:17.931252+0000","last_fullsized":"2024-09-21T01:14:17.931252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923741+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:14:17.923741+0000","last_peered":"2024-09-21T01:14:17.923741+0000","last_clean":"2024-09-21T01:14:17.923741+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:14:17.923741+0000","last_undegraded":"2024-09-21T01:14:17.923741+0000","last_fullsized":"2024-09-21T01:14:17.923741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926964+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:16.926964+0000","last_peered":"2024-09-21T01:14:16.926964+0000","last_clean":"2024-09-21T01:14:16.926964+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:16.926964+0000","last_undegraded":"2024-09-21T01:14:16.926964+0000","last_fullsized":"2024-09-21T01:14:16.926964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T01:14:16.926772+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:14:16.926772+0000","last_peered":"2024-09-21T01:14:16.926772+0000","last_clean":"2024-09-21T01:14:16.926772+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:14:16.926772+0000","last_undegraded":"2024-09-21T01:14:16.926772+0000","last_fullsized":"2024-09-21T01:14:16.926772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924268+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:14:17.924268+0000","last_peered":"2024-09-21T01:14:17.924268+0000","last_clean":"2024-09-21T01:14:17.924268+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:14:17.924268+0000","last_undegraded":"2024-09-21T01:14:17.924268+0000","last_fullsized":"2024-09-21T01:14:17.924268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65787,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":209,"num_read_kb":174,"num_write":238,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":201618,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776147,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":401232,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":966656,"data_stored":1041897,"data_compressed":40660,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":839680,"data_stored":392215,"data_compressed":2877,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332130,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":835584,"data_stored":392593,"data_compressed":2877,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495656,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":993599,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659181,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":835584,"data_stored":400420,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855409,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":993277,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":391757,"data_compressed":2877,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":460850,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":464173,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":402150,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64592,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61269,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60319,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:14:25.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:24 smithi037 ceph-mon[31105]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:25.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:24 smithi137 ceph-mon[34607]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:25.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:24 smithi144 ceph-mon[34818]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:26.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:25 smithi037 ceph-mon[31105]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:25 smithi137 ceph-mon[34607]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:26.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:25 smithi144 ceph-mon[34818]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s; 23 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:27.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:14:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:28.142 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:27 smithi037 ceph-mon[31105]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/1966606712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108d20 msgr2=0x7f0e5810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/1966606712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108d20 0x7f0e5810f550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009ca0 tx=0x7f0e5002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/1966606712 shutdown_connections 2024-09-21T01:14:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/1966606712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108d20 0x7f0e5810f550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/1966606712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e581083d0 0x7f0e581087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/1966606712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e58102ae0 0x7f0e58102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/1966606712 >> 172.21.15.37:0/1966606712 conn(0x7f0e58079760 msgr2=0x7f0e58079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/1966606712 shutdown_connections 2024-09-21T01:14:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/1966606712 wait complete. 2024-09-21T01:14:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.234+0000 7f0e5e5c6640 1 Processor -- start 2024-09-21T01:14:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 -- start start 2024-09-21T01:14:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 0x7f0e5819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e581083d0 0x7f0e5819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e58108d20 0x7f0e5819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58112990 con 0x7f0e58102ae0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58112810 con 0x7f0e58108d20 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5e5c6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58112b10 con 0x7f0e581083d0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 0x7f0e5819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 0x7f0e5819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35662/0 (socket says 172.21.15.37:35662) 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 -- 172.21.15.37:0/4262452151 learned_addr learned my addr 172.21.15.37:0/4262452151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e5cb63640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e58108d20 0x7f0e5819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e577fe640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e581083d0 0x7f0e5819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 -- 172.21.15.37:0/4262452151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e581083d0 msgr2=0x7f0e5819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e581083d0 0x7f0e5819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 -- 172.21.15.37:0/4262452151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e58108d20 msgr2=0x7f0e5819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e58108d20 0x7f0e5819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.235+0000 7f0e57fff640 1 -- 172.21.15.37:0/4262452151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e581a0360 con 0x7f0e58102ae0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.236+0000 7f0e57fff640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 0x7f0e5819a3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9f0 tx=0x7f0e4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.236+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800cd80 con 0x7f0e58102ae0 2024-09-21T01:14:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.236+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e480054d0 con 0x7f0e58102ae0 2024-09-21T01:14:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.236+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e581a0650 con 0x7f0e58102ae0 2024-09-21T01:14:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.236+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48010690 con 0x7f0e58102ae0 2024-09-21T01:14:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.236+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e581a6db0 con 0x7f0e58102ae0 2024-09-21T01:14:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.237+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e58103d10 con 0x7f0e58102ae0 2024-09-21T01:14:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.239+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0e48004e50 con 0x7f0e58102ae0 2024-09-21T01:14:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.239+0000 7f0e557fa640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b65a0 0x7f0e400b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.239+0000 7f0e577fe640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b65a0 0x7f0e400b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.240+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0e480e7b00 con 0x7f0e58102ae0 2024-09-21T01:14:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.240+0000 7f0e577fe640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b65a0 0x7f0e400b8ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c005fd0 tx=0x7f0e4c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.243+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e48056710 con 0x7f0e58102ae0 2024-09-21T01:14:28.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:27 smithi137 ceph-mon[34607]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:27 smithi144 ceph-mon[34818]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 18 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T01:14:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.428+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e58063800 con 0x7f0e400b65a0 2024-09-21T01:14:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.433+0000 7f0e557fa640 1 -- 172.21.15.37:0/4262452151 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259080 (secure 0 0 0) 0x7f0e58063800 con 0x7f0e400b65a0 2024-09-21T01:14:28.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b65a0 msgr2=0x7f0e400b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b65a0 0x7f0e400b8ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c005fd0 tx=0x7f0e4c005850 comp rx=0 tx=0).stop 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 msgr2=0x7f0e5819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 0x7f0e5819a3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9f0 tx=0x7f0e4800edf0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 shutdown_connections 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b65a0 0x7f0e400b8ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e58108d20 0x7f0e5819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e581083d0 0x7f0e5819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 --2- 172.21.15.37:0/4262452151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102ae0 0x7f0e5819a3f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 >> 172.21.15.37:0/4262452151 conn(0x7f0e58079760 msgr2=0x7f0e58101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 shutdown_connections 2024-09-21T01:14:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:28.436+0000 7f0e5e5c6640 1 -- 172.21.15.37:0/4262452151 wait complete. 2024-09-21T01:14:29.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:28 smithi037 ceph-mon[31105]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:29.351 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-21T01:14:26.857524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660646,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":331,"num_read_kb":268,"num_write":364,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":290,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372052,"kb_used_data":10272,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569772,"statfs":{"total":1151940427776,"available":1151559446528,"internally_reserved":0,"allocated":10518528,"data_stored":6776910,"data_compressed":182481,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11900,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":63,"num_write":10,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":185,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.938702"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924932+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:14:17.924932+0000","last_peered":"2024-09-21T01:14:17.924932+0000","last_clean":"2024-09-21T01:14:17.924932+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:14:17.924932+0000","last_undegraded":"2024-09-21T01:14:17.924932+0000","last_fullsized":"2024-09-21T01:14:17.924932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923724+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:14:17.923724+0000","last_peered":"2024-09-21T01:14:17.923724+0000","last_clean":"2024-09-21T01:14:17.923724+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:14:17.923724+0000","last_undegraded":"2024-09-21T01:14:17.923724+0000","last_fullsized":"2024-09-21T01:14:17.923724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923391+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:14:17.923391+0000","last_peered":"2024-09-21T01:14:17.923391+0000","last_clean":"2024-09-21T01:14:17.923391+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:14:17.923391+0000","last_undegraded":"2024-09-21T01:14:17.923391+0000","last_fullsized":"2024-09-21T01:14:17.923391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684972+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:14:18.684972+0000","last_peered":"2024-09-21T01:14:18.684972+0000","last_clean":"2024-09-21T01:14:18.684972+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:14:18.684972+0000","last_undegraded":"2024-09-21T01:14:18.684972+0000","last_fullsized":"2024-09-21T01:14:18.684972+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930927+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:14:17.930927+0000","last_peered":"2024-09-21T01:14:17.930927+0000","last_clean":"2024-09-21T01:14:17.930927+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:14:17.930927+0000","last_undegraded":"2024-09-21T01:14:17.930927+0000","last_fullsized":"2024-09-21T01:14:17.930927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924410+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:14:17.924410+0000","last_peered":"2024-09-21T01:14:17.924410+0000","last_clean":"2024-09-21T01:14:17.924410+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:14:17.924410+0000","last_undegraded":"2024-09-21T01:14:17.924410+0000","last_fullsized":"2024-09-21T01:14:17.924410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927191+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:14:17.927191+0000","last_peered":"2024-09-21T01:14:17.927191+0000","last_clean":"2024-09-21T01:14:17.927191+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:14:17.927191+0000","last_undegraded":"2024-09-21T01:14:17.927191+0000","last_fullsized":"2024-09-21T01:14:17.927191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747256+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:14:18.747256+0000","last_peered":"2024-09-21T01:14:18.747256+0000","last_clean":"2024-09-21T01:14:18.747256+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:14:18.747256+0000","last_undegraded":"2024-09-21T01:14:18.747256+0000","last_fullsized":"2024-09-21T01:14:18.747256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925110+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:14:17.925110+0000","last_peered":"2024-09-21T01:14:17.925110+0000","last_clean":"2024-09-21T01:14:17.925110+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:14:17.925110+0000","last_undegraded":"2024-09-21T01:14:17.925110+0000","last_fullsized":"2024-09-21T01:14:17.925110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927539+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:14:17.927539+0000","last_peered":"2024-09-21T01:14:17.927539+0000","last_clean":"2024-09-21T01:14:17.927539+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:14:17.927539+0000","last_undegraded":"2024-09-21T01:14:17.927539+0000","last_fullsized":"2024-09-21T01:14:17.927539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685157+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:14:18.685157+0000","last_peered":"2024-09-21T01:14:18.685157+0000","last_clean":"2024-09-21T01:14:18.685157+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:14:18.685157+0000","last_undegraded":"2024-09-21T01:14:18.685157+0000","last_fullsized":"2024-09-21T01:14:18.685157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927255+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:14:17.927255+0000","last_peered":"2024-09-21T01:14:17.927255+0000","last_clean":"2024-09-21T01:14:17.927255+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:14:17.927255+0000","last_undegraded":"2024-09-21T01:14:17.927255+0000","last_fullsized":"2024-09-21T01:14:17.927255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923448+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:14:17.923448+0000","last_peered":"2024-09-21T01:14:17.923448+0000","last_clean":"2024-09-21T01:14:17.923448+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:14:17.923448+0000","last_undegraded":"2024-09-21T01:14:17.923448+0000","last_fullsized":"2024-09-21T01:14:17.923448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923365+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:14:17.923365+0000","last_peered":"2024-09-21T01:14:17.923365+0000","last_clean":"2024-09-21T01:14:17.923365+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:14:17.923365+0000","last_undegraded":"2024-09-21T01:14:17.923365+0000","last_fullsized":"2024-09-21T01:14:17.923365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746958+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:14:18.746958+0000","last_peered":"2024-09-21T01:14:18.746958+0000","last_clean":"2024-09-21T01:14:18.746958+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:14:18.746958+0000","last_undegraded":"2024-09-21T01:14:18.746958+0000","last_fullsized":"2024-09-21T01:14:18.746958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924947+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:14:17.924947+0000","last_peered":"2024-09-21T01:14:17.924947+0000","last_clean":"2024-09-21T01:14:17.924947+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:14:17.924947+0000","last_undegraded":"2024-09-21T01:14:17.924947+0000","last_fullsized":"2024-09-21T01:14:17.924947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924242+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:14:17.924242+0000","last_peered":"2024-09-21T01:14:17.924242+0000","last_clean":"2024-09-21T01:14:17.924242+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:14:17.924242+0000","last_undegraded":"2024-09-21T01:14:17.924242+0000","last_fullsized":"2024-09-21T01:14:17.924242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922116+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:14:17.922116+0000","last_peered":"2024-09-21T01:14:17.922116+0000","last_clean":"2024-09-21T01:14:17.922116+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:14:17.922116+0000","last_undegraded":"2024-09-21T01:14:17.922116+0000","last_fullsized":"2024-09-21T01:14:17.922116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924432+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:14:17.924432+0000","last_peered":"2024-09-21T01:14:17.924432+0000","last_clean":"2024-09-21T01:14:17.924432+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:14:17.924432+0000","last_undegraded":"2024-09-21T01:14:17.924432+0000","last_fullsized":"2024-09-21T01:14:17.924432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927309+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:14:17.927309+0000","last_peered":"2024-09-21T01:14:17.927309+0000","last_clean":"2024-09-21T01:14:17.927309+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:14:17.927309+0000","last_undegraded":"2024-09-21T01:14:17.927309+0000","last_fullsized":"2024-09-21T01:14:17.927309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746708+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:14:18.746708+0000","last_peered":"2024-09-21T01:14:18.746708+0000","last_clean":"2024-09-21T01:14:18.746708+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:14:18.746708+0000","last_undegraded":"2024-09-21T01:14:18.746708+0000","last_fullsized":"2024-09-21T01:14:18.746708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925650+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:14:17.925650+0000","last_peered":"2024-09-21T01:14:17.925650+0000","last_clean":"2024-09-21T01:14:17.925650+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:14:17.925650+0000","last_undegraded":"2024-09-21T01:14:17.925650+0000","last_fullsized":"2024-09-21T01:14:17.925650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921819+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:14:17.921819+0000","last_peered":"2024-09-21T01:14:17.921819+0000","last_clean":"2024-09-21T01:14:17.921819+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:14:17.921819+0000","last_undegraded":"2024-09-21T01:14:17.921819+0000","last_fullsized":"2024-09-21T01:14:17.921819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922493+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:14:17.922493+0000","last_peered":"2024-09-21T01:14:17.922493+0000","last_clean":"2024-09-21T01:14:17.922493+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:14:17.922493+0000","last_undegraded":"2024-09-21T01:14:17.922493+0000","last_fullsized":"2024-09-21T01:14:17.922493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925743+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:14:17.925743+0000","last_peered":"2024-09-21T01:14:17.925743+0000","last_clean":"2024-09-21T01:14:17.925743+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:14:17.925743+0000","last_undegraded":"2024-09-21T01:14:17.925743+0000","last_fullsized":"2024-09-21T01:14:17.925743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927386+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:14:17.927386+0000","last_peered":"2024-09-21T01:14:17.927386+0000","last_clean":"2024-09-21T01:14:17.927386+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:14:17.927386+0000","last_undegraded":"2024-09-21T01:14:17.927386+0000","last_fullsized":"2024-09-21T01:14:17.927386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923527+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:14:17.923527+0000","last_peered":"2024-09-21T01:14:17.923527+0000","last_clean":"2024-09-21T01:14:17.923527+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:14:17.923527+0000","last_undegraded":"2024-09-21T01:14:17.923527+0000","last_fullsized":"2024-09-21T01:14:17.923527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922197+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:14:17.922197+0000","last_peered":"2024-09-21T01:14:17.922197+0000","last_clean":"2024-09-21T01:14:17.922197+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:14:17.922197+0000","last_undegraded":"2024-09-21T01:14:17.922197+0000","last_fullsized":"2024-09-21T01:14:17.922197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922060+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:14:17.922060+0000","last_peered":"2024-09-21T01:14:17.922060+0000","last_clean":"2024-09-21T01:14:17.922060+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:14:17.922060+0000","last_undegraded":"2024-09-21T01:14:17.922060+0000","last_fullsized":"2024-09-21T01:14:17.922060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928744+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:14:17.928744+0000","last_peered":"2024-09-21T01:14:17.928744+0000","last_clean":"2024-09-21T01:14:17.928744+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:14:17.928744+0000","last_undegraded":"2024-09-21T01:14:17.928744+0000","last_fullsized":"2024-09-21T01:14:17.928744+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930735+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:14:17.930735+0000","last_peered":"2024-09-21T01:14:17.930735+0000","last_clean":"2024-09-21T01:14:17.930735+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:14:17.930735+0000","last_undegraded":"2024-09-21T01:14:17.930735+0000","last_fullsized":"2024-09-21T01:14:17.930735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":54,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:22.690227+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:14:22.690227+0000","last_peered":"2024-09-21T01:14:22.690227+0000","last_clean":"2024-09-21T01:14:22.690227+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:14:22.690227+0000","last_undegraded":"2024-09-21T01:14:22.690227+0000","last_fullsized":"2024-09-21T01:14:22.690227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926322+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:14:17.926322+0000","last_peered":"2024-09-21T01:14:17.926322+0000","last_clean":"2024-09-21T01:14:17.926322+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:14:17.926322+0000","last_undegraded":"2024-09-21T01:14:17.926322+0000","last_fullsized":"2024-09-21T01:14:17.926322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924654+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:14:17.924654+0000","last_peered":"2024-09-21T01:14:17.924654+0000","last_clean":"2024-09-21T01:14:17.924654+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:14:17.924654+0000","last_undegraded":"2024-09-21T01:14:17.924654+0000","last_fullsized":"2024-09-21T01:14:17.924654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":69,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:22.689350+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:14:22.689350+0000","last_peered":"2024-09-21T01:14:22.689350+0000","last_clean":"2024-09-21T01:14:22.689350+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:14:22.689350+0000","last_undegraded":"2024-09-21T01:14:22.689350+0000","last_fullsized":"2024-09-21T01:14:22.689350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747031+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:14:18.747031+0000","last_peered":"2024-09-21T01:14:18.747031+0000","last_clean":"2024-09-21T01:14:18.747031+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:14:18.747031+0000","last_undegraded":"2024-09-21T01:14:18.747031+0000","last_fullsized":"2024-09-21T01:14:18.747031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923822+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:14:17.923822+0000","last_peered":"2024-09-21T01:14:17.923822+0000","last_clean":"2024-09-21T01:14:17.923822+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:14:17.923822+0000","last_undegraded":"2024-09-21T01:14:17.923822+0000","last_fullsized":"2024-09-21T01:14:17.923822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746707+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:14:18.746707+0000","last_peered":"2024-09-21T01:14:18.746707+0000","last_clean":"2024-09-21T01:14:18.746707+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:14:18.746707+0000","last_undegraded":"2024-09-21T01:14:18.746707+0000","last_fullsized":"2024-09-21T01:14:18.746707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'28","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:22.689365+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:14:22.689365+0000","last_peered":"2024-09-21T01:14:22.689365+0000","last_clean":"2024-09-21T01:14:22.689365+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:14:22.689365+0000","last_undegraded":"2024-09-21T01:14:22.689365+0000","last_fullsized":"2024-09-21T01:14:22.689365+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62840,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":85,"num_write":30,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931236+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:14:17.931236+0000","last_peered":"2024-09-21T01:14:17.931236+0000","last_clean":"2024-09-21T01:14:17.931236+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:14:17.931236+0000","last_undegraded":"2024-09-21T01:14:17.931236+0000","last_fullsized":"2024-09-21T01:14:17.931236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927187+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:14:17.927187+0000","last_peered":"2024-09-21T01:14:17.927187+0000","last_clean":"2024-09-21T01:14:17.927187+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:14:17.927187+0000","last_undegraded":"2024-09-21T01:14:17.927187+0000","last_fullsized":"2024-09-21T01:14:17.927187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927360+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:14:17.927360+0000","last_peered":"2024-09-21T01:14:17.927360+0000","last_clean":"2024-09-21T01:14:17.927360+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:14:17.927360+0000","last_undegraded":"2024-09-21T01:14:17.927360+0000","last_fullsized":"2024-09-21T01:14:17.927360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:23.691767+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:14:23.691767+0000","last_peered":"2024-09-21T01:14:23.691767+0000","last_clean":"2024-09-21T01:14:23.691767+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:14:23.691767+0000","last_undegraded":"2024-09-21T01:14:23.691767+0000","last_fullsized":"2024-09-21T01:14:23.691767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927236+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:14:17.927236+0000","last_peered":"2024-09-21T01:14:17.927236+0000","last_clean":"2024-09-21T01:14:17.927236+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:14:17.927236+0000","last_undegraded":"2024-09-21T01:14:17.927236+0000","last_fullsized":"2024-09-21T01:14:17.927236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.748047+0000","last_change":"2024-09-21T01:14:18.747968+0000","last_active":"2024-09-21T01:14:18.748047+0000","last_peered":"2024-09-21T01:14:18.748047+0000","last_clean":"2024-09-21T01:14:18.748047+0000","last_became_active":"2024-09-21T01:14:18.747693+0000","last_became_peered":"2024-09-21T01:14:18.747693+0000","last_unstale":"2024-09-21T01:14:18.748047+0000","last_undegraded":"2024-09-21T01:14:18.748047+0000","last_fullsized":"2024-09-21T01:14:18.748047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:41.855089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928998+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:14:17.928998+0000","last_peered":"2024-09-21T01:14:17.928998+0000","last_clean":"2024-09-21T01:14:17.928998+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:14:17.928998+0000","last_undegraded":"2024-09-21T01:14:17.928998+0000","last_fullsized":"2024-09-21T01:14:17.928998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928145+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:14:17.928145+0000","last_peered":"2024-09-21T01:14:17.928145+0000","last_clean":"2024-09-21T01:14:17.928145+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:14:17.928145+0000","last_undegraded":"2024-09-21T01:14:17.928145+0000","last_fullsized":"2024-09-21T01:14:17.928145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927446+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:14:17.927446+0000","last_peered":"2024-09-21T01:14:17.927446+0000","last_clean":"2024-09-21T01:14:17.927446+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:14:17.927446+0000","last_undegraded":"2024-09-21T01:14:17.927446+0000","last_fullsized":"2024-09-21T01:14:17.927446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:21.688656+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:14:21.688656+0000","last_peered":"2024-09-21T01:14:21.688656+0000","last_clean":"2024-09-21T01:14:21.688656+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:14:21.688656+0000","last_undegraded":"2024-09-21T01:14:21.688656+0000","last_fullsized":"2024-09-21T01:14:21.688656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928119+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928119+0000","last_peered":"2024-09-21T01:14:17.928119+0000","last_clean":"2024-09-21T01:14:17.928119+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928119+0000","last_undegraded":"2024-09-21T01:14:17.928119+0000","last_fullsized":"2024-09-21T01:14:17.928119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684890+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684890+0000","last_peered":"2024-09-21T01:14:18.684890+0000","last_clean":"2024-09-21T01:14:18.684890+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684890+0000","last_undegraded":"2024-09-21T01:14:18.684890+0000","last_fullsized":"2024-09-21T01:14:18.684890+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921815+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:14:17.921815+0000","last_peered":"2024-09-21T01:14:17.921815+0000","last_clean":"2024-09-21T01:14:17.921815+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:14:17.921815+0000","last_undegraded":"2024-09-21T01:14:17.921815+0000","last_fullsized":"2024-09-21T01:14:17.921815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751427+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751427+0000","last_peered":"2024-09-21T01:14:18.751427+0000","last_clean":"2024-09-21T01:14:18.751427+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751427+0000","last_undegraded":"2024-09-21T01:14:18.751427+0000","last_fullsized":"2024-09-21T01:14:18.751427+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926780+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:14:17.926780+0000","last_peered":"2024-09-21T01:14:17.926780+0000","last_clean":"2024-09-21T01:14:17.926780+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:14:17.926780+0000","last_undegraded":"2024-09-21T01:14:17.926780+0000","last_fullsized":"2024-09-21T01:14:17.926780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":53,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:24.692655+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:14:24.692655+0000","last_peered":"2024-09-21T01:14:24.692655+0000","last_clean":"2024-09-21T01:14:24.692655+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:14:24.692655+0000","last_undegraded":"2024-09-21T01:14:24.692655+0000","last_fullsized":"2024-09-21T01:14:24.692655+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.934228+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:14:17.934228+0000","last_peered":"2024-09-21T01:14:17.934228+0000","last_clean":"2024-09-21T01:14:17.934228+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:14:17.934228+0000","last_undegraded":"2024-09-21T01:14:17.934228+0000","last_fullsized":"2024-09-21T01:14:17.934228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:21.686286+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:14:21.686286+0000","last_peered":"2024-09-21T01:14:21.686286+0000","last_clean":"2024-09-21T01:14:21.686286+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:14:21.686286+0000","last_undegraded":"2024-09-21T01:14:21.686286+0000","last_fullsized":"2024-09-21T01:14:21.686286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924719+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:14:17.924719+0000","last_peered":"2024-09-21T01:14:17.924719+0000","last_clean":"2024-09-21T01:14:17.924719+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:14:17.924719+0000","last_undegraded":"2024-09-21T01:14:17.924719+0000","last_fullsized":"2024-09-21T01:14:17.924719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928622+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.928622+0000","last_peered":"2024-09-21T01:14:17.928622+0000","last_clean":"2024-09-21T01:14:17.928622+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.928622+0000","last_undegraded":"2024-09-21T01:14:17.928622+0000","last_fullsized":"2024-09-21T01:14:17.928622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.933370+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:14:17.933370+0000","last_peered":"2024-09-21T01:14:17.933370+0000","last_clean":"2024-09-21T01:14:17.933370+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:14:17.933370+0000","last_undegraded":"2024-09-21T01:14:17.933370+0000","last_fullsized":"2024-09-21T01:14:17.933370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931407+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931407+0000","last_peered":"2024-09-21T01:14:17.931407+0000","last_clean":"2024-09-21T01:14:17.931407+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931407+0000","last_undegraded":"2024-09-21T01:14:17.931407+0000","last_fullsized":"2024-09-21T01:14:17.931407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927592+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:14:17.927592+0000","last_peered":"2024-09-21T01:14:17.927592+0000","last_clean":"2024-09-21T01:14:17.927592+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:14:17.927592+0000","last_undegraded":"2024-09-21T01:14:17.927592+0000","last_fullsized":"2024-09-21T01:14:17.927592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924452+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:17.924452+0000","last_peered":"2024-09-21T01:14:17.924452+0000","last_clean":"2024-09-21T01:14:17.924452+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:17.924452+0000","last_undegraded":"2024-09-21T01:14:17.924452+0000","last_fullsized":"2024-09-21T01:14:17.924452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921846+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:14:17.921846+0000","last_peered":"2024-09-21T01:14:17.921846+0000","last_clean":"2024-09-21T01:14:17.921846+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:14:17.921846+0000","last_undegraded":"2024-09-21T01:14:17.921846+0000","last_fullsized":"2024-09-21T01:14:17.921846+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930172+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:14:17.930172+0000","last_peered":"2024-09-21T01:14:17.930172+0000","last_clean":"2024-09-21T01:14:17.930172+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:14:17.930172+0000","last_undegraded":"2024-09-21T01:14:17.930172+0000","last_fullsized":"2024-09-21T01:14:17.930172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930491+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:14:17.930491+0000","last_peered":"2024-09-21T01:14:17.930491+0000","last_clean":"2024-09-21T01:14:17.930491+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:14:17.930491+0000","last_undegraded":"2024-09-21T01:14:17.930491+0000","last_fullsized":"2024-09-21T01:14:17.930491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921731+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:17.921731+0000","last_peered":"2024-09-21T01:14:17.921731+0000","last_clean":"2024-09-21T01:14:17.921731+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:17.921731+0000","last_undegraded":"2024-09-21T01:14:17.921731+0000","last_fullsized":"2024-09-21T01:14:17.921731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924751+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:14:17.924751+0000","last_peered":"2024-09-21T01:14:17.924751+0000","last_clean":"2024-09-21T01:14:17.924751+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:14:17.924751+0000","last_undegraded":"2024-09-21T01:14:17.924751+0000","last_fullsized":"2024-09-21T01:14:17.924751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921967+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.921967+0000","last_peered":"2024-09-21T01:14:17.921967+0000","last_clean":"2024-09-21T01:14:17.921967+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.921967+0000","last_undegraded":"2024-09-21T01:14:17.921967+0000","last_fullsized":"2024-09-21T01:14:17.921967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921784+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:14:17.921784+0000","last_peered":"2024-09-21T01:14:17.921784+0000","last_clean":"2024-09-21T01:14:17.921784+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:14:17.921784+0000","last_undegraded":"2024-09-21T01:14:17.921784+0000","last_fullsized":"2024-09-21T01:14:17.921784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926772+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:14:17.926772+0000","last_peered":"2024-09-21T01:14:17.926772+0000","last_clean":"2024-09-21T01:14:17.926772+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:14:17.926772+0000","last_undegraded":"2024-09-21T01:14:17.926772+0000","last_fullsized":"2024-09-21T01:14:17.926772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746675+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:14:18.746675+0000","last_peered":"2024-09-21T01:14:18.746675+0000","last_clean":"2024-09-21T01:14:18.746675+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:14:18.746675+0000","last_undegraded":"2024-09-21T01:14:18.746675+0000","last_fullsized":"2024-09-21T01:14:18.746675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931252+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931252+0000","last_peered":"2024-09-21T01:14:17.931252+0000","last_clean":"2024-09-21T01:14:17.931252+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931252+0000","last_undegraded":"2024-09-21T01:14:17.931252+0000","last_fullsized":"2024-09-21T01:14:17.931252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923741+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:14:17.923741+0000","last_peered":"2024-09-21T01:14:17.923741+0000","last_clean":"2024-09-21T01:14:17.923741+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:14:17.923741+0000","last_undegraded":"2024-09-21T01:14:17.923741+0000","last_fullsized":"2024-09-21T01:14:17.923741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922330+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:17.922330+0000","last_peered":"2024-09-21T01:14:17.922330+0000","last_clean":"2024-09-21T01:14:17.922330+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:17.922330+0000","last_undegraded":"2024-09-21T01:14:17.922330+0000","last_fullsized":"2024-09-21T01:14:17.922330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922207+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:14:17.922207+0000","last_peered":"2024-09-21T01:14:17.922207+0000","last_clean":"2024-09-21T01:14:17.922207+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:14:17.922207+0000","last_undegraded":"2024-09-21T01:14:17.922207+0000","last_fullsized":"2024-09-21T01:14:17.922207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":58,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:21.685704+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:14:21.685704+0000","last_peered":"2024-09-21T01:14:21.685704+0000","last_clean":"2024-09-21T01:14:21.685704+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:14:21.685704+0000","last_undegraded":"2024-09-21T01:14:21.685704+0000","last_fullsized":"2024-09-21T01:14:21.685704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70044,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":255,"num_read_kb":204,"num_write":239,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":210132,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776148,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":401232,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972376,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1054642,"data_compressed":43544,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135902,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":400820,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332131,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":401081,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495656,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":993599,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":835584,"data_stored":400420,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855410,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":993277,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018935,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":400128,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":909312,"data_stored":465107,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":464173,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":402150,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64592,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65526,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64576,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:14:29.355 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:14:29.355 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T01:14:29.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T01:14:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:28 smithi137 ceph-mon[34607]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:28 smithi144 ceph-mon[34818]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:14:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:30.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:29 smithi037 ceph-mon[31105]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s; 16 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T01:14:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 -- 172.21.15.37:0/2330262806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c06c5e0 msgr2=0x7f881c1063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2330262806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c06c5e0 0x7f881c1063e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8818009900 tx=0x7f881802a410 comp rx=0 tx=0).stop 2024-09-21T01:14:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 -- 172.21.15.37:0/2330262806 shutdown_connections 2024-09-21T01:14:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2330262806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f881c1094c0 0x7f881c10b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2330262806 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c106920 0x7f881c108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2330262806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c06c5e0 0x7f881c1063e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 -- 172.21.15.37:0/2330262806 >> 172.21.15.37:0/2330262806 conn(0x7f881c0fe020 msgr2=0x7f881c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 -- 172.21.15.37:0/2330262806 shutdown_connections 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.130+0000 7f8823d4d640 1 -- 172.21.15.37:0/2330262806 wait complete. 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 Processor -- start 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 -- start start 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c06c5e0 0x7f881c103a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f881c106920 0x7f881c1022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 0x7f881c102820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f881c10f3b0 con 0x7f881c1094c0 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f881c10f230 con 0x7f881c06c5e0 2024-09-21T01:14:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8823d4d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f881c10f530 con 0x7f881c106920 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f88222ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 0x7f881c102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f88222ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 0x7f881c102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35680/0 (socket says 172.21.15.37:35680) 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f88222ea640 1 -- 172.21.15.37:0/2179854106 learned_addr learned my addr 172.21.15.37:0/2179854106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f88212e8640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f881c106920 0x7f881c1022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.131+0000 7f8821ae9640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c06c5e0 0x7f881c103a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f88222ea640 1 -- 172.21.15.37:0/2179854106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f881c106920 msgr2=0x7f881c1022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f88222ea640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f881c106920 0x7f881c1022e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f88222ea640 1 -- 172.21.15.37:0/2179854106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c06c5e0 msgr2=0x7f881c103a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f88222ea640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c06c5e0 0x7f881c103a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f88222ea640 1 -- 172.21.15.37:0/2179854106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c102f20 con 0x7f881c1094c0 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f8821ae9640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c06c5e0 0x7f881c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f88222ea640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 0x7f881c102820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f881400eaa0 tx=0x7f881400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881400cdb0 con 0x7f881c1094c0 2024-09-21T01:14:30.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8814005020 con 0x7f881c1094c0 2024-09-21T01:14:30.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c1a4070 con 0x7f881c1094c0 2024-09-21T01:14:30.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88140116d0 con 0x7f881c1094c0 2024-09-21T01:14:30.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.132+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c1a44d0 con 0x7f881c1094c0 2024-09-21T01:14:30.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.133+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c0ffb40 con 0x7f881c1094c0 2024-09-21T01:14:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.135+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f88140051d0 con 0x7f881c1094c0 2024-09-21T01:14:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.136+0000 7f8812ffd640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88080b65a0 0x7f88080b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.136+0000 7f8821ae9640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88080b65a0 0x7f88080b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.136+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f88140e7aa0 con 0x7f881c1094c0 2024-09-21T01:14:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.136+0000 7f8821ae9640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88080b65a0 0x7f88080b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8818031440 tx=0x7f8818005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.139+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8814016030 con 0x7f881c1094c0 2024-09-21T01:14:30.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.398+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f881c02e640 con 0x7f881c1094c0 2024-09-21T01:14:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.402+0000 7f8812ffd640 1 -- 172.21.15.37:0/2179854106 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f88140ae190 con 0x7f881c1094c0 2024-09-21T01:14:30.404 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-21T01:14:30.404 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD2He5mIMXbFxAA5MEHsSvU1Qoy5beCSq92VQ== 2024-09-21T01:14:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.404+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88080b65a0 msgr2=0x7f88080b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.404+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88080b65a0 0x7f88080b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8818031440 tx=0x7f8818005d50 comp rx=0 tx=0).stop 2024-09-21T01:14:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 msgr2=0x7f881c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 0x7f881c102820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f881400eaa0 tx=0x7f881400ef60 comp rx=0 tx=0).stop 2024-09-21T01:14:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 shutdown_connections 2024-09-21T01:14:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88080b65a0 0x7f88080b8ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f881c1094c0 0x7f881c102820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f881c106920 0x7f881c1022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 --2- 172.21.15.37:0/2179854106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f881c06c5e0 0x7f881c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 >> 172.21.15.37:0/2179854106 conn(0x7f881c0fe020 msgr2=0x7f881c104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 shutdown_connections 2024-09-21T01:14:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:30.405+0000 7f8823d4d640 1 -- 172.21.15.37:0/2179854106 wait complete. 2024-09-21T01:14:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:29 smithi137 ceph-mon[34607]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s; 16 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T01:14:30.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:29 smithi144 ceph-mon[34818]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.6 KiB/s wr, 13 op/s; 16 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T01:14:30.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:30 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2179854106' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:14:30.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:30 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2179854106' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:14:31.197 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:14:31.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T01:14:31.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T01:14:31.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T01:14:31.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:30 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2179854106' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:14:31.322 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:30 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2179854106' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:14:31.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:30 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2179854106' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:14:31.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:30 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2179854106' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:14:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 -- 172.21.15.37:0/3709268360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984103bb0 msgr2=0x7fb984103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 --2- 172.21.15.37:0/3709268360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984103bb0 0x7fb984103fc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb974009900 tx=0x7fb97402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 -- 172.21.15.37:0/3709268360 shutdown_connections 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 --2- 172.21.15.37:0/3709268360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb984109e40 0x7fb984110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 --2- 172.21.15.37:0/3709268360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9841094f0 0x7fb984109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 --2- 172.21.15.37:0/3709268360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984103bb0 0x7fb984103fc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 -- 172.21.15.37:0/3709268360 >> 172.21.15.37:0/3709268360 conn(0x7fb9840ff600 msgr2=0x7fb984101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 -- 172.21.15.37:0/3709268360 shutdown_connections 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 -- 172.21.15.37:0/3709268360 wait complete. 2024-09-21T01:14:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 Processor -- start 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.020+0000 7fb98a704640 1 -- start start 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb98a704640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb984103bb0 0x7fb984075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb98a704640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9841094f0 0x7fb984075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb98a704640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 0x7fb984076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb98a704640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb984113b00 con 0x7fb984109e40 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb98a704640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb984113980 con 0x7fb984103bb0 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb98a704640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb984113c80 con 0x7fb9841094f0 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 0x7fb984076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb983fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb984103bb0 0x7fb984075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 0x7fb984076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35692/0 (socket says 172.21.15.37:35692) 2024-09-21T01:14:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 -- 172.21.15.37:0/3623165679 learned_addr learned my addr 172.21.15.37:0/3623165679 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb9837fe640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9841094f0 0x7fb984075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 -- 172.21.15.37:0/3623165679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9841094f0 msgr2=0x7fb984075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9841094f0 0x7fb984075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 -- 172.21.15.37:0/3623165679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb984103bb0 msgr2=0x7fb984075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb984103bb0 0x7fb984075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb988ca1640 1 -- 172.21.15.37:0/3623165679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9841a8700 con 0x7fb984109e40 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.021+0000 7fb9837fe640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9841094f0 0x7fb984075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.022+0000 7fb988ca1640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 0x7fb984076190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00cce0 tx=0x7fb97c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.022+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00f450 con 0x7fb984109e40 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.022+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb97c00faa0 con 0x7fb984109e40 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.022+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c018b70 con 0x7fb984109e40 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.022+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9841a89f0 con 0x7fb984109e40 2024-09-21T01:14:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.022+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9841a8ee0 con 0x7fb984109e40 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.023+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb984103fc0 con 0x7fb984109e40 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.025+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb97c018d10 con 0x7fb984109e40 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.026+0000 7fb9817fa640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb96c0b65a0 0x7fb96c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.026+0000 7fb983fff640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb96c0b65a0 0x7fb96c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.026+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb97c0e7990 con 0x7fb984109e40 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.027+0000 7fb983fff640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb96c0b65a0 0x7fb96c0b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.029+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb97c014030 con 0x7fb984109e40 2024-09-21T01:14:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.223+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fb984076a10 con 0x7fb984109e40 2024-09-21T01:14:32.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.223+0000 7fb9817fa640 1 -- 172.21.15.37:0/3623165679 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v52) ==== 86+0+133 (secure 0 0 0) 0x7fb984076a10 con 0x7fb984109e40 2024-09-21T01:14:32.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb96c0b65a0 msgr2=0x7fb96c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:32.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb96c0b65a0 0x7fb96c0b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974031400 comp rx=0 tx=0).stop 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 msgr2=0x7fb984076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 0x7fb984076190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00cce0 tx=0x7fb97c00a620 comp rx=0 tx=0).stop 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 shutdown_connections 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb96c0b65a0 0x7fb96c0b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb984109e40 0x7fb984076190 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9841094f0 0x7fb984075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 --2- 172.21.15.37:0/3623165679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb984103bb0 0x7fb984075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 >> 172.21.15.37:0/3623165679 conn(0x7fb9840ff600 msgr2=0x7fb984101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 shutdown_connections 2024-09-21T01:14:32.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:32.226+0000 7fb98a704640 1 -- 172.21.15.37:0/3623165679 wait complete. 2024-09-21T01:14:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:32 smithi037 ceph-mon[31105]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T01:14:32.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:32 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3623165679' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:14:32.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:32 smithi137 ceph-mon[34607]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T01:14:32.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:32 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3623165679' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:14:32.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:32 smithi144 ceph-mon[34818]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T01:14:32.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:32 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3623165679' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:14:33.007 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":52,"timestamp":"2024-09-21T01:13:40.679411+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T01:14:33.007 INFO:tasks.ceph_manager:config epoch is 52 2024-09-21T01:14:33.007 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T01:14:33.007 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T01:14:33.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T01:14:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 -- 172.21.15.37:0/3605935625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 msgr2=0x7f3644110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3605935625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f3644110620 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f363c009ca0 tx=0x7f363c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 -- 172.21.15.37:0/3605935625 shutdown_connections 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3605935625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f3644110620 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3605935625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36441094a0 0x7f36441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3605935625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3644103b60 0x7f3644103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 -- 172.21.15.37:0/3605935625 >> 172.21.15.37:0/3605935625 conn(0x7f364407b850 msgr2=0x7f364407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.745+0000 7f3648f1b640 1 -- 172.21.15.37:0/3605935625 shutdown_connections 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.746+0000 7f3648f1b640 1 -- 172.21.15.37:0/3605935625 wait complete. 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 Processor -- start 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 -- start start 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3644103b60 0x7f364419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36441094a0 0x7f364419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f364419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3644113ab0 con 0x7f3644109df0 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3644113930 con 0x7f36441094a0 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3648f1b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3644113c30 con 0x7f3644103b60 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3642d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f364419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3642d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f364419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35720/0 (socket says 172.21.15.37:35720) 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3642d9d640 1 -- 172.21.15.37:0/3024931906 learned_addr learned my addr 172.21.15.37:0/3024931906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f3641d9b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36441094a0 0x7f364419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.747+0000 7f364259c640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3644103b60 0x7f364419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3642d9d640 1 -- 172.21.15.37:0/3024931906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3644103b60 msgr2=0x7f364419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3642d9d640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3644103b60 0x7f364419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3642d9d640 1 -- 172.21.15.37:0/3024931906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36441094a0 msgr2=0x7f364419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3642d9d640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36441094a0 0x7f364419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3642d9d640 1 -- 172.21.15.37:0/3024931906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36441a02f0 con 0x7f3644109df0 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3642d9d640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f364419fc80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f363c005cc0 tx=0x7f363c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c003bf0 con 0x7f3644109df0 2024-09-21T01:14:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441a0580 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f363c003d90 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c02fb20 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.748+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a0ac0 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.749+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3644103f70 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.751+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f363c004580 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.751+0000 7f36337fe640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f362c0b65d0 0x7f362c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.751+0000 7f364259c640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f362c0b65d0 0x7f362c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.752+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f363c108930 con 0x7f3644109df0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.752+0000 7f364259c640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f362c0b65d0 0x7f362c0b8ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3634005fd0 tx=0x7f3634005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.754+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f363c0cf060 con 0x7f3644109df0 2024-09-21T01:14:33.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.991+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f364402e640 con 0x7f3644109df0 2024-09-21T01:14:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.996+0000 7f36337fe640 1 -- 172.21.15.37:0/3024931906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296438 (secure 0 0 0) 0x7f363c0098b0 con 0x7f3644109df0 2024-09-21T01:14:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f362c0b65d0 msgr2=0x7f362c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f362c0b65d0 0x7f362c0b8ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3634005fd0 tx=0x7f3634005850 comp rx=0 tx=0).stop 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 msgr2=0x7f364419fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f364419fc80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f363c005cc0 tx=0x7f363c02f380 comp rx=0 tx=0).stop 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 shutdown_connections 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f362c0b65d0 0x7f362c0b8ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3644109df0 0x7f364419fc80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36441094a0 0x7f364419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 --2- 172.21.15.37:0/3024931906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3644103b60 0x7f364419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:33.999+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 >> 172.21.15.37:0/3024931906 conn(0x7f364407b850 msgr2=0x7f3644105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:34.000+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 shutdown_connections 2024-09-21T01:14:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:34.000+0000 7f3648f1b640 1 -- 172.21.15.37:0/3024931906 wait complete. 2024-09-21T01:14:34.653 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:34 smithi037 ceph-mon[31105]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:14:34.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:34 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3024931906' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:14:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:34 smithi137 ceph-mon[34607]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:14:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:34 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3024931906' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:14:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:34 smithi144 ceph-mon[34818]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:14:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:34 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3024931906' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:14:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2729102960},{"type":"v1","addr":"172.21.15.37:6801","nonce":2729102960}]},"active_addr":"172.21.15.37:6801/2729102960","active_change":"2024-09-21T01:06:16.751254+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24121,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24140,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1605150269}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3816892973}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3851831853}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1137444280}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3310012135}]}]} 2024-09-21T01:14:34.688 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T01:14:34.688 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T01:14:34.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:14:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 -- 172.21.15.37:0/1598953712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 msgr2=0x7f6ba0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 --2- 172.21.15.37:0/1598953712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba0110330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009ca0 tx=0x7f6b9802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 -- 172.21.15.37:0/1598953712 shutdown_connections 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 --2- 172.21.15.37:0/1598953712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba0110330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 --2- 172.21.15.37:0/1598953712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ba0105270 0x7f6ba010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 --2- 172.21.15.37:0/1598953712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0104920 0x7f6ba0104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 -- 172.21.15.37:0/1598953712 >> 172.21.15.37:0/1598953712 conn(0x7f6ba0079760 msgr2=0x7f6ba0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 -- 172.21.15.37:0/1598953712 shutdown_connections 2024-09-21T01:14:35.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.425+0000 7f6ba5250640 1 -- 172.21.15.37:0/1598953712 wait complete. 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.426+0000 7f6ba5250640 1 Processor -- start 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.426+0000 7f6ba5250640 1 -- start start 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6ba5250640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ba0104920 0x7f6ba019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6ba5250640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0105270 0x7f6ba019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6ba5250640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba019fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6ba5250640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0113ba0 con 0x7f6ba010ded0 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6ba5250640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0113a20 con 0x7f6ba0104920 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6ba5250640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0113d20 con 0x7f6ba0105270 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba019fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba019fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35734/0 (socket says 172.21.15.37:35734) 2024-09-21T01:14:35.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 -- 172.21.15.37:0/2999228363 learned_addr learned my addr 172.21.15.37:0/2999228363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9e59c640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0105270 0x7f6ba019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9ed9d640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ba0104920 0x7f6ba019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 -- 172.21.15.37:0/2999228363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0105270 msgr2=0x7f6ba019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0105270 0x7f6ba019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 -- 172.21.15.37:0/2999228363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ba0104920 msgr2=0x7f6ba019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ba0104920 0x7f6ba019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 -- 172.21.15.37:0/2999228363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba01a0600 con 0x7f6ba010ded0 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.427+0000 7f6b9f59e640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba019fed0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6b98031a20 tx=0x7f6b98031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.428+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98003cf0 con 0x7f6ba010ded0 2024-09-21T01:14:35.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.428+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba01a0890 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.428+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b980044f0 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.428+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9802fce0 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.428+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba01a7050 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.429+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba006c130 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.430+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6b98004040 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.431+0000 7f6b97fff640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b8c0b65a0 0x7f6b8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.431+0000 7f6b9ed9d640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b8c0b65a0 0x7f6b8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.431+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6b98108970 con 0x7f6ba010ded0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.431+0000 7f6b9ed9d640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b8c0b65a0 0x7f6b8c0b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ba006c830 tx=0x7f6b90008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.436+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b980cf0a0 con 0x7f6ba010ded0 2024-09-21T01:14:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.623+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ba01090b0 con 0x7f6ba010ded0 2024-09-21T01:14:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.625+0000 7f6b97fff640 1 -- 172.21.15.37:0/2999228363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7f6b980098b0 con 0x7f6ba010ded0 2024-09-21T01:14:35.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:35.627 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b8c0b65a0 msgr2=0x7f6b8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b8c0b65a0 0x7f6b8c0b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ba006c830 tx=0x7f6b90008040 comp rx=0 tx=0).stop 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 msgr2=0x7f6ba019fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba019fed0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6b98031a20 tx=0x7f6b98031a50 comp rx=0 tx=0).stop 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 shutdown_connections 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b8c0b65a0 0x7f6b8c0b8ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba010ded0 0x7f6ba019fed0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0105270 0x7f6ba019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 --2- 172.21.15.37:0/2999228363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ba0104920 0x7f6ba019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.627+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 >> 172.21.15.37:0/2999228363 conn(0x7f6ba0079760 msgr2=0x7f6ba0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.628+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 shutdown_connections 2024-09-21T01:14:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:35.628+0000 7f6ba5250640 1 -- 172.21.15.37:0/2999228363 wait complete. 2024-09-21T01:14:36.266 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T01:14:36.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:14:36.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:36 smithi037 ceph-mon[31105]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T01:14:36.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:36 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2999228363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:36.527 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:36 smithi137 ceph-mon[34607]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T01:14:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:36 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2999228363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:36 smithi144 ceph-mon[34818]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T01:14:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:36 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2999228363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 -- 172.21.15.37:0/2867683490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc108d10 msgr2=0x7fabdc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/2867683490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc108d10 0x7fabdc10f540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009ca0 tx=0x7fabd402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 -- 172.21.15.37:0/2867683490 shutdown_connections 2024-09-21T01:14:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/2867683490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc108d10 0x7fabdc10f540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/2867683490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc1083c0 0x7fabdc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/2867683490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabdc102a80 0x7fabdc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 -- 172.21.15.37:0/2867683490 >> 172.21.15.37:0/2867683490 conn(0x7fabdc079740 msgr2=0x7fabdc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 -- 172.21.15.37:0/2867683490 shutdown_connections 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 -- 172.21.15.37:0/2867683490 wait complete. 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.063+0000 7fabe2a3f640 1 Processor -- start 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 -- start start 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabdc102a80 0x7fabdc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 0x7fabdc19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc108d10 0x7fabdc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc112980 con 0x7fabdc1083c0 2024-09-21T01:14:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc112800 con 0x7fabdc108d10 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe2a3f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc112b00 con 0x7fabdc102a80 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 0x7fabdc19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 0x7fabdc19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52998/0 (socket says 172.21.15.37:52998) 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 -- 172.21.15.37:0/173403965 learned_addr learned my addr 172.21.15.37:0/173403965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabe0fdc640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc108d10 0x7fabdc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdbfff640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabdc102a80 0x7fabdc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 -- 172.21.15.37:0/173403965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabdc102a80 msgr2=0x7fabdc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabdc102a80 0x7fabdc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 -- 172.21.15.37:0/173403965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc108d10 msgr2=0x7fabdc19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc108d10 0x7fabdc19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.064+0000 7fabdb7fe640 1 -- 172.21.15.37:0/173403965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc1a6590 con 0x7fabdc1083c0 2024-09-21T01:14:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.065+0000 7fabdb7fe640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 0x7fabdc19b810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fabd0005fd0 tx=0x7fabd000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.065+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0017070 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.065+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabd0009c30 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.065+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc1a6880 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.065+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0003d30 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.065+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc1a6dc0 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.066+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc103d00 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.068+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fabd0003ed0 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.068+0000 7fabd97fa640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fabc40b65a0 0x7fabc40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.069+0000 7fabdbfff640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fabc40b65a0 0x7fabc40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.069+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fabd00e7780 con 0x7fabdc1083c0 2024-09-21T01:14:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.069+0000 7fabdbfff640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fabc40b65a0 0x7fabc40b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fabdc06c6c0 tx=0x7fabcc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:37.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.072+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fabd0020030 con 0x7fabdc1083c0 2024-09-21T01:14:37.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.262+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabdc06bf70 con 0x7fabdc1083c0 2024-09-21T01:14:37.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.264+0000 7fabd97fa640 1 -- 172.21.15.37:0/173403965 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7fabd00adeb0 con 0x7fabdc1083c0 2024-09-21T01:14:37.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:14:37.266 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fabc40b65a0 msgr2=0x7fabc40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fabc40b65a0 0x7fabc40b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fabdc06c6c0 tx=0x7fabcc00b390 comp rx=0 tx=0).stop 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 msgr2=0x7fabdc19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 0x7fabdc19b810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fabd0005fd0 tx=0x7fabd000dde0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 shutdown_connections 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fabc40b65a0 0x7fabc40b8ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc108d10 0x7fabdc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabdc1083c0 0x7fabdc19b810 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 --2- 172.21.15.37:0/173403965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabdc102a80 0x7fabdc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 >> 172.21.15.37:0/173403965 conn(0x7fabdc079740 msgr2=0x7fabdc1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 shutdown_connections 2024-09-21T01:14:37.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:37.266+0000 7fabe2a3f640 1 -- 172.21.15.37:0/173403965 wait complete. 2024-09-21T01:14:37.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:37 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/173403965' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:37.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:37 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/173403965' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:37.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:37 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/173403965' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:14:37.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T01:14:37.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T01:14:37.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T01:14:37.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T01:14:37.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T01:14:37.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T01:14:37.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T01:14:37.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T01:14:37.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T01:14:37.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T01:14:37.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T01:14:37.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T01:14:38.588 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.638 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:38 smithi037 ceph-mon[31105]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:14:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.918 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.919 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.919 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:38 smithi137 ceph-mon[34607]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:14:38.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:38 smithi144 ceph-mon[34818]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T01:14:38.921 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.923 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.125+0000 7f475c6ef640 1 -- 172.21.15.37:0/2116055212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47541083b0 msgr2=0x7f47541087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.125+0000 7f475c6ef640 1 --2- 172.21.15.37:0/2116055212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47541083b0 0x7f47541087c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4744009860 tx=0x7f474402a340 comp rx=0 tx=0).stop 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 -- 172.21.15.37:0/2116055212 shutdown_connections 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 --2- 172.21.15.37:0/2116055212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4754108d00 0x7f475410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 --2- 172.21.15.37:0/2116055212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47541083b0 0x7f47541087c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 --2- 172.21.15.37:0/2116055212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4754102a70 0x7f4754102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 -- 172.21.15.37:0/2116055212 >> 172.21.15.37:0/2116055212 conn(0x7f4754079710 msgr2=0x7f4754079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 -- 172.21.15.37:0/2116055212 shutdown_connections 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.126+0000 7f475c6ef640 1 -- 172.21.15.37:0/2116055212 wait complete. 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.127+0000 7f475c6ef640 1 Processor -- start 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.127+0000 7f475c6ef640 1 -- start start 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.127+0000 7f475c6ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4754102a70 0x7f475419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.127+0000 7f475c6ef640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47541083b0 0x7f475419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f475c6ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4754108d00 0x7f475419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f475c6ef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47541129c0 con 0x7f4754102a70 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f475c6ef640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4754112840 con 0x7f4754108d00 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f475c6ef640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4754112b40 con 0x7f47541083b0 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47541083b0 0x7f475419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47541083b0 0x7f475419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35368/0 (socket says 172.21.15.37:35368) 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 -- 172.21.15.37:0/1529239020 learned_addr learned my addr 172.21.15.37:0/1529239020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f475ac8c640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4754108d00 0x7f475419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 -- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4754108d00 msgr2=0x7f475419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4754108d00 0x7f475419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 -- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4754102a70 msgr2=0x7f475419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4754102a70 0x7f475419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f4759c8a640 1 -- 172.21.15.37:0/1529239020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47541a0430 con 0x7f47541083b0 2024-09-21T01:14:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.128+0000 7f475ac8c640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4754108d00 0x7f475419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.129+0000 7f4759c8a640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47541083b0 0x7f475419aa60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4744035040 tx=0x7f4744032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.129+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744040020 con 0x7f47541083b0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.129+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47541a06c0 con 0x7f47541083b0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.129+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4744030e10 con 0x7f47541083b0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.129+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744037040 con 0x7f47541083b0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.129+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47541a6e80 con 0x7f47541083b0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.130+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4754063b50 con 0x7f47541083b0 2024-09-21T01:14:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.132+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4744043020 con 0x7f47541083b0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f474b7fe640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47400b65a0 0x7f47400b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f475a48b640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47400b65a0 0x7f47400b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4744107a50 con 0x7f47541083b0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f474b7fe640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] conn(0x7f47400c0110 0x7f47400c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 --> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4744036e90 con 0x7f47400c0110 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f4744107e40 con 0x7f47541083b0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.133+0000 7f475a48b640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47400b65a0 0x7f47400b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47500058c0 tx=0x7f4750005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.134+0000 7f475ac8c640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] conn(0x7f47400c0110 0x7f47400c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.134+0000 7f475ac8c640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] conn(0x7f47400c0110 0x7f47400c2600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.135+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== osd.1 v2:172.21.15.137:6800/806118255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4744036e90 con 0x7f47400c0110 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.149+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 --> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4754063f50 con 0x7f47400c0110 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.149+0000 7f474b7fe640 1 -- 172.21.15.37:0/1529239020 <== osd.1 v2:172.21.15.137:6800/806118255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4754063f50 con 0x7f47400c0110 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.149+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] conn(0x7f47400c0110 msgr2=0x7f47400c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.149+0000 7f475c6ef640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] conn(0x7f47400c0110 0x7f47400c2600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47400b65a0 msgr2=0x7f47400b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f47400b65a0 0x7f47400b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47500058c0 tx=0x7f4750005850 comp rx=0 tx=0).stop 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47541083b0 msgr2=0x7f475419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 --2- 172.21.15.37:0/1529239020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47541083b0 0x7f475419aa60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4744035040 tx=0x7f4744032d50 comp rx=0 tx=0).stop 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475ac8c640 1 -- 172.21.15.37:0/1529239020 reap_dead start 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 shutdown_connections 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 >> 172.21.15.37:0/1529239020 conn(0x7f4754079710 msgr2=0x7f4754101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 shutdown_connections 2024-09-21T01:14:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:39.150+0000 7f475c6ef640 1 -- 172.21.15.37:0/1529239020 wait complete. 2024-09-21T01:14:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:40.024 INFO:teuthology.orchestra.run.smithi037.stdout:55834574923 2024-09-21T01:14:40.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 -- 172.21.15.37:0/640052861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac1083d0 msgr2=0x7f3dac1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 --2- 172.21.15.37:0/640052861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac1083d0 0x7f3dac1087e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009900 tx=0x7f3d9c02a410 comp rx=0 tx=0).stop 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 -- 172.21.15.37:0/640052861 shutdown_connections 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 --2- 172.21.15.37:0/640052861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dac108d20 0x7f3dac10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 --2- 172.21.15.37:0/640052861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac1083d0 0x7f3dac1087e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 --2- 172.21.15.37:0/640052861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dac102ae0 0x7f3dac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 -- 172.21.15.37:0/640052861 >> 172.21.15.37:0/640052861 conn(0x7f3dac079760 msgr2=0x7f3dac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 -- 172.21.15.37:0/640052861 shutdown_connections 2024-09-21T01:14:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.507+0000 7f3db45ce640 1 -- 172.21.15.37:0/640052861 wait complete. 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 Processor -- start 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 -- start start 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dac102ae0 0x7f3dac199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dac1083d0 0x7f3dac199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac108d20 0x7f3dac19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac112990 con 0x7f3dac108d20 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac112810 con 0x7f3dac102ae0 2024-09-21T01:14:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db45ce640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac112b10 con 0x7f3dac1083d0 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.508+0000 7f3db2b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac108d20 0x7f3dac19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac108d20 0x7f3dac19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53044/0 (socket says 172.21.15.37:53044) 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 -- 172.21.15.37:0/3720048727 learned_addr learned my addr 172.21.15.37:0/3720048727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db1b69640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dac1083d0 0x7f3dac199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db236a640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dac102ae0 0x7f3dac199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 -- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dac1083d0 msgr2=0x7f3dac199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dac1083d0 0x7f3dac199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 -- 172.21.15.37:0/3720048727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dac102ae0 msgr2=0x7f3dac199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dac102ae0 0x7f3dac199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 -- 172.21.15.37:0/3720048727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac19f2f0 con 0x7f3dac108d20 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db2b6b640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac108d20 0x7f3dac19ebc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3da400eaa0 tx=0x7f3da400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400cdb0 con 0x7f3dac108d20 2024-09-21T01:14:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3da4005020 con 0x7f3dac108d20 2024-09-21T01:14:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac19f5e0 con 0x7f3dac108d20 2024-09-21T01:14:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40116d0 con 0x7f3dac108d20 2024-09-21T01:14:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.509+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac06bb40 con 0x7f3dac108d20 2024-09-21T01:14:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.510+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dac06c110 con 0x7f3dac108d20 2024-09-21T01:14:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.512+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3da40051d0 con 0x7f3dac108d20 2024-09-21T01:14:40.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.513+0000 7f3da37fe640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d980b65a0 0x7f3d980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.513+0000 7f3db236a640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d980b65a0 0x7f3d980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.513+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3da40e7a30 con 0x7f3dac108d20 2024-09-21T01:14:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.513+0000 7f3da37fe640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] conn(0x7f3d980c0110 0x7f3d980c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.513+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 --> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3da4018ec0 con 0x7f3d980c0110 2024-09-21T01:14:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.513+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f3da40e7de0 con 0x7f3dac108d20 2024-09-21T01:14:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.514+0000 7f3db236a640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d980b65a0 0x7f3d980b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da800f7a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.514+0000 7f3db1b69640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] conn(0x7f3d980c0110 0x7f3d980c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.514+0000 7f3db1b69640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] conn(0x7f3d980c0110 0x7f3d980c2600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:40.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.515+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== osd.8 v2:172.21.15.144:6816/2167195424 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3da4018ec0 con 0x7f3d980c0110 2024-09-21T01:14:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.529+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 --> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3dac06c590 con 0x7f3d980c0110 2024-09-21T01:14:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3da37fe640 1 -- 172.21.15.37:0/3720048727 <== osd.8 v2:172.21.15.144:6816/2167195424 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3dac06c590 con 0x7f3d980c0110 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] conn(0x7f3d980c0110 msgr2=0x7f3d980c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] conn(0x7f3d980c0110 0x7f3d980c2600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d980b65a0 msgr2=0x7f3d980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d980b65a0 0x7f3d980b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da800f7a0 comp rx=0 tx=0).stop 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac108d20 msgr2=0x7f3dac19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 --2- 172.21.15.37:0/3720048727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac108d20 0x7f3dac19ebc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3da400eaa0 tx=0x7f3da400ef60 comp rx=0 tx=0).stop 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db2b6b640 1 -- 172.21.15.37:0/3720048727 reap_dead start 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 shutdown_connections 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 >> 172.21.15.37:0/3720048727 conn(0x7f3dac079760 msgr2=0x7f3dac104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 shutdown_connections 2024-09-21T01:14:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.530+0000 7f3db45ce640 1 -- 172.21.15.37:0/3720048727 wait complete. 2024-09-21T01:14:40.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:40 smithi037 ceph-mon[31105]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T01:14:40.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:40 smithi137 ceph-mon[34607]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T01:14:40.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:40 smithi144 ceph-mon[34818]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 -- 172.21.15.37:0/2216049769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 msgr2=0x7f8a3c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/2216049769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c10f520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009ca0 tx=0x7f8a3402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 -- 172.21.15.37:0/2216049769 shutdown_connections 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/2216049769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c10f520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/2216049769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a3c1083a0 0x7f8a3c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/2216049769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a3c102a60 0x7f8a3c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 -- 172.21.15.37:0/2216049769 >> 172.21.15.37:0/2216049769 conn(0x7f8a3c079730 msgr2=0x7f8a3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 -- 172.21.15.37:0/2216049769 shutdown_connections 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.420+0000 7f8a40ef9640 1 -- 172.21.15.37:0/2216049769 wait complete. 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 Processor -- start 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 -- start start 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a3c102a60 0x7f8a3c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a3c1083a0 0x7f8a3c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c112960 con 0x7f8a3c108cf0 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1127e0 con 0x7f8a3c1083a0 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.421+0000 7f8a40ef9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c112ae0 con 0x7f8a3c102a60 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53028/0 (socket says 172.21.15.37:53028) 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 -- 172.21.15.37:0/272729234 learned_addr learned my addr 172.21.15.37:0/272729234 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3a59c640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a3c102a60 0x7f8a3c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a39d9b640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a3c1083a0 0x7f8a3c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 -- 172.21.15.37:0/272729234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a3c102a60 msgr2=0x7f8a3c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a3c102a60 0x7f8a3c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 -- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a3c1083a0 msgr2=0x7f8a3c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a3c1083a0 0x7f8a3c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 -- 172.21.15.37:0/272729234 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c1a0310 con 0x7f8a3c108cf0 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a3ad9d640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c19fca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005cc0 tx=0x7f8a3402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34003cf0 con 0x7f8a3c108cf0 2024-09-21T01:14:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3c1a05a0 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a340044f0 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3402fd10 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.422+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3c1a6e20 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.423+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a3c063b50 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.425+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8a34004040 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.426+0000 7f8a2b7fe640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8a240b65d0 0x7f8a240b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.426+0000 7f8a3a59c640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8a240b65d0 0x7f8a240b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.426+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8a34108d20 con 0x7f8a3c108cf0 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.426+0000 7f8a2b7fe640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] conn(0x7f8a240c0140 0x7f8a240c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.426+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 --> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a240c2d00 con 0x7f8a240c0140 2024-09-21T01:14:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.426+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f8a34109150 con 0x7f8a3c108cf0 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.427+0000 7f8a3a59c640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8a240b65d0 0x7f8a240b8ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0058c0 tx=0x7f8a2c00a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.427+0000 7f8a39d9b640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] conn(0x7f8a240c0140 0x7f8a240c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.427+0000 7f8a39d9b640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] conn(0x7f8a240c0140 0x7f8a240c2630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.428+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== osd.4 v2:172.21.15.137:6808/2853866210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a240c2d00 con 0x7f8a240c0140 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.442+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 --> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a3c063f50 con 0x7f8a240c0140 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a2b7fe640 1 -- 172.21.15.37:0/272729234 <== osd.4 v2:172.21.15.137:6808/2853866210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8a3c063f50 con 0x7f8a240c0140 2024-09-21T01:14:41.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] conn(0x7f8a240c0140 msgr2=0x7f8a240c2630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] conn(0x7f8a240c0140 0x7f8a240c2630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8a240b65d0 msgr2=0x7f8a240b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8a240b65d0 0x7f8a240b8ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0058c0 tx=0x7f8a2c00a250 comp rx=0 tx=0).stop 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 msgr2=0x7f8a3c19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.443+0000 7f8a40ef9640 1 --2- 172.21.15.37:0/272729234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c108cf0 0x7f8a3c19fca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005cc0 tx=0x7f8a3402f470 comp rx=0 tx=0).stop 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.444+0000 7f8a3ad9d640 1 -- 172.21.15.37:0/272729234 reap_dead start 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.444+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 shutdown_connections 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.444+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 >> 172.21.15.37:0/272729234 conn(0x7f8a3c079730 msgr2=0x7f8a3c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.444+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 shutdown_connections 2024-09-21T01:14:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:40.444+0000 7f8a40ef9640 1 -- 172.21.15.37:0/272729234 wait complete. 2024-09-21T01:14:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:128849018938 2024-09-21T01:14:41.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T01:14:42.631 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:42 smithi037 ceph-mon[31105]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:14:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.723+0000 7f9c86921640 1 -- 172.21.15.37:0/3726456820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 msgr2=0x7f9c8010d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.723+0000 7f9c86921640 1 --2- 172.21.15.37:0/3726456820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8010d8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009900 tx=0x7f9c7402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 -- 172.21.15.37:0/3726456820 shutdown_connections 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 --2- 172.21.15.37:0/3726456820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c8010de30 0x7f9c80110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 --2- 172.21.15.37:0/3726456820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8010d8f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 --2- 172.21.15.37:0/3726456820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c80104880 0x7f9c80104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 -- 172.21.15.37:0/3726456820 >> 172.21.15.37:0/3726456820 conn(0x7f9c80079750 msgr2=0x7f9c80079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 -- 172.21.15.37:0/3726456820 shutdown_connections 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 -- 172.21.15.37:0/3726456820 wait complete. 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 Processor -- start 2024-09-21T01:14:42.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.724+0000 7f9c86921640 1 -- start start 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c86921640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c80104880 0x7f9c8019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c86921640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c86921640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c8010de30 0x7f9c8019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c86921640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c80113ab0 con 0x7f9c801052b0 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c86921640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c80113930 con 0x7f9c80104880 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c86921640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c80113c30 con 0x7f9c8010de30 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53070/0 (socket says 172.21.15.37:53070) 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 -- 172.21.15.37:0/213798441 learned_addr learned my addr 172.21.15.37:0/213798441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7ffff640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c80104880 0x7f9c8019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c84ebe640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c8010de30 0x7f9c8019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 -- 172.21.15.37:0/213798441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c8010de30 msgr2=0x7f9c8019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c8010de30 0x7f9c8019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 -- 172.21.15.37:0/213798441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c80104880 msgr2=0x7f9c8019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c80104880 0x7f9c8019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.725+0000 7f9c7f7fe640 1 -- 172.21.15.37:0/213798441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c801a03d0 con 0x7f9c801052b0 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.726+0000 7f9c7f7fe640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8019aac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c74006010 tx=0x7f9c74004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.726+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7403f030 con 0x7f9c801052b0 2024-09-21T01:14:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.726+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c801a0660 con 0x7f9c801052b0 2024-09-21T01:14:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.726+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c74004460 con 0x7f9c801052b0 2024-09-21T01:14:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.726+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74035070 con 0x7f9c801052b0 2024-09-21T01:14:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.726+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c801a0b40 con 0x7f9c801052b0 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.727+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c80107430 con 0x7f9c801052b0 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.729+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9c74042030 con 0x7f9c801052b0 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.729+0000 7f9c7d7fa640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9c680b65d0 0x7f9c680b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.729+0000 7f9c7ffff640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9c680b65d0 0x7f9c680b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.729+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9c741078b0 con 0x7f9c801052b0 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.730+0000 7f9c7d7fa640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] conn(0x7f9c680c0140 0x7f9c680c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.730+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 --> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c74046e50 con 0x7f9c680c0140 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.730+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9c74107ce0 con 0x7f9c801052b0 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.730+0000 7f9c84ebe640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] conn(0x7f9c680c0140 0x7f9c680c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.730+0000 7f9c7ffff640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9c680b65d0 0x7f9c680b8ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000abe0 tx=0x7f9c7000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.730+0000 7f9c84ebe640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] conn(0x7f9c680c0140 0x7f9c680c2630 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.731+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== osd.6 v2:172.21.15.37:6818/1539811253 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c74046e50 con 0x7f9c680c0140 2024-09-21T01:14:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.746+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 --> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9c8006c1e0 con 0x7f9c680c0140 2024-09-21T01:14:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.746+0000 7f9c7d7fa640 1 -- 172.21.15.37:0/213798441 <== osd.6 v2:172.21.15.37:6818/1539811253 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9c8006c1e0 con 0x7f9c680c0140 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.746+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] conn(0x7f9c680c0140 msgr2=0x7f9c680c2630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.746+0000 7f9c86921640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] conn(0x7f9c680c0140 0x7f9c680c2630 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9c680b65d0 msgr2=0x7f9c680b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9c680b65d0 0x7f9c680b8ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000abe0 tx=0x7f9c7000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 msgr2=0x7f9c8019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 --2- 172.21.15.37:0/213798441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c801052b0 0x7f9c8019aac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c74006010 tx=0x7f9c74004060 comp rx=0 tx=0).stop 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c84ebe640 1 -- 172.21.15.37:0/213798441 reap_dead start 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 shutdown_connections 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 >> 172.21.15.37:0/213798441 conn(0x7f9c80079750 msgr2=0x7f9c801069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 shutdown_connections 2024-09-21T01:14:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:42.747+0000 7f9c86921640 1 -- 172.21.15.37:0/213798441 wait complete. 2024-09-21T01:14:42.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:42 smithi137 ceph-mon[34607]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:14:42.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:42 smithi144 ceph-mon[34818]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:14:43.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 -- 172.21.15.37:0/1267242967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0110200 msgr2=0x7f26e0112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:43.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 --2- 172.21.15.37:0/1267242967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0110200 0x7f26e0112620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009ca0 tx=0x7f26d802a950 comp rx=0 tx=0).stop 2024-09-21T01:14:43.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 -- 172.21.15.37:0/1267242967 shutdown_connections 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 --2- 172.21.15.37:0/1267242967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0110200 0x7f26e0112620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 --2- 172.21.15.37:0/1267242967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0102fa0 0x7f26e010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 --2- 172.21.15.37:0/1267242967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26e0102650 0x7f26e0102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 -- 172.21.15.37:0/1267242967 >> 172.21.15.37:0/1267242967 conn(0x7f26e0079760 msgr2=0x7f26e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 -- 172.21.15.37:0/1267242967 shutdown_connections 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.543+0000 7f26e7538640 1 -- 172.21.15.37:0/1267242967 wait complete. 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 Processor -- start 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 -- start start 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26e0102650 0x7f26e019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0102fa0 0x7f26e019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0110200 0x7f26e01a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:43.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0115cf0 con 0x7f26e0102fa0 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0115b70 con 0x7f26e0102650 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e7538640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0115e70 con 0x7f26e0110200 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0102fa0 0x7f26e019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0102fa0 0x7f26e019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53088/0 (socket says 172.21.15.37:53088) 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 -- 172.21.15.37:0/3867511438 learned_addr learned my addr 172.21.15.37:0/3867511438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e52d4640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26e0102650 0x7f26e019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e5ad5640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0110200 0x7f26e01a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 -- 172.21.15.37:0/3867511438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0110200 msgr2=0x7f26e01a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0110200 0x7f26e01a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 -- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26e0102650 msgr2=0x7f26e019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26e0102650 0x7f26e019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.544+0000 7f26e4ad3640 1 -- 172.21.15.37:0/3867511438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e01a2530 con 0x7f26e0102fa0 2024-09-21T01:14:43.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.545+0000 7f26e4ad3640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0102fa0 0x7f26e019cb60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c890 tx=0x7f26d000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.545+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0004220 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.545+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e01a2820 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.545+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d00043c0 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.545+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0004a00 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.545+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a8f80 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.546+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26e0111e80 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.548+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f26d00079b0 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.548+0000 7f26d67fc640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26cc0b65a0 0x7f26cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.548+0000 7f26e52d4640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26cc0b65a0 0x7f26cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.548+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f26d00e7680 con 0x7f26e0102fa0 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.549+0000 7f26d67fc640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] conn(0x7f26cc0c0110 0x7f26cc0c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.549+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 --> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26cc0c2cd0 con 0x7f26cc0c0110 2024-09-21T01:14:43.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.549+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f26d00e7a30 con 0x7f26e0102fa0 2024-09-21T01:14:43.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.549+0000 7f26e52d4640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26cc0b65a0 0x7f26cc0b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0058c0 tx=0x7f26dc00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:43.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.549+0000 7f26e5ad5640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] conn(0x7f26cc0c0110 0x7f26cc0c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:43.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.549+0000 7f26e5ad5640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] conn(0x7f26cc0c0110 0x7f26cc0c2600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:43.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.550+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== osd.10 v2:172.21.15.137:6824/1223382537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26cc0c2cd0 con 0x7f26cc0c0110 2024-09-21T01:14:43.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.564+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 --> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26e006b350 con 0x7f26cc0c0110 2024-09-21T01:14:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26d67fc640 1 -- 172.21.15.37:0/3867511438 <== osd.10 v2:172.21.15.137:6824/1223382537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f26e006b350 con 0x7f26cc0c0110 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] conn(0x7f26cc0c0110 msgr2=0x7f26cc0c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] conn(0x7f26cc0c0110 0x7f26cc0c2600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26cc0b65a0 msgr2=0x7f26cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26cc0b65a0 0x7f26cc0b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0058c0 tx=0x7f26dc00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0102fa0 msgr2=0x7f26e019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 --2- 172.21.15.37:0/3867511438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0102fa0 0x7f26e019cb60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c890 tx=0x7f26d000cd50 comp rx=0 tx=0).stop 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e5ad5640 1 -- 172.21.15.37:0/3867511438 reap_dead start 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 shutdown_connections 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 >> 172.21.15.37:0/3867511438 conn(0x7f26e0079760 msgr2=0x7f26e01114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 shutdown_connections 2024-09-21T01:14:43.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.565+0000 7f26e7538640 1 -- 172.21.15.37:0/3867511438 wait complete. 2024-09-21T01:14:44.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 -- 172.21.15.37:0/2632375620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c108cf0 msgr2=0x7f044c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 --2- 172.21.15.37:0/2632375620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c108cf0 0x7f044c10f520 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f044402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 -- 172.21.15.37:0/2632375620 shutdown_connections 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 --2- 172.21.15.37:0/2632375620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c108cf0 0x7f044c10f520 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 --2- 172.21.15.37:0/2632375620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c1083a0 0x7f044c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 --2- 172.21.15.37:0/2632375620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f044c102a60 0x7f044c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 -- 172.21.15.37:0/2632375620 >> 172.21.15.37:0/2632375620 conn(0x7f044c079730 msgr2=0x7f044c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 -- 172.21.15.37:0/2632375620 shutdown_connections 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.362+0000 7f0451d29640 1 -- 172.21.15.37:0/2632375620 wait complete. 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 Processor -- start 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 -- start start 2024-09-21T01:14:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c102a60 0x7f044c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c1083a0 0x7f044c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f044c108cf0 0x7f044c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f044c112960 con 0x7f044c102a60 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1127e0 con 0x7f044c108cf0 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.363+0000 7f0451d29640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f044c112ae0 con 0x7f044c1083a0 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c102a60 0x7f044c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c102a60 0x7f044c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53118/0 (socket says 172.21.15.37:53118) 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 -- 172.21.15.37:0/331508172 learned_addr learned my addr 172.21.15.37:0/331508172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044affd640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c1083a0 0x7f044c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044bfff640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f044c108cf0 0x7f044c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 -- 172.21.15.37:0/331508172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c1083a0 msgr2=0x7f044c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f044c1083a0 0x7f044c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:44.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 -- 172.21.15.37:0/331508172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f044c108cf0 msgr2=0x7f044c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f044c108cf0 0x7f044c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 -- 172.21.15.37:0/331508172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c19f260 con 0x7f044c102a60 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044bfff640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f044c108cf0 0x7f044c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f044b7fe640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c102a60 0x7f044c1992f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f043c00eab0 tx=0x7f043c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c00ce40 con 0x7f044c102a60 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c19f550 con 0x7f044c102a60 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f043c011920 con 0x7f044c102a60 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c010a30 con 0x7f044c102a60 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.364+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c1a5cb0 con 0x7f044c102a60 2024-09-21T01:14:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.365+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f044c063b50 con 0x7f044c102a60 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.367+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f043c010bd0 con 0x7f044c102a60 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f0448ff9640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04340b65a0 0x7f04340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f044affd640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04340b65a0 0x7f04340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f043c0e7d10 con 0x7f044c102a60 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f0448ff9640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] conn(0x7f04340c0110 0x7f04340c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 --> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f043c018e50 con 0x7f04340c0110 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f043c0e8140 con 0x7f044c102a60 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f044bfff640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] conn(0x7f04340c0110 0x7f04340c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.368+0000 7f044affd640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04340b65a0 0x7f04340b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f044c06a3e0 tx=0x7f0440005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.369+0000 7f044bfff640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] conn(0x7f04340c0110 0x7f04340c2600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.369+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== osd.3 v2:172.21.15.37:6810/261274699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f043c018e50 con 0x7f04340c0110 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.383+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 --> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f044c063f80 con 0x7f04340c0110 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.383+0000 7f0448ff9640 1 -- 172.21.15.37:0/331508172 <== osd.3 v2:172.21.15.37:6810/261274699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f044c063f80 con 0x7f04340c0110 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] conn(0x7f04340c0110 msgr2=0x7f04340c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] conn(0x7f04340c0110 0x7f04340c2600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04340b65a0 msgr2=0x7f04340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04340b65a0 0x7f04340b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f044c06a3e0 tx=0x7f0440005f90 comp rx=0 tx=0).stop 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c102a60 msgr2=0x7f044c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 --2- 172.21.15.37:0/331508172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f044c102a60 0x7f044c1992f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f043c00eab0 tx=0x7f043c00ef70 comp rx=0 tx=0).stop 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f044bfff640 1 -- 172.21.15.37:0/331508172 reap_dead start 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 shutdown_connections 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 >> 172.21.15.37:0/331508172 conn(0x7f044c079730 msgr2=0x7f044c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 shutdown_connections 2024-09-21T01:14:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:44.384+0000 7f0451d29640 1 -- 172.21.15.37:0/331508172 wait complete. 2024-09-21T01:14:44.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:44 smithi037 ceph-mon[31105]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T01:14:44.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:44 smithi137 ceph-mon[34607]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T01:14:44.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:44 smithi144 ceph-mon[34818]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T01:14:45.043 INFO:teuthology.orchestra.run.smithi037.stdout:103079215168 2024-09-21T01:14:45.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T01:14:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 -- 172.21.15.37:0/135403095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 msgr2=0x7fece01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 --2- 172.21.15.37:0/135403095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece01098b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009900 tx=0x7fecd402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 -- 172.21.15.37:0/135403095 shutdown_connections 2024-09-21T01:14:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 --2- 172.21.15.37:0/135403095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fece0109df0 0x7fece0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 --2- 172.21.15.37:0/135403095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece01098b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 --2- 172.21.15.37:0/135403095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece0103b60 0x7fece0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 -- 172.21.15.37:0/135403095 >> 172.21.15.37:0/135403095 conn(0x7fece007b850 msgr2=0x7fece007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 -- 172.21.15.37:0/135403095 shutdown_connections 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.397+0000 7fece66ca640 1 -- 172.21.15.37:0/135403095 wait complete. 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 Processor -- start 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 -- start start 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece0103b60 0x7fece019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fece0109df0 0x7fece019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fece0113ab0 con 0x7fece01094a0 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fece0113930 con 0x7fece0109df0 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.398+0000 7fece66ca640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fece0113c30 con 0x7fece0103b60 2024-09-21T01:14:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53126/0 (socket says 172.21.15.37:53126) 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 -- 172.21.15.37:0/3036671899 learned_addr learned my addr 172.21.15.37:0/3036671899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdffff640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece0103b60 0x7fece019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fece4c67640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fece0109df0 0x7fece019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 -- 172.21.15.37:0/3036671899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece0103b60 msgr2=0x7fece019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece0103b60 0x7fece019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 -- 172.21.15.37:0/3036671899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fece0109df0 msgr2=0x7fece019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fece0109df0 0x7fece019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 -- 172.21.15.37:0/3036671899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece01a0450 con 0x7fece01094a0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdf7fe640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece019aa80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fecd402a930 tx=0x7fecd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd403f030 con 0x7fece01094a0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece01a06e0 con 0x7fece01094a0 2024-09-21T01:14:45.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecd4003aa0 con 0x7fece01094a0 2024-09-21T01:14:45.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.399+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4035070 con 0x7fece01094a0 2024-09-21T01:14:45.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.400+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece01a6ea0 con 0x7fece01094a0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.400+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fece0063b50 con 0x7fece01094a0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.402+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fecd4042030 con 0x7fece01094a0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdd7fa640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fecc80b65a0 0x7fecc80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdffff640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fecc80b65a0 0x7fecc80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fecd4107f80 con 0x7fece01094a0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdd7fa640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] conn(0x7fecc80c0110 0x7fecc80c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 --> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecd4044e50 con 0x7fecc80c0110 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fecd4108330 con 0x7fece01094a0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fece4c67640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] conn(0x7fecc80c0110 0x7fecc80c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.403+0000 7fecdffff640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fecc80b65a0 0x7fecc80b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fecd0005fd0 tx=0x7fecd000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.404+0000 7fece4c67640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] conn(0x7fecc80c0110 0x7fecc80c2600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:45.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.404+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== osd.0 v2:172.21.15.37:6802/3448292591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecd4044e50 con 0x7fecc80c0110 2024-09-21T01:14:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 --> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fece0063f50 con 0x7fecc80c0110 2024-09-21T01:14:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fecdd7fa640 1 -- 172.21.15.37:0/3036671899 <== osd.0 v2:172.21.15.37:6802/3448292591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fece0063f50 con 0x7fecc80c0110 2024-09-21T01:14:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] conn(0x7fecc80c0110 msgr2=0x7fecc80c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] conn(0x7fecc80c0110 0x7fecc80c2600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fecc80b65a0 msgr2=0x7fecc80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fecc80b65a0 0x7fecc80b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fecd0005fd0 tx=0x7fecd000b390 comp rx=0 tx=0).stop 2024-09-21T01:14:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 msgr2=0x7fece019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece66ca640 1 --2- 172.21.15.37:0/3036671899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece01094a0 0x7fece019aa80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fecd402a930 tx=0x7fecd4004270 comp rx=0 tx=0).stop 2024-09-21T01:14:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.420+0000 7fece4c67640 1 -- 172.21.15.37:0/3036671899 reap_dead start 2024-09-21T01:14:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.421+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 shutdown_connections 2024-09-21T01:14:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.421+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 >> 172.21.15.37:0/3036671899 conn(0x7fece007b850 msgr2=0x7fece0105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.421+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 shutdown_connections 2024-09-21T01:14:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:45.421+0000 7fece66ca640 1 -- 172.21.15.37:0/3036671899 wait complete. 2024-09-21T01:14:46.137 INFO:teuthology.orchestra.run.smithi037.stdout:266287972381 2024-09-21T01:14:46.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T01:14:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 -- 172.21.15.37:0/834138043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74108d20 msgr2=0x7f7f7410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 --2- 172.21.15.37:0/834138043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74108d20 0x7f7f7410f550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ca0 tx=0x7f7f6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 -- 172.21.15.37:0/834138043 shutdown_connections 2024-09-21T01:14:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 --2- 172.21.15.37:0/834138043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74108d20 0x7f7f7410f550 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 --2- 172.21.15.37:0/834138043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f741083d0 0x7f7f741087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 --2- 172.21.15.37:0/834138043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f74102ae0 0x7f7f74102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 -- 172.21.15.37:0/834138043 >> 172.21.15.37:0/834138043 conn(0x7f7f74079760 msgr2=0x7f7f74079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 -- 172.21.15.37:0/834138043 shutdown_connections 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.770+0000 7f7f78f51640 1 -- 172.21.15.37:0/834138043 wait complete. 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.771+0000 7f7f78f51640 1 Processor -- start 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 -- start start 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74102ae0 0x7f7f7419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f741083d0 0x7f7f7419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f74108d20 0x7f7f7419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74112990 con 0x7f7f74102ae0 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74112810 con 0x7f7f741083d0 2024-09-21T01:14:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f78f51640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74112b10 con 0x7f7f74108d20 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74102ae0 0x7f7f7419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74102ae0 0x7f7f7419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53102/0 (socket says 172.21.15.37:53102) 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 -- 172.21.15.37:0/2582386775 learned_addr learned my addr 172.21.15.37:0/2582386775 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f72d9d640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f74108d20 0x7f7f7419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f71d9b640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f741083d0 0x7f7f7419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 -- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f74108d20 msgr2=0x7f7f7419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f74108d20 0x7f7f7419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 -- 172.21.15.37:0/2582386775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f741083d0 msgr2=0x7f7f7419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f741083d0 0x7f7f7419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 -- 172.21.15.37:0/2582386775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f741a0400 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f71d9b640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f741083d0 0x7f7f7419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f72d9d640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f74108d20 0x7f7f7419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.772+0000 7f7f7259c640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74102ae0 0x7f7f7419a490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c970 tx=0x7f7f6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.773+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64007bb0 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.773+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f64007d50 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.773+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400f450 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.773+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f741a06f0 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.773+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f741a6e50 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.773+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f74063b10 con 0x7f7f74102ae0 2024-09-21T01:14:46.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.775+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7f64004ee0 con 0x7f7f74102ae0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.776+0000 7f7f637fe640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7f5c0b6620 0x7f7f5c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.776+0000 7f7f71d9b640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7f5c0b6620 0x7f7f5c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.776+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7f640e76f0 con 0x7f7f74102ae0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.776+0000 7f7f637fe640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] conn(0x7f7f5c0c0190 0x7f7f5c0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.776+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 --> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f64012ec0 con 0x7f7f5c0c0190 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.776+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f7f640e7b20 con 0x7f7f74102ae0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.777+0000 7f7f72d9d640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] conn(0x7f7f5c0c0190 0x7f7f5c0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.777+0000 7f7f71d9b640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7f5c0b6620 0x7f7f5c0b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005fd0 tx=0x7f7f680094d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.777+0000 7f7f72d9d640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] conn(0x7f7f5c0c0190 0x7f7f5c0c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.778+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== osd.2 v2:172.21.15.144:6800/4236488029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f64012ec0 con 0x7f7f5c0c0190 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.792+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 --> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f74063f10 con 0x7f7f5c0c0190 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.792+0000 7f7f637fe640 1 -- 172.21.15.37:0/2582386775 <== osd.2 v2:172.21.15.144:6800/4236488029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f74063f10 con 0x7f7f5c0c0190 2024-09-21T01:14:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] conn(0x7f7f5c0c0190 msgr2=0x7f7f5c0c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] conn(0x7f7f5c0c0190 0x7f7f5c0c2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7f5c0b6620 msgr2=0x7f7f5c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7f5c0b6620 0x7f7f5c0b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005fd0 tx=0x7f7f680094d0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74102ae0 msgr2=0x7f7f7419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 --2- 172.21.15.37:0/2582386775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f74102ae0 0x7f7f7419a490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c970 tx=0x7f7f6400ce30 comp rx=0 tx=0).stop 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f72d9d640 1 -- 172.21.15.37:0/2582386775 reap_dead start 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 shutdown_connections 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 >> 172.21.15.37:0/2582386775 conn(0x7f7f74079760 msgr2=0x7f7f74101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 shutdown_connections 2024-09-21T01:14:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:43.793+0000 7f7f78f51640 1 -- 172.21.15.37:0/2582386775 wait complete. 2024-09-21T01:14:46.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:46 smithi037 ceph-mon[31105]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-21T01:14:46.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:46 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 -- 172.21.15.37:0/1851179691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 msgr2=0x7ff6cc109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 --2- 172.21.15.37:0/1851179691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc109900 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009900 tx=0x7ff6c002a410 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 -- 172.21.15.37:0/1851179691 shutdown_connections 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 --2- 172.21.15.37:0/1851179691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc109e40 0x7ff6cc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 --2- 172.21.15.37:0/1851179691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc109900 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 --2- 172.21.15.37:0/1851179691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6cc103bb0 0x7ff6cc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.718+0000 7ff6d2554640 1 -- 172.21.15.37:0/1851179691 >> 172.21.15.37:0/1851179691 conn(0x7ff6cc0ff600 msgr2=0x7ff6cc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.719+0000 7ff6d2554640 1 -- 172.21.15.37:0/1851179691 shutdown_connections 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.719+0000 7ff6d2554640 1 -- 172.21.15.37:0/1851179691 wait complete. 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.719+0000 7ff6d2554640 1 Processor -- start 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.719+0000 7ff6d2554640 1 -- start start 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d2554640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc103bb0 0x7ff6cc19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d2554640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d2554640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6cc109e40 0x7ff6cc19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d2554640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc113b00 con 0x7ff6cc1094f0 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d2554640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc113980 con 0x7ff6cc109e40 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d2554640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6cc113c80 con 0x7ff6cc103bb0 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc103bb0 0x7ff6cc19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46330/0 (socket says 172.21.15.37:46330) 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 -- 172.21.15.37:0/2749815323 learned_addr learned my addr 172.21.15.37:0/2749815323 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6d0af1640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6cc109e40 0x7ff6cc19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 -- 172.21.15.37:0/2749815323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc103bb0 msgr2=0x7ff6cc19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc103bb0 0x7ff6cc19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 -- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6cc109e40 msgr2=0x7ff6cc19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6cc109e40 0x7ff6cc19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 -- 172.21.15.37:0/2749815323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6cc1a0460 con 0x7ff6cc1094f0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.720+0000 7ff6cb7fe640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc19aa90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6c002a930 tx=0x7ff6c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.721+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c003f030 con 0x7ff6cc1094f0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.721+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6cc1a06f0 con 0x7ff6cc1094f0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.721+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6c0003aa0 con 0x7ff6cc1094f0 2024-09-21T01:14:46.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.721+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0035070 con 0x7ff6cc1094f0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.721+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6cc1a6eb0 con 0x7ff6cc1094f0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.722+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6cc063b50 con 0x7ff6cc1094f0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.724+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff6c0042030 con 0x7ff6cc1094f0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.724+0000 7ff6c97fa640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6b40b65a0 0x7ff6b40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6cbfff640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6b40b65a0 0x7ff6b40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff6c0107f60 con 0x7ff6cc1094f0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6c97fa640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] conn(0x7ff6b40c0110 0x7ff6b40c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 --> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6c0009080 con 0x7ff6b40c0110 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff6c0108390 con 0x7ff6cc1094f0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6d0af1640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] conn(0x7ff6b40c0110 0x7ff6b40c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6cbfff640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6b40b65a0 0x7ff6b40b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00bbe0 tx=0x7ff6bc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.725+0000 7ff6d0af1640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] conn(0x7ff6b40c0110 0x7ff6b40c2600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.727+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== osd.7 v2:172.21.15.137:6816/1960224257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6c0009080 con 0x7ff6b40c0110 2024-09-21T01:14:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.740+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 --> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6cc063f80 con 0x7ff6b40c0110 2024-09-21T01:14:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6c97fa640 1 -- 172.21.15.37:0/2749815323 <== osd.7 v2:172.21.15.137:6816/1960224257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff6cc063f80 con 0x7ff6b40c0110 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] conn(0x7ff6b40c0110 msgr2=0x7ff6b40c2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] conn(0x7ff6b40c0110 0x7ff6b40c2600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6b40b65a0 msgr2=0x7ff6b40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6b40b65a0 0x7ff6b40b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00bbe0 tx=0x7ff6bc00b390 comp rx=0 tx=0).stop 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 msgr2=0x7ff6cc19aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 --2- 172.21.15.37:0/2749815323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc1094f0 0x7ff6cc19aa90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6c002a930 tx=0x7ff6c0004270 comp rx=0 tx=0).stop 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d0af1640 1 -- 172.21.15.37:0/2749815323 reap_dead start 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 shutdown_connections 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 >> 172.21.15.37:0/2749815323 conn(0x7ff6cc0ff600 msgr2=0x7ff6cc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 shutdown_connections 2024-09-21T01:14:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:46.741+0000 7ff6d2554640 1 -- 172.21.15.37:0/2749815323 wait complete. 2024-09-21T01:14:46.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:46 smithi137 ceph-mon[34607]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-21T01:14:46.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:46 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:14:46.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:46 smithi144 ceph-mon[34818]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-21T01:14:46.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:46 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:14:47.512 INFO:teuthology.orchestra.run.smithi037.stdout:219043332135 2024-09-21T01:14:47.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T01:14:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 -- 172.21.15.37:0/1082358382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4441083a0 msgr2=0x7fa4441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:47.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 --2- 172.21.15.37:0/1082358382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4441083a0 0x7fa4441087b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa438009860 tx=0x7fa43802a340 comp rx=0 tx=0).stop 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 -- 172.21.15.37:0/1082358382 shutdown_connections 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 --2- 172.21.15.37:0/1082358382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444108cf0 0x7fa44410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 --2- 172.21.15.37:0/1082358382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4441083a0 0x7fa4441087b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 --2- 172.21.15.37:0/1082358382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa444102a60 0x7fa444102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 -- 172.21.15.37:0/1082358382 >> 172.21.15.37:0/1082358382 conn(0x7fa444079730 msgr2=0x7fa444079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 -- 172.21.15.37:0/1082358382 shutdown_connections 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.707+0000 7fa449b6c640 1 -- 172.21.15.37:0/1082358382 wait complete. 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.708+0000 7fa449b6c640 1 Processor -- start 2024-09-21T01:14:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.708+0000 7fa449b6c640 1 -- start start 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa449b6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444102a60 0x7fa4440ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa449b6c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4441083a0 0x7fa4440ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa449b6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa444108cf0 0x7fa4441000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa449b6c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa444112960 con 0x7fa444102a60 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa449b6c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441127e0 con 0x7fa444108cf0 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa449b6c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa444112ae0 con 0x7fa4441083a0 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444102a60 0x7fa4440ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444102a60 0x7fa4440ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46348/0 (socket says 172.21.15.37:46348) 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 -- 172.21.15.37:0/3455954083 learned_addr learned my addr 172.21.15.37:0/3455954083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa443fff640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa444108cf0 0x7fa4441000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa442ffd640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4441083a0 0x7fa4440ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 -- 172.21.15.37:0/3455954083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4441083a0 msgr2=0x7fa4440ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4441083a0 0x7fa4440ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 -- 172.21.15.37:0/3455954083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa444108cf0 msgr2=0x7fa4441000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa444108cf0 0x7fa4441000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 -- 172.21.15.37:0/3455954083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4441a8780 con 0x7fa444102a60 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa443fff640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa444108cf0 0x7fa4441000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.709+0000 7fa4437fe640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444102a60 0x7fa4440ff670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa43400ea60 tx=0x7fa43400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.710+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43400cde0 con 0x7fa444102a60 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.710+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4441a8a70 con 0x7fa444102a60 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.710+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4340035f0 con 0x7fa444102a60 2024-09-21T01:14:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.710+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434010690 con 0x7fa444102a60 2024-09-21T01:14:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.710+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44419a3a0 con 0x7fa444102a60 2024-09-21T01:14:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.711+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa444063b50 con 0x7fa444102a60 2024-09-21T01:14:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.713+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa4340037a0 con 0x7fa444102a60 2024-09-21T01:14:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.714+0000 7fa440ff9640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b6620 0x7fa42c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.714+0000 7fa442ffd640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b6620 0x7fa42c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.714+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4340e7df0 con 0x7fa444102a60 2024-09-21T01:14:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.715+0000 7fa440ff9640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] conn(0x7fa42c0c0190 0x7fa42c0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.715+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 --> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa43400be50 con 0x7fa42c0c0190 2024-09-21T01:14:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.715+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa4340e81e0 con 0x7fa444102a60 2024-09-21T01:14:47.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.715+0000 7fa443fff640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] conn(0x7fa42c0c0190 0x7fa42c0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:47.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.715+0000 7fa442ffd640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b6620 0x7fa42c0b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4380303f0 tx=0x7fa438030340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:47.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.715+0000 7fa443fff640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] conn(0x7fa42c0c0190 0x7fa42c0c2680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:47.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.716+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== osd.9 v2:172.21.15.37:6826/3861420573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa43400be50 con 0x7fa42c0c0190 2024-09-21T01:14:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.733+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 --> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa444063fd0 con 0x7fa42c0c0190 2024-09-21T01:14:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.734+0000 7fa440ff9640 1 -- 172.21.15.37:0/3455954083 <== osd.9 v2:172.21.15.37:6826/3861420573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa444063fd0 con 0x7fa42c0c0190 2024-09-21T01:14:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.734+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] conn(0x7fa42c0c0190 msgr2=0x7fa42c0c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.734+0000 7fa449b6c640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] conn(0x7fa42c0c0190 0x7fa42c0c2680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b6620 msgr2=0x7fa42c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b6620 0x7fa42c0b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4380303f0 tx=0x7fa438030340 comp rx=0 tx=0).stop 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444102a60 msgr2=0x7fa4440ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 --2- 172.21.15.37:0/3455954083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa444102a60 0x7fa4440ff670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa43400ea60 tx=0x7fa43400ef20 comp rx=0 tx=0).stop 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa443fff640 1 -- 172.21.15.37:0/3455954083 reap_dead start 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 shutdown_connections 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 >> 172.21.15.37:0/3455954083 conn(0x7fa444079730 msgr2=0x7fa44406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 shutdown_connections 2024-09-21T01:14:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:47.735+0000 7fa449b6c640 1 -- 172.21.15.37:0/3455954083 wait complete. 2024-09-21T01:14:47.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:47.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:47.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:47 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:47 smithi037 ceph-mon[31105]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 -- 172.21.15.37:0/1019766344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894108d20 msgr2=0x7f189410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 --2- 172.21.15.37:0/1019766344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894108d20 0x7f189410f550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f188c009ca0 tx=0x7f188c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 -- 172.21.15.37:0/1019766344 shutdown_connections 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 --2- 172.21.15.37:0/1019766344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894108d20 0x7f189410f550 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 --2- 172.21.15.37:0/1019766344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18941083d0 0x7f18941087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 --2- 172.21.15.37:0/1019766344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1894102ae0 0x7f1894102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 -- 172.21.15.37:0/1019766344 >> 172.21.15.37:0/1019766344 conn(0x7f1894079760 msgr2=0x7f1894079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 -- 172.21.15.37:0/1019766344 shutdown_connections 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.021+0000 7f189a79e640 1 -- 172.21.15.37:0/1019766344 wait complete. 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 Processor -- start 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 -- start start 2024-09-21T01:14:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894102ae0 0x7f189419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18941083d0 0x7f189419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1894108d20 0x7f189419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18941129e0 con 0x7f1894102ae0 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1894112860 con 0x7f1894108d20 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f189a79e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1894112b60 con 0x7f18941083d0 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f1893fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894102ae0 0x7f189419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f1893fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894102ae0 0x7f189419b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46360/0 (socket says 172.21.15.37:46360) 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f1893fff640 1 -- 172.21.15.37:0/2884707441 learned_addr learned my addr 172.21.15.37:0/2884707441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.022+0000 7f18937fe640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18941083d0 0x7f189419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1893fff640 1 -- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18941083d0 msgr2=0x7f189419b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1893fff640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18941083d0 0x7f189419b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1898d3b640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1894108d20 0x7f189419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1893fff640 1 -- 172.21.15.37:0/2884707441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1894108d20 msgr2=0x7f189419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1893fff640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1894108d20 0x7f189419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1893fff640 1 -- 172.21.15.37:0/2884707441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18941a64b0 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1898d3b640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1894108d20 0x7f189419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f1893fff640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894102ae0 0x7f189419b1f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f188400c890 tx=0x7f188400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884004220 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18840043c0 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18941a67a0 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884004a00 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.023+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941a6d30 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.024+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1894063b50 con 0x7f1894102ae0 2024-09-21T01:14:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.026+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f18840079b0 con 0x7f1894102ae0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18917fa640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f187c0b6620 0x7f187c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18937fe640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f187c0b6620 0x7f187c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f18840e7830 con 0x7f1894102ae0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18917fa640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] conn(0x7f187c0c0190 0x7f187c0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 --> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1884012ec0 con 0x7f187c0c0190 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f18840e7be0 con 0x7f1894102ae0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f18937fe640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f187c0b6620 0x7f187c0b8b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1888005fd0 tx=0x7f1888005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.027+0000 7f1898d3b640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] conn(0x7f187c0c0190 0x7f187c0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.028+0000 7f1898d3b640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] conn(0x7f187c0c0190 0x7f187c0c2680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.029+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== osd.5 v2:172.21.15.144:6808/2563342587 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1884012ec0 con 0x7f187c0c0190 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.042+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 --> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1894063f80 con 0x7f187c0c0190 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f18917fa640 1 -- 172.21.15.37:0/2884707441 <== osd.5 v2:172.21.15.144:6808/2563342587 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1894063f80 con 0x7f187c0c0190 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] conn(0x7f187c0c0190 msgr2=0x7f187c0c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] conn(0x7f187c0c0190 0x7f187c0c2680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f187c0b6620 msgr2=0x7f187c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f187c0b6620 0x7f187c0b8b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1888005fd0 tx=0x7f1888005850 comp rx=0 tx=0).stop 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894102ae0 msgr2=0x7f189419b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 --2- 172.21.15.37:0/2884707441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894102ae0 0x7f189419b1f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f188400c890 tx=0x7f188400cd50 comp rx=0 tx=0).stop 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f1898d3b640 1 -- 172.21.15.37:0/2884707441 reap_dead start 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 shutdown_connections 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 >> 172.21.15.37:0/2884707441 conn(0x7f1894079760 msgr2=0x7f1894104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 shutdown_connections 2024-09-21T01:14:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:48.043+0000 7f189a79e640 1 -- 172.21.15.37:0/2884707441 wait complete. 2024-09-21T01:14:48.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:47 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:47 smithi137 ceph-mon[34607]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:47 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:14:48.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:47 smithi144 ceph-mon[34818]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:14:48.606 INFO:teuthology.orchestra.run.smithi037.stdout:77309411399 2024-09-21T01:14:48.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T01:14:49.352 INFO:teuthology.orchestra.run.smithi037.stdout:244813135907 2024-09-21T01:14:49.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T01:14:49.777 INFO:teuthology.orchestra.run.smithi037.stdout:150323855415 2024-09-21T01:14:49.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T01:14:50.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:49 smithi137 ceph-mon[34607]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:14:50.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:49 smithi144 ceph-mon[34818]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:14:50.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:49 smithi037 ceph-mon[31105]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:14:50.636 INFO:teuthology.orchestra.run.smithi037.stdout:34359738449 2024-09-21T01:14:50.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 -- 172.21.15.37:0/2140668157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec102f20 msgr2=0x7f3fec103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 --2- 172.21.15.37:0/2140668157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec102f20 0x7f3fec103330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009900 tx=0x7f3fe802a410 comp rx=0 tx=0).stop 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 -- 172.21.15.37:0/2140668157 shutdown_connections 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 --2- 172.21.15.37:0/2140668157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fec1058f0 0x7f3fec10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 --2- 172.21.15.37:0/2140668157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fec104fa0 0x7f3fec1053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 --2- 172.21.15.37:0/2140668157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec102f20 0x7f3fec103330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 -- 172.21.15.37:0/2140668157 >> 172.21.15.37:0/2140668157 conn(0x7f3fec077aa0 msgr2=0x7f3fec077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 -- 172.21.15.37:0/2140668157 shutdown_connections 2024-09-21T01:14:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.861+0000 7f3ff299f640 1 -- 172.21.15.37:0/2140668157 wait complete. 2024-09-21T01:14:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.862+0000 7f3ff299f640 1 Processor -- start 2024-09-21T01:14:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.862+0000 7f3ff299f640 1 -- start start 2024-09-21T01:14:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff299f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fec102f20 0x7f3fec19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff299f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec104fa0 0x7f3fec19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff299f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fec1058f0 0x7f3fec19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff299f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec1127c0 con 0x7f3fec104fa0 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff299f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec112640 con 0x7f3fec1058f0 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff299f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec112940 con 0x7f3fec102f20 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec104fa0 0x7f3fec19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec104fa0 0x7f3fec19a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46388/0 (socket says 172.21.15.37:46388) 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 -- 172.21.15.37:0/3484910757 learned_addr learned my addr 172.21.15.37:0/3484910757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff199d640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fec102f20 0x7f3fec19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff219e640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fec1058f0 0x7f3fec19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 -- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fec102f20 msgr2=0x7f3fec19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fec102f20 0x7f3fec19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 -- 172.21.15.37:0/3484910757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fec1058f0 msgr2=0x7f3fec19fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fec1058f0 0x7f3fec19fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff119c640 1 -- 172.21.15.37:0/3484910757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec1a0190 con 0x7f3fec104fa0 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff219e640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fec1058f0 0x7f3fec19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.863+0000 7f3ff199d640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fec102f20 0x7f3fec19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.864+0000 7f3ff119c640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec104fa0 0x7f3fec19a880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00d740 tx=0x7f3fdc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.864+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc017070 con 0x7f3fec104fa0 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.864+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fec1a0480 con 0x7f3fec104fa0 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.864+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fdc00de50 con 0x7f3fec104fa0 2024-09-21T01:14:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.864+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00f620 con 0x7f3fec104fa0 2024-09-21T01:14:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.864+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fec1a6ca0 con 0x7f3fec104fa0 2024-09-21T01:14:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.865+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fec063ad0 con 0x7f3fec104fa0 2024-09-21T01:14:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.868+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3fdc01a070 con 0x7f3fec104fa0 2024-09-21T01:14:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.868+0000 7f3fe2ffd640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3fd80b6650 0x7f3fd80b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.868+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3fdc0e7280 con 0x7f3fec104fa0 2024-09-21T01:14:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.869+0000 7f3fe2ffd640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] conn(0x7f3fd80c01c0 0x7f3fd80c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.869+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 --> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fdc016ec0 con 0x7f3fd80c01c0 2024-09-21T01:14:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.869+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f3fdc0e76b0 con 0x7f3fec104fa0 2024-09-21T01:14:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.869+0000 7f3ff199d640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3fd80b6650 0x7f3fd80b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.869+0000 7f3ff219e640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] conn(0x7f3fd80c01c0 0x7f3fd80c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.869+0000 7f3ff199d640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3fd80b6650 0x7f3fd80b8b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000c00 tx=0x7f3fe8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.870+0000 7f3ff219e640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] conn(0x7f3fd80c01c0 0x7f3fd80c26b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.871+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== osd.11 v2:172.21.15.144:6824/679956163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3fdc016ec0 con 0x7f3fd80c01c0 2024-09-21T01:14:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.885+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 --> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fec063ed0 con 0x7f3fd80c01c0 2024-09-21T01:14:50.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.886+0000 7f3fe2ffd640 1 -- 172.21.15.37:0/3484910757 <== osd.11 v2:172.21.15.144:6824/679956163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3fec063ed0 con 0x7f3fd80c01c0 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.886+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] conn(0x7f3fd80c01c0 msgr2=0x7f3fd80c26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.886+0000 7f3ff299f640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] conn(0x7f3fd80c01c0 0x7f3fd80c26b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.886+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3fd80b6650 msgr2=0x7f3fd80b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.886+0000 7f3ff299f640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3fd80b6650 0x7f3fd80b8b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8000c00 tx=0x7f3fe8005a20 comp rx=0 tx=0).stop 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.886+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec104fa0 msgr2=0x7f3fec19a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.887+0000 7f3ff299f640 1 --2- 172.21.15.37:0/3484910757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fec104fa0 0x7f3fec19a880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00d740 tx=0x7f3fdc00dc00 comp rx=0 tx=0).stop 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.887+0000 7f3ff219e640 1 -- 172.21.15.37:0/3484910757 reap_dead start 2024-09-21T01:14:50.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.887+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 shutdown_connections 2024-09-21T01:14:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.887+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 >> 172.21.15.37:0/3484910757 conn(0x7f3fec077aa0 msgr2=0x7f3fec101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.887+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 shutdown_connections 2024-09-21T01:14:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:50.887+0000 7f3ff299f640 1 -- 172.21.15.37:0/3484910757 wait complete. 2024-09-21T01:14:51.356 INFO:teuthology.orchestra.run.smithi037.stdout:197568495661 2024-09-21T01:14:51.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T01:14:52.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:51 smithi037 ceph-mon[31105]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:14:52.043 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:52.094 INFO:teuthology.orchestra.run.smithi037.stdout:176093659186 2024-09-21T01:14:52.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T01:14:52.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:51 smithi137 ceph-mon[34607]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:14:52.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:51 smithi144 ceph-mon[34818]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:14:52.513 INFO:teuthology.orchestra.run.smithi037.stdout:292057776154 2024-09-21T01:14:52.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T01:14:52.577 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:52.579 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:52.580 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:52.580 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:52.580 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:53.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:53 smithi037 ceph-mon[31105]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/1515390321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102f30 msgr2=0x7fbc8410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/1515390321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102f30 0x7fbc8410fc50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009900 tx=0x7fbc7402a480 comp rx=0 tx=0).stop 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/1515390321 shutdown_connections 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/1515390321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc84110190 0x7fbc841125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/1515390321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102f30 0x7fbc8410fc50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/1515390321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc841025e0 0x7fbc841029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.929+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/1515390321 >> 172.21.15.37:0/1515390321 conn(0x7fbc84079710 msgr2=0x7fbc84079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.930+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/1515390321 shutdown_connections 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.930+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/1515390321 wait complete. 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.930+0000 7fbc8b8c6640 1 Processor -- start 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.930+0000 7fbc8b8c6640 1 -- start start 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc841025e0 0x7fbc8419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc84102f30 0x7fbc8419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 0x7fbc841a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84115c80 con 0x7fbc84110190 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84115b00 con 0x7fbc84102f30 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84115e00 con 0x7fbc841025e0 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 0x7fbc841a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 0x7fbc841a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46408/0 (socket says 172.21.15.37:46408) 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 -- 172.21.15.37:0/894126292 learned_addr learned my addr 172.21.15.37:0/894126292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc88e61640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc84102f30 0x7fbc8419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89662640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc841025e0 0x7fbc8419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 -- 172.21.15.37:0/894126292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc841025e0 msgr2=0x7fbc8419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc841025e0 0x7fbc8419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 -- 172.21.15.37:0/894126292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc84102f30 msgr2=0x7fbc8419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc84102f30 0x7fbc8419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 -- 172.21.15.37:0/894126292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc841a2620 con 0x7fbc84110190 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc88e61640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc84102f30 0x7fbc8419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc89e63640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 0x7fbc841a1ef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00eb10 tx=0x7fbc7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c004b20 con 0x7fbc84110190 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc7c004cc0 con 0x7fbc84110190 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c010670 con 0x7fbc84110190 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.931+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc841a2910 con 0x7fbc84110190 2024-09-21T01:14:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.932+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc841a9070 con 0x7fbc84110190 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.932+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8406c260 con 0x7fbc84110190 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.934+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbc7c005000 con 0x7fbc84110190 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.935+0000 7fbc7a7fc640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbc700b65a0 0x7fbc700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.935+0000 7fbc89662640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbc700b65a0 0x7fbc700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.935+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbc7c0e7ce0 con 0x7fbc84110190 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.935+0000 7fbc89662640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbc700b65a0 0x7fbc700b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009aa0 tx=0x7fbc80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:53.938+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc7c056710 con 0x7fbc84110190 2024-09-21T01:14:54.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.132+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fbc841029f0 con 0x7fbc84110190 2024-09-21T01:14:54.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.132+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/894126292 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbc841029f0 con 0x7fbc84110190 2024-09-21T01:14:54.132 INFO:teuthology.orchestra.run.smithi037.stdout:219043332137 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbc700b65a0 msgr2=0x7fbc700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbc700b65a0 0x7fbc700b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009aa0 tx=0x7fbc80005f90 comp rx=0 tx=0).stop 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 msgr2=0x7fbc841a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 0x7fbc841a1ef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00eb10 tx=0x7fbc7c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 shutdown_connections 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbc700b65a0 0x7fbc700b8ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84110190 0x7fbc841a1ef0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc84102f30 0x7fbc8419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 --2- 172.21.15.37:0/894126292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc841025e0 0x7fbc8419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.134+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 >> 172.21.15.37:0/894126292 conn(0x7fbc84079710 msgr2=0x7fbc84109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.135+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 shutdown_connections 2024-09-21T01:14:54.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.135+0000 7fbc8b8c6640 1 -- 172.21.15.37:0/894126292 wait complete. 2024-09-21T01:14:54.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 -- 172.21.15.37:0/2533709333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 msgr2=0x7fc744104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 --2- 172.21.15.37:0/2533709333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc744104dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc734009ca0 tx=0x7fc73402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 -- 172.21.15.37:0/2533709333 shutdown_connections 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 --2- 172.21.15.37:0/2533709333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74410de20 0x7fc744110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 --2- 172.21.15.37:0/2533709333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744105310 0x7fc74410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 --2- 172.21.15.37:0/2533709333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc744104dd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 -- 172.21.15.37:0/2533709333 >> 172.21.15.37:0/2533709333 conn(0x7fc744079710 msgr2=0x7fc744079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 -- 172.21.15.37:0/2533709333 shutdown_connections 2024-09-21T01:14:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.295+0000 7fc749542640 1 -- 172.21.15.37:0/2533709333 wait complete. 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 Processor -- start 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 -- start start 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc74419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744105310 0x7fc74419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74410de20 0x7fc74419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc744113a80 con 0x7fc7441049c0 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc744113900 con 0x7fc744105310 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc749542640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc744113c00 con 0x7fc74410de20 2024-09-21T01:14:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc742ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc74419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc742ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc74419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46412/0 (socket says 172.21.15.37:46412) 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc742ffd640 1 -- 172.21.15.37:0/1381286763 learned_addr learned my addr 172.21.15.37:0/1381286763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc7427fc640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744105310 0x7fc74419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.296+0000 7fc7437fe640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74410de20 0x7fc74419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc742ffd640 1 -- 172.21.15.37:0/1381286763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74410de20 msgr2=0x7fc74419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc742ffd640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74410de20 0x7fc74419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc742ffd640 1 -- 172.21.15.37:0/1381286763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744105310 msgr2=0x7fc74419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc742ffd640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744105310 0x7fc74419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc742ffd640 1 -- 172.21.15.37:0/1381286763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7441a0420 con 0x7fc7441049c0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc742ffd640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc74419a570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc73402ade0 tx=0x7fc734031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc734003b70 con 0x7fc7441049c0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7441a06b0 con 0x7fc7441049c0 2024-09-21T01:14:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc734003d10 con 0x7fc7441049c0 2024-09-21T01:14:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73402fa50 con 0x7fc7441049c0 2024-09-21T01:14:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.297+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7441a0bf0 con 0x7fc7441049c0 2024-09-21T01:14:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.298+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74406c280 con 0x7fc7441049c0 2024-09-21T01:14:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.301+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc734004580 con 0x7fc7441049c0 2024-09-21T01:14:54.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.301+0000 7fc72bfff640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc72c0b65d0 0x7fc72c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.302+0000 7fc7427fc640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc72c0b65d0 0x7fc72c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.302+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc734108850 con 0x7fc7441049c0 2024-09-21T01:14:54.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.302+0000 7fc7427fc640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc72c0b65d0 0x7fc72c0b8ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc74410fcd0 tx=0x7fc738005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.305+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7340cef80 con 0x7fc7441049c0 2024-09-21T01:14:54.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:53 smithi137 ceph-mon[34607]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:14:54.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:53 smithi144 ceph-mon[34818]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 -- 172.21.15.37:0/983821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc068102a60 msgr2=0x7fc068102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 --2- 172.21.15.37:0/983821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc068102a60 0x7fc068102e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc064009900 tx=0x7fc06402a410 comp rx=0 tx=0).stop 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 -- 172.21.15.37:0/983821292 shutdown_connections 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 --2- 172.21.15.37:0/983821292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068108cf0 0x7fc06810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 --2- 172.21.15.37:0/983821292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0681083a0 0x7fc0681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 --2- 172.21.15.37:0/983821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc068102a60 0x7fc068102e70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 -- 172.21.15.37:0/983821292 >> 172.21.15.37:0/983821292 conn(0x7fc068079730 msgr2=0x7fc068079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 -- 172.21.15.37:0/983821292 shutdown_connections 2024-09-21T01:14:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.480+0000 7fc06f55e640 1 -- 172.21.15.37:0/983821292 wait complete. 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 Processor -- start 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 -- start start 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 0x7fc06819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0681083a0 0x7fc06819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068108cf0 0x7fc06819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc068112960 con 0x7fc0681083a0 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681127e0 con 0x7fc068102a60 2024-09-21T01:14:54.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.481+0000 7fc06f55e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc068112ae0 con 0x7fc068108cf0 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 0x7fc06819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06caf9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0681083a0 0x7fc06819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 0x7fc06819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:38534/0 (socket says 172.21.15.37:38534) 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 -- 172.21.15.37:0/3844772984 learned_addr learned my addr 172.21.15.37:0/3844772984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06dafb640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068108cf0 0x7fc06819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 -- 172.21.15.37:0/3844772984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068108cf0 msgr2=0x7fc06819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068108cf0 0x7fc06819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 -- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0681083a0 msgr2=0x7fc06819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0681083a0 0x7fc06819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 -- 172.21.15.37:0/3844772984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0681a03d0 con 0x7fc068102a60 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.482+0000 7fc06d2fa640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 0x7fc06819a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc064005940 tx=0x7fc064004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.483+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06403f030 con 0x7fc068102a60 2024-09-21T01:14:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.483+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc064003aa0 con 0x7fc068102a60 2024-09-21T01:14:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.483+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0681a0660 con 0x7fc068102a60 2024-09-21T01:14:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.483+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064035070 con 0x7fc068102a60 2024-09-21T01:14:54.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.483+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0681a6e20 con 0x7fc068102a60 2024-09-21T01:14:54.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.484+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc068102e70 con 0x7fc068102a60 2024-09-21T01:14:54.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.486+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc064042030 con 0x7fc068102a60 2024-09-21T01:14:54.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.486+0000 7fc05a7fc640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0540b6620 0x7fc0540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:54.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.487+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc064107e20 con 0x7fc068102a60 2024-09-21T01:14:54.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.487+0000 7fc06caf9640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0540b6620 0x7fc0540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:54.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.487+0000 7fc06caf9640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0540b6620 0x7fc0540b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc068100b70 tx=0x7fc05c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:54.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.490+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0640ce550 con 0x7fc068102a60 2024-09-21T01:14:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.504+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc74419b6a0 con 0x7fc7441049c0 2024-09-21T01:14:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.505+0000 7fc72bfff640 1 -- 172.21.15.37:0/1381286763 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7340d3360 con 0x7fc7441049c0 2024-09-21T01:14:54.506 INFO:teuthology.orchestra.run.smithi037.stdout:34359738451 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc72c0b65d0 msgr2=0x7fc72c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc72c0b65d0 0x7fc72c0b8ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc74410fcd0 tx=0x7fc738005f90 comp rx=0 tx=0).stop 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 msgr2=0x7fc74419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc74419a570 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc73402ade0 tx=0x7fc734031770 comp rx=0 tx=0).stop 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 shutdown_connections 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc72c0b65d0 0x7fc72c0b8ae0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74410de20 0x7fc74419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc744105310 0x7fc74419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.508+0000 7fc749542640 1 --2- 172.21.15.37:0/1381286763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7441049c0 0x7fc74419a570 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.509+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 >> 172.21.15.37:0/1381286763 conn(0x7fc744079710 msgr2=0x7fc744106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.509+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 shutdown_connections 2024-09-21T01:14:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.509+0000 7fc749542640 1 -- 172.21.15.37:0/1381286763 wait complete. 2024-09-21T01:14:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.693+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc06819b590 con 0x7fc068102a60 2024-09-21T01:14:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.694+0000 7fc05a7fc640 1 -- 172.21.15.37:0/3844772984 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc06819b590 con 0x7fc068102a60 2024-09-21T01:14:54.695 INFO:teuthology.orchestra.run.smithi037.stdout:197568495663 2024-09-21T01:14:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0540b6620 msgr2=0x7fc0540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0540b6620 0x7fc0540b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc068100b70 tx=0x7fc05c005f90 comp rx=0 tx=0).stop 2024-09-21T01:14:54.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 msgr2=0x7fc06819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 0x7fc06819a460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc064005940 tx=0x7fc064004270 comp rx=0 tx=0).stop 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 shutdown_connections 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0540b6620 0x7fc0540b8b30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068108cf0 0x7fc06819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0681083a0 0x7fc06819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 --2- 172.21.15.37:0/3844772984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc068102a60 0x7fc06819a460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 >> 172.21.15.37:0/3844772984 conn(0x7fc068079730 msgr2=0x7fc068101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 shutdown_connections 2024-09-21T01:14:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:54.697+0000 7fc06f55e640 1 -- 172.21.15.37:0/3844772984 wait complete. 2024-09-21T01:14:55.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 -- 172.21.15.37:0/527846324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268108730 msgr2=0x7fc268108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 --2- 172.21.15.37:0/527846324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268108730 0x7fc268108b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc258009930 tx=0x7fc25802a420 comp rx=0 tx=0).stop 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 -- 172.21.15.37:0/527846324 shutdown_connections 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 --2- 172.21.15.37:0/527846324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc268102770 0x7fc2681105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 --2- 172.21.15.37:0/527846324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc268101e20 0x7fc268102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 --2- 172.21.15.37:0/527846324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268108730 0x7fc268108b40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 -- 172.21.15.37:0/527846324 >> 172.21.15.37:0/527846324 conn(0x7fc268077cc0 msgr2=0x7fc268078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 -- 172.21.15.37:0/527846324 shutdown_connections 2024-09-21T01:14:55.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.054+0000 7fc26cf03640 1 -- 172.21.15.37:0/527846324 wait complete. 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 Processor -- start 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 -- start start 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 0x7fc26819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc268102770 0x7fc26819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc268108730 0x7fc26819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc268113ab0 con 0x7fc268101e20 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc268113930 con 0x7fc268108730 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26cf03640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc268113c30 con 0x7fc268102770 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 0x7fc26819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 0x7fc26819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46456/0 (socket says 172.21.15.37:46456) 2024-09-21T01:14:55.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.055+0000 7fc26659c640 1 -- 172.21.15.37:0/4064359146 learned_addr learned my addr 172.21.15.37:0/4064359146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc265d9b640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc268102770 0x7fc26819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc266d9d640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc268108730 0x7fc26819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26659c640 1 -- 172.21.15.37:0/4064359146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc268102770 msgr2=0x7fc26819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26659c640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc268102770 0x7fc26819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26659c640 1 -- 172.21.15.37:0/4064359146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc268108730 msgr2=0x7fc26819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26659c640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc268108730 0x7fc26819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26659c640 1 -- 172.21.15.37:0/4064359146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2681a0430 con 0x7fc268101e20 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26659c640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 0x7fc26819a4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc258004770 tx=0x7fc2580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25803f070 con 0x7fc268101e20 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2681a06c0 con 0x7fc268101e20 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc25803b460 con 0x7fc268101e20 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258035070 con 0x7fc268101e20 2024-09-21T01:14:55.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.056+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2681a6e80 con 0x7fc268101e20 2024-09-21T01:14:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.058+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26806b850 con 0x7fc268101e20 2024-09-21T01:14:55.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.059+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc25803b8d0 con 0x7fc268101e20 2024-09-21T01:14:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.060+0000 7fc2577fe640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc2500b65a0 0x7fc2500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.060+0000 7fc265d9b640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc2500b65a0 0x7fc2500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.060+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc258107870 con 0x7fc268101e20 2024-09-21T01:14:55.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.060+0000 7fc265d9b640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc2500b65a0 0x7fc2500b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc268101b60 tx=0x7fc25c009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:55.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.064+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2580cdfa0 con 0x7fc268101e20 2024-09-21T01:14:55.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:54 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/894126292' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:14:55.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:54 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1381286763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:14:55.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:54 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3844772984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:14:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.256+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc26810bc60 con 0x7fc268101e20 2024-09-21T01:14:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.256+0000 7fc2577fe640 1 -- 172.21.15.37:0/4064359146 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc2580d2380 con 0x7fc268101e20 2024-09-21T01:14:55.256 INFO:teuthology.orchestra.run.smithi037.stdout:266287972383 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc2500b65a0 msgr2=0x7fc2500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc2500b65a0 0x7fc2500b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc268101b60 tx=0x7fc25c009680 comp rx=0 tx=0).stop 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 msgr2=0x7fc26819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 0x7fc26819a4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc258004770 tx=0x7fc2580042f0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 shutdown_connections 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc2500b65a0 0x7fc2500b8ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc268108730 0x7fc26819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc268102770 0x7fc26819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 --2- 172.21.15.37:0/4064359146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc268101e20 0x7fc26819a4c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.258+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 >> 172.21.15.37:0/4064359146 conn(0x7fc268077cc0 msgr2=0x7fc2681053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:55.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.259+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 shutdown_connections 2024-09-21T01:14:55.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.259+0000 7fc26cf03640 1 -- 172.21.15.37:0/4064359146 wait complete. 2024-09-21T01:14:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 -- 172.21.15.37:0/2017968594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c109e10 msgr2=0x7f3b7c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 --2- 172.21.15.37:0/2017968594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c109e10 0x7f3b7c110640 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009ca0 tx=0x7f3b7402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 -- 172.21.15.37:0/2017968594 shutdown_connections 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 --2- 172.21.15.37:0/2017968594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c109e10 0x7f3b7c110640 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 --2- 172.21.15.37:0/2017968594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b7c1094c0 0x7f3b7c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 --2- 172.21.15.37:0/2017968594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c103b80 0x7f3b7c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 -- 172.21.15.37:0/2017968594 >> 172.21.15.37:0/2017968594 conn(0x7f3b7c0ff5d0 msgr2=0x7f3b7c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 -- 172.21.15.37:0/2017968594 shutdown_connections 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.386+0000 7f3b82be4640 1 -- 172.21.15.37:0/2017968594 wait complete. 2024-09-21T01:14:55.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 Processor -- start 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 -- start start 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 0x7f3b7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c1094c0 0x7f3b7c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b7c109e10 0x7f3b7c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c113ad0 con 0x7f3b7c103b80 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c113950 con 0x7f3b7c1094c0 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b82be4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c113c50 con 0x7f3b7c109e10 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.387+0000 7f3b80980640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 0x7f3b7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 0x7f3b7c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46476/0 (socket says 172.21.15.37:46476) 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 -- 172.21.15.37:0/675916970 learned_addr learned my addr 172.21.15.37:0/675916970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b81181640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b7c109e10 0x7f3b7c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c1094c0 0x7f3b7c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 -- 172.21.15.37:0/675916970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b7c109e10 msgr2=0x7f3b7c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b7c109e10 0x7f3b7c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 -- 172.21.15.37:0/675916970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c1094c0 msgr2=0x7f3b7c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c1094c0 0x7f3b7c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 -- 172.21.15.37:0/675916970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1a8720 con 0x7f3b7c103b80 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c1094c0 0x7f3b7c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b80980640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 0x7f3b7c075710 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c890 tx=0x7f3b6400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64004220 con 0x7f3b7c103b80 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b640043c0 con 0x7f3b7c103b80 2024-09-21T01:14:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c1a8a10 con 0x7f3b7c103b80 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64004a00 con 0x7f3b7c103b80 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.388+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c1a8fa0 con 0x7f3b7c103b80 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.390+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c103f90 con 0x7f3b7c103b80 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.391+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3b640079b0 con 0x7f3b7c103b80 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.392+0000 7f3b79ffb640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3b680b6620 0x7f3b680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.392+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3b680b6620 0x7f3b680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.392+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3b640e71a0 con 0x7f3b7c103b80 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.392+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3b680b6620 0x7f3b680b8b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c106e80 tx=0x7f3b6c00b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.396+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b64014030 con 0x7f3b7c103b80 2024-09-21T01:14:55.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:54 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/894126292' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:14:55.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:54 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1381286763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:14:55.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:54 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3844772984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:14:55.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/894126292' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:14:55.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1381286763' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:14:55.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:54 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3844772984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:14:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.593+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3b7c02e640 con 0x7f3b7c103b80 2024-09-21T01:14:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.593+0000 7f3b79ffb640 1 -- 172.21.15.37:0/675916970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3b640ad8d0 con 0x7f3b7c103b80 2024-09-21T01:14:55.594 INFO:teuthology.orchestra.run.smithi037.stdout:103079215170 2024-09-21T01:14:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.595+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3b680b6620 msgr2=0x7f3b680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.595+0000 7f3b82be4640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3b680b6620 0x7f3b680b8b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c106e80 tx=0x7f3b6c00b5f0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.595+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 msgr2=0x7f3b7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.595+0000 7f3b82be4640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 0x7f3b7c075710 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c890 tx=0x7f3b6400cd50 comp rx=0 tx=0).stop 2024-09-21T01:14:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 shutdown_connections 2024-09-21T01:14:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3b680b6620 0x7f3b680b8b30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b7c109e10 0x7f3b7c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b7c1094c0 0x7f3b7c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 --2- 172.21.15.37:0/675916970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c103b80 0x7f3b7c075710 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 >> 172.21.15.37:0/675916970 conn(0x7f3b7c0ff5d0 msgr2=0x7f3b7c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 shutdown_connections 2024-09-21T01:14:55.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:55.596+0000 7f3b82be4640 1 -- 172.21.15.37:0/675916970 wait complete. 2024-09-21T01:14:56.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:55 smithi037 ceph-mon[31105]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-21T01:14:56.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:55 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4064359146' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:14:56.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:55 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/675916970' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:14:56.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:55 smithi137 ceph-mon[34607]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-21T01:14:56.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:55 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/4064359146' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:14:56.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:55 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/675916970' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:14:56.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:55 smithi144 ceph-mon[34818]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-21T01:14:56.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:55 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/4064359146' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:14:56.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:55 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/675916970' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:14:57.029 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972381 got 266287972383 for osd.10 2024-09-21T01:14:57.029 DEBUG:teuthology.parallel:result is None 2024-09-21T01:14:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 -- 172.21.15.37:0/1138962970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 msgr2=0x7fbf7410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 --2- 172.21.15.37:0/1138962970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7410f540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009ca0 tx=0x7fbf6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 -- 172.21.15.37:0/1138962970 shutdown_connections 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 --2- 172.21.15.37:0/1138962970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7410f540 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 --2- 172.21.15.37:0/1138962970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf741083c0 0x7fbf741087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 --2- 172.21.15.37:0/1138962970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf74102a80 0x7fbf74102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 -- 172.21.15.37:0/1138962970 >> 172.21.15.37:0/1138962970 conn(0x7fbf74079740 msgr2=0x7fbf74079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 -- 172.21.15.37:0/1138962970 shutdown_connections 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.210+0000 7fbf78868640 1 -- 172.21.15.37:0/1138962970 wait complete. 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.211+0000 7fbf78868640 1 Processor -- start 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.211+0000 7fbf78868640 1 -- start start 2024-09-21T01:14:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf78868640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf74102a80 0x7fbf7419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf78868640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf741083c0 0x7fbf7419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf78868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf78868640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74112980 con 0x7fbf74108d10 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf78868640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74112800 con 0x7fbf741083c0 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf78868640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbf74112b00 con 0x7fbf74102a80 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36362/0 (socket says 172.21.15.37:36362) 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 -- 172.21.15.37:0/722816053 learned_addr learned my addr 172.21.15.37:0/722816053 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf7259c640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf74102a80 0x7fbf7419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf69d9b640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf741083c0 0x7fbf7419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 -- 172.21.15.37:0/722816053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf74102a80 msgr2=0x7fbf7419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf74102a80 0x7fbf7419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 -- 172.21.15.37:0/722816053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf741083c0 msgr2=0x7fbf7419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:57.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf741083c0 0x7fbf7419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 -- 172.21.15.37:0/722816053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf741a0430 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.212+0000 7fbf72d9d640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7419fd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0098d0 tx=0x7fbf6c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.213+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003b70 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.213+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741a06c0 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.213+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf6c003d10 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.213+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c02fa20 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.213+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a6e80 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.214+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74103d00 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.215+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbf6c02fbe0 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.216+0000 7fbf6bfff640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf600b65a0 0x7fbf600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.216+0000 7fbf7259c640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf600b65a0 0x7fbf600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.216+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbf6c1088c0 con 0x7fbf74108d10 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.216+0000 7fbf7259c640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf600b65a0 0x7fbf600b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009bd0 tx=0x7fbf64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.219+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf6c0ceff0 con 0x7fbf74108d10 2024-09-21T01:14:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.411+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbf7410bb40 con 0x7fbf74108d10 2024-09-21T01:14:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.411+0000 7fbf6bfff640 1 -- 172.21.15.37:0/722816053 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbf6c0d33d0 con 0x7fbf74108d10 2024-09-21T01:14:57.412 INFO:teuthology.orchestra.run.smithi037.stdout:150323855417 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.413+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf600b65a0 msgr2=0x7fbf600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.413+0000 7fbf78868640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf600b65a0 0x7fbf600b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009bd0 tx=0x7fbf64005f90 comp rx=0 tx=0).stop 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.413+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 msgr2=0x7fbf7419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.413+0000 7fbf78868640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7419fd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0098d0 tx=0x7fbf6c0317b0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 shutdown_connections 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf600b65a0 0x7fbf600b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf74108d10 0x7fbf7419fd00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf741083c0 0x7fbf7419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 --2- 172.21.15.37:0/722816053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf74102a80 0x7fbf7419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 >> 172.21.15.37:0/722816053 conn(0x7fbf74079740 msgr2=0x7fbf7406bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 shutdown_connections 2024-09-21T01:14:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:57.414+0000 7fbf78868640 1 -- 172.21.15.37:0/722816053 wait complete. 2024-09-21T01:14:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:14:57.682 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332135 got 219043332137 for osd.8 2024-09-21T01:14:57.682 DEBUG:teuthology.parallel:result is None 2024-09-21T01:14:58.079 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738451 for osd.0 2024-09-21T01:14:58.079 DEBUG:teuthology.parallel:result is None 2024-09-21T01:14:58.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:57 smithi037 ceph-mon[31105]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-21T01:14:58.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:57 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/722816053' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:14:58.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 -- 172.21.15.37:0/2107070447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715410de70 msgr2=0x7f7154110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 --2- 172.21.15.37:0/2107070447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715410de70 0x7f7154110340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f714c009ca0 tx=0x7f714c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 -- 172.21.15.37:0/2107070447 shutdown_connections 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 --2- 172.21.15.37:0/2107070447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715410de70 0x7f7154110340 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 --2- 172.21.15.37:0/2107070447 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71541052a0 0x7f715410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 --2- 172.21.15.37:0/2107070447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71541048c0 0x7f7154104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 -- 172.21.15.37:0/2107070447 >> 172.21.15.37:0/2107070447 conn(0x7f7154079760 msgr2=0x7f7154079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 -- 172.21.15.37:0/2107070447 shutdown_connections 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.269+0000 7f715b48a640 1 -- 172.21.15.37:0/2107070447 wait complete. 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 Processor -- start 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 -- start start 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71541048c0 0x7f715419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 0x7f715419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:58.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715410de70 0x7f715419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7154113ad0 con 0x7f71541052a0 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7154113950 con 0x7f71541048c0 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.270+0000 7f715b48a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7154113c50 con 0x7f715410de70 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 0x7f715419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 0x7f715419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36368/0 (socket says 172.21.15.37:36368) 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 -- 172.21.15.37:0/986630762 learned_addr learned my addr 172.21.15.37:0/986630762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7159226640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71541048c0 0x7f715419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7159a27640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715410de70 0x7f715419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 -- 172.21.15.37:0/986630762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715410de70 msgr2=0x7f715419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715410de70 0x7f715419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 -- 172.21.15.37:0/986630762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71541048c0 msgr2=0x7f715419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71541048c0 0x7f715419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 -- 172.21.15.37:0/986630762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71541a0410 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7159a27640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715410de70 0x7f715419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f7158a25640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 0x7f715419aa40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f714400d740 tx=0x7f714400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144017070 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714400de50 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541a0700 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714400f620 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.271+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a6e60 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.272+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715406c190 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.274+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f714401a070 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.275+0000 7f714a7fc640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71400b6620 0x7f71400b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.275+0000 7f7159226640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71400b6620 0x7f71400b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.275+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f71440e6d50 con 0x7f71541052a0 2024-09-21T01:14:58.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.275+0000 7f7159226640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71400b6620 0x7f71400b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7150005fd0 tx=0x7f715000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:14:58.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.278+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71440ad500 con 0x7f71541052a0 2024-09-21T01:14:58.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:57 smithi137 ceph-mon[34607]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-21T01:14:58.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:57 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/722816053' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:14:58.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:57 smithi144 ceph-mon[34818]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-21T01:14:58.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:57 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/722816053' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:14:58.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.471+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7154104cd0 con 0x7f71541052a0 2024-09-21T01:14:58.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.471+0000 7f714a7fc640 1 -- 172.21.15.37:0/986630762 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71440b18e0 con 0x7f71541052a0 2024-09-21T01:14:58.471 INFO:teuthology.orchestra.run.smithi037.stdout:55834574926 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71400b6620 msgr2=0x7f71400b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71400b6620 0x7f71400b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7150005fd0 tx=0x7f715000b390 comp rx=0 tx=0).stop 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 msgr2=0x7f715419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 0x7f715419aa40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f714400d740 tx=0x7f714400dc00 comp rx=0 tx=0).stop 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 shutdown_connections 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71400b6620 0x7f71400b8b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715410de70 0x7f715419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71541052a0 0x7f715419aa40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 --2- 172.21.15.37:0/986630762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71541048c0 0x7f715419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:14:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.473+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 >> 172.21.15.37:0/986630762 conn(0x7f7154079760 msgr2=0x7f71541006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:14:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.474+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 shutdown_connections 2024-09-21T01:14:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:14:58.474+0000 7f715b48a640 1 -- 172.21.15.37:0/986630762 wait complete. 2024-09-21T01:14:59.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:58 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/986630762' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:14:59.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:58 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/986630762' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:14:59.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:58 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/986630762' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:14:59.849 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215168 got 103079215170 for osd.3 2024-09-21T01:14:59.850 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:00.153 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:14:59 smithi037 ceph-mon[31105]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T01:15:00.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:14:59 smithi137 ceph-mon[34607]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T01:15:00.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:14:59 smithi144 ceph-mon[34818]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 -- 172.21.15.37:0/3268906613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d8105300 msgr2=0x7fe3d810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/3268906613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d8105300 0x7fe3d810d850 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009900 tx=0x7fe3c802a410 comp rx=0 tx=0).stop 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 -- 172.21.15.37:0/3268906613 shutdown_connections 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/3268906613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d810de10 0x7fe3d8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/3268906613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d8105300 0x7fe3d810d850 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/3268906613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d81049b0 0x7fe3d8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 -- 172.21.15.37:0/3268906613 >> 172.21.15.37:0/3268906613 conn(0x7fe3d8079730 msgr2=0x7fe3d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 -- 172.21.15.37:0/3268906613 shutdown_connections 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.566+0000 7fe3dfa97640 1 -- 172.21.15.37:0/3268906613 wait complete. 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 Processor -- start 2024-09-21T01:15:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 -- start start 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 0x7fe3d819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d8105300 0x7fe3d819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d810de10 0x7fe3d819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8113ac0 con 0x7fe3d81049b0 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8113940 con 0x7fe3d8105300 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dfa97640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8113c40 con 0x7fe3d810de10 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dd833640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 0x7fe3d819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dd032640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d8105300 0x7fe3d819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.567+0000 7fe3dd833640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 0x7fe3d819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36418/0 (socket says 172.21.15.37:36418) 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd833640 1 -- 172.21.15.37:0/2737019083 learned_addr learned my addr 172.21.15.37:0/2737019083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3de034640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d810de10 0x7fe3d819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd032640 1 -- 172.21.15.37:0/2737019083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d810de10 msgr2=0x7fe3d819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd032640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d810de10 0x7fe3d819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd032640 1 -- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 msgr2=0x7fe3d819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd032640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 0x7fe3d819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd032640 1 -- 172.21.15.37:0/2737019083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d81a0400 con 0x7fe3d8105300 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd833640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 0x7fe3d819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3dd032640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d8105300 0x7fe3d819aa30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009230 tx=0x7fe3c803ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.568+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8035070 con 0x7fe3d8105300 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.569+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d81a0690 con 0x7fe3d8105300 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.569+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3c8003cb0 con 0x7fe3d8105300 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.569+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8031d70 con 0x7fe3d8105300 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.569+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d81025d0 con 0x7fe3d8105300 2024-09-21T01:15:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.570+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d806b560 con 0x7fe3d8105300 2024-09-21T01:15:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.572+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe3c80314a0 con 0x7fe3d8105300 2024-09-21T01:15:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.573+0000 7fe3ceffd640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3c40b6620 0x7fe3c40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.573+0000 7fe3dd833640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3c40b6620 0x7fe3c40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.573+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe3c810b970 con 0x7fe3d8105300 2024-09-21T01:15:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.573+0000 7fe3dd833640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3c40b6620 0x7fe3c40b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40058c0 tx=0x7fe3d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.575+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3c80d2060 con 0x7fe3d8105300 2024-09-21T01:15:00.713 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574926 for osd.1 2024-09-21T01:15:00.713 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.778+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe3d8108f10 con 0x7fe3d8105300 2024-09-21T01:15:00.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.779+0000 7fe3ceffd640 1 -- 172.21.15.37:0/2737019083 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3c80d6440 con 0x7fe3d8105300 2024-09-21T01:15:00.779 INFO:teuthology.orchestra.run.smithi037.stdout:77309411402 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3c40b6620 msgr2=0x7fe3c40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3c40b6620 0x7fe3c40b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40058c0 tx=0x7fe3d4005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d8105300 msgr2=0x7fe3d819aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d8105300 0x7fe3d819aa30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009230 tx=0x7fe3c803ac10 comp rx=0 tx=0).stop 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 shutdown_connections 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe3c40b6620 0x7fe3c40b8b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d810de10 0x7fe3d819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3d8105300 0x7fe3d819aa30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 --2- 172.21.15.37:0/2737019083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d81049b0 0x7fe3d819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 >> 172.21.15.37:0/2737019083 conn(0x7fe3d8079730 msgr2=0x7fe3d8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 shutdown_connections 2024-09-21T01:15:00.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.781+0000 7fe3dfa97640 1 -- 172.21.15.37:0/2737019083 wait complete. 2024-09-21T01:15:00.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:00 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/998735735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:15:00.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:00 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2737019083' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:15:01.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:00 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/998735735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:15:01.322 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:00 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2737019083' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:15:01.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:00 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/998735735' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:15:01.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:00 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2737019083' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:15:01.572 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411402 for osd.2 2024-09-21T01:15:01.572 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:02.098 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:01 smithi037 ceph-mon[31105]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T01:15:02.126 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855415 got 150323855417 for osd.5 2024-09-21T01:15:02.126 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/3986790083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 msgr2=0x7fbbf4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/3986790083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf4110620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009900 tx=0x7fbbec02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/3986790083 shutdown_connections 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/3986790083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf4110620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/3986790083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 0x7fbbf41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/3986790083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4103b60 0x7fbbf4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/3986790083 >> 172.21.15.37:0/3986790083 conn(0x7fbbf407b850 msgr2=0x7fbbf407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.293+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/3986790083 shutdown_connections 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.294+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/3986790083 wait complete. 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.294+0000 7fbbf8b7a640 1 Processor -- start 2024-09-21T01:15:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.294+0000 7fbbf8b7a640 1 -- start start 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf8b7a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4103b60 0x7fbbf419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf8b7a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 0x7fbbf419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf8b7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf8b7a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4113ab0 con 0x7fbbf4109df0 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf8b7a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4113930 con 0x7fbbf41094a0 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf8b7a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4113c30 con 0x7fbbf4103b60 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36438/0 (socket says 172.21.15.37:36438) 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf2d9d640 1 -- 172.21.15.37:0/2409292825 learned_addr learned my addr 172.21.15.37:0/2409292825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 0x7fbbf419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf259c640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4103b60 0x7fbbf419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 -- 172.21.15.37:0/2409292825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4103b60 msgr2=0x7fbbf419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4103b60 0x7fbbf419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 -- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 msgr2=0x7fbbf419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 -- 172.21.15.37:0/2409292825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf41a0390 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf2d9d640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.295+0000 7fbbf1d9b640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 0x7fbbf419a9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbbf406c9f0 tx=0x7fbbe800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.296+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8010430 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.296+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf41a0680 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.296+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe8010a80 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.296+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8017a20 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.296+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf41a6de0 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.297+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf4103f70 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.298+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbbe8017ca0 con 0x7fbbf41094a0 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.299+0000 7fbbe37fe640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbbdc0b65a0 0x7fbbdc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.299+0000 7fbbf259c640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbbdc0b65a0 0x7fbbdc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:02.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.299+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbbe80e7ef0 con 0x7fbbf41094a0 2024-09-21T01:15:02.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.300+0000 7fbbf259c640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbbdc0b65a0 0x7fbbdc0b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005fd0 tx=0x7fbbe400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:02.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.302+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbbe80ae670 con 0x7fbbf41094a0 2024-09-21T01:15:02.321 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:01 smithi144 ceph-mon[34818]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T01:15:02.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:01 smithi137 ceph-mon[34607]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T01:15:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.491+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbbf419b550 con 0x7fbbf41094a0 2024-09-21T01:15:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.492+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2409292825 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbbf419b550 con 0x7fbbf41094a0 2024-09-21T01:15:02.492 INFO:teuthology.orchestra.run.smithi037.stdout:244813135910 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbbdc0b65a0 msgr2=0x7fbbdc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbbdc0b65a0 0x7fbbdc0b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4005fd0 tx=0x7fbbe400b390 comp rx=0 tx=0).stop 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 msgr2=0x7fbbf419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 0x7fbbf419a9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbbf406c9f0 tx=0x7fbbe800ef90 comp rx=0 tx=0).stop 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 shutdown_connections 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbbdc0b65a0 0x7fbbdc0b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf4109df0 0x7fbbf419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbbf41094a0 0x7fbbf419a9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 --2- 172.21.15.37:0/2409292825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbf4103b60 0x7fbbf419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 >> 172.21.15.37:0/2409292825 conn(0x7fbbf407b850 msgr2=0x7fbbf4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 shutdown_connections 2024-09-21T01:15:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:02.494+0000 7fbbf8b7a640 1 -- 172.21.15.37:0/2409292825 wait complete. 2024-09-21T01:15:03.233 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:02 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2409292825' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:15:03.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135907 got 244813135910 for osd.9 2024-09-21T01:15:03.263 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 -- 172.21.15.37:0/4168150049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca8109df0 msgr2=0x7f4ca8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 --2- 172.21.15.37:0/4168150049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca8109df0 0x7f4ca8110620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009ca0 tx=0x7f4ca002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 -- 172.21.15.37:0/4168150049 shutdown_connections 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 --2- 172.21.15.37:0/4168150049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca8109df0 0x7f4ca8110620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 --2- 172.21.15.37:0/4168150049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca81094a0 0x7f4ca81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 --2- 172.21.15.37:0/4168150049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca8103b60 0x7f4ca8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 -- 172.21.15.37:0/4168150049 >> 172.21.15.37:0/4168150049 conn(0x7f4ca807b850 msgr2=0x7f4ca807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 -- 172.21.15.37:0/4168150049 shutdown_connections 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.458+0000 7f4cae572640 1 -- 172.21.15.37:0/4168150049 wait complete. 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.459+0000 7f4cae572640 1 Processor -- start 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.459+0000 7f4cae572640 1 -- start start 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cae572640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca8103b60 0x7f4ca819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cae572640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 0x7f4ca819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cae572640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca8109df0 0x7f4ca819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cae572640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8113ab0 con 0x7f4ca81094a0 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cae572640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8113930 con 0x7f4ca8103b60 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cae572640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8113c30 con 0x7f4ca8109df0 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 0x7f4ca819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 0x7f4ca819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36388/0 (socket says 172.21.15.37:36388) 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 -- 172.21.15.37:0/998735735 learned_addr learned my addr 172.21.15.37:0/998735735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca7fff640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca8103b60 0x7f4ca819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cacb0f640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca8109df0 0x7f4ca819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 -- 172.21.15.37:0/998735735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca8109df0 msgr2=0x7f4ca819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca8109df0 0x7f4ca819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 -- 172.21.15.37:0/998735735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca8103b60 msgr2=0x7f4ca819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca8103b60 0x7f4ca819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 -- 172.21.15.37:0/998735735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca81a0410 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4cacb0f640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca8109df0 0x7f4ca819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.460+0000 7f4ca77fe640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 0x7f4ca819aa40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00e9c0 tx=0x7f4c9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.461+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00ccc0 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.461+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c9c0054d0 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.461+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c010430 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.461+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca81a0700 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.461+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca81a6e60 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.462+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca8103f70 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.463+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4c9c005020 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.464+0000 7f4ca57fa640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c900b6620 0x7f4c900b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.464+0000 7f4ca7fff640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c900b6620 0x7f4c900b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.464+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4c9c0e7790 con 0x7f4ca81094a0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.465+0000 7f4ca7fff640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c900b6620 0x7f4c900b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005d00 tx=0x7f4c9800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.469+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c9c0adec0 con 0x7f4ca81094a0 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.669+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4ca810b650 con 0x7f4ca81094a0 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stdout:128849018942 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.669+0000 7f4ca57fa640 1 -- 172.21.15.37:0/998735735 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4c9c0b22a0 con 0x7f4ca81094a0 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.671+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c900b6620 msgr2=0x7f4c900b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.671+0000 7f4cae572640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c900b6620 0x7f4c900b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005d00 tx=0x7f4c9800b410 comp rx=0 tx=0).stop 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.671+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 msgr2=0x7f4ca819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.671+0000 7f4cae572640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 0x7f4ca819aa40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00e9c0 tx=0x7f4c9c00ee80 comp rx=0 tx=0).stop 2024-09-21T01:15:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 shutdown_connections 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c900b6620 0x7f4c900b8b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ca8109df0 0x7f4ca819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca81094a0 0x7f4ca819aa40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 --2- 172.21.15.37:0/998735735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ca8103b60 0x7f4ca819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 >> 172.21.15.37:0/998735735 conn(0x7f4ca807b850 msgr2=0x7f4ca8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 shutdown_connections 2024-09-21T01:15:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:00.672+0000 7f4cae572640 1 -- 172.21.15.37:0/998735735 wait complete. 2024-09-21T01:15:03.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:02 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2409292825' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:15:03.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:02 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2409292825' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:15:04.020 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018938 got 128849018942 for osd.4 2024-09-21T01:15:04.020 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:04.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:03 smithi037 ceph-mon[31105]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:04.416 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:04.416 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:04.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:03 smithi137 ceph-mon[34607]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:04.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:03 smithi144 ceph-mon[34818]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:04.456 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495661 got 197568495663 for osd.7 2024-09-21T01:15:04.456 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 -- 172.21.15.37:0/3810772406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c102a60 msgr2=0x7f3d8c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 --2- 172.21.15.37:0/3810772406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c102a60 0x7f3d8c102e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009ca0 tx=0x7f3d7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 -- 172.21.15.37:0/3810772406 shutdown_connections 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 --2- 172.21.15.37:0/3810772406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 --2- 172.21.15.37:0/3810772406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 0x7f3d8c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 --2- 172.21.15.37:0/3810772406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c102a60 0x7f3d8c102e70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 -- 172.21.15.37:0/3810772406 >> 172.21.15.37:0/3810772406 conn(0x7f3d8c079730 msgr2=0x7f3d8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 -- 172.21.15.37:0/3810772406 shutdown_connections 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.131+0000 7f3d908be640 1 -- 172.21.15.37:0/3810772406 wait complete. 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.132+0000 7f3d908be640 1 Processor -- start 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.132+0000 7f3d908be640 1 -- start start 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.132+0000 7f3d908be640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d8c102a60 0x7f3d8c104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.132+0000 7f3d908be640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 0x7f3d8c104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.132+0000 7f3d908be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d908be640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c112960 con 0x7f3d8c108cf0 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d908be640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1127e0 con 0x7f3d8c1083a0 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d908be640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c112ae0 con 0x7f3d8c102a60 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36454/0 (socket says 172.21.15.37:36454) 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 -- 172.21.15.37:0/721368595 learned_addr learned my addr 172.21.15.37:0/721368595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8a59c640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d8c102a60 0x7f3d8c104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d89d9b640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 0x7f3d8c104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 -- 172.21.15.37:0/721368595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d8c102a60 msgr2=0x7f3d8c104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d8c102a60 0x7f3d8c104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 -- 172.21.15.37:0/721368595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 msgr2=0x7f3d8c104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 0x7f3d8c104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 -- 172.21.15.37:0/721368595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c1a86c0 con 0x7f3d8c108cf0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d89d9b640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 0x7f3d8c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d8ad9d640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c104cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400d750 tx=0x7f3d8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84017070 con 0x7f3d8c108cf0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c1a89b0 con 0x7f3d8c108cf0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d840054d0 con 0x7f3d8c108cf0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.133+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84004c60 con 0x7f3d8c108cf0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.134+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1a8ef0 con 0x7f3d8c108cf0 2024-09-21T01:15:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.134+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c102e70 con 0x7f3d8c108cf0 2024-09-21T01:15:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.136+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3d84009bd0 con 0x7f3d8c108cf0 2024-09-21T01:15:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.137+0000 7f3d7b7fe640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d740b65a0 0x7f3d740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.137+0000 7f3d8a59c640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d740b65a0 0x7f3d740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.137+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3d840e7200 con 0x7f3d8c108cf0 2024-09-21T01:15:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.137+0000 7f3d8a59c640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d740b65a0 0x7f3d740b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005e30 tx=0x7f3d7c009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.140+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d840ad930 con 0x7f3d8c108cf0 2024-09-21T01:15:05.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.329+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3d8c1a9280 con 0x7f3d8c108cf0 2024-09-21T01:15:05.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.330+0000 7f3d7b7fe640 1 -- 172.21.15.37:0/721368595 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3d840b1d10 con 0x7f3d8c108cf0 2024-09-21T01:15:05.330 INFO:teuthology.orchestra.run.smithi037.stdout:176093659190 2024-09-21T01:15:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d740b65a0 msgr2=0x7f3d740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d740b65a0 0x7f3d740b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005e30 tx=0x7f3d7c009360 comp rx=0 tx=0).stop 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 msgr2=0x7f3d8c104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c104cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400d750 tx=0x7f3d8400dc10 comp rx=0 tx=0).stop 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 shutdown_connections 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3d740b65a0 0x7f3d740b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d8c108cf0 0x7f3d8c104cd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d8c1083a0 0x7f3d8c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 --2- 172.21.15.37:0/721368595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d8c102a60 0x7f3d8c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 >> 172.21.15.37:0/721368595 conn(0x7f3d8c079730 msgr2=0x7f3d8c1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 shutdown_connections 2024-09-21T01:15:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.332+0000 7f3d908be640 1 -- 172.21.15.37:0/721368595 wait complete. 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 -- 172.21.15.37:0/3330824669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 msgr2=0x7f521010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 --2- 172.21.15.37:0/3330824669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521010f530 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5208009ca0 tx=0x7f520802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 -- 172.21.15.37:0/3330824669 shutdown_connections 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 --2- 172.21.15.37:0/3330824669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521010f530 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 --2- 172.21.15.37:0/3330824669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52101083b0 0x7f52101087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 --2- 172.21.15.37:0/3330824669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5210102a70 0x7f5210102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 -- 172.21.15.37:0/3330824669 >> 172.21.15.37:0/3330824669 conn(0x7f5210079730 msgr2=0x7f5210079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 -- 172.21.15.37:0/3330824669 shutdown_connections 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.378+0000 7f521776f640 1 -- 172.21.15.37:0/3330824669 wait complete. 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 Processor -- start 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 -- start start 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5210102a70 0x7f521019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52101083b0 0x7f521019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5210113a90 con 0x7f5210108d00 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5210113910 con 0x7f5210102a70 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521776f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5210113c10 con 0x7f52101083b0 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f5215d0c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f5215d0c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36470/0 (socket says 172.21.15.37:36470) 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f5215d0c640 1 -- 172.21.15.37:0/1371934284 learned_addr learned my addr 172.21.15.37:0/1371934284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f521550b640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5210102a70 0x7f521019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.379+0000 7f5214d0a640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52101083b0 0x7f521019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f5215d0c640 1 -- 172.21.15.37:0/1371934284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52101083b0 msgr2=0x7f521019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f5215d0c640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52101083b0 0x7f521019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f5215d0c640 1 -- 172.21.15.37:0/1371934284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5210102a70 msgr2=0x7f521019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f5215d0c640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5210102a70 0x7f521019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f5215d0c640 1 -- 172.21.15.37:0/1371934284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52101a0390 con 0x7f5210108d00 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f5215d0c640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521019fc60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f52080098d0 tx=0x7f52080317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208003b70 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5208003d10 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520802fa20 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52101a0620 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.380+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52101a6de0 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.382+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5210103cf0 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.383+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f520802fbe0 con 0x7f5210108d00 2024-09-21T01:15:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.384+0000 7f52067fc640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51fc0b6620 0x7f51fc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:05.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.384+0000 7f521550b640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51fc0b6620 0x7f51fc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:05.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.384+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5208108850 con 0x7f5210108d00 2024-09-21T01:15:05.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.385+0000 7f521550b640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51fc0b6620 0x7f51fc0b8b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f520c009bd0 tx=0x7f520c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:05.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.387+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52080cf010 con 0x7f5210108d00 2024-09-21T01:15:05.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.576+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f521010ab30 con 0x7f5210108d00 2024-09-21T01:15:05.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.577+0000 7f52067fc640 1 -- 172.21.15.37:0/1371934284 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f52080d33f0 con 0x7f5210108d00 2024-09-21T01:15:05.577 INFO:teuthology.orchestra.run.smithi037.stdout:292057776157 2024-09-21T01:15:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51fc0b6620 msgr2=0x7f51fc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51fc0b6620 0x7f51fc0b8b30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f520c009bd0 tx=0x7f520c005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 msgr2=0x7f521019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521019fc60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f52080098d0 tx=0x7f52080317b0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 shutdown_connections 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51fc0b6620 0x7f51fc0b8b30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210108d00 0x7f521019fc60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52101083b0 0x7f521019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 --2- 172.21.15.37:0/1371934284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5210102a70 0x7f521019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 >> 172.21.15.37:0/1371934284 conn(0x7f5210079730 msgr2=0x7f5210104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 shutdown_connections 2024-09-21T01:15:05.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:05.579+0000 7f521776f640 1 -- 172.21.15.37:0/1371934284 wait complete. 2024-09-21T01:15:06.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:05 smithi037 ceph-mon[31105]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:06.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:05 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/721368595' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:15:06.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:05 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1371934284' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:15:06.346 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776154 got 292057776157 for osd.11 2024-09-21T01:15:06.346 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:06.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:05 smithi137 ceph-mon[34607]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:06.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:05 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/721368595' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:15:06.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:05 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1371934284' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:15:06.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:05 smithi144 ceph-mon[34818]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:06.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:05 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/721368595' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:15:06.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:05 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1371934284' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:15:06.699 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659186 got 176093659190 for osd.6 2024-09-21T01:15:06.700 DEBUG:teuthology.parallel:result is None 2024-09-21T01:15:06.700 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:15:06.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:15:06.982 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 -- 172.21.15.37:0/1717292916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 msgr2=0x7faccc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 --2- 172.21.15.37:0/1717292916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc1087c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7facc0009900 tx=0x7facc002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 -- 172.21.15.37:0/1717292916 shutdown_connections 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 --2- 172.21.15.37:0/1717292916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc108d00 0x7faccc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 --2- 172.21.15.37:0/1717292916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc1087c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 --2- 172.21.15.37:0/1717292916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faccc103180 0x7faccc103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 -- 172.21.15.37:0/1717292916 >> 172.21.15.37:0/1717292916 conn(0x7faccc077c60 msgr2=0x7faccc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 -- 172.21.15.37:0/1717292916 shutdown_connections 2024-09-21T01:15:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.497+0000 7facd21a2640 1 -- 172.21.15.37:0/1717292916 wait complete. 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 Processor -- start 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 -- start start 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc103180 0x7faccc19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faccc108d00 0x7faccc19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faccc113ae0 con 0x7faccc1083b0 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faccc113960 con 0x7faccc103180 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7facd21a2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faccc113c60 con 0x7faccc108d00 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.498+0000 7faccaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56562/0 (socket says 172.21.15.37:56562) 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 -- 172.21.15.37:0/3931209692 learned_addr learned my addr 172.21.15.37:0/3931209692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccbfff640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faccc108d00 0x7faccc19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccb7fe640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc103180 0x7faccc19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 -- 172.21.15.37:0/3931209692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faccc108d00 msgr2=0x7faccc19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faccc108d00 0x7faccc19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 -- 172.21.15.37:0/3931209692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc103180 msgr2=0x7faccc19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc103180 0x7faccc19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 -- 172.21.15.37:0/3931209692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc1a04e0 con 0x7faccc1083b0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccb7fe640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc103180 0x7faccc19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7faccaffd640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc19ab10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7facc0006010 tx=0x7facc0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc003f030 con 0x7faccc1083b0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facc0003aa0 con 0x7faccc1083b0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faccc1a0770 con 0x7faccc1083b0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0035070 con 0x7faccc1083b0 2024-09-21T01:15:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.499+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faccc1a6f30 con 0x7faccc1083b0 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.500+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faccc06ac50 con 0x7faccc1083b0 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.503+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7facc0042030 con 0x7faccc1083b0 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.504+0000 7facc8ff9640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7facb40b65a0 0x7facb40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.504+0000 7faccb7fe640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7facb40b65a0 0x7facb40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.504+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7facc0107d30 con 0x7faccc1083b0 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.505+0000 7faccb7fe640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7facb40b65a0 0x7facb40b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facbc009c20 tx=0x7facbc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.508+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facc00ce460 con 0x7faccc1083b0 2024-09-21T01:15:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.696+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faccc063800 con 0x7facb40b65a0 2024-09-21T01:15:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.701+0000 7facc8ff9640 1 -- 172.21.15.37:0/3931209692 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259053 (secure 0 0 0) 0x7faccc063800 con 0x7facb40b65a0 2024-09-21T01:15:07.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:07.704 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:15:07.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7facb40b65a0 msgr2=0x7facb40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7facb40b65a0 0x7facb40b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facbc009c20 tx=0x7facbc005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 msgr2=0x7faccc19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc19ab10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7facc0006010 tx=0x7facc0004060 comp rx=0 tx=0).stop 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 shutdown_connections 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7facb40b65a0 0x7facb40b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faccc108d00 0x7faccc19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faccc1083b0 0x7faccc19ab10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 --2- 172.21.15.37:0/3931209692 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faccc103180 0x7faccc19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 >> 172.21.15.37:0/3931209692 conn(0x7faccc077c60 msgr2=0x7faccc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 shutdown_connections 2024-09-21T01:15:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:07.705+0000 7facd21a2640 1 -- 172.21.15.37:0/3931209692 wait complete. 2024-09-21T01:15:08.482 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-21T01:15:06.869335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662634,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":732,"num_read_kb":470,"num_write":366,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372048,"kb_used_data":10272,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569776,"statfs":{"total":1151940427776,"available":1151559450624,"internally_reserved":0,"allocated":10518528,"data_stored":6782874,"data_compressed":182481,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003512"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924932+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:14:17.924932+0000","last_peered":"2024-09-21T01:14:17.924932+0000","last_clean":"2024-09-21T01:14:17.924932+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:14:17.924932+0000","last_undegraded":"2024-09-21T01:14:17.924932+0000","last_fullsized":"2024-09-21T01:14:17.924932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923724+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:14:17.923724+0000","last_peered":"2024-09-21T01:14:17.923724+0000","last_clean":"2024-09-21T01:14:17.923724+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:14:17.923724+0000","last_undegraded":"2024-09-21T01:14:17.923724+0000","last_fullsized":"2024-09-21T01:14:17.923724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923391+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:14:17.923391+0000","last_peered":"2024-09-21T01:14:17.923391+0000","last_clean":"2024-09-21T01:14:17.923391+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:14:17.923391+0000","last_undegraded":"2024-09-21T01:14:17.923391+0000","last_fullsized":"2024-09-21T01:14:17.923391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684972+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:14:18.684972+0000","last_peered":"2024-09-21T01:14:18.684972+0000","last_clean":"2024-09-21T01:14:18.684972+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:14:18.684972+0000","last_undegraded":"2024-09-21T01:14:18.684972+0000","last_fullsized":"2024-09-21T01:14:18.684972+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930927+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:14:17.930927+0000","last_peered":"2024-09-21T01:14:17.930927+0000","last_clean":"2024-09-21T01:14:17.930927+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:14:17.930927+0000","last_undegraded":"2024-09-21T01:14:17.930927+0000","last_fullsized":"2024-09-21T01:14:17.930927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924410+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:14:17.924410+0000","last_peered":"2024-09-21T01:14:17.924410+0000","last_clean":"2024-09-21T01:14:17.924410+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:14:17.924410+0000","last_undegraded":"2024-09-21T01:14:17.924410+0000","last_fullsized":"2024-09-21T01:14:17.924410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927191+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:14:17.927191+0000","last_peered":"2024-09-21T01:14:17.927191+0000","last_clean":"2024-09-21T01:14:17.927191+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:14:17.927191+0000","last_undegraded":"2024-09-21T01:14:17.927191+0000","last_fullsized":"2024-09-21T01:14:17.927191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747256+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:14:18.747256+0000","last_peered":"2024-09-21T01:14:18.747256+0000","last_clean":"2024-09-21T01:14:18.747256+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:14:18.747256+0000","last_undegraded":"2024-09-21T01:14:18.747256+0000","last_fullsized":"2024-09-21T01:14:18.747256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925110+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:14:17.925110+0000","last_peered":"2024-09-21T01:14:17.925110+0000","last_clean":"2024-09-21T01:14:17.925110+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:14:17.925110+0000","last_undegraded":"2024-09-21T01:14:17.925110+0000","last_fullsized":"2024-09-21T01:14:17.925110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927539+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:14:17.927539+0000","last_peered":"2024-09-21T01:14:17.927539+0000","last_clean":"2024-09-21T01:14:17.927539+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:14:17.927539+0000","last_undegraded":"2024-09-21T01:14:17.927539+0000","last_fullsized":"2024-09-21T01:14:17.927539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685157+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:14:18.685157+0000","last_peered":"2024-09-21T01:14:18.685157+0000","last_clean":"2024-09-21T01:14:18.685157+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:14:18.685157+0000","last_undegraded":"2024-09-21T01:14:18.685157+0000","last_fullsized":"2024-09-21T01:14:18.685157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927255+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:14:17.927255+0000","last_peered":"2024-09-21T01:14:17.927255+0000","last_clean":"2024-09-21T01:14:17.927255+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:14:17.927255+0000","last_undegraded":"2024-09-21T01:14:17.927255+0000","last_fullsized":"2024-09-21T01:14:17.927255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923448+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:14:17.923448+0000","last_peered":"2024-09-21T01:14:17.923448+0000","last_clean":"2024-09-21T01:14:17.923448+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:14:17.923448+0000","last_undegraded":"2024-09-21T01:14:17.923448+0000","last_fullsized":"2024-09-21T01:14:17.923448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923365+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:14:17.923365+0000","last_peered":"2024-09-21T01:14:17.923365+0000","last_clean":"2024-09-21T01:14:17.923365+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:14:17.923365+0000","last_undegraded":"2024-09-21T01:14:17.923365+0000","last_fullsized":"2024-09-21T01:14:17.923365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746958+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:14:18.746958+0000","last_peered":"2024-09-21T01:14:18.746958+0000","last_clean":"2024-09-21T01:14:18.746958+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:14:18.746958+0000","last_undegraded":"2024-09-21T01:14:18.746958+0000","last_fullsized":"2024-09-21T01:14:18.746958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924947+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:14:17.924947+0000","last_peered":"2024-09-21T01:14:17.924947+0000","last_clean":"2024-09-21T01:14:17.924947+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:14:17.924947+0000","last_undegraded":"2024-09-21T01:14:17.924947+0000","last_fullsized":"2024-09-21T01:14:17.924947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924242+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:14:17.924242+0000","last_peered":"2024-09-21T01:14:17.924242+0000","last_clean":"2024-09-21T01:14:17.924242+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:14:17.924242+0000","last_undegraded":"2024-09-21T01:14:17.924242+0000","last_fullsized":"2024-09-21T01:14:17.924242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922116+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:14:17.922116+0000","last_peered":"2024-09-21T01:14:17.922116+0000","last_clean":"2024-09-21T01:14:17.922116+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:14:17.922116+0000","last_undegraded":"2024-09-21T01:14:17.922116+0000","last_fullsized":"2024-09-21T01:14:17.922116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924432+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:14:17.924432+0000","last_peered":"2024-09-21T01:14:17.924432+0000","last_clean":"2024-09-21T01:14:17.924432+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:14:17.924432+0000","last_undegraded":"2024-09-21T01:14:17.924432+0000","last_fullsized":"2024-09-21T01:14:17.924432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927309+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:14:17.927309+0000","last_peered":"2024-09-21T01:14:17.927309+0000","last_clean":"2024-09-21T01:14:17.927309+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:14:17.927309+0000","last_undegraded":"2024-09-21T01:14:17.927309+0000","last_fullsized":"2024-09-21T01:14:17.927309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746708+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:14:18.746708+0000","last_peered":"2024-09-21T01:14:18.746708+0000","last_clean":"2024-09-21T01:14:18.746708+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:14:18.746708+0000","last_undegraded":"2024-09-21T01:14:18.746708+0000","last_fullsized":"2024-09-21T01:14:18.746708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925650+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:14:17.925650+0000","last_peered":"2024-09-21T01:14:17.925650+0000","last_clean":"2024-09-21T01:14:17.925650+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:14:17.925650+0000","last_undegraded":"2024-09-21T01:14:17.925650+0000","last_fullsized":"2024-09-21T01:14:17.925650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921819+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:14:17.921819+0000","last_peered":"2024-09-21T01:14:17.921819+0000","last_clean":"2024-09-21T01:14:17.921819+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:14:17.921819+0000","last_undegraded":"2024-09-21T01:14:17.921819+0000","last_fullsized":"2024-09-21T01:14:17.921819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922493+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:14:17.922493+0000","last_peered":"2024-09-21T01:14:17.922493+0000","last_clean":"2024-09-21T01:14:17.922493+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:14:17.922493+0000","last_undegraded":"2024-09-21T01:14:17.922493+0000","last_fullsized":"2024-09-21T01:14:17.922493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925743+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:14:17.925743+0000","last_peered":"2024-09-21T01:14:17.925743+0000","last_clean":"2024-09-21T01:14:17.925743+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:14:17.925743+0000","last_undegraded":"2024-09-21T01:14:17.925743+0000","last_fullsized":"2024-09-21T01:14:17.925743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927386+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:14:17.927386+0000","last_peered":"2024-09-21T01:14:17.927386+0000","last_clean":"2024-09-21T01:14:17.927386+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:14:17.927386+0000","last_undegraded":"2024-09-21T01:14:17.927386+0000","last_fullsized":"2024-09-21T01:14:17.927386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923527+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:14:17.923527+0000","last_peered":"2024-09-21T01:14:17.923527+0000","last_clean":"2024-09-21T01:14:17.923527+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:14:17.923527+0000","last_undegraded":"2024-09-21T01:14:17.923527+0000","last_fullsized":"2024-09-21T01:14:17.923527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922197+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:14:17.922197+0000","last_peered":"2024-09-21T01:14:17.922197+0000","last_clean":"2024-09-21T01:14:17.922197+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:14:17.922197+0000","last_undegraded":"2024-09-21T01:14:17.922197+0000","last_fullsized":"2024-09-21T01:14:17.922197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922060+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:14:17.922060+0000","last_peered":"2024-09-21T01:14:17.922060+0000","last_clean":"2024-09-21T01:14:17.922060+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:14:17.922060+0000","last_undegraded":"2024-09-21T01:14:17.922060+0000","last_fullsized":"2024-09-21T01:14:17.922060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928744+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:14:17.928744+0000","last_peered":"2024-09-21T01:14:17.928744+0000","last_clean":"2024-09-21T01:14:17.928744+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:14:17.928744+0000","last_undegraded":"2024-09-21T01:14:17.928744+0000","last_fullsized":"2024-09-21T01:14:17.928744+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930735+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:14:17.930735+0000","last_peered":"2024-09-21T01:14:17.930735+0000","last_clean":"2024-09-21T01:14:17.930735+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:14:17.930735+0000","last_undegraded":"2024-09-21T01:14:17.930735+0000","last_fullsized":"2024-09-21T01:14:17.930735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:02.746318+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:15:02.746318+0000","last_peered":"2024-09-21T01:15:02.746318+0000","last_clean":"2024-09-21T01:15:02.746318+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:15:02.746318+0000","last_undegraded":"2024-09-21T01:15:02.746318+0000","last_fullsized":"2024-09-21T01:15:02.746318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926322+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:14:17.926322+0000","last_peered":"2024-09-21T01:14:17.926322+0000","last_clean":"2024-09-21T01:14:17.926322+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:14:17.926322+0000","last_undegraded":"2024-09-21T01:14:17.926322+0000","last_fullsized":"2024-09-21T01:14:17.926322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924654+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:14:17.924654+0000","last_peered":"2024-09-21T01:14:17.924654+0000","last_clean":"2024-09-21T01:14:17.924654+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:14:17.924654+0000","last_undegraded":"2024-09-21T01:14:17.924654+0000","last_fullsized":"2024-09-21T01:14:17.924654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:02.745849+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:15:02.745849+0000","last_peered":"2024-09-21T01:15:02.745849+0000","last_clean":"2024-09-21T01:15:02.745849+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:15:02.745849+0000","last_undegraded":"2024-09-21T01:15:02.745849+0000","last_fullsized":"2024-09-21T01:15:02.745849+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747031+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:14:18.747031+0000","last_peered":"2024-09-21T01:14:18.747031+0000","last_clean":"2024-09-21T01:14:18.747031+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:14:18.747031+0000","last_undegraded":"2024-09-21T01:14:18.747031+0000","last_fullsized":"2024-09-21T01:14:18.747031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923822+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:14:17.923822+0000","last_peered":"2024-09-21T01:14:17.923822+0000","last_clean":"2024-09-21T01:14:17.923822+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:14:17.923822+0000","last_undegraded":"2024-09-21T01:14:17.923822+0000","last_fullsized":"2024-09-21T01:14:17.923822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746707+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:14:18.746707+0000","last_peered":"2024-09-21T01:14:18.746707+0000","last_clean":"2024-09-21T01:14:18.746707+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:14:18.746707+0000","last_undegraded":"2024-09-21T01:14:18.746707+0000","last_fullsized":"2024-09-21T01:14:18.746707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'30","reported_seq":183,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:02.745490+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:15:02.745490+0000","last_peered":"2024-09-21T01:15:02.745490+0000","last_clean":"2024-09-21T01:15:02.745490+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:15:02.745490+0000","last_undegraded":"2024-09-21T01:15:02.745490+0000","last_fullsized":"2024-09-21T01:15:02.745490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64828,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":130,"num_read_kb":127,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931236+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:14:17.931236+0000","last_peered":"2024-09-21T01:14:17.931236+0000","last_clean":"2024-09-21T01:14:17.931236+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:14:17.931236+0000","last_undegraded":"2024-09-21T01:14:17.931236+0000","last_fullsized":"2024-09-21T01:14:17.931236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927187+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:14:17.927187+0000","last_peered":"2024-09-21T01:14:17.927187+0000","last_clean":"2024-09-21T01:14:17.927187+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:14:17.927187+0000","last_undegraded":"2024-09-21T01:14:17.927187+0000","last_fullsized":"2024-09-21T01:14:17.927187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927360+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:14:17.927360+0000","last_peered":"2024-09-21T01:14:17.927360+0000","last_clean":"2024-09-21T01:14:17.927360+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:14:17.927360+0000","last_undegraded":"2024-09-21T01:14:17.927360+0000","last_fullsized":"2024-09-21T01:14:17.927360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:03.747139+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:15:03.747139+0000","last_peered":"2024-09-21T01:15:03.747139+0000","last_clean":"2024-09-21T01:15:03.747139+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:15:03.747139+0000","last_undegraded":"2024-09-21T01:15:03.747139+0000","last_fullsized":"2024-09-21T01:15:03.747139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927236+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:14:17.927236+0000","last_peered":"2024-09-21T01:14:17.927236+0000","last_clean":"2024-09-21T01:14:17.927236+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:14:17.927236+0000","last_undegraded":"2024-09-21T01:14:17.927236+0000","last_fullsized":"2024-09-21T01:14:17.927236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.748047+0000","last_change":"2024-09-21T01:14:18.747968+0000","last_active":"2024-09-21T01:14:18.748047+0000","last_peered":"2024-09-21T01:14:18.748047+0000","last_clean":"2024-09-21T01:14:18.748047+0000","last_became_active":"2024-09-21T01:14:18.747693+0000","last_became_peered":"2024-09-21T01:14:18.747693+0000","last_unstale":"2024-09-21T01:14:18.748047+0000","last_undegraded":"2024-09-21T01:14:18.748047+0000","last_fullsized":"2024-09-21T01:14:18.748047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:41.855089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928998+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:14:17.928998+0000","last_peered":"2024-09-21T01:14:17.928998+0000","last_clean":"2024-09-21T01:14:17.928998+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:14:17.928998+0000","last_undegraded":"2024-09-21T01:14:17.928998+0000","last_fullsized":"2024-09-21T01:14:17.928998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928145+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:14:17.928145+0000","last_peered":"2024-09-21T01:14:17.928145+0000","last_clean":"2024-09-21T01:14:17.928145+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:14:17.928145+0000","last_undegraded":"2024-09-21T01:14:17.928145+0000","last_fullsized":"2024-09-21T01:14:17.928145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927446+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:14:17.927446+0000","last_peered":"2024-09-21T01:14:17.927446+0000","last_clean":"2024-09-21T01:14:17.927446+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:14:17.927446+0000","last_undegraded":"2024-09-21T01:14:17.927446+0000","last_fullsized":"2024-09-21T01:14:17.927446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:01.745492+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:15:01.745492+0000","last_peered":"2024-09-21T01:15:01.745492+0000","last_clean":"2024-09-21T01:15:01.745492+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:15:01.745492+0000","last_undegraded":"2024-09-21T01:15:01.745492+0000","last_fullsized":"2024-09-21T01:15:01.745492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928119+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928119+0000","last_peered":"2024-09-21T01:14:17.928119+0000","last_clean":"2024-09-21T01:14:17.928119+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928119+0000","last_undegraded":"2024-09-21T01:14:17.928119+0000","last_fullsized":"2024-09-21T01:14:17.928119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684890+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684890+0000","last_peered":"2024-09-21T01:14:18.684890+0000","last_clean":"2024-09-21T01:14:18.684890+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684890+0000","last_undegraded":"2024-09-21T01:14:18.684890+0000","last_fullsized":"2024-09-21T01:14:18.684890+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921815+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:14:17.921815+0000","last_peered":"2024-09-21T01:14:17.921815+0000","last_clean":"2024-09-21T01:14:17.921815+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:14:17.921815+0000","last_undegraded":"2024-09-21T01:14:17.921815+0000","last_fullsized":"2024-09-21T01:14:17.921815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751427+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751427+0000","last_peered":"2024-09-21T01:14:18.751427+0000","last_clean":"2024-09-21T01:14:18.751427+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751427+0000","last_undegraded":"2024-09-21T01:14:18.751427+0000","last_fullsized":"2024-09-21T01:14:18.751427+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926780+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:14:17.926780+0000","last_peered":"2024-09-21T01:14:17.926780+0000","last_clean":"2024-09-21T01:14:17.926780+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:14:17.926780+0000","last_undegraded":"2024-09-21T01:14:17.926780+0000","last_fullsized":"2024-09-21T01:14:17.926780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:04.748017+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:15:04.748017+0000","last_peered":"2024-09-21T01:15:04.748017+0000","last_clean":"2024-09-21T01:15:04.748017+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:15:04.748017+0000","last_undegraded":"2024-09-21T01:15:04.748017+0000","last_fullsized":"2024-09-21T01:15:04.748017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.934228+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:14:17.934228+0000","last_peered":"2024-09-21T01:14:17.934228+0000","last_clean":"2024-09-21T01:14:17.934228+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:14:17.934228+0000","last_undegraded":"2024-09-21T01:14:17.934228+0000","last_fullsized":"2024-09-21T01:14:17.934228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":90,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:01.744064+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:15:01.744064+0000","last_peered":"2024-09-21T01:15:01.744064+0000","last_clean":"2024-09-21T01:15:01.744064+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:15:01.744064+0000","last_undegraded":"2024-09-21T01:15:01.744064+0000","last_fullsized":"2024-09-21T01:15:01.744064+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924719+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:14:17.924719+0000","last_peered":"2024-09-21T01:14:17.924719+0000","last_clean":"2024-09-21T01:14:17.924719+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:14:17.924719+0000","last_undegraded":"2024-09-21T01:14:17.924719+0000","last_fullsized":"2024-09-21T01:14:17.924719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928622+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.928622+0000","last_peered":"2024-09-21T01:14:17.928622+0000","last_clean":"2024-09-21T01:14:17.928622+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.928622+0000","last_undegraded":"2024-09-21T01:14:17.928622+0000","last_fullsized":"2024-09-21T01:14:17.928622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.933370+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:14:17.933370+0000","last_peered":"2024-09-21T01:14:17.933370+0000","last_clean":"2024-09-21T01:14:17.933370+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:14:17.933370+0000","last_undegraded":"2024-09-21T01:14:17.933370+0000","last_fullsized":"2024-09-21T01:14:17.933370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931407+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931407+0000","last_peered":"2024-09-21T01:14:17.931407+0000","last_clean":"2024-09-21T01:14:17.931407+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931407+0000","last_undegraded":"2024-09-21T01:14:17.931407+0000","last_fullsized":"2024-09-21T01:14:17.931407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927592+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:14:17.927592+0000","last_peered":"2024-09-21T01:14:17.927592+0000","last_clean":"2024-09-21T01:14:17.927592+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:14:17.927592+0000","last_undegraded":"2024-09-21T01:14:17.927592+0000","last_fullsized":"2024-09-21T01:14:17.927592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924452+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:17.924452+0000","last_peered":"2024-09-21T01:14:17.924452+0000","last_clean":"2024-09-21T01:14:17.924452+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:17.924452+0000","last_undegraded":"2024-09-21T01:14:17.924452+0000","last_fullsized":"2024-09-21T01:14:17.924452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921846+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:14:17.921846+0000","last_peered":"2024-09-21T01:14:17.921846+0000","last_clean":"2024-09-21T01:14:17.921846+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:14:17.921846+0000","last_undegraded":"2024-09-21T01:14:17.921846+0000","last_fullsized":"2024-09-21T01:14:17.921846+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930172+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:14:17.930172+0000","last_peered":"2024-09-21T01:14:17.930172+0000","last_clean":"2024-09-21T01:14:17.930172+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:14:17.930172+0000","last_undegraded":"2024-09-21T01:14:17.930172+0000","last_fullsized":"2024-09-21T01:14:17.930172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930491+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:14:17.930491+0000","last_peered":"2024-09-21T01:14:17.930491+0000","last_clean":"2024-09-21T01:14:17.930491+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:14:17.930491+0000","last_undegraded":"2024-09-21T01:14:17.930491+0000","last_fullsized":"2024-09-21T01:14:17.930491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921731+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:17.921731+0000","last_peered":"2024-09-21T01:14:17.921731+0000","last_clean":"2024-09-21T01:14:17.921731+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:17.921731+0000","last_undegraded":"2024-09-21T01:14:17.921731+0000","last_fullsized":"2024-09-21T01:14:17.921731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924751+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:14:17.924751+0000","last_peered":"2024-09-21T01:14:17.924751+0000","last_clean":"2024-09-21T01:14:17.924751+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:14:17.924751+0000","last_undegraded":"2024-09-21T01:14:17.924751+0000","last_fullsized":"2024-09-21T01:14:17.924751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921967+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.921967+0000","last_peered":"2024-09-21T01:14:17.921967+0000","last_clean":"2024-09-21T01:14:17.921967+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.921967+0000","last_undegraded":"2024-09-21T01:14:17.921967+0000","last_fullsized":"2024-09-21T01:14:17.921967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921784+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:14:17.921784+0000","last_peered":"2024-09-21T01:14:17.921784+0000","last_clean":"2024-09-21T01:14:17.921784+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:14:17.921784+0000","last_undegraded":"2024-09-21T01:14:17.921784+0000","last_fullsized":"2024-09-21T01:14:17.921784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926772+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:14:17.926772+0000","last_peered":"2024-09-21T01:14:17.926772+0000","last_clean":"2024-09-21T01:14:17.926772+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:14:17.926772+0000","last_undegraded":"2024-09-21T01:14:17.926772+0000","last_fullsized":"2024-09-21T01:14:17.926772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746675+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:14:18.746675+0000","last_peered":"2024-09-21T01:14:18.746675+0000","last_clean":"2024-09-21T01:14:18.746675+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:14:18.746675+0000","last_undegraded":"2024-09-21T01:14:18.746675+0000","last_fullsized":"2024-09-21T01:14:18.746675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931252+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931252+0000","last_peered":"2024-09-21T01:14:17.931252+0000","last_clean":"2024-09-21T01:14:17.931252+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931252+0000","last_undegraded":"2024-09-21T01:14:17.931252+0000","last_fullsized":"2024-09-21T01:14:17.931252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923741+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:14:17.923741+0000","last_peered":"2024-09-21T01:14:17.923741+0000","last_clean":"2024-09-21T01:14:17.923741+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:14:17.923741+0000","last_undegraded":"2024-09-21T01:14:17.923741+0000","last_fullsized":"2024-09-21T01:14:17.923741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922330+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:17.922330+0000","last_peered":"2024-09-21T01:14:17.922330+0000","last_clean":"2024-09-21T01:14:17.922330+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:17.922330+0000","last_undegraded":"2024-09-21T01:14:17.922330+0000","last_fullsized":"2024-09-21T01:14:17.922330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922207+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:14:17.922207+0000","last_peered":"2024-09-21T01:14:17.922207+0000","last_clean":"2024-09-21T01:14:17.922207+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:14:17.922207+0000","last_undegraded":"2024-09-21T01:14:17.922207+0000","last_fullsized":"2024-09-21T01:14:17.922207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:01.743480+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:15:01.743480+0000","last_peered":"2024-09-21T01:15:01.743480+0000","last_clean":"2024-09-21T01:15:01.743480+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:15:01.743480+0000","last_undegraded":"2024-09-21T01:15:01.743480+0000","last_fullsized":"2024-09-21T01:15:01.743480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72032,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":656,"num_read_kb":406,"num_write":241,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":216096,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":401232,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972385,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1056630,"data_compressed":43544,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":400820,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332140,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":401081,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495665,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":993599,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659191,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":835584,"data_stored":400420,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855419,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":993277,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018944,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":400128,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":467095,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":466161,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":402150,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66580,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":67514,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66564,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:15:08.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:15:08.765 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:08 smithi144 ceph-mon[34818]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:08.765 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:08 smithi137 ceph-mon[34607]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:08 smithi037 ceph-mon[31105]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:08.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:08.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:15:08.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:15:08.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:15:09.033 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:09.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:09 smithi037 ceph-mon[31105]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:15:09.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 -- 172.21.15.37:0/4277148139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 msgr2=0x7f80341098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 --2- 172.21.15.37:0/4277148139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f80341098b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8024009900 tx=0x7f802402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 -- 172.21.15.37:0/4277148139 shutdown_connections 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 --2- 172.21.15.37:0/4277148139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 0x7f8034110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 --2- 172.21.15.37:0/4277148139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f80341098b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 --2- 172.21.15.37:0/4277148139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 0x7f8034103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 -- 172.21.15.37:0/4277148139 >> 172.21.15.37:0/4277148139 conn(0x7f803407b850 msgr2=0x7f803407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 -- 172.21.15.37:0/4277148139 shutdown_connections 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 -- 172.21.15.37:0/4277148139 wait complete. 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.531+0000 7f803b2ee640 1 Processor -- start 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 -- start start 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 0x7f8034075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f8034075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 0x7f8034076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8034113ab0 con 0x7f80341094a0 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8034113930 con 0x7f8034103b60 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803b2ee640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8034113c30 con 0x7f8034109df0 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f8034075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f8034075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56584/0 (socket says 172.21.15.37:56584) 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 -- 172.21.15.37:0/715806163 learned_addr learned my addr 172.21.15.37:0/715806163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803908a640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 0x7f8034075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803988b640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 0x7f8034076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 -- 172.21.15.37:0/715806163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 msgr2=0x7f8034076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 0x7f8034076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 -- 172.21.15.37:0/715806163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 msgr2=0x7f8034075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 0x7f8034075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 -- 172.21.15.37:0/715806163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80341a8820 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803908a640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 0x7f8034075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f803988b640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 0x7f8034076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.532+0000 7f8038889640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f8034075c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f802402a930 tx=0x7f8024004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.533+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802403f030 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.533+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8024003aa0 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.533+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80341a8ab0 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.533+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024035070 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.533+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80341a8f90 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.534+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8034103f70 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.535+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8024042030 con 0x7f80341094a0 2024-09-21T01:15:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.536+0000 7f802a7fc640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f80200b65a0 0x7f80200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.536+0000 7f803908a640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f80200b65a0 0x7f80200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.536+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8024107fe0 con 0x7f80341094a0 2024-09-21T01:15:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.537+0000 7f803908a640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f80200b65a0 0x7f80200b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8030005fd0 tx=0x7f8030005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.539+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80240ce710 con 0x7f80341094a0 2024-09-21T01:15:09.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:09 smithi137 ceph-mon[34607]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:15:09.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:09 smithi144 ceph-mon[34818]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:15:09.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.727+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8034063800 con 0x7f80200b65a0 2024-09-21T01:15:09.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.731+0000 7f802a7fc640 1 -- 172.21.15.37:0/715806163 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259054 (secure 0 0 0) 0x7f8034063800 con 0x7f80200b65a0 2024-09-21T01:15:09.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:09.734 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:15:09.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f80200b65a0 msgr2=0x7f80200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:09.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f80200b65a0 0x7f80200b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8030005fd0 tx=0x7f8030005850 comp rx=0 tx=0).stop 2024-09-21T01:15:09.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 msgr2=0x7f8034075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:09.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f8034075c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f802402a930 tx=0x7f8024004270 comp rx=0 tx=0).stop 2024-09-21T01:15:09.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 shutdown_connections 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f80200b65a0 0x7f80200b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8034109df0 0x7f8034076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80341094a0 0x7f8034075c50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 --2- 172.21.15.37:0/715806163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8034103b60 0x7f8034075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 >> 172.21.15.37:0/715806163 conn(0x7f803407b850 msgr2=0x7f8034105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 shutdown_connections 2024-09-21T01:15:09.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:09.735+0000 7f803b2ee640 1 -- 172.21.15.37:0/715806163 wait complete. 2024-09-21T01:15:10.472 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-21T01:15:08.869919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662634,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":767,"num_read_kb":490,"num_write":366,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372048,"kb_used_data":10272,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569776,"statfs":{"total":1151940427776,"available":1151559450624,"internally_reserved":0,"allocated":10518528,"data_stored":6782874,"data_compressed":182481,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003397"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924932+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:14:17.924932+0000","last_peered":"2024-09-21T01:14:17.924932+0000","last_clean":"2024-09-21T01:14:17.924932+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:14:17.924932+0000","last_undegraded":"2024-09-21T01:14:17.924932+0000","last_fullsized":"2024-09-21T01:14:17.924932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923724+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:14:17.923724+0000","last_peered":"2024-09-21T01:14:17.923724+0000","last_clean":"2024-09-21T01:14:17.923724+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:14:17.923724+0000","last_undegraded":"2024-09-21T01:14:17.923724+0000","last_fullsized":"2024-09-21T01:14:17.923724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923391+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:14:17.923391+0000","last_peered":"2024-09-21T01:14:17.923391+0000","last_clean":"2024-09-21T01:14:17.923391+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:14:17.923391+0000","last_undegraded":"2024-09-21T01:14:17.923391+0000","last_fullsized":"2024-09-21T01:14:17.923391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684972+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:14:18.684972+0000","last_peered":"2024-09-21T01:14:18.684972+0000","last_clean":"2024-09-21T01:14:18.684972+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:14:18.684972+0000","last_undegraded":"2024-09-21T01:14:18.684972+0000","last_fullsized":"2024-09-21T01:14:18.684972+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930927+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:14:17.930927+0000","last_peered":"2024-09-21T01:14:17.930927+0000","last_clean":"2024-09-21T01:14:17.930927+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:14:17.930927+0000","last_undegraded":"2024-09-21T01:14:17.930927+0000","last_fullsized":"2024-09-21T01:14:17.930927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924410+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:14:17.924410+0000","last_peered":"2024-09-21T01:14:17.924410+0000","last_clean":"2024-09-21T01:14:17.924410+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:14:17.924410+0000","last_undegraded":"2024-09-21T01:14:17.924410+0000","last_fullsized":"2024-09-21T01:14:17.924410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927191+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:14:17.927191+0000","last_peered":"2024-09-21T01:14:17.927191+0000","last_clean":"2024-09-21T01:14:17.927191+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:14:17.927191+0000","last_undegraded":"2024-09-21T01:14:17.927191+0000","last_fullsized":"2024-09-21T01:14:17.927191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747256+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:14:18.747256+0000","last_peered":"2024-09-21T01:14:18.747256+0000","last_clean":"2024-09-21T01:14:18.747256+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:14:18.747256+0000","last_undegraded":"2024-09-21T01:14:18.747256+0000","last_fullsized":"2024-09-21T01:14:18.747256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925110+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:14:17.925110+0000","last_peered":"2024-09-21T01:14:17.925110+0000","last_clean":"2024-09-21T01:14:17.925110+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:14:17.925110+0000","last_undegraded":"2024-09-21T01:14:17.925110+0000","last_fullsized":"2024-09-21T01:14:17.925110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927539+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:14:17.927539+0000","last_peered":"2024-09-21T01:14:17.927539+0000","last_clean":"2024-09-21T01:14:17.927539+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:14:17.927539+0000","last_undegraded":"2024-09-21T01:14:17.927539+0000","last_fullsized":"2024-09-21T01:14:17.927539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685157+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:14:18.685157+0000","last_peered":"2024-09-21T01:14:18.685157+0000","last_clean":"2024-09-21T01:14:18.685157+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:14:18.685157+0000","last_undegraded":"2024-09-21T01:14:18.685157+0000","last_fullsized":"2024-09-21T01:14:18.685157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927255+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:14:17.927255+0000","last_peered":"2024-09-21T01:14:17.927255+0000","last_clean":"2024-09-21T01:14:17.927255+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:14:17.927255+0000","last_undegraded":"2024-09-21T01:14:17.927255+0000","last_fullsized":"2024-09-21T01:14:17.927255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923448+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:14:17.923448+0000","last_peered":"2024-09-21T01:14:17.923448+0000","last_clean":"2024-09-21T01:14:17.923448+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:14:17.923448+0000","last_undegraded":"2024-09-21T01:14:17.923448+0000","last_fullsized":"2024-09-21T01:14:17.923448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923365+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:14:17.923365+0000","last_peered":"2024-09-21T01:14:17.923365+0000","last_clean":"2024-09-21T01:14:17.923365+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:14:17.923365+0000","last_undegraded":"2024-09-21T01:14:17.923365+0000","last_fullsized":"2024-09-21T01:14:17.923365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746958+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:14:18.746958+0000","last_peered":"2024-09-21T01:14:18.746958+0000","last_clean":"2024-09-21T01:14:18.746958+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:14:18.746958+0000","last_undegraded":"2024-09-21T01:14:18.746958+0000","last_fullsized":"2024-09-21T01:14:18.746958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924947+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:14:17.924947+0000","last_peered":"2024-09-21T01:14:17.924947+0000","last_clean":"2024-09-21T01:14:17.924947+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:14:17.924947+0000","last_undegraded":"2024-09-21T01:14:17.924947+0000","last_fullsized":"2024-09-21T01:14:17.924947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924242+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:14:17.924242+0000","last_peered":"2024-09-21T01:14:17.924242+0000","last_clean":"2024-09-21T01:14:17.924242+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:14:17.924242+0000","last_undegraded":"2024-09-21T01:14:17.924242+0000","last_fullsized":"2024-09-21T01:14:17.924242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922116+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:14:17.922116+0000","last_peered":"2024-09-21T01:14:17.922116+0000","last_clean":"2024-09-21T01:14:17.922116+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:14:17.922116+0000","last_undegraded":"2024-09-21T01:14:17.922116+0000","last_fullsized":"2024-09-21T01:14:17.922116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924432+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:14:17.924432+0000","last_peered":"2024-09-21T01:14:17.924432+0000","last_clean":"2024-09-21T01:14:17.924432+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:14:17.924432+0000","last_undegraded":"2024-09-21T01:14:17.924432+0000","last_fullsized":"2024-09-21T01:14:17.924432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927309+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:14:17.927309+0000","last_peered":"2024-09-21T01:14:17.927309+0000","last_clean":"2024-09-21T01:14:17.927309+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:14:17.927309+0000","last_undegraded":"2024-09-21T01:14:17.927309+0000","last_fullsized":"2024-09-21T01:14:17.927309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746708+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:14:18.746708+0000","last_peered":"2024-09-21T01:14:18.746708+0000","last_clean":"2024-09-21T01:14:18.746708+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:14:18.746708+0000","last_undegraded":"2024-09-21T01:14:18.746708+0000","last_fullsized":"2024-09-21T01:14:18.746708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925650+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:14:17.925650+0000","last_peered":"2024-09-21T01:14:17.925650+0000","last_clean":"2024-09-21T01:14:17.925650+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:14:17.925650+0000","last_undegraded":"2024-09-21T01:14:17.925650+0000","last_fullsized":"2024-09-21T01:14:17.925650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921819+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:14:17.921819+0000","last_peered":"2024-09-21T01:14:17.921819+0000","last_clean":"2024-09-21T01:14:17.921819+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:14:17.921819+0000","last_undegraded":"2024-09-21T01:14:17.921819+0000","last_fullsized":"2024-09-21T01:14:17.921819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922493+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:14:17.922493+0000","last_peered":"2024-09-21T01:14:17.922493+0000","last_clean":"2024-09-21T01:14:17.922493+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:14:17.922493+0000","last_undegraded":"2024-09-21T01:14:17.922493+0000","last_fullsized":"2024-09-21T01:14:17.922493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925743+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:14:17.925743+0000","last_peered":"2024-09-21T01:14:17.925743+0000","last_clean":"2024-09-21T01:14:17.925743+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:14:17.925743+0000","last_undegraded":"2024-09-21T01:14:17.925743+0000","last_fullsized":"2024-09-21T01:14:17.925743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927386+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:14:17.927386+0000","last_peered":"2024-09-21T01:14:17.927386+0000","last_clean":"2024-09-21T01:14:17.927386+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:14:17.927386+0000","last_undegraded":"2024-09-21T01:14:17.927386+0000","last_fullsized":"2024-09-21T01:14:17.927386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923527+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:14:17.923527+0000","last_peered":"2024-09-21T01:14:17.923527+0000","last_clean":"2024-09-21T01:14:17.923527+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:14:17.923527+0000","last_undegraded":"2024-09-21T01:14:17.923527+0000","last_fullsized":"2024-09-21T01:14:17.923527+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922197+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:14:17.922197+0000","last_peered":"2024-09-21T01:14:17.922197+0000","last_clean":"2024-09-21T01:14:17.922197+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:14:17.922197+0000","last_undegraded":"2024-09-21T01:14:17.922197+0000","last_fullsized":"2024-09-21T01:14:17.922197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922060+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:14:17.922060+0000","last_peered":"2024-09-21T01:14:17.922060+0000","last_clean":"2024-09-21T01:14:17.922060+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:14:17.922060+0000","last_undegraded":"2024-09-21T01:14:17.922060+0000","last_fullsized":"2024-09-21T01:14:17.922060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928744+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:14:17.928744+0000","last_peered":"2024-09-21T01:14:17.928744+0000","last_clean":"2024-09-21T01:14:17.928744+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:14:17.928744+0000","last_undegraded":"2024-09-21T01:14:17.928744+0000","last_fullsized":"2024-09-21T01:14:17.928744+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930735+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:14:17.930735+0000","last_peered":"2024-09-21T01:14:17.930735+0000","last_clean":"2024-09-21T01:14:17.930735+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:14:17.930735+0000","last_undegraded":"2024-09-21T01:14:17.930735+0000","last_fullsized":"2024-09-21T01:14:17.930735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:02.746318+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:15:02.746318+0000","last_peered":"2024-09-21T01:15:02.746318+0000","last_clean":"2024-09-21T01:15:02.746318+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:15:02.746318+0000","last_undegraded":"2024-09-21T01:15:02.746318+0000","last_fullsized":"2024-09-21T01:15:02.746318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926322+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:14:17.926322+0000","last_peered":"2024-09-21T01:14:17.926322+0000","last_clean":"2024-09-21T01:14:17.926322+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:14:17.926322+0000","last_undegraded":"2024-09-21T01:14:17.926322+0000","last_fullsized":"2024-09-21T01:14:17.926322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921594+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:14:17.921594+0000","last_peered":"2024-09-21T01:14:17.921594+0000","last_clean":"2024-09-21T01:14:17.921594+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:14:17.921594+0000","last_undegraded":"2024-09-21T01:14:17.921594+0000","last_fullsized":"2024-09-21T01:14:17.921594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924654+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:14:17.924654+0000","last_peered":"2024-09-21T01:14:17.924654+0000","last_clean":"2024-09-21T01:14:17.924654+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:14:17.924654+0000","last_undegraded":"2024-09-21T01:14:17.924654+0000","last_fullsized":"2024-09-21T01:14:17.924654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'4","reported_seq":159,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:07.753026+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:15:07.753026+0000","last_peered":"2024-09-21T01:15:07.753026+0000","last_clean":"2024-09-21T01:15:07.753026+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:15:07.753026+0000","last_undegraded":"2024-09-21T01:15:07.753026+0000","last_fullsized":"2024-09-21T01:15:07.753026+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747031+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:14:18.747031+0000","last_peered":"2024-09-21T01:14:18.747031+0000","last_clean":"2024-09-21T01:14:18.747031+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:14:18.747031+0000","last_undegraded":"2024-09-21T01:14:18.747031+0000","last_fullsized":"2024-09-21T01:14:18.747031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923822+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:14:17.923822+0000","last_peered":"2024-09-21T01:14:17.923822+0000","last_clean":"2024-09-21T01:14:17.923822+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:14:17.923822+0000","last_undegraded":"2024-09-21T01:14:17.923822+0000","last_fullsized":"2024-09-21T01:14:17.923822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746707+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:14:18.746707+0000","last_peered":"2024-09-21T01:14:18.746707+0000","last_clean":"2024-09-21T01:14:18.746707+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:14:18.746707+0000","last_undegraded":"2024-09-21T01:14:18.746707+0000","last_fullsized":"2024-09-21T01:14:18.746707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'30","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:07.752509+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:15:07.752509+0000","last_peered":"2024-09-21T01:15:07.752509+0000","last_clean":"2024-09-21T01:15:07.752509+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:15:07.752509+0000","last_undegraded":"2024-09-21T01:15:07.752509+0000","last_fullsized":"2024-09-21T01:15:07.752509+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64828,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":32,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931236+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:14:17.931236+0000","last_peered":"2024-09-21T01:14:17.931236+0000","last_clean":"2024-09-21T01:14:17.931236+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:14:17.931236+0000","last_undegraded":"2024-09-21T01:14:17.931236+0000","last_fullsized":"2024-09-21T01:14:17.931236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927187+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:14:17.927187+0000","last_peered":"2024-09-21T01:14:17.927187+0000","last_clean":"2024-09-21T01:14:17.927187+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:14:17.927187+0000","last_undegraded":"2024-09-21T01:14:17.927187+0000","last_fullsized":"2024-09-21T01:14:17.927187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927360+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:14:17.927360+0000","last_peered":"2024-09-21T01:14:17.927360+0000","last_clean":"2024-09-21T01:14:17.927360+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:14:17.927360+0000","last_undegraded":"2024-09-21T01:14:17.927360+0000","last_fullsized":"2024-09-21T01:14:17.927360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:03.747139+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:15:03.747139+0000","last_peered":"2024-09-21T01:15:03.747139+0000","last_clean":"2024-09-21T01:15:03.747139+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:15:03.747139+0000","last_undegraded":"2024-09-21T01:15:03.747139+0000","last_fullsized":"2024-09-21T01:15:03.747139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927236+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:14:17.927236+0000","last_peered":"2024-09-21T01:14:17.927236+0000","last_clean":"2024-09-21T01:14:17.927236+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:14:17.927236+0000","last_undegraded":"2024-09-21T01:14:17.927236+0000","last_fullsized":"2024-09-21T01:14:17.927236+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.748047+0000","last_change":"2024-09-21T01:14:18.747968+0000","last_active":"2024-09-21T01:14:18.748047+0000","last_peered":"2024-09-21T01:14:18.748047+0000","last_clean":"2024-09-21T01:14:18.748047+0000","last_became_active":"2024-09-21T01:14:18.747693+0000","last_became_peered":"2024-09-21T01:14:18.747693+0000","last_unstale":"2024-09-21T01:14:18.748047+0000","last_undegraded":"2024-09-21T01:14:18.748047+0000","last_fullsized":"2024-09-21T01:14:18.748047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:41.855089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928998+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:14:17.928998+0000","last_peered":"2024-09-21T01:14:17.928998+0000","last_clean":"2024-09-21T01:14:17.928998+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:14:17.928998+0000","last_undegraded":"2024-09-21T01:14:17.928998+0000","last_fullsized":"2024-09-21T01:14:17.928998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928145+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:14:17.928145+0000","last_peered":"2024-09-21T01:14:17.928145+0000","last_clean":"2024-09-21T01:14:17.928145+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:14:17.928145+0000","last_undegraded":"2024-09-21T01:14:17.928145+0000","last_fullsized":"2024-09-21T01:14:17.928145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927446+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:14:17.927446+0000","last_peered":"2024-09-21T01:14:17.927446+0000","last_clean":"2024-09-21T01:14:17.927446+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:14:17.927446+0000","last_undegraded":"2024-09-21T01:14:17.927446+0000","last_fullsized":"2024-09-21T01:14:17.927446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'6","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:06.764007+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:15:06.764007+0000","last_peered":"2024-09-21T01:15:06.764007+0000","last_clean":"2024-09-21T01:15:06.764007+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:15:06.764007+0000","last_undegraded":"2024-09-21T01:15:06.764007+0000","last_fullsized":"2024-09-21T01:15:06.764007+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928119+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928119+0000","last_peered":"2024-09-21T01:14:17.928119+0000","last_clean":"2024-09-21T01:14:17.928119+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928119+0000","last_undegraded":"2024-09-21T01:14:17.928119+0000","last_fullsized":"2024-09-21T01:14:17.928119+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684890+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684890+0000","last_peered":"2024-09-21T01:14:18.684890+0000","last_clean":"2024-09-21T01:14:18.684890+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684890+0000","last_undegraded":"2024-09-21T01:14:18.684890+0000","last_fullsized":"2024-09-21T01:14:18.684890+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921815+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:14:17.921815+0000","last_peered":"2024-09-21T01:14:17.921815+0000","last_clean":"2024-09-21T01:14:17.921815+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:14:17.921815+0000","last_undegraded":"2024-09-21T01:14:17.921815+0000","last_fullsized":"2024-09-21T01:14:17.921815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751427+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751427+0000","last_peered":"2024-09-21T01:14:18.751427+0000","last_clean":"2024-09-21T01:14:18.751427+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751427+0000","last_undegraded":"2024-09-21T01:14:18.751427+0000","last_fullsized":"2024-09-21T01:14:18.751427+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926780+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:14:17.926780+0000","last_peered":"2024-09-21T01:14:17.926780+0000","last_clean":"2024-09-21T01:14:17.926780+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:14:17.926780+0000","last_undegraded":"2024-09-21T01:14:17.926780+0000","last_fullsized":"2024-09-21T01:14:17.926780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:04.748017+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:15:04.748017+0000","last_peered":"2024-09-21T01:15:04.748017+0000","last_clean":"2024-09-21T01:15:04.748017+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:15:04.748017+0000","last_undegraded":"2024-09-21T01:15:04.748017+0000","last_fullsized":"2024-09-21T01:15:04.748017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.934228+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:14:17.934228+0000","last_peered":"2024-09-21T01:14:17.934228+0000","last_clean":"2024-09-21T01:14:17.934228+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:14:17.934228+0000","last_undegraded":"2024-09-21T01:14:17.934228+0000","last_fullsized":"2024-09-21T01:14:17.934228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'5","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:06.751494+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:15:06.751494+0000","last_peered":"2024-09-21T01:15:06.751494+0000","last_clean":"2024-09-21T01:15:06.751494+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:15:06.751494+0000","last_undegraded":"2024-09-21T01:15:06.751494+0000","last_fullsized":"2024-09-21T01:15:06.751494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924719+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:14:17.924719+0000","last_peered":"2024-09-21T01:14:17.924719+0000","last_clean":"2024-09-21T01:14:17.924719+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:14:17.924719+0000","last_undegraded":"2024-09-21T01:14:17.924719+0000","last_fullsized":"2024-09-21T01:14:17.924719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928622+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.928622+0000","last_peered":"2024-09-21T01:14:17.928622+0000","last_clean":"2024-09-21T01:14:17.928622+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.928622+0000","last_undegraded":"2024-09-21T01:14:17.928622+0000","last_fullsized":"2024-09-21T01:14:17.928622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.933370+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:14:17.933370+0000","last_peered":"2024-09-21T01:14:17.933370+0000","last_clean":"2024-09-21T01:14:17.933370+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:14:17.933370+0000","last_undegraded":"2024-09-21T01:14:17.933370+0000","last_fullsized":"2024-09-21T01:14:17.933370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931407+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931407+0000","last_peered":"2024-09-21T01:14:17.931407+0000","last_clean":"2024-09-21T01:14:17.931407+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931407+0000","last_undegraded":"2024-09-21T01:14:17.931407+0000","last_fullsized":"2024-09-21T01:14:17.931407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927592+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:14:17.927592+0000","last_peered":"2024-09-21T01:14:17.927592+0000","last_clean":"2024-09-21T01:14:17.927592+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:14:17.927592+0000","last_undegraded":"2024-09-21T01:14:17.927592+0000","last_fullsized":"2024-09-21T01:14:17.927592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924452+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:14:17.924452+0000","last_peered":"2024-09-21T01:14:17.924452+0000","last_clean":"2024-09-21T01:14:17.924452+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:14:17.924452+0000","last_undegraded":"2024-09-21T01:14:17.924452+0000","last_fullsized":"2024-09-21T01:14:17.924452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921846+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:14:17.921846+0000","last_peered":"2024-09-21T01:14:17.921846+0000","last_clean":"2024-09-21T01:14:17.921846+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:14:17.921846+0000","last_undegraded":"2024-09-21T01:14:17.921846+0000","last_fullsized":"2024-09-21T01:14:17.921846+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930172+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:14:17.930172+0000","last_peered":"2024-09-21T01:14:17.930172+0000","last_clean":"2024-09-21T01:14:17.930172+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:14:17.930172+0000","last_undegraded":"2024-09-21T01:14:17.930172+0000","last_fullsized":"2024-09-21T01:14:17.930172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930491+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:14:17.930491+0000","last_peered":"2024-09-21T01:14:17.930491+0000","last_clean":"2024-09-21T01:14:17.930491+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:14:17.930491+0000","last_undegraded":"2024-09-21T01:14:17.930491+0000","last_fullsized":"2024-09-21T01:14:17.930491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921731+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:17.921731+0000","last_peered":"2024-09-21T01:14:17.921731+0000","last_clean":"2024-09-21T01:14:17.921731+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:17.921731+0000","last_undegraded":"2024-09-21T01:14:17.921731+0000","last_fullsized":"2024-09-21T01:14:17.921731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924751+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:14:17.924751+0000","last_peered":"2024-09-21T01:14:17.924751+0000","last_clean":"2024-09-21T01:14:17.924751+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:14:17.924751+0000","last_undegraded":"2024-09-21T01:14:17.924751+0000","last_fullsized":"2024-09-21T01:14:17.924751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921967+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.921967+0000","last_peered":"2024-09-21T01:14:17.921967+0000","last_clean":"2024-09-21T01:14:17.921967+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.921967+0000","last_undegraded":"2024-09-21T01:14:17.921967+0000","last_fullsized":"2024-09-21T01:14:17.921967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921784+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:14:17.921784+0000","last_peered":"2024-09-21T01:14:17.921784+0000","last_clean":"2024-09-21T01:14:17.921784+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:14:17.921784+0000","last_undegraded":"2024-09-21T01:14:17.921784+0000","last_fullsized":"2024-09-21T01:14:17.921784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927552+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:14:17.927552+0000","last_peered":"2024-09-21T01:14:17.927552+0000","last_clean":"2024-09-21T01:14:17.927552+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:14:17.927552+0000","last_undegraded":"2024-09-21T01:14:17.927552+0000","last_fullsized":"2024-09-21T01:14:17.927552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926772+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:14:17.926772+0000","last_peered":"2024-09-21T01:14:17.926772+0000","last_clean":"2024-09-21T01:14:17.926772+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:14:17.926772+0000","last_undegraded":"2024-09-21T01:14:17.926772+0000","last_fullsized":"2024-09-21T01:14:17.926772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.746675+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:14:18.746675+0000","last_peered":"2024-09-21T01:14:18.746675+0000","last_clean":"2024-09-21T01:14:18.746675+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:14:18.746675+0000","last_undegraded":"2024-09-21T01:14:18.746675+0000","last_fullsized":"2024-09-21T01:14:18.746675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'12","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931252+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931252+0000","last_peered":"2024-09-21T01:14:17.931252+0000","last_clean":"2024-09-21T01:14:17.931252+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931252+0000","last_undegraded":"2024-09-21T01:14:17.931252+0000","last_fullsized":"2024-09-21T01:14:17.931252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.923741+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:14:17.923741+0000","last_peered":"2024-09-21T01:14:17.923741+0000","last_clean":"2024-09-21T01:14:17.923741+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:14:17.923741+0000","last_undegraded":"2024-09-21T01:14:17.923741+0000","last_fullsized":"2024-09-21T01:14:17.923741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922330+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:17.922330+0000","last_peered":"2024-09-21T01:14:17.922330+0000","last_clean":"2024-09-21T01:14:17.922330+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:17.922330+0000","last_undegraded":"2024-09-21T01:14:17.922330+0000","last_fullsized":"2024-09-21T01:14:17.922330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922207+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:14:17.922207+0000","last_peered":"2024-09-21T01:14:17.922207+0000","last_clean":"2024-09-21T01:14:17.922207+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:14:17.922207+0000","last_undegraded":"2024-09-21T01:14:17.922207+0000","last_fullsized":"2024-09-21T01:14:17.922207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'13","reported_seq":103,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:06.750987+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:15:06.750987+0000","last_peered":"2024-09-21T01:15:06.750987+0000","last_clean":"2024-09-21T01:15:06.750987+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:15:06.750987+0000","last_undegraded":"2024-09-21T01:15:06.750987+0000","last_fullsized":"2024-09-21T01:15:06.750987+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72032,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":691,"num_read_kb":426,"num_write":241,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":216096,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":401232,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972386,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1056630,"data_compressed":43544,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":400820,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332141,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":401081,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495666,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":993599,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659191,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":835584,"data_stored":400420,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855419,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":993277,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018944,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":400128,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":467095,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":466161,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":402150,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66580,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":67514,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66564,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:15:10.476 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:15:10.476 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T01:15:10.476 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T01:15:10.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T01:15:10.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:10 smithi137 ceph-mon[34607]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:10 smithi144 ceph-mon[34818]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:10.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:10 smithi037 ceph-mon[31105]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 -- 172.21.15.37:0/209468987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 msgr2=0x7f71f810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 --2- 172.21.15.37:0/209468987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f810d8d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009900 tx=0x7f71ec02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 -- 172.21.15.37:0/209468987 shutdown_connections 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 --2- 172.21.15.37:0/209468987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f810de10 0x7f71f8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 --2- 172.21.15.37:0/209468987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f810d8d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 --2- 172.21.15.37:0/209468987 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f8104860 0x7f71f8104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.275+0000 7f71fd50c640 1 -- 172.21.15.37:0/209468987 >> 172.21.15.37:0/209468987 conn(0x7f71f8079740 msgr2=0x7f71f8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.276+0000 7f71fd50c640 1 -- 172.21.15.37:0/209468987 shutdown_connections 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.276+0000 7f71fd50c640 1 -- 172.21.15.37:0/209468987 wait complete. 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.276+0000 7f71fd50c640 1 Processor -- start 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 -- start start 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f8104860 0x7f71f819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f810de10 0x7f71f819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8113b20 con 0x7f71f8105290 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81139a0 con 0x7f71f810de10 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71fd50c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8113ca0 con 0x7f71f8104860 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71f67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71f67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56596/0 (socket says 172.21.15.37:56596) 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71f67fc640 1 -- 172.21.15.37:0/3412637228 learned_addr learned my addr 172.21.15.37:0/3412637228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71f6ffd640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f8104860 0x7f71f819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.277+0000 7f71f77fe640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f810de10 0x7f71f819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.278+0000 7f71f67fc640 1 -- 172.21.15.37:0/3412637228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f8104860 msgr2=0x7f71f819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.278+0000 7f71f67fc640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f8104860 0x7f71f819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.278+0000 7f71f67fc640 1 -- 172.21.15.37:0/3412637228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f810de10 msgr2=0x7f71f819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.278+0000 7f71f67fc640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f810de10 0x7f71f819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.278+0000 7f71f67fc640 1 -- 172.21.15.37:0/3412637228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f81a04e0 con 0x7f71f8105290 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.278+0000 7f71f67fc640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f819ab10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005ab0 tx=0x7f71ec003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.279+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03f070 con 0x7f71f8105290 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.279+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ec031b50 con 0x7f71f8105290 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.279+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec035030 con 0x7f71f8105290 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.279+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f81a0770 con 0x7f71f8105290 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.280+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f81a6f30 con 0x7f71f8105290 2024-09-21T01:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.281+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f806c1e0 con 0x7f71f8105290 2024-09-21T01:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.282+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f71ec042070 con 0x7f71f8105290 2024-09-21T01:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.283+0000 7f71dffff640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71e00b6620 0x7f71e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.283+0000 7f71f6ffd640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71e00b6620 0x7f71e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.283+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f71ec107a70 con 0x7f71f8105290 2024-09-21T01:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.283+0000 7f71f6ffd640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71e00b6620 0x7f71e00b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71f806c8e0 tx=0x7f71e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:11.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.287+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71ec0d2580 con 0x7f71f8105290 2024-09-21T01:15:11.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:11 smithi037 ceph-mon[31105]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:15:11.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.516+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f71f819b6a0 con 0x7f71f8105290 2024-09-21T01:15:11.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.516+0000 7f71dffff640 1 -- 172.21.15.37:0/3412637228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f71ec0d74c0 con 0x7f71f8105290 2024-09-21T01:15:11.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:11.517 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.518+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71e00b6620 msgr2=0x7f71e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.518+0000 7f71fd50c640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71e00b6620 0x7f71e00b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71f806c8e0 tx=0x7f71e8005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.518+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 msgr2=0x7f71f819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.518+0000 7f71fd50c640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f819ab10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005ab0 tx=0x7f71ec003b90 comp rx=0 tx=0).stop 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 shutdown_connections 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f71e00b6620 0x7f71e00b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71f810de10 0x7f71f819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71f8105290 0x7f71f819ab10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 --2- 172.21.15.37:0/3412637228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f8104860 0x7f71f819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 >> 172.21.15.37:0/3412637228 conn(0x7f71f8079740 msgr2=0x7f71f80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 shutdown_connections 2024-09-21T01:15:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:11.519+0000 7f71fd50c640 1 -- 172.21.15.37:0/3412637228 wait complete. 2024-09-21T01:15:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:11 smithi137 ceph-mon[34607]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:15:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:11 smithi144 ceph-mon[34818]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:15:12.184 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T01:15:12.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:12 smithi137 ceph-mon[34607]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:12 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3412637228' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:15:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:12.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:12 smithi037 ceph-mon[31105]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:12.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:12 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3412637228' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:15:12.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:12 smithi144 ceph-mon[34818]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:12 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3412637228' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:15:12.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 -- 172.21.15.37:0/4056496973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 msgr2=0x7f72d81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/4056496973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d81087f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009900 tx=0x7f72cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 -- 172.21.15.37:0/4056496973 shutdown_connections 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/4056496973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72d8108d30 0x7f72d810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/4056496973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d81087f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/4056496973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 0x7f72d8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 -- 172.21.15.37:0/4056496973 >> 172.21.15.37:0/4056496973 conn(0x7f72d8079750 msgr2=0x7f72d8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 -- 172.21.15.37:0/4056496973 shutdown_connections 2024-09-21T01:15:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.939+0000 7f72ddc6e640 1 -- 172.21.15.37:0/4056496973 wait complete. 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.940+0000 7f72ddc6e640 1 Processor -- start 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.940+0000 7f72ddc6e640 1 -- start start 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 0x7f72d819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72d8108d30 0x7f72d819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72d81129f0 con 0x7f72d81083e0 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72d8112870 con 0x7f72d8102aa0 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72d8112b70 con 0x7f72d8108d30 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d819b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56616/0 (socket says 172.21.15.37:56616) 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 -- 172.21.15.37:0/2624223783 learned_addr learned my addr 172.21.15.37:0/2624223783 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:12.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d77fe640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 0x7f72d819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d7fff640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72d8108d30 0x7f72d819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 -- 172.21.15.37:0/2624223783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72d8108d30 msgr2=0x7f72d819bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72d8108d30 0x7f72d819bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 -- 172.21.15.37:0/2624223783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 msgr2=0x7f72d819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 0x7f72d819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 -- 172.21.15.37:0/2624223783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d81a65f0 con 0x7f72d81083e0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d77fe640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 0x7f72d819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d6ffd640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d819b8a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72cc02a930 tx=0x7f72cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc03f030 con 0x7f72d81083e0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.941+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d81a6880 con 0x7f72d81083e0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.942+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72cc003aa0 con 0x7f72d81083e0 2024-09-21T01:15:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.942+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc035070 con 0x7f72d81083e0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.942+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d81a6db0 con 0x7f72d81083e0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.943+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d8102eb0 con 0x7f72d81083e0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.944+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f72cc042030 con 0x7f72d81083e0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.945+0000 7f72d4ff9640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f72c00b65d0 0x7f72c00b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.945+0000 7f72d77fe640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f72c00b65d0 0x7f72c00b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.945+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f72cc107cb0 con 0x7f72d81083e0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.945+0000 7f72d77fe640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f72c00b65d0 0x7f72c00b8ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72c8005d00 tx=0x7f72c8005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:12.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:12.949+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72cc0ce3e0 con 0x7f72d81083e0 2024-09-21T01:15:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.180+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72d802e640 con 0x7f72d81083e0 2024-09-21T01:15:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.180+0000 7f72d4ff9640 1 -- 172.21.15.37:0/2624223783 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11976 (secure 0 0 0) 0x7f72cc0d27c0 con 0x7f72d81083e0 2024-09-21T01:15:13.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:13.181 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:14:02.645763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:15:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:15:13.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f72c00b65d0 msgr2=0x7f72c00b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f72c00b65d0 0x7f72c00b8ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72c8005d00 tx=0x7f72c8005c70 comp rx=0 tx=0).stop 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 msgr2=0x7f72d819b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d819b8a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72cc02a930 tx=0x7f72cc004270 comp rx=0 tx=0).stop 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 shutdown_connections 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f72c00b65d0 0x7f72c00b8ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72d8108d30 0x7f72d819bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d81083e0 0x7f72d819b8a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 --2- 172.21.15.37:0/2624223783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72d8102aa0 0x7f72d819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 >> 172.21.15.37:0/2624223783 conn(0x7f72d8079750 msgr2=0x7f72d8106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:13.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 shutdown_connections 2024-09-21T01:15:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:13.183+0000 7f72ddc6e640 1 -- 172.21.15.37:0/2624223783 wait complete. 2024-09-21T01:15:13.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:13 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2624223783' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:13.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:13 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2624223783' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:13 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2624223783' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:13.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:14.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:14 smithi037 ceph-mon[31105]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.656+0000 7f0bb8544640 1 -- 172.21.15.37:0/418466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb01083d0 msgr2=0x7f0bb01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.656+0000 7f0bb8544640 1 --2- 172.21.15.37:0/418466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb01083d0 0x7f0bb01087e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009900 tx=0x7f0ba002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.656+0000 7f0bb8544640 1 -- 172.21.15.37:0/418466499 shutdown_connections 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.656+0000 7f0bb8544640 1 --2- 172.21.15.37:0/418466499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb0108d20 0x7f0bb010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.656+0000 7f0bb8544640 1 --2- 172.21.15.37:0/418466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb01083d0 0x7f0bb01087e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.656+0000 7f0bb8544640 1 --2- 172.21.15.37:0/418466499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb0102a90 0x7f0bb0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.657+0000 7f0bb8544640 1 -- 172.21.15.37:0/418466499 >> 172.21.15.37:0/418466499 conn(0x7f0bb0079750 msgr2=0x7f0bb0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.657+0000 7f0bb8544640 1 -- 172.21.15.37:0/418466499 shutdown_connections 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.657+0000 7f0bb8544640 1 -- 172.21.15.37:0/418466499 wait complete. 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.657+0000 7f0bb8544640 1 Processor -- start 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.657+0000 7f0bb8544640 1 -- start start 2024-09-21T01:15:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb0102a90 0x7f0bb019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb01083d0 0x7f0bb019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 0x7f0bb019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01129d0 con 0x7f0bb0108d20 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0112850 con 0x7f0bb01083d0 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0112b50 con 0x7f0bb0102a90 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 0x7f0bb019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 0x7f0bb019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56642/0 (socket says 172.21.15.37:56642) 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 -- 172.21.15.37:0/1494215240 learned_addr learned my addr 172.21.15.37:0/1494215240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb5adf640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb01083d0 0x7f0bb019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb62e0640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb0102a90 0x7f0bb019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 -- 172.21.15.37:0/1494215240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb0102a90 msgr2=0x7f0bb019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb0102a90 0x7f0bb019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 -- 172.21.15.37:0/1494215240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb01083d0 msgr2=0x7f0bb019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb01083d0 0x7f0bb019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 -- 172.21.15.37:0/1494215240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb01a66b0 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb6ae1640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 0x7f0bb019be20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800b970 tx=0x7f0ba800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8019070 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba8014440 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb01a69a0 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.658+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80075d0 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.659+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb01a6e60 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.659+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb0103d10 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.661+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0ba801c070 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.662+0000 7f0ba77fe640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b9c0b65a0 0x7f0b9c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.662+0000 7f0bb62e0640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b9c0b65a0 0x7f0b9c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.662+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0ba80e6e60 con 0x7f0bb0108d20 2024-09-21T01:15:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.662+0000 7f0bb62e0640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b9c0b65a0 0x7f0b9c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0bb006c740 tx=0x7f0bac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:14.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.665+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ba80b1930 con 0x7f0bb0108d20 2024-09-21T01:15:14.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:14 smithi137 ceph-mon[34607]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:14.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:14 smithi144 ceph-mon[34818]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:14.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.895+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bb0102ea0 con 0x7f0bb0108d20 2024-09-21T01:15:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.896+0000 7f0ba77fe640 1 -- 172.21.15.37:0/1494215240 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11976 (secure 0 0 0) 0x7f0bb0102ea0 con 0x7f0bb0108d20 2024-09-21T01:15:14.897 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:14.897 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:14:02.645763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:15:14.897 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b9c0b65a0 msgr2=0x7f0b9c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b9c0b65a0 0x7f0b9c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0bb006c740 tx=0x7f0bac00b390 comp rx=0 tx=0).stop 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 msgr2=0x7f0bb019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 0x7f0bb019be20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800b970 tx=0x7f0ba800be30 comp rx=0 tx=0).stop 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 shutdown_connections 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b9c0b65a0 0x7f0b9c0b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bb0108d20 0x7f0bb019be20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bb01083d0 0x7f0bb019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 --2- 172.21.15.37:0/1494215240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb0102a90 0x7f0bb019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 >> 172.21.15.37:0/1494215240 conn(0x7f0bb0079750 msgr2=0x7f0bb0104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:14.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 shutdown_connections 2024-09-21T01:15:14.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:14.899+0000 7f0bb8544640 1 -- 172.21.15.37:0/1494215240 wait complete. 2024-09-21T01:15:15.562 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:15 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1494215240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:15.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:15:15.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:15 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1494215240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:15.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:15 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1494215240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:15.857 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 -- 172.21.15.37:0/3343670520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4178109e00 msgr2=0x7f4178110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 --2- 172.21.15.37:0/3343670520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4178109e00 0x7f4178110630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4170009ca0 tx=0x7f417002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 -- 172.21.15.37:0/3343670520 shutdown_connections 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 --2- 172.21.15.37:0/3343670520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4178109e00 0x7f4178110630 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 --2- 172.21.15.37:0/3343670520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41781094b0 0x7f41781098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 --2- 172.21.15.37:0/3343670520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4178103bc0 0x7f4178103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 -- 172.21.15.37:0/3343670520 >> 172.21.15.37:0/3343670520 conn(0x7f417807b910 msgr2=0x7f417807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 -- 172.21.15.37:0/3343670520 shutdown_connections 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.358+0000 7f417d327640 1 -- 172.21.15.37:0/3343670520 wait complete. 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.359+0000 7f417d327640 1 Processor -- start 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.359+0000 7f417d327640 1 -- start start 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.359+0000 7f417d327640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4178103bc0 0x7f417819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.359+0000 7f417d327640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 0x7f417819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f417d327640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4178109e00 0x7f417819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f417d327640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4178113ac0 con 0x7f41781094b0 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f417d327640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4178113940 con 0x7f4178109e00 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f417d327640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4178113c40 con 0x7f4178103bc0 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 0x7f417819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 0x7f417819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58978/0 (socket says 172.21.15.37:58978) 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 -- 172.21.15.37:0/2768959066 learned_addr learned my addr 172.21.15.37:0/2768959066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f4176ffd640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4178103bc0 0x7f417819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41777fe640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4178109e00 0x7f417819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 -- 172.21.15.37:0/2768959066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4178103bc0 msgr2=0x7f417819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4178103bc0 0x7f417819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 -- 172.21.15.37:0/2768959066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4178109e00 msgr2=0x7f417819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4178109e00 0x7f417819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 -- 172.21.15.37:0/2768959066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41781a03c0 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f41767fc640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 0x7f417819a9f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c970 tx=0x7f416c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c007bb0 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41781a06b0 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f416c007d50 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c004e10 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.360+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41781a6e10 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.362+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4178103fd0 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.363+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f416c005000 con 0x7f41781094b0 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.364+0000 7f415ffff640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41600b65a0 0x7f41600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.364+0000 7f4176ffd640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41600b65a0 0x7f41600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.364+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f416c0e7170 con 0x7f41781094b0 2024-09-21T01:15:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.364+0000 7f4176ffd640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41600b65a0 0x7f41600b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4168005fd0 tx=0x7f416800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:16.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.368+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f416c014030 con 0x7f41781094b0 2024-09-21T01:15:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.557+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f417810b660 con 0x7f41781094b0 2024-09-21T01:15:16.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:16 smithi037 ceph-mon[31105]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:16.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.558+0000 7f415ffff640 1 -- 172.21.15.37:0/2768959066 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7f416c0d0020 con 0x7f41781094b0 2024-09-21T01:15:16.559 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:16.559 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:15:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41600b65a0 msgr2=0x7f41600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41600b65a0 0x7f41600b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4168005fd0 tx=0x7f416800b390 comp rx=0 tx=0).stop 2024-09-21T01:15:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 msgr2=0x7f417819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 0x7f417819a9f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c970 tx=0x7f416c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 shutdown_connections 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41600b65a0 0x7f41600b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4178109e00 0x7f417819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41781094b0 0x7f417819a9f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 --2- 172.21.15.37:0/2768959066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4178103bc0 0x7f417819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 >> 172.21.15.37:0/2768959066 conn(0x7f417807b910 msgr2=0x7f4178105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 shutdown_connections 2024-09-21T01:15:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:16.561+0000 7f417d327640 1 -- 172.21.15.37:0/2768959066 wait complete. 2024-09-21T01:15:16.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:16 smithi137 ceph-mon[34607]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:16.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:16 smithi144 ceph-mon[34818]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:17.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:17.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:17 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2768959066' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:17.531 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:17.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:17 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2768959066' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:17.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:17 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2768959066' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:18.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3038283122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 msgr2=0x7f49b01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3038283122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b01087e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4998009900 tx=0x7f499802a410 comp rx=0 tx=0).stop 2024-09-21T01:15:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3038283122 shutdown_connections 2024-09-21T01:15:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3038283122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b0108d20 0x7f49b010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3038283122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b01087e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3038283122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0102ae0 0x7f49b0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3038283122 >> 172.21.15.37:0/3038283122 conn(0x7f49b0079760 msgr2=0x7f49b0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3038283122 shutdown_connections 2024-09-21T01:15:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.050+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3038283122 wait complete. 2024-09-21T01:15:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 Processor -- start 2024-09-21T01:15:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 -- start start 2024-09-21T01:15:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0102ae0 0x7f49b019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b0108d20 0x7f49b019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0112aa0 con 0x7f49b01083d0 2024-09-21T01:15:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0112920 con 0x7f49b0108d20 2024-09-21T01:15:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49b4a4a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0112c20 con 0x7f49b0102ae0 2024-09-21T01:15:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59000/0 (socket says 172.21.15.37:59000) 2024-09-21T01:15:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 -- 172.21.15.37:0/3784914655 learned_addr learned my addr 172.21.15.37:0/3784914655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49aed9d640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b0108d20 0x7f49b019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49ae59c640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0102ae0 0x7f49b019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 -- 172.21.15.37:0/3784914655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0102ae0 msgr2=0x7f49b019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0102ae0 0x7f49b019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 -- 172.21.15.37:0/3784914655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b0108d20 msgr2=0x7f49b019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b0108d20 0x7f49b019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.051+0000 7f49add9b640 1 -- 172.21.15.37:0/3784914655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b01a0530 con 0x7f49b01083d0 2024-09-21T01:15:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.052+0000 7f49add9b640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b019ab60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4998031440 tx=0x7f4998003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.052+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499803f070 con 0x7f49b01083d0 2024-09-21T01:15:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.052+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b01a07c0 con 0x7f49b01083d0 2024-09-21T01:15:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.052+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4998031d60 con 0x7f49b01083d0 2024-09-21T01:15:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.052+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998035030 con 0x7f49b01083d0 2024-09-21T01:15:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.052+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b01a6f80 con 0x7f49b01083d0 2024-09-21T01:15:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.053+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b0103d10 con 0x7f49b01083d0 2024-09-21T01:15:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.054+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4998042070 con 0x7f49b01083d0 2024-09-21T01:15:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.056+0000 7f49a77fe640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f499c0b65a0 0x7f499c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.056+0000 7f49ae59c640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f499c0b65a0 0x7f499c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.056+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4998108290 con 0x7f49b01083d0 2024-09-21T01:15:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.056+0000 7f49ae59c640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f499c0b65a0 0x7f499c0b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f49a000a810 tx=0x7f49a0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.059+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49980ce9c0 con 0x7f49b01083d0 2024-09-21T01:15:18.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.284+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49b019b6f0 con 0x7f49b01083d0 2024-09-21T01:15:18.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.285+0000 7f49a77fe640 1 -- 172.21.15.37:0/3784914655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11976 (secure 0 0 0) 0x7f49b019b6f0 con 0x7f49b01083d0 2024-09-21T01:15:18.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:14:02.645763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:15:18.286 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:15:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f499c0b65a0 msgr2=0x7f499c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f499c0b65a0 0x7f499c0b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f49a000a810 tx=0x7f49a0008040 comp rx=0 tx=0).stop 2024-09-21T01:15:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 msgr2=0x7f49b019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b019ab60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4998031440 tx=0x7f4998003d50 comp rx=0 tx=0).stop 2024-09-21T01:15:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 shutdown_connections 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f499c0b65a0 0x7f499c0b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49b0108d20 0x7f49b019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49b01083d0 0x7f49b019ab60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 --2- 172.21.15.37:0/3784914655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49b0102ae0 0x7f49b019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 >> 172.21.15.37:0/3784914655 conn(0x7f49b0079760 msgr2=0x7f49b006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 shutdown_connections 2024-09-21T01:15:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:18.288+0000 7f49b4a4a640 1 -- 172.21.15.37:0/3784914655 wait complete. 2024-09-21T01:15:18.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:18 smithi137 ceph-mon[34607]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:18.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:18 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3784914655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:18.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:18 smithi144 ceph-mon[34818]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:18.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:18 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3784914655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:18.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:18 smithi037 ceph-mon[31105]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:18.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:18 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3784914655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:18.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:13:51.265572+0000', 'modified': '2024-09-21T01:14:02.645763+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24635, 'mds_1': 24631, 'mds_2': 24610, 'mds_3': 24605, 'mds_4': 24604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14808': {'gid': 14808, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/3638461031', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 3638461031}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 3638461031}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14820': {'gid': 14820, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/3072910125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 3072910125}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 3072910125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24554': {'gid': 24554, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6833/1167918014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 1167918014}, {'type': 'v1', 'addr': '172.21.15.137:6833', 'nonce': 1167918014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6833/299841905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6832', 'nonce': 299841905}, {'type': 'v1', 'addr': '172.21.15.144:6833', 'nonce': 299841905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6835/2865149890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 2865149890}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 2865149890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24604': {'gid': 24604, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.144:6835/3565351680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3565351680}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3565351680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24605': {'gid': 24605, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.137:6837/234673492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 234673492}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 234673492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.144:6837/3444337683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 3444337683}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 3444337683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.144:6839/2711377630', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 2711377630}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 2711377630}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24635': {'gid': 24635, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6839/302617634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 302617634}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 302617634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24635, 'qdb_cluster': [24635, 24610, 24631, 24605, 24604]} 2024-09-21T01:15:18.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T01:15:18.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T01:15:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 -- 172.21.15.37:0/914167546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c102a80 msgr2=0x7fe73c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 --2- 172.21.15.37:0/914167546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c102a80 0x7fe73c102e90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009900 tx=0x7fe72c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 -- 172.21.15.37:0/914167546 shutdown_connections 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 --2- 172.21.15.37:0/914167546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c108d10 0x7fe73c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 --2- 172.21.15.37:0/914167546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c1083c0 0x7fe73c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 --2- 172.21.15.37:0/914167546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c102a80 0x7fe73c102e90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 -- 172.21.15.37:0/914167546 >> 172.21.15.37:0/914167546 conn(0x7fe73c079740 msgr2=0x7fe73c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 -- 172.21.15.37:0/914167546 shutdown_connections 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.693+0000 7fe741ad6640 1 -- 172.21.15.37:0/914167546 wait complete. 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 Processor -- start 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 -- start start 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c102a80 0x7fe73c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c1083c0 0x7fe73c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 0x7fe73c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c113aa0 con 0x7fe73c108d10 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c113920 con 0x7fe73c1083c0 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe741ad6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c113c20 con 0x7fe73c102a80 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe73bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 0x7fe73c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe73bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 0x7fe73c19fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59022/0 (socket says 172.21.15.37:59022) 2024-09-21T01:15:19.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe73bfff640 1 -- 172.21.15.37:0/2867159020 learned_addr learned my addr 172.21.15.37:0/2867159020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe73affd640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c1083c0 0x7fe73c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.694+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c102a80 0x7fe73c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73bfff640 1 -- 172.21.15.37:0/2867159020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c102a80 msgr2=0x7fe73c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73bfff640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c102a80 0x7fe73c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73bfff640 1 -- 172.21.15.37:0/2867159020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c1083c0 msgr2=0x7fe73c19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73bfff640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c1083c0 0x7fe73c19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73bfff640 1 -- 172.21.15.37:0/2867159020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c1a02c0 con 0x7fe73c108d10 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c102a80 0x7fe73c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe73bfff640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 0x7fe73c19fc50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe73400cce0 tx=0x7fe73400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe738ff9640 1 -- 172.21.15.37:0/2867159020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73400f450 con 0x7fe73c108d10 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe738ff9640 1 -- 172.21.15.37:0/2867159020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe73400faa0 con 0x7fe73c108d10 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c1a05b0 con 0x7fe73c108d10 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe738ff9640 1 -- 172.21.15.37:0/2867159020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734018a80 con 0x7fe73c108d10 2024-09-21T01:15:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.695+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c1a6dd0 con 0x7fe73c108d10 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 Processor -- start 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe738ff9640 1 -- 172.21.15.37:0/2867159020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe73400fc50 con 0x7fe73c108d10 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 -- start start 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910bd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910bd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee91034c10 con 0x55ee90cee0a0 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee91024040 con 0x55ee90cf6280 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe74804a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee91027e50 con 0x55ee90d16f60 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910bd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59034/0 (socket says 172.21.15.37:59034) 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3744319621 learned_addr learned my addr 172.21.15.37:0/3744319621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe73affd640 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.698+0000 7fe73affd640 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910bd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3744319621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 msgr2=0x55ee910bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3744319621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 msgr2=0x55ee910bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910bd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3744319621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee90d82540 con 0x55ee90cee0a0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe738ff9640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7240b6540 0x7fe7240b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73affd640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7240b6540 0x7fe7240b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910bd440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0096c0 tx=0x7fe72c031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6075d83eafba28c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe738ff9640 1 -- 172.21.15.37:0/2867159020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe7340e7720 con 0x7fe73c108d10 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe721ffb640 1 -- 172.21.15.37:0/3744319621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c03f070 con 0x55ee90cee0a0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe721ffb640 1 -- 172.21.15.37:0/3744319621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe72c0316a0 con 0x55ee90cee0a0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.699+0000 7fe721ffb640 1 -- 172.21.15.37:0/3744319621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c035070 con 0x55ee90cee0a0 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 -- 172.21.15.37:0/3744319621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 msgr2=0x55ee910bd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910bd440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0096c0 tx=0x7fe72c031e60 comp rx=0 tx=0).stop 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe73affd640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7240b6540 0x7fe7240b8a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe73c1080a0 tx=0x7fe73000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 -- 172.21.15.37:0/3744319621 shutdown_connections 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910bd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910bd440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 --2- 172.21.15.37:0/3744319621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 -- 172.21.15.37:0/3744319621 >> 172.21.15.37:0/3744319621 conn(0x55ee90d0b350 msgr2=0x55ee910badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 -- 172.21.15.37:0/3744319621 shutdown_connections 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.700+0000 7fe74804a740 1 -- 172.21.15.37:0/3744319621 wait complete. 2024-09-21T01:15:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 -- start start 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 Processor -- start 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee90e855f0 con 0x55ee90cee0a0 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee90fbf010 con 0x55ee90cf6280 2024-09-21T01:15:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee910cb680 con 0x55ee90d16f60 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.701+0000 7fe74804a740 10 client.0 _ll_register_callbacks cb 0x55ee9101e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59044/0 (socket says 172.21.15.37:59044) 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3734430718 learned_addr learned my addr 172.21.15.37:0/3734430718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73bfff640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73affd640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 msgr2=0x55ee910d49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3734430718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 msgr2=0x55ee910c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 -- 172.21.15.37:0/3734430718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee90feca00 con 0x55ee90cee0a0 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73affd640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:19.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910c8730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe72c005ab0 tx=0x7fe72c031520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78dd3e7826ed7c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe71affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe71affd640 1 -- 172.21.15.37:0/3734430718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c04b020 con 0x55ee90cee0a0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe71affd640 1 -- 172.21.15.37:0/3734430718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe72c004460 con 0x55ee90cee0a0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.702+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe72c0316a0 con 0x55ee90cee0a0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe71affd640 1 -- 172.21.15.37:0/3734430718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe72c035070 con 0x55ee90cee0a0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 10 client.15207 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee910d74e0 con 0x55ee90cee0a0 2024-09-21T01:15:19.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe71affd640 1 -- 172.21.15.37:0/3734430718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe72c0316a0 con 0x55ee90cee0a0 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe71affd640 1 -- 172.21.15.37:0/3734430718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe72c044850 con 0x55ee90cee0a0 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 10 client.15207 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 10 client.15207 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 20 client.15207 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90cd58e0 0x55ee910db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 4 client.15207 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.703+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee91036b60 con 0x55ee90cd58e0 2024-09-21T01:15:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.704+0000 7fe73affd640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90cd58e0 0x55ee910db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.704+0000 7fe71affd640 10 client.15207 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.704+0000 7fe73affd640 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90cd58e0 0x55ee910db0b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e243dd38a1d5960f server_cookie=237f6dcf78079431 in_seq=0 out_seq=0 2024-09-21T01:15:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe71affd640 1 -- 172.21.15.37:0/3734430718 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee91036b60 con 0x55ee90cd58e0 2024-09-21T01:15:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe71affd640 10 client.15207 handle_command_reply: tid=0 2024-09-21T01:15:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 client.15207 shutdown 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 msgr2=0x55ee910c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910c8730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe72c005ab0 tx=0x7fe72c031520 comp rx=0 tx=0).stop 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 shutdown_connections 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90cd58e0 0x55ee910db0b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 --2- 172.21.15.37:0/3734430718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910c8730 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 >> 172.21.15.37:0/3734430718 conn(0x55ee90d0b350 msgr2=0x55ee910c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe71affd640 0 client.15207 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 shutdown_connections 2024-09-21T01:15:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 1 -- 172.21.15.37:0/3734430718 wait complete. 2024-09-21T01:15:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.705+0000 7fe74804a740 20 client.15207 trim_cache size 0 max 16384 2024-09-21T01:15:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 Processor -- start 2024-09-21T01:15:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 -- start start 2024-09-21T01:15:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cee0a0 0x55ee910c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 0x55ee910b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee910d93f0 con 0x55ee90cf6280 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee910d9ac0 con 0x55ee90cee0a0 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe74804a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee910da190 con 0x55ee90d16f60 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 0x55ee910b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 0x55ee910b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59050/0 (socket says 172.21.15.37:59050) 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 -- 172.21.15.37:0/3484514064 learned_addr learned my addr 172.21.15.37:0/3484514064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 -- 172.21.15.37:0/3484514064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 msgr2=0x55ee910d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 -- 172.21.15.37:0/3484514064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cee0a0 msgr2=0x55ee910c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cee0a0 0x55ee910c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 -- 172.21.15.37:0/3484514064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee910d91f0 con 0x55ee90cf6280 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.724+0000 7fe73affd640 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 0x55ee910b5ad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55ee910dbe50 tx=0x7fe730004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86a9ab9dc01b8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe7217fa640 1 -- 172.21.15.37:0/3484514064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730032640 con 0x55ee90cf6280 2024-09-21T01:15:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe7217fa640 1 -- 172.21.15.37:0/3484514064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe73002a860 con 0x55ee90cf6280 2024-09-21T01:15:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe7217fa640 1 -- 172.21.15.37:0/3484514064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300218e0 con 0x55ee90cf6280 2024-09-21T01:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe74804a740 1 -- 172.21.15.37:0/3484514064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 msgr2=0x55ee910b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe74804a740 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 0x55ee910b5ad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55ee910dbe50 tx=0x7fe730004730 comp rx=0 tx=0).stop 2024-09-21T01:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe74804a740 1 -- 172.21.15.37:0/3484514064 shutdown_connections 2024-09-21T01:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe74804a740 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe74804a740 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cf6280 0x55ee910b5ad0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.725+0000 7fe74804a740 1 --2- 172.21.15.37:0/3484514064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cee0a0 0x55ee910c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 -- 172.21.15.37:0/3484514064 >> 172.21.15.37:0/3484514064 conn(0x55ee90d0b350 msgr2=0x55ee910c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 -- 172.21.15.37:0/3484514064 shutdown_connections 2024-09-21T01:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 -- 172.21.15.37:0/3484514064 wait complete. 2024-09-21T01:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 -- start start 2024-09-21T01:15:19.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 Processor -- start 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.726+0000 7fe74804a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910e2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe74804a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee910daf30 con 0x55ee90cee0a0 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe74804a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee910da860 con 0x55ee90cf6280 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe74804a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee910db600 con 0x55ee90d16f60 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe74804a740 10 client.0 _ll_register_callbacks cb 0x7fe73000a770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910ddff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59054/0 (socket says 172.21.15.37:59054) 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 -- 172.21.15.37:0/1621411724 learned_addr learned my addr 172.21.15.37:0/1621411724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73bfff640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73affd640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 -- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 msgr2=0x55ee910e2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910e2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 -- 172.21.15.37:0/1621411724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 msgr2=0x55ee910de5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910de5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 -- 172.21.15.37:0/1621411724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee910e26d0 con 0x55ee90cee0a0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe73b7fe640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910ddff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe72c02a930 tx=0x7fe72c0044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9666cb0c13d6da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe71affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe71affd640 1 -- 172.21.15.37:0/1621411724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c04b040 con 0x55ee90cee0a0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.727+0000 7fe71affd640 1 -- 172.21.15.37:0/1621411724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe72c003a00 con 0x55ee90cee0a0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe73002a860 con 0x55ee90cee0a0 2024-09-21T01:15:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe71affd640 1 -- 172.21.15.37:0/1621411724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe72c03f040 con 0x55ee90cee0a0 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 10 client.15213 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ee910e3a90 con 0x55ee90cee0a0 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe71affd640 1 -- 172.21.15.37:0/1621411724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe73002a860 con 0x55ee90cee0a0 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe71affd640 1 -- 172.21.15.37:0/1621411724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe72c059020 con 0x55ee90cee0a0 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 10 client.15213 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 10 client.15213 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 20 client.15213 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90caac90 0x55ee91149370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 4 client.15213 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "status"}) -- 0x55ee91032610 con 0x55ee90caac90 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.728+0000 7fe73affd640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90caac90 0x55ee91149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe71affd640 10 client.15213 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe73affd640 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90caac90 0x55ee91149370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8a3613341f778258 server_cookie=bfaa2e31fcd7c23e in_seq=0 out_seq=0 2024-09-21T01:15:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe71affd640 1 -- 172.21.15.37:0/1621411724 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ee91032610 con 0x55ee90caac90 2024-09-21T01:15:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe71affd640 10 client.15213 handle_command_reply: tid=0 2024-09-21T01:15:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 client.15213 shutdown 2024-09-21T01:15:19.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 msgr2=0x55ee910ddff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910ddff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe72c02a930 tx=0x7fe72c0044f0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 shutdown_connections 2024-09-21T01:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ee90caac90 0x55ee91149370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee90d16f60 0x55ee910e2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee90cf6280 0x55ee910de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 --2- 172.21.15.37:0/1621411724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee90cee0a0 0x55ee910ddff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 >> 172.21.15.37:0/1621411724 conn(0x55ee90d0b350 msgr2=0x55ee910c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe71affd640 0 client.15213 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.729+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 shutdown_connections 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe74804a740 1 -- 172.21.15.37:0/1621411724 wait complete. 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe74804a740 20 client.15213 trim_cache size 0 max 16384 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24604, 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:19.736 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 78.088672786000004, 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 115.89094741300001 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:19.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7240b6540 msgr2=0x7fe7240b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7240b6540 0x7fe7240b8a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe73c1080a0 tx=0x7fe73000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 msgr2=0x7fe73c19fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 0x7fe73c19fc50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe73400cce0 tx=0x7fe73400a620 comp rx=0 tx=0).stop 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 shutdown_connections 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe7240b6540 0x7fe7240b8a50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108d10 0x7fe73c19fc50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe73c1083c0 0x7fe73c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 --2- 172.21.15.37:0/2867159020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c102a80 0x7fe73c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.730+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 >> 172.21.15.37:0/2867159020 conn(0x7fe73c079740 msgr2=0x7fe73c101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.731+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 shutdown_connections 2024-09-21T01:15:19.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:19.731+0000 7fe741ad6640 1 -- 172.21.15.37:0/2867159020 wait complete. 2024-09-21T01:15:20.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:20 smithi037 ceph-mon[31105]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-21T01:15:20.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:20 smithi037 ceph-mon[31105]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T01:15:20.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T01:15:20.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:20 smithi137 ceph-mon[34607]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-21T01:15:20.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:20 smithi137 ceph-mon[34607]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T01:15:20.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:20 smithi144 ceph-mon[34818]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-21T01:15:20.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:20 smithi144 ceph-mon[34818]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T01:15:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:21.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 -- 172.21.15.37:0/2535259099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b041083a0 msgr2=0x7f7b041087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/2535259099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b041083a0 0x7f7b041087b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009900 tx=0x7f7aec02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 -- 172.21.15.37:0/2535259099 shutdown_connections 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/2535259099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b04108cf0 0x7f7b0410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/2535259099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b041083a0 0x7f7b041087b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/2535259099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b04102a60 0x7f7b04102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 -- 172.21.15.37:0/2535259099 >> 172.21.15.37:0/2535259099 conn(0x7f7b04079730 msgr2=0x7f7b04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 -- 172.21.15.37:0/2535259099 shutdown_connections 2024-09-21T01:15:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.215+0000 7f7b0a07b640 1 -- 172.21.15.37:0/2535259099 wait complete. 2024-09-21T01:15:21.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 Processor -- start 2024-09-21T01:15:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 -- start start 2024-09-21T01:15:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b04102a60 0x7f7b0419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b041083a0 0x7f7b0419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 0x7f7b0419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041129a0 con 0x7f7b04108cf0 2024-09-21T01:15:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04112820 con 0x7f7b041083a0 2024-09-21T01:15:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b0a07b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04112b20 con 0x7f7b04102a60 2024-09-21T01:15:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.216+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 0x7f7b0419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 0x7f7b0419be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59066/0 (socket says 172.21.15.37:59066) 2024-09-21T01:15:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 -- 172.21.15.37:0/29430859 learned_addr learned my addr 172.21.15.37:0/29430859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b037fe640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b04102a60 0x7f7b0419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b041083a0 0x7f7b0419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 -- 172.21.15.37:0/29430859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b04102a60 msgr2=0x7f7b0419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b04102a60 0x7f7b0419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 -- 172.21.15.37:0/29430859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b041083a0 msgr2=0x7f7b0419b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b041083a0 0x7f7b0419b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 -- 172.21.15.37:0/29430859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b041a6660 con 0x7f7b04108cf0 2024-09-21T01:15:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b03fff640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 0x7f7b0419be50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00b970 tx=0x7f7afc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b00ff9640 1 -- 172.21.15.37:0/29430859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc019070 con 0x7f7b04108cf0 2024-09-21T01:15:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b00ff9640 1 -- 172.21.15.37:0/29430859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7afc014440 con 0x7f7b04108cf0 2024-09-21T01:15:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b041a6950 con 0x7f7b04108cf0 2024-09-21T01:15:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b00ff9640 1 -- 172.21.15.37:0/29430859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0075d0 con 0x7f7b04108cf0 2024-09-21T01:15:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.217+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b041a6e10 con 0x7f7b04108cf0 2024-09-21T01:15:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 Processor -- start 2024-09-21T01:15:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b00ff9640 1 -- 172.21.15.37:0/29430859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7afc01c070 con 0x7f7b04108cf0 2024-09-21T01:15:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 -- start start 2024-09-21T01:15:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db69cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db69d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2d6280 0x5602db69d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602db614c10 con 0x5602db2ce0a0 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602db604040 con 0x5602db2d6280 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.220+0000 7f7b105ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5602db607e50 con 0x5602db2f6f60 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db69d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db69d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59076/0 (socket says 172.21.15.37:59076) 2024-09-21T01:15:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 -- 172.21.15.37:0/4058819796 learned_addr learned my addr 172.21.15.37:0/4058819796 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db69cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2d6280 0x5602db69d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b00ff9640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7af00b6540 0x7f7af00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 -- 172.21.15.37:0/4058819796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 msgr2=0x5602db69cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db69cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 -- 172.21.15.37:0/4058819796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2d6280 msgr2=0x5602db69d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2d6280 0x5602db69d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 -- 172.21.15.37:0/4058819796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602db362540 con 0x5602db2ce0a0 2024-09-21T01:15:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2d6280 0x5602db69d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b00ff9640 1 -- 172.21.15.37:0/29430859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7afc0e6780 con 0x7f7b04108cf0 2024-09-21T01:15:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b03fff640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7af00b6540 0x7f7af00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.221+0000 7f7b037fe640 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db69d440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7af400bcb0 tx=0x7f7af40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7806a20716d62e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.222+0000 7f7af9ffb640 1 -- 172.21.15.37:0/4058819796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af401c480 con 0x5602db2ce0a0 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.222+0000 7f7af9ffb640 1 -- 172.21.15.37:0/4058819796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7af401cad0 con 0x5602db2ce0a0 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.222+0000 7f7af9ffb640 1 -- 172.21.15.37:0/4058819796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4011c70 con 0x5602db2ce0a0 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 -- 172.21.15.37:0/4058819796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 msgr2=0x5602db69d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b03fff640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7af00b6540 0x7f7af00b8a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00b940 tx=0x7f7afc004b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db69d440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7af400bcb0 tx=0x7f7af40107a0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 -- 172.21.15.37:0/4058819796 shutdown_connections 2024-09-21T01:15:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2d6280 0x5602db69d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db69d440 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 --2- 172.21.15.37:0/4058819796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db69cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 -- 172.21.15.37:0/4058819796 >> 172.21.15.37:0/4058819796 conn(0x5602db2eb350 msgr2=0x5602db69adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 -- 172.21.15.37:0/4058819796 shutdown_connections 2024-09-21T01:15:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 -- 172.21.15.37:0/4058819796 wait complete. 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 -- start start 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.223+0000 7f7b105ef740 1 Processor -- start 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db6a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2f6f60 0x5602db6b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602db4655f0 con 0x5602db2ce0a0 2024-09-21T01:15:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602db59f010 con 0x5602db2f6f60 2024-09-21T01:15:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5602db6ab6e0 con 0x5602db2d6280 2024-09-21T01:15:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b105ef740 10 client.0 _ll_register_callbacks cb 0x5602db5fe340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db6a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db6a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59088/0 (socket says 172.21.15.37:59088) 2024-09-21T01:15:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 -- 172.21.15.37:0/1381511583 learned_addr learned my addr 172.21.15.37:0/1381511583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b037fe640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2f6f60 0x5602db6b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 -- 172.21.15.37:0/1381511583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 msgr2=0x5602db6a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 -- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2f6f60 msgr2=0x5602db6b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2f6f60 0x5602db6b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 -- 172.21.15.37:0/1381511583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602db5cca00 con 0x5602db2ce0a0 2024-09-21T01:15:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db6a8aa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009900 tx=0x7f7aec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645f7567dcad959e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.224+0000 7f7ae2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1381511583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec035040 con 0x5602db2ce0a0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1381511583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7aec004450 con 0x5602db2ce0a0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7af401cad0 con 0x5602db2ce0a0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1381511583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7aec052050 con 0x5602db2ce0a0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 10 client.15225 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602db6b7610 con 0x5602db2ce0a0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1381511583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7af401cad0 con 0x5602db2ce0a0 2024-09-21T01:15:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1381511583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7aec03d610 con 0x5602db2ce0a0 2024-09-21T01:15:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 10 client.15225 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 10 client.15225 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T01:15:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 20 client.15225 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db2b58e0 0x5602db6bb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 4 client.15225 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.225+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602db616b60 con 0x5602db2b58e0 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.226+0000 7f7b037fe640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db2b58e0 0x5602db6bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.226+0000 7f7b037fe640 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db2b58e0 0x5602db6bb070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8741d504490af570 server_cookie=3e6a89e28f5bc7f1 in_seq=0 out_seq=0 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.226+0000 7f7ae2ffd640 10 client.15225 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1381511583 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602db616b60 con 0x5602db2b58e0 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7ae2ffd640 10 client.15225 handle_command_reply: tid=0 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 client.15225 shutdown 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 msgr2=0x5602db6a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db6a8aa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009900 tx=0x7f7aec009260 comp rx=0 tx=0).stop 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 shutdown_connections 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db2b58e0 0x5602db6bb070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2f6f60 0x5602db6b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1381511583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2ce0a0 0x5602db6a8aa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 >> 172.21.15.37:0/1381511583 conn(0x5602db2eb350 msgr2=0x5602db6a0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7ae2ffd640 0 client.15225 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 shutdown_connections 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 1 -- 172.21.15.37:0/1381511583 wait complete. 2024-09-21T01:15:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.227+0000 7f7b105ef740 20 client.15225 trim_cache size 0 max 16384 2024-09-21T01:15:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.245+0000 7f7b105ef740 1 Processor -- start 2024-09-21T01:15:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.245+0000 7f7b105ef740 1 -- start start 2024-09-21T01:15:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 0x5602db6a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b105ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602db6b93b0 con 0x5602db2f6f60 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b105ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602db6b9a80 con 0x5602db2ce0a0 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b105ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5602db6ba150 con 0x5602db2d6280 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 0x5602db6a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 0x5602db6a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59092/0 (socket says 172.21.15.37:59092) 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 -- 172.21.15.37:0/2647486920 learned_addr learned my addr 172.21.15.37:0/2647486920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 -- 172.21.15.37:0/2647486920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 msgr2=0x5602db6a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b037fe640 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 -- 172.21.15.37:0/2647486920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 msgr2=0x5602db6a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 -- 172.21.15.37:0/2647486920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602db695080 con 0x5602db2f6f60 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 0x5602db6a3a50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098d0 tx=0x7f7aec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2306408752d4633f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.246+0000 7f7af97fa640 1 -- 172.21.15.37:0/2647486920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec035030 con 0x5602db2f6f60 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7af97fa640 1 -- 172.21.15.37:0/2647486920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aec004250 con 0x5602db2f6f60 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7af97fa640 1 -- 172.21.15.37:0/2647486920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec041040 con 0x5602db2f6f60 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 -- 172.21.15.37:0/2647486920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 msgr2=0x5602db6a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 0x5602db6a3a50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098d0 tx=0x7f7aec031400 comp rx=0 tx=0).stop 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 -- 172.21.15.37:0/2647486920 shutdown_connections 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2f6f60 0x5602db6a3a50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2d6280 0x5602db6a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 --2- 172.21.15.37:0/2647486920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 -- 172.21.15.37:0/2647486920 >> 172.21.15.37:0/2647486920 conn(0x5602db2eb350 msgr2=0x5602db6a2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 -- 172.21.15.37:0/2647486920 shutdown_connections 2024-09-21T01:15:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.247+0000 7f7b105ef740 1 -- 172.21.15.37:0/2647486920 wait complete. 2024-09-21T01:15:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 -- start start 2024-09-21T01:15:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 Processor -- start 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 0x5602db6bcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db6bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602db6baef0 con 0x5602db2d6280 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602db6ba820 con 0x5602db2ce0a0 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5602db6bb5c0 con 0x5602db2f6f60 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b105ef740 10 client.0 _ll_register_callbacks cb 0x7f7aec009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 0x5602db6bcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 0x5602db6bcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59102/0 (socket says 172.21.15.37:59102) 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b037fe640 1 -- 172.21.15.37:0/1990545968 learned_addr learned my addr 172.21.15.37:0/1990545968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.248+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db6bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b037fe640 1 -- 172.21.15.37:0/1990545968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 msgr2=0x5602db6bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b037fe640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db6bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b037fe640 1 -- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 msgr2=0x5602db6c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b037fe640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b037fe640 1 -- 172.21.15.37:0/1990545968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602db6bdcf0 con 0x5602db2d6280 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b037fe640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 0x5602db6bcfe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7af400ba40 tx=0x7f7af400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a175b9ddeae2be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7ae2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1990545968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4005240 con 0x5602db2d6280 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1990545968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7af40053e0 con 0x5602db2d6280 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aec004250 con 0x5602db2d6280 2024-09-21T01:15:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1990545968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7af4011560 con 0x5602db2d6280 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b105ef740 10 client.15231 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602db726540 con 0x5602db2d6280 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.249+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1990545968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aec004250 con 0x5602db2d6280 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1990545968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7af401c8d0 con 0x5602db2d6280 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b105ef740 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b105ef740 10 client.15231 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b105ef740 20 client.15231 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db28ac90 0x5602db729be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b105ef740 4 client.15231 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "status"}) -- 0x5602db612610 con 0x5602db28ac90 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db28ac90 0x5602db729be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7b02ffd640 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db28ac90 0x5602db729be0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9f5705e5172e93d4 server_cookie=fe198a42052593db in_seq=0 out_seq=0 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.250+0000 7f7ae2ffd640 10 client.15231 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1990545968 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5602db612610 con 0x5602db28ac90 2024-09-21T01:15:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7ae2ffd640 10 client.15231 handle_command_reply: tid=0 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 client.15231 shutdown 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 msgr2=0x5602db6bcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 0x5602db6bcfe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7af400ba40 tx=0x7f7af400bc00 comp rx=0 tx=0).stop 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 shutdown_connections 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5602db28ac90 0x5602db729be0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602db2f6f60 0x5602db6bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602db2d6280 0x5602db6bcfe0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7ae2ffd640 0 client.15231 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 --2- 172.21.15.37:0/1990545968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602db2ce0a0 0x5602db6c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 >> 172.21.15.37:0/1990545968 conn(0x5602db2eb350 msgr2=0x5602db6a3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 shutdown_connections 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 1 -- 172.21.15.37:0/1990545968 wait complete. 2024-09-21T01:15:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.251+0000 7f7b105ef740 20 client.15231 trim_cache size 0 max 16384 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24605, 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 80.625182351999996, 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:21.258 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:21.259 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:21.259 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 112.22399697900001 2024-09-21T01:15:21.259 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7af00b6540 msgr2=0x7f7af00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7af00b6540 0x7f7af00b8a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00b940 tx=0x7f7afc004b50 comp rx=0 tx=0).stop 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 msgr2=0x7f7b0419be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 0x7f7b0419be50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00b970 tx=0x7f7afc00be30 comp rx=0 tx=0).stop 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 shutdown_connections 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7af00b6540 0x7f7af00b8a50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b04108cf0 0x7f7b0419be50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b041083a0 0x7f7b0419b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 --2- 172.21.15.37:0/29430859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b04102a60 0x7f7b0419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 >> 172.21.15.37:0/29430859 conn(0x7f7b04079730 msgr2=0x7f7b04104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 shutdown_connections 2024-09-21T01:15:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:21.252+0000 7f7b0a07b640 1 -- 172.21.15.37:0/29430859 wait complete. 2024-09-21T01:15:22.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T01:15:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:22.609 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:22 smithi037 ceph-mon[31105]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:22.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:22 smithi137 ceph-mon[34607]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:22.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:22 smithi144 ceph-mon[34818]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 -- 172.21.15.37:0/2863382090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 msgr2=0x7f08ac1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/2863382090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac1087d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0894009900 tx=0x7f089402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 -- 172.21.15.37:0/2863382090 shutdown_connections 2024-09-21T01:15:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/2863382090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 0x7f08ac10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/2863382090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac1087d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/2863382090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 0x7f08ac102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 -- 172.21.15.37:0/2863382090 >> 172.21.15.37:0/2863382090 conn(0x7f08ac079740 msgr2=0x7f08ac079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 -- 172.21.15.37:0/2863382090 shutdown_connections 2024-09-21T01:15:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 -- 172.21.15.37:0/2863382090 wait complete. 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.854+0000 7f08b2aa0640 1 Processor -- start 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 -- start start 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 0x7f08ac19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 0x7f08ac19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac113a90 con 0x7f08ac1083c0 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac113910 con 0x7f08ac102a80 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b2aa0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac113c10 con 0x7f08ac108d10 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59120/0 (socket says 172.21.15.37:59120) 2024-09-21T01:15:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 -- 172.21.15.37:0/366633414 learned_addr learned my addr 172.21.15.37:0/366633414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b083c640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 0x7f08ac19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b103d640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 0x7f08ac19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 -- 172.21.15.37:0/366633414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 msgr2=0x7f08ac19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 0x7f08ac19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 -- 172.21.15.37:0/366633414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 msgr2=0x7f08ac19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 0x7f08ac19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 -- 172.21.15.37:0/366633414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac1a04d0 con 0x7f08ac1083c0 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b083c640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 0x7f08ac19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08b103d640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 0x7f08ac19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.855+0000 7f08abfff640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac19ab00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0894032fd0 tx=0x7f0894004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.856+0000 7f08a9ffb640 1 -- 172.21.15.37:0/366633414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089403f030 con 0x7f08ac1083c0 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.856+0000 7f08a9ffb640 1 -- 172.21.15.37:0/366633414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0894004490 con 0x7f08ac1083c0 2024-09-21T01:15:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.856+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ac1a0760 con 0x7f08ac1083c0 2024-09-21T01:15:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.856+0000 7f08a9ffb640 1 -- 172.21.15.37:0/366633414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894035070 con 0x7f08ac1083c0 2024-09-21T01:15:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.856+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ac1a6f20 con 0x7f08ac1083c0 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.858+0000 7f08b9014740 1 Processor -- start 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 -- start start 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08a9ffb640 1 -- 172.21.15.37:0/366633414 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0894042030 con 0x7f08ac1083c0 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 0x561f0b9e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b6130a0 0x561f0b9e2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0b9e2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f0b959c10 con 0x561f0b63bf60 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f0b949040 con 0x561f0b61b280 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b9014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561f0b94ce50 con 0x561f0b6130a0 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b103d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 0x561f0b9e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b103d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 0x561f0b9e1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59136/0 (socket says 172.21.15.37:59136) 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b103d640 1 -- 172.21.15.37:0/2350651169 learned_addr learned my addr 172.21.15.37:0/2350651169 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08abfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0b9e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.859+0000 7f08b083c640 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b6130a0 0x561f0b9e2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b103d640 1 -- 172.21.15.37:0/2350651169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b6130a0 msgr2=0x561f0b9e2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b103d640 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b6130a0 0x561f0b9e2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b103d640 1 -- 172.21.15.37:0/2350651169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 msgr2=0x561f0b9e2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b103d640 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0b9e2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b103d640 1 -- 172.21.15.37:0/2350651169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0b6a7540 con 0x561f0b63bf60 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08a9ffb640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f08980b6590 0x7f08980b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b103d640 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 0x561f0b9e1f00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f08a400ba60 tx=0x7f08a400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed54ce39800eceb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08a9ffb640 1 -- 172.21.15.37:0/366633414 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f08941078f0 con 0x7f08ac1083c0 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08b083c640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f08980b6590 0x7f08980b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08a2ffd640 1 -- 172.21.15.37:0/2350651169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4017420 con 0x561f0b63bf60 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08a2ffd640 1 -- 172.21.15.37:0/2350651169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08a4017a70 con 0x561f0b63bf60 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.860+0000 7f08a2ffd640 1 -- 172.21.15.37:0/2350651169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a400fac0 con 0x561f0b63bf60 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 -- 172.21.15.37:0/2350651169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 msgr2=0x561f0b9e1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b083c640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f08980b6590 0x7f08980b8aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x561f0b9e0b80 tx=0x7f089c0098c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 0x561f0b9e1f00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f08a400ba60 tx=0x7f08a400bf20 comp rx=0 tx=0).stop 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 -- 172.21.15.37:0/2350651169 shutdown_connections 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0b9e2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b6130a0 0x561f0b9e2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 --2- 172.21.15.37:0/2350651169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b63bf60 0x561f0b9e1f00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 -- 172.21.15.37:0/2350651169 >> 172.21.15.37:0/2350651169 conn(0x561f0b630350 msgr2=0x561f0b9dfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 -- 172.21.15.37:0/2350651169 shutdown_connections 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.861+0000 7f08b9014740 1 -- 172.21.15.37:0/2350651169 wait complete. 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 -- start start 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 Processor -- start 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b61b280 0x561f0b9f7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b63bf60 0x561f0b9fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f0b7aa5f0 con 0x561f0b6130a0 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f0b8e4010 con 0x561f0b63bf60 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b9014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561f0b9f4af0 con 0x561f0b61b280 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.862+0000 7f08b083c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b9014740 10 client.0 _ll_register_callbacks cb 0x561f0b943340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59140/0 (socket says 172.21.15.37:59140) 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 -- 172.21.15.37:0/1403510575 learned_addr learned my addr 172.21.15.37:0/1403510575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08abfff640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b61b280 0x561f0b9f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b103d640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b63bf60 0x561f0b9fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 -- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b61b280 msgr2=0x561f0b9f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b61b280 0x561f0b9f7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 -- 172.21.15.37:0/1403510575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b63bf60 msgr2=0x561f0b9fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b63bf60 0x561f0b9fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 -- 172.21.15.37:0/1403510575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0b911a00 con 0x561f0b6130a0 2024-09-21T01:15:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b103d640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b63bf60 0x561f0b9fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b083c640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9f6a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f089c010aa0 tx=0x7f089c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47f65773dc1ef52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f088bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f088bfff640 1 -- 172.21.15.37:0/1403510575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c01d9b0 con 0x561f0b6130a0 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f088bfff640 1 -- 172.21.15.37:0/1403510575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f089c01db50 con 0x561f0b6130a0 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.863+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08a4017a70 con 0x561f0b6130a0 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f088bfff640 1 -- 172.21.15.37:0/1403510575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f089c01dd50 con 0x561f0b6130a0 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561f0ba05000 con 0x561f0b6130a0 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f088bfff640 1 -- 172.21.15.37:0/1403510575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08a4017a70 con 0x561f0b6130a0 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f088bfff640 1 -- 172.21.15.37:0/1403510575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f089c01e4a0 con 0x561f0b6130a0 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 10 client.15243 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 20 client.15243 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5fa8e0 0x561f0ba08b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 4 client.15243 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.864+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f0b95bb60 con 0x561f0b5fa8e0 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.865+0000 7f08abfff640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5fa8e0 0x561f0ba08b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.865+0000 7f088bfff640 10 client.15243 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.865+0000 7f08abfff640 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5fa8e0 0x561f0ba08b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8ee75743b0c002f server_cookie=d9a57062925853b6 in_seq=0 out_seq=0 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f088bfff640 1 -- 172.21.15.37:0/1403510575 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f0b95bb60 con 0x561f0b5fa8e0 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f088bfff640 10 client.15243 handle_command_reply: tid=0 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 client.15243 shutdown 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 msgr2=0x561f0b9f6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9f6a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f089c010aa0 tx=0x7f089c004a40 comp rx=0 tx=0).stop 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 shutdown_connections 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5fa8e0 0x561f0ba08b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b63bf60 0x561f0b9fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b61b280 0x561f0b9f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f088bfff640 0 client.15243 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 --2- 172.21.15.37:0/1403510575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9f6a20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.866+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 >> 172.21.15.37:0/1403510575 conn(0x561f0b630350 msgr2=0x561f0b9e5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.867+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 shutdown_connections 2024-09-21T01:15:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.867+0000 7f08b9014740 1 -- 172.21.15.37:0/1403510575 wait complete. 2024-09-21T01:15:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.867+0000 7f08b9014740 20 client.15243 trim_cache size 0 max 16384 2024-09-21T01:15:22.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 Processor -- start 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 -- start start 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0ba02e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0b9efa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f0ba06e40 con 0x561f0b6130a0 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f0ba07510 con 0x561f0b61b280 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b9014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561f0ba07be0 con 0x561f0b63bf60 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b083c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b083c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9fbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59150/0 (socket says 172.21.15.37:59150) 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.885+0000 7f08b083c640 1 -- 172.21.15.37:0/1392722256 learned_addr learned my addr 172.21.15.37:0/1392722256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08abfff640 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0ba02e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b103d640 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0b9efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b083c640 1 -- 172.21.15.37:0/1392722256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 msgr2=0x561f0b9efa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b083c640 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0b9efa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b083c640 1 -- 172.21.15.37:0/1392722256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 msgr2=0x561f0ba02e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b083c640 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0ba02e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b083c640 1 -- 172.21.15.37:0/1392722256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f0b9f78c0 con 0x561f0b6130a0 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b103d640 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0b9efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08b083c640 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9fbe00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f089c009ef0 tx=0x7f089c012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d8b36c52752079 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08a27fc640 1 -- 172.21.15.37:0/1392722256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c01ed30 con 0x561f0b6130a0 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08a27fc640 1 -- 172.21.15.37:0/1392722256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f089c01e410 con 0x561f0b6130a0 2024-09-21T01:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.886+0000 7f08a27fc640 1 -- 172.21.15.37:0/1392722256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c029b40 con 0x561f0b6130a0 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 -- 172.21.15.37:0/1392722256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 msgr2=0x561f0b9fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9fbe00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f089c009ef0 tx=0x7f089c012e70 comp rx=0 tx=0).stop 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 -- 172.21.15.37:0/1392722256 shutdown_connections 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0b9efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b61b280 0x561f0ba02e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 --2- 172.21.15.37:0/1392722256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b6130a0 0x561f0b9fbe00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 -- 172.21.15.37:0/1392722256 >> 172.21.15.37:0/1392722256 conn(0x561f0b630350 msgr2=0x561f0b9f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 -- 172.21.15.37:0/1392722256 shutdown_connections 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 -- 172.21.15.37:0/1392722256 wait complete. 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 -- start start 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.887+0000 7f08b9014740 1 Processor -- start 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b6130a0 0x561f0ba02c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 0x561f0ba11260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0ba117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f0ba08980 con 0x561f0b61b280 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f0ba082b0 con 0x561f0b6130a0 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561f0ba09050 con 0x561f0b63bf60 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b9014740 10 client.0 _ll_register_callbacks cb 0x7f089c009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 0x561f0ba11260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 0x561f0ba11260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59152/0 (socket says 172.21.15.37:59152) 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 -- 172.21.15.37:0/3091177344 learned_addr learned my addr 172.21.15.37:0/3091177344 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b083c640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b6130a0 0x561f0ba02c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08b103d640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0ba117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 -- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 msgr2=0x561f0ba117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0ba117a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 -- 172.21.15.37:0/3091177344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b6130a0 msgr2=0x561f0ba02c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.888+0000 7f08abfff640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b6130a0 0x561f0ba02c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08abfff640 1 -- 172.21.15.37:0/3091177344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f0ba0ffa0 con 0x561f0b61b280 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b103d640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0ba117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08abfff640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 0x561f0ba11260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0894105350 tx=0x7f089410d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ae059367292289 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f088bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f088bfff640 1 -- 172.21.15.37:0/3091177344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894049040 con 0x561f0b61b280 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f088bfff640 1 -- 172.21.15.37:0/3091177344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f08940c9cb0 con 0x561f0b61b280 2024-09-21T01:15:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f089c01e410 con 0x561f0b61b280 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f088bfff640 1 -- 172.21.15.37:0/3091177344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f08940cd1b0 con 0x561f0b61b280 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b9014740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561f0ba74380 con 0x561f0b61b280 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f088bfff640 1 -- 172.21.15.37:0/3091177344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f089c01e410 con 0x561f0b61b280 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f088bfff640 1 -- 172.21.15.37:0/3091177344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f08940d6fd0 con 0x561f0b61b280 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b9014740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b9014740 10 client.15249 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.889+0000 7f08b9014740 20 client.15249 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.890+0000 7f08b9014740 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5cfc90 0x561f0ba77ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.890+0000 7f08b9014740 4 client.15249 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.890+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "status"}) -- 0x561f0b957610 con 0x561f0b5cfc90 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.890+0000 7f08b083c640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5cfc90 0x561f0ba77ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.890+0000 7f08b083c640 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5cfc90 0x561f0ba77ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9c3fc481cc32443 server_cookie=f332b670c0085b43 in_seq=0 out_seq=0 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.890+0000 7f088bfff640 10 client.15249 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f088bfff640 1 -- 172.21.15.37:0/3091177344 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561f0b957610 con 0x561f0b5cfc90 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f088bfff640 10 client.15249 handle_command_reply: tid=0 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 client.15249 shutdown 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 msgr2=0x561f0ba11260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 0x561f0ba11260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0894105350 tx=0x7f089410d530 comp rx=0 tx=0).stop 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 shutdown_connections 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x561f0b5cfc90 0x561f0ba77ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561f0b63bf60 0x561f0ba117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f0b61b280 0x561f0ba11260 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 --2- 172.21.15.37:0/3091177344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f0b6130a0 0x561f0ba02c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 >> 172.21.15.37:0/3091177344 conn(0x561f0b630350 msgr2=0x561f0b9f6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f088bfff640 0 client.15249 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 shutdown_connections 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 1 -- 172.21.15.37:0/3091177344 wait complete. 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.891+0000 7f08b9014740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24610, 2024-09-21T01:15:22.898 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 83.273718462999994, 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 116.513670111 2024-09-21T01:15:22.899 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f08980b6590 msgr2=0x7f08980b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f08980b6590 0x7f08980b8aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x561f0b9e0b80 tx=0x7f089c0098c0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 msgr2=0x7f08ac19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac19ab00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0894032fd0 tx=0x7f0894004270 comp rx=0 tx=0).stop 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 shutdown_connections 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f08980b6590 0x7f08980b8aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08ac108d10 0x7f08ac19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ac1083c0 0x7f08ac19ab00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 --2- 172.21.15.37:0/366633414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08ac102a80 0x7f08ac19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 >> 172.21.15.37:0/366633414 conn(0x7f08ac079740 msgr2=0x7f08ac104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 shutdown_connections 2024-09-21T01:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:22.892+0000 7f08b2aa0640 1 -- 172.21.15.37:0/366633414 wait complete. 2024-09-21T01:15:23.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T01:15:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:24.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:24 smithi037 ceph-mon[31105]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 -- 172.21.15.37:0/923566227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4410de70 msgr2=0x7f0d44110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 --2- 172.21.15.37:0/923566227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4410de70 0x7f0d44110340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009900 tx=0x7f0d3c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 -- 172.21.15.37:0/923566227 shutdown_connections 2024-09-21T01:15:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 --2- 172.21.15.37:0/923566227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4410de70 0x7f0d44110340 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 --2- 172.21.15.37:0/923566227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d441052a0 0x7f0d4410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 --2- 172.21.15.37:0/923566227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d441048c0 0x7f0d44104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 -- 172.21.15.37:0/923566227 >> 172.21.15.37:0/923566227 conn(0x7f0d44079760 msgr2=0x7f0d44079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 -- 172.21.15.37:0/923566227 shutdown_connections 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.462+0000 7f0d495a6640 1 -- 172.21.15.37:0/923566227 wait complete. 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 Processor -- start 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 -- start start 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 0x7f0d4419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d441052a0 0x7f0d4419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d4410de70 0x7f0d4419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44113ab0 con 0x7f0d441048c0 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44113930 con 0x7f0d4410de70 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.463+0000 7f0d495a6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44113c30 con 0x7f0d441052a0 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 0x7f0d4419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 0x7f0d4419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59160/0 (socket says 172.21.15.37:59160) 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 -- 172.21.15.37:0/1595064068 learned_addr learned my addr 172.21.15.37:0/1595064068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d427fc640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d441052a0 0x7f0d4419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d437fe640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d4410de70 0x7f0d4419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 -- 172.21.15.37:0/1595064068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d441052a0 msgr2=0x7f0d4419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d441052a0 0x7f0d4419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 -- 172.21.15.37:0/1595064068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d4410de70 msgr2=0x7f0d4419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d4410de70 0x7f0d4419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 -- 172.21.15.37:0/1595064068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441a0430 con 0x7f0d441048c0 2024-09-21T01:15:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d437fe640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d4410de70 0x7f0d4419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d42ffd640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 0x7f0d4419a4c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400d770 tx=0x7f0d3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d2bfff640 1 -- 172.21.15.37:0/1595064068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34017070 con 0x7f0d441048c0 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441a0720 con 0x7f0d441048c0 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d2bfff640 1 -- 172.21.15.37:0/1595064068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d34009c30 con 0x7f0d441048c0 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d2bfff640 1 -- 172.21.15.37:0/1595064068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34003cc0 con 0x7f0d441048c0 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.464+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441a6e80 con 0x7f0d441048c0 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 Processor -- start 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 -- start start 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x562715888f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x562715889440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715889980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562715800c10 con 0x5627154e2f60 2024-09-21T01:15:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627157f0040 con 0x5627154ba0a0 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5627157f3e50 con 0x5627154c2280 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x562715888f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d2bfff640 1 -- 172.21.15.37:0/1595064068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0d34010460 con 0x7f0d441048c0 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.467+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x562715888f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59172/0 (socket says 172.21.15.37:59172) 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 -- 172.21.15.37:0/3088061493 learned_addr learned my addr 172.21.15.37:0/3088061493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d427fc640 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715889980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 -- 172.21.15.37:0/3088061493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 msgr2=0x562715889980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715889980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 -- 172.21.15.37:0/3088061493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 msgr2=0x562715889440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x562715889440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 -- 172.21.15.37:0/3088061493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271554e540 con 0x5627154e2f60 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d437fe640 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x562715888f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c031440 tx=0x7f0d3c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837a9f4e40f948f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d297fa640 1 -- 172.21.15.37:0/3088061493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c03f070 con 0x5627154e2f60 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d297fa640 1 -- 172.21.15.37:0/3088061493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d3c0316a0 con 0x5627154e2f60 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.468+0000 7f0d297fa640 1 -- 172.21.15.37:0/3088061493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c035070 con 0x5627154e2f60 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d2bfff640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d2c0b6510 0x7f0d2c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d42ffd640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d2c0b6510 0x7f0d2c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d2bfff640 1 -- 172.21.15.37:0/1595064068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0d340e6d20 con 0x7f0d441048c0 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/3088061493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 msgr2=0x562715888f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x562715888f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c031440 tx=0x7f0d3c032cd0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/3088061493 shutdown_connections 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715889980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x562715889440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/3088061493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x562715888f00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/3088061493 >> 172.21.15.37:0/3088061493 conn(0x5627154d7350 msgr2=0x562715886df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d42ffd640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d2c0b6510 0x7f0d2c0b8a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d340a9480 tx=0x7f0d3407a1e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/3088061493 shutdown_connections 2024-09-21T01:15:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.469+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/3088061493 wait complete. 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 -- start start 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 Processor -- start 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x5627158947a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715894d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x5627158a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627156515f0 con 0x5627154e2f60 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56271578b010 con 0x5627154ba0a0 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562715897680 con 0x5627154c2280 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d4fb1a740 10 client.0 _ll_register_callbacks cb 0x5627157ea340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x5627158a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x5627158a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59182/0 (socket says 172.21.15.37:59182) 2024-09-21T01:15:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d437fe640 1 -- 172.21.15.37:0/2334536114 learned_addr learned my addr 172.21.15.37:0/2334536114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x5627158947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.470+0000 7f0d427fc640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715894d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d437fe640 1 -- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 msgr2=0x562715894d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715894d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d437fe640 1 -- 172.21.15.37:0/2334536114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 msgr2=0x5627158947a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x5627158947a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d437fe640 1 -- 172.21.15.37:0/2334536114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627157b8a00 con 0x5627154e2f60 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x5627158a09a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009320 tx=0x7f0d3c005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662abbfce68e3d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2334536114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c035030 con 0x5627154e2f60 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d3c0316a0 con 0x5627154e2f60 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2334536114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0d3c0048c0 con 0x5627154e2f60 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2334536114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d3c03f040 con 0x5627154e2f60 2024-09-21T01:15:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d4fb1a740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5627158a3550 con 0x5627154e2f60 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.471+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2334536114 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d3c0316a0 con 0x5627154e2f60 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2334536114 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0d3c03ba90 con 0x5627154e2f60 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d4fb1a740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d4fb1a740 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d4fb1a740 20 client.15261 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154a18e0 0x5627158a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d4fb1a740 4 client.15261 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562715802b60 con 0x5627154a18e0 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d427fc640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154a18e0 0x5627158a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d26ff5640 10 client.15261 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.472+0000 7f0d427fc640 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154a18e0 0x5627158a6ad0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26a0575e370f0617 server_cookie=7b77c7f4fbf3f2b6 in_seq=0 out_seq=0 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.473+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2334536114 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562715802b60 con 0x5627154a18e0 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.473+0000 7f0d26ff5640 10 client.15261 handle_command_reply: tid=0 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.473+0000 7f0d4fb1a740 1 client.15261 shutdown 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 msgr2=0x5627158a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x5627158a09a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009320 tx=0x7f0d3c005310 comp rx=0 tx=0).stop 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 shutdown_connections 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154a18e0 0x5627158a6ad0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154e2f60 0x5627158a09a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x562715894d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2334536114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154ba0a0 0x5627158947a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d26ff5640 0 client.15261 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 >> 172.21.15.37:0/2334536114 conn(0x5627154d7350 msgr2=0x56271588c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 shutdown_connections 2024-09-21T01:15:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2334536114 wait complete. 2024-09-21T01:15:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.474+0000 7f0d4fb1a740 20 client.15261 trim_cache size 0 max 16384 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 Processor -- start 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 -- start start 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 0x56271588f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x5627158a0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627158a4e10 con 0x5627154ba0a0 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627158a54e0 con 0x5627154a18e0 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.492+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5627158a5bb0 con 0x5627154c2280 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 0x56271588f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 0x56271588f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59196/0 (socket says 172.21.15.37:59196) 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 -- 172.21.15.37:0/784583780 learned_addr learned my addr 172.21.15.37:0/784583780 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d437fe640 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d437fe640 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x5627158a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 -- 172.21.15.37:0/784583780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 msgr2=0x5627158a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x5627158a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 -- 172.21.15.37:0/784583780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 msgr2=0x5627158a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 -- 172.21.15.37:0/784583780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562715895a60 con 0x5627154ba0a0 2024-09-21T01:15:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d427fc640 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 0x56271588f020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d38004dd0 tx=0x7f0d3800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305a4cdd2f7003c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d28ff9640 1 -- 172.21.15.37:0/784583780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38003b70 con 0x5627154ba0a0 2024-09-21T01:15:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d28ff9640 1 -- 172.21.15.37:0/784583780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d3801e030 con 0x5627154ba0a0 2024-09-21T01:15:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.493+0000 7f0d28ff9640 1 -- 172.21.15.37:0/784583780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38012710 con 0x5627154ba0a0 2024-09-21T01:15:24.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/784583780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 msgr2=0x56271588f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 0x56271588f020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d38004dd0 tx=0x7f0d3800a570 comp rx=0 tx=0).stop 2024-09-21T01:15:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/784583780 shutdown_connections 2024-09-21T01:15:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154c2280 0x5627158a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154ba0a0 0x56271588f020 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/784583780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/784583780 >> 172.21.15.37:0/784583780 conn(0x5627154d7350 msgr2=0x56271588f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/784583780 shutdown_connections 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/784583780 wait complete. 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.494+0000 7f0d4fb1a740 1 -- start start 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 Processor -- start 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154ba0a0 0x5627158a8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 0x5627158a8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627158a6950 con 0x5627154c2280 2024-09-21T01:15:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5627158a6280 con 0x5627154a18e0 2024-09-21T01:15:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5627158a7020 con 0x5627154ba0a0 2024-09-21T01:15:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 0x5627158a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d4fb1a740 10 client.0 _ll_register_callbacks cb 0x7f0d3c032c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 0x5627158a8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59202/0 (socket says 172.21.15.37:59202) 2024-09-21T01:15:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 -- 172.21.15.37:0/2786193729 learned_addr learned my addr 172.21.15.37:0/2786193729 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 -- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154ba0a0 msgr2=0x5627158a8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d427fc640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154ba0a0 0x5627158a8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154ba0a0 0x5627158a8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 -- 172.21.15.37:0/2786193729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 msgr2=0x5627158a7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.495+0000 7f0d437fe640 1 -- 172.21.15.37:0/2786193729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627159150a0 con 0x5627154c2280 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d437fe640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 0x5627158a8750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c044550 tx=0x7f0d3c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71f6af742d4ff32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2786193729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c035040 con 0x5627154c2280 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2786193729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0d3c004460 con 0x5627154c2280 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d3801e030 con 0x5627154c2280 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2786193729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0d3c0319e0 con 0x5627154c2280 2024-09-21T01:15:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d4fb1a740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562715916320 con 0x5627154c2280 2024-09-21T01:15:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2786193729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d3801e030 con 0x5627154c2280 2024-09-21T01:15:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2786193729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0d3c03b460 con 0x5627154c2280 2024-09-21T01:15:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d4fb1a740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d4fb1a740 10 client.15267 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:15:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.496+0000 7f0d4fb1a740 20 client.15267 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.497+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154e2f60 0x562715919c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.497+0000 7f0d4fb1a740 4 client.15267 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.497+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "status"}) -- 0x5627157fe610 con 0x5627154e2f60 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.497+0000 7f0d427fc640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154e2f60 0x562715919c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.497+0000 7f0d26ff5640 10 client.15267 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.497+0000 7f0d427fc640 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154e2f60 0x562715919c40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf6b6c344d6ef637 server_cookie=421a4cbd90e071ae in_seq=0 out_seq=0 2024-09-21T01:15:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d26ff5640 1 -- 172.21.15.37:0/2786193729 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5627157fe610 con 0x5627154e2f60 2024-09-21T01:15:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d26ff5640 10 client.15267 handle_command_reply: tid=0 2024-09-21T01:15:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 client.15267 shutdown 2024-09-21T01:15:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 msgr2=0x5627158a8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 0x5627158a8750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c044550 tx=0x7f0d3c009650 comp rx=0 tx=0).stop 2024-09-21T01:15:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 shutdown_connections 2024-09-21T01:15:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5627154e2f60 0x562715919c40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627154c2280 0x5627158a8750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5627154ba0a0 0x5627158a8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 --2- 172.21.15.37:0/2786193729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5627154a18e0 0x5627158a7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 >> 172.21.15.37:0/2786193729 conn(0x5627154d7350 msgr2=0x562715886600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d26ff5640 0 client.15267 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 shutdown_connections 2024-09-21T01:15:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 1 -- 172.21.15.37:0/2786193729 wait complete. 2024-09-21T01:15:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.498+0000 7f0d4fb1a740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T01:15:24.511 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:24.511 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24631, 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 85.893082657999997, 2024-09-21T01:15:24.512 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:24.513 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:24.513 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:24.513 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 112.907348113 2024-09-21T01:15:24.513 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d2c0b6510 msgr2=0x7f0d2c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d2c0b6510 0x7f0d2c0b8a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d340a9480 tx=0x7f0d3407a1e0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 msgr2=0x7f0d4419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 0x7f0d4419a4c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400d770 tx=0x7f0d3400dc30 comp rx=0 tx=0).stop 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 shutdown_connections 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d2c0b6510 0x7f0d2c0b8a20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d4410de70 0x7f0d4419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d441052a0 0x7f0d4419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 --2- 172.21.15.37:0/1595064068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d441048c0 0x7f0d4419a4c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 >> 172.21.15.37:0/1595064068 conn(0x7f0d44079760 msgr2=0x7f0d44100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 shutdown_connections 2024-09-21T01:15:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:24.499+0000 7f0d495a6640 1 -- 172.21.15.37:0/1595064068 wait complete. 2024-09-21T01:15:24.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:24 smithi137 ceph-mon[34607]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:24.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:24 smithi144 ceph-mon[34818]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:25.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:15:25.409 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.896+0000 7fec7cba1640 1 -- 172.21.15.37:0/2980828771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78106c30 msgr2=0x7fec78110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.896+0000 7fec7cba1640 1 --2- 172.21.15.37:0/2980828771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78106c30 0x7fec78110680 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec70009ca0 tx=0x7fec7002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 -- 172.21.15.37:0/2980828771 shutdown_connections 2024-09-21T01:15:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 --2- 172.21.15.37:0/2980828771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78106c30 0x7fec78110680 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 --2- 172.21.15.37:0/2980828771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec781062e0 0x7fec781066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 --2- 172.21.15.37:0/2980828771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec78102000 0x7fec78102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 -- 172.21.15.37:0/2980828771 >> 172.21.15.37:0/2980828771 conn(0x7fec78079e40 msgr2=0x7fec7807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 -- 172.21.15.37:0/2980828771 shutdown_connections 2024-09-21T01:15:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 -- 172.21.15.37:0/2980828771 wait complete. 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.897+0000 7fec7cba1640 1 Processor -- start 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 -- start start 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 0x7fec78102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec781062e0 0x7fec781034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec78106c30 0x7fec78103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec78113ad0 con 0x7fec78102000 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec78113950 con 0x7fec781062e0 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7cba1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec78113c50 con 0x7fec78106c30 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 0x7fec78102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 0x7fec78102fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52508/0 (socket says 172.21.15.37:52508) 2024-09-21T01:15:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 -- 172.21.15.37:0/3132850353 learned_addr learned my addr 172.21.15.37:0/3132850353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec75d9b640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec781062e0 0x7fec781034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec78106c30 0x7fec78103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 -- 172.21.15.37:0/3132850353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec78106c30 msgr2=0x7fec78103a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec78106c30 0x7fec78103a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 -- 172.21.15.37:0/3132850353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec781062e0 msgr2=0x7fec781034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec781062e0 0x7fec781034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 -- 172.21.15.37:0/3132850353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec781a8740 con 0x7fec78102000 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec75d9b640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec781062e0 0x7fec781034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec78106c30 0x7fec78103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.898+0000 7fec7659c640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 0x7fec78102fa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c890 tx=0x7fec6800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.899+0000 7fec677fe640 1 -- 172.21.15.37:0/3132850353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68004220 con 0x7fec78102000 2024-09-21T01:15:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.899+0000 7fec677fe640 1 -- 172.21.15.37:0/3132850353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec680043c0 con 0x7fec78102000 2024-09-21T01:15:25.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.899+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781a8a30 con 0x7fec78102000 2024-09-21T01:15:25.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.899+0000 7fec677fe640 1 -- 172.21.15.37:0/3132850353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68004a00 con 0x7fec78102000 2024-09-21T01:15:25.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.899+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781a8fc0 con 0x7fec78102000 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.901+0000 7fec677fe640 1 -- 172.21.15.37:0/3132850353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fec680079b0 con 0x7fec78102000 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec83115740 1 Processor -- start 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec83115740 1 -- start start 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec677fe640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fec600b6590 0x7fec600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec83115740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff78af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec83115740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff78b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fec600b6590 0x7fec600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.902+0000 7fec83115740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff78b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec83115740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff702c10 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec83115740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff6f2040 con 0x55e3ff3e4f60 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec83115740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff6f5e50 con 0x55e3ff3c4280 2024-09-21T01:15:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec677fe640 1 -- 172.21.15.37:0/3132850353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fec680e70c0 con 0x7fec78102000 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff78b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff78b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52510/0 (socket says 172.21.15.37:52510) 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 -- 172.21.15.37:0/3967997950 learned_addr learned my addr 172.21.15.37:0/3967997950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff78b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fec600b6590 0x7fec600b8aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec700094e0 tx=0x7fec70009840 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 -- 172.21.15.37:0/3967997950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 msgr2=0x55e3ff78b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff78b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 -- 172.21.15.37:0/3967997950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 msgr2=0x55e3ff78af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff78af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 -- 172.21.15.37:0/3967997950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ff450540 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.903+0000 7fec75d9b640 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff78b440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00bce0 tx=0x7fec6c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1949c99a117e701b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.904+0000 7fec64ff9640 1 -- 172.21.15.37:0/3967997950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c015070 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.904+0000 7fec64ff9640 1 -- 172.21.15.37:0/3967997950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec6c01a910 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.904+0000 7fec64ff9640 1 -- 172.21.15.37:0/3967997950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011900 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.904+0000 7fec83115740 1 -- 172.21.15.37:0/3967997950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 msgr2=0x55e3ff78b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.904+0000 7fec83115740 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff78b440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00bce0 tx=0x7fec6c00f730 comp rx=0 tx=0).stop 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 -- 172.21.15.37:0/3967997950 shutdown_connections 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff78b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff78b440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 --2- 172.21.15.37:0/3967997950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff78af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 -- 172.21.15.37:0/3967997950 >> 172.21.15.37:0/3967997950 conn(0x55e3ff3d9350 msgr2=0x55e3ff788df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 -- 172.21.15.37:0/3967997950 shutdown_connections 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 -- 172.21.15.37:0/3967997950 wait complete. 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 -- start start 2024-09-21T01:15:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 Processor -- start 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff796ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff797000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.905+0000 7fec83115740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec83115740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff5535f0 con 0x55e3ff3e4f60 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec83115740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff68d010 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec83115740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7996e0 con 0x55e3ff3c4280 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec83115740 10 client.0 _ll_register_callbacks cb 0x55e3ff6ec340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7a2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52520/0 (socket says 172.21.15.37:52520) 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 -- 172.21.15.37:0/3471434972 learned_addr learned my addr 172.21.15.37:0/3471434972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec75d9b640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff797000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec7659c640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff796ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 -- 172.21.15.37:0/3471434972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 msgr2=0x55e3ff797000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff797000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 -- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 msgr2=0x55e3ff796ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff796ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 -- 172.21.15.37:0/3471434972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ff6baa00 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec7659c640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff796ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec76d9d640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7a2a00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec70031750 tx=0x7fec7002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e10c7cbe7405c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec5dffb640 1 -- 172.21.15.37:0/3471434972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec700047c0 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec5dffb640 1 -- 172.21.15.37:0/3471434972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fec7002f660 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.906+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec6c01a910 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec5dffb640 1 -- 172.21.15.37:0/3471434972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fec7002f860 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 10 client.15279 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e3ff7a56f0 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec5dffb640 1 -- 172.21.15.37:0/3471434972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec6c01a910 con 0x55e3ff3e4f60 2024-09-21T01:15:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec5dffb640 1 -- 172.21.15.37:0/3471434972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fec700309a0 con 0x55e3ff3e4f60 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 20 client.15279 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff3a38e0 0x55e3ff7a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 4 client.15279 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3ff704b60 con 0x55e3ff3a38e0 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.907+0000 7fec7659c640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff3a38e0 0x55e3ff7a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.908+0000 7fec7659c640 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff3a38e0 0x55e3ff7a91e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66826dc25fe17d1 server_cookie=ffae8af1b991d85b in_seq=0 out_seq=0 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.908+0000 7fec5dffb640 10 client.15279 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec5dffb640 1 -- 172.21.15.37:0/3471434972 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3ff704b60 con 0x55e3ff3a38e0 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec5dffb640 10 client.15279 handle_command_reply: tid=0 2024-09-21T01:15:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 client.15279 shutdown 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 msgr2=0x55e3ff7a2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7a2a00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec70031750 tx=0x7fec7002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 shutdown_connections 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff3a38e0 0x55e3ff7a91e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7a2a00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff797000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 --2- 172.21.15.37:0/3471434972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff796ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec5dffb640 0 client.15279 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 >> 172.21.15.37:0/3471434972 conn(0x55e3ff3d9350 msgr2=0x55e3ff78e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 shutdown_connections 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 1 -- 172.21.15.37:0/3471434972 wait complete. 2024-09-21T01:15:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.909+0000 7fec83115740 20 client.15279 trim_cache size 0 max 16384 2024-09-21T01:15:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.927+0000 7fec83115740 1 Processor -- start 2024-09-21T01:15:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.927+0000 7fec83115740 1 -- start start 2024-09-21T01:15:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec83115740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec83115740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 0x55e3ff7a6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec83115740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3e4f60 0x55e3ff791a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec83115740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7a7520 con 0x55e3ff3c4280 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec83115740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7a7bf0 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec83115740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7a82c0 con 0x55e3ff3e4f60 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 0x55e3ff7a6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 0x55e3ff7a6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52524/0 (socket says 172.21.15.37:52524) 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 -- 172.21.15.37:0/923208125 learned_addr learned my addr 172.21.15.37:0/923208125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec76d9d640 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3e4f60 0x55e3ff791a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec7659c640 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 -- 172.21.15.37:0/923208125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3e4f60 msgr2=0x55e3ff791a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3e4f60 0x55e3ff791a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 -- 172.21.15.37:0/923208125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 msgr2=0x55e3ff7a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 -- 172.21.15.37:0/923208125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ff783080 con 0x55e3ff3c4280 2024-09-21T01:15:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec7659c640 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.928+0000 7fec75d9b640 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 0x55e3ff7a6f80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55e3ff789b80 tx=0x7fec6c00ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fd25bb677ce45d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec5ffff640 1 -- 172.21.15.37:0/923208125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c029070 con 0x55e3ff3c4280 2024-09-21T01:15:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec5ffff640 1 -- 172.21.15.37:0/923208125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec6c004680 con 0x55e3ff3c4280 2024-09-21T01:15:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec5ffff640 1 -- 172.21.15.37:0/923208125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c015050 con 0x55e3ff3c4280 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 -- 172.21.15.37:0/923208125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 msgr2=0x55e3ff7a6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 0x55e3ff7a6f80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55e3ff789b80 tx=0x7fec6c00ba60 comp rx=0 tx=0).stop 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 -- 172.21.15.37:0/923208125 shutdown_connections 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3e4f60 0x55e3ff791a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3c4280 0x55e3ff7a6f80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 --2- 172.21.15.37:0/923208125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 -- 172.21.15.37:0/923208125 >> 172.21.15.37:0/923208125 conn(0x55e3ff3d9350 msgr2=0x55e3ff790d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 -- 172.21.15.37:0/923208125 shutdown_connections 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.929+0000 7fec83115740 1 -- 172.21.15.37:0/923208125 wait complete. 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 -- start start 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 Processor -- start 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff7aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7a9060 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7a8990 con 0x55e3ff3e4f60 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff7a9730 con 0x55e3ff3c4280 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec83115740 10 client.0 _ll_register_callbacks cb 0x7fec70009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52530/0 (socket says 172.21.15.37:52530) 2024-09-21T01:15:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.930+0000 7fec7659c640 1 -- 172.21.15.37:0/530823877 learned_addr learned my addr 172.21.15.37:0/530823877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec75d9b640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff7aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec76d9d640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec7659c640 1 -- 172.21.15.37:0/530823877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 msgr2=0x55e3ff7aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec7659c640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff7aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec7659c640 1 -- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 msgr2=0x55e3ff7ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec7659c640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec7659c640 1 -- 172.21.15.37:0/530823877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ff7ab8f0 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec76d9d640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec75d9b640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff7aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec7659c640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7b19c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fec68005fd0 tx=0x7fec68011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4c403390e799fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec5dffb640 1 -- 172.21.15.37:0/530823877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6801d040 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec5dffb640 1 -- 172.21.15.37:0/530823877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fec680d0bd0 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec6c004680 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec5dffb640 1 -- 172.21.15.37:0/530823877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fec680ad950 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec83115740 10 client.15285 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e3ff7b12f0 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.931+0000 7fec5dffb640 1 -- 172.21.15.37:0/530823877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec6c004680 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec5dffb640 1 -- 172.21.15.37:0/530823877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fec68058ab0 con 0x55e3ff3bc0a0 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec83115740 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec83115740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec83115740 20 client.15285 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec83115740 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff378c90 0x55e3ff817c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec83115740 4 client.15285 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "status"}) -- 0x55e3ff700610 con 0x55e3ff378c90 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.932+0000 7fec75d9b640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff378c90 0x55e3ff817c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec75d9b640 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff378c90 0x55e3ff817c90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa8f5e1caab2d55 server_cookie=287062d4330fba0f in_seq=0 out_seq=0 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec5dffb640 10 client.15285 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec5dffb640 1 -- 172.21.15.37:0/530823877 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e3ff700610 con 0x55e3ff378c90 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec5dffb640 10 client.15285 handle_command_reply: tid=0 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 client.15285 shutdown 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 msgr2=0x55e3ff7b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7b19c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fec68005fd0 tx=0x7fec68011040 comp rx=0 tx=0).stop 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 shutdown_connections 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e3ff378c90 0x55e3ff817c90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e3ff3e4f60 0x55e3ff7ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3ff3c4280 0x55e3ff7aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 --2- 172.21.15.37:0/530823877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3ff3bc0a0 0x55e3ff7b19c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 >> 172.21.15.37:0/530823877 conn(0x55e3ff3d9350 msgr2=0x55e3ff791a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec5dffb640 0 client.15285 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 shutdown_connections 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 1 -- 172.21.15.37:0/530823877 wait complete. 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.933+0000 7fec83115740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24635, 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:25.941 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 94.376686445999994, 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 105.377262949 2024-09-21T01:15:25.942 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fec600b6590 msgr2=0x7fec600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fec600b6590 0x7fec600b8aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec700094e0 tx=0x7fec70009840 comp rx=0 tx=0).stop 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 msgr2=0x7fec78102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 0x7fec78102fa0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c890 tx=0x7fec6800cd50 comp rx=0 tx=0).stop 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 shutdown_connections 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fec600b6590 0x7fec600b8aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec78106c30 0x7fec78103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec781062e0 0x7fec781034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 --2- 172.21.15.37:0/3132850353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec78102000 0x7fec78102fa0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:25.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 >> 172.21.15.37:0/3132850353 conn(0x7fec78079e40 msgr2=0x7fec78107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 shutdown_connections 2024-09-21T01:15:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:25.934+0000 7fec7cba1640 1 -- 172.21.15.37:0/3132850353 wait complete. 2024-09-21T01:15:26.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:26 smithi037 ceph-mon[31105]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T01:15:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:26 smithi137 ceph-mon[34607]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T01:15:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:26 smithi144 ceph-mon[34818]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T01:15:26.691 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T01:15:26.691 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:15:26.701 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:15:26.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T01:15:26.960 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 -- 172.21.15.37:0/1170706518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f301036e0 msgr2=0x7f8f30103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 --2- 172.21.15.37:0/1170706518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f301036e0 0x7f8f30103af0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009900 tx=0x7f8f2402a480 comp rx=0 tx=0).stop 2024-09-21T01:15:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 -- 172.21.15.37:0/1170706518 shutdown_connections 2024-09-21T01:15:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 --2- 172.21.15.37:0/1170706518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f30104080 0x7f8f3010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 --2- 172.21.15.37:0/1170706518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f301036e0 0x7f8f30103af0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 --2- 172.21.15.37:0/1170706518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f30102650 0x7f8f30102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 -- 172.21.15.37:0/1170706518 >> 172.21.15.37:0/1170706518 conn(0x7f8f300fdfe0 msgr2=0x7f8f30100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.499+0000 7f8f34c07640 1 -- 172.21.15.37:0/1170706518 shutdown_connections 2024-09-21T01:15:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.500+0000 7f8f34c07640 1 -- 172.21.15.37:0/1170706518 wait complete. 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.500+0000 7f8f34c07640 1 Processor -- start 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.500+0000 7f8f34c07640 1 -- start start 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f34c07640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f30102650 0x7f8f30199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f34c07640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f301036e0 0x7f8f3019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f34c07640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 0x7f8f3019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f34c07640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010e2a0 con 0x7f8f30104080 2024-09-21T01:15:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f34c07640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010e120 con 0x7f8f301036e0 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f34c07640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010e420 con 0x7f8f30102650 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 0x7f8f3019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 0x7f8f3019b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52544/0 (socket says 172.21.15.37:52544) 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 -- 172.21.15.37:0/4238295517 learned_addr learned my addr 172.21.15.37:0/4238295517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2e59c640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f30102650 0x7f8f30199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2dd9b640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f301036e0 0x7f8f3019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 -- 172.21.15.37:0/4238295517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f30102650 msgr2=0x7f8f30199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f30102650 0x7f8f30199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 -- 172.21.15.37:0/4238295517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f301036e0 msgr2=0x7f8f3019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f301036e0 0x7f8f3019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 -- 172.21.15.37:0/4238295517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3019ba20 con 0x7f8f30104080 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2dd9b640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f301036e0 0x7f8f3019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.501+0000 7f8f2ed9d640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 0x7f8f3019b200 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800eaa0 tx=0x7f8f2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.502+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800cdb0 con 0x7f8f30104080 2024-09-21T01:15:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.502+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3019bd10 con 0x7f8f30104080 2024-09-21T01:15:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.502+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f28005020 con 0x7f8f30104080 2024-09-21T01:15:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.502+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280116d0 con 0x7f8f30104080 2024-09-21T01:15:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.502+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f301a2410 con 0x7f8f30104080 2024-09-21T01:15:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.503+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f301a25e0 con 0x7f8f30104080 2024-09-21T01:15:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.504+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8f280054a0 con 0x7f8f30104080 2024-09-21T01:15:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.505+0000 7f8f1f7fe640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8f180b6510 0x7f8f180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.505+0000 7f8f2e59c640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8f180b6510 0x7f8f180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.505+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8f280e7880 con 0x7f8f30104080 2024-09-21T01:15:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.505+0000 7f8f2e59c640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8f180b6510 0x7f8f180b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8f200058c0 tx=0x7f8f2000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:27.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.508+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f28016030 con 0x7f8f30104080 2024-09-21T01:15:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.716+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8f30100010 con 0x7f8f180b6510 2024-09-21T01:15:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.717+0000 7f8f1f7fe640 1 -- 172.21.15.37:0/4238295517 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8f30100010 con 0x7f8f180b6510 2024-09-21T01:15:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-09-21T01:15:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-09-21T01:15:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-09-21T01:15:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8f180b6510 msgr2=0x7f8f180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8f180b6510 0x7f8f180b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8f200058c0 tx=0x7f8f2000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 msgr2=0x7f8f3019b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 0x7f8f3019b200 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800eaa0 tx=0x7f8f2800ef60 comp rx=0 tx=0).stop 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 shutdown_connections 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8f180b6510 0x7f8f180b8a20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f30104080 0x7f8f3019b200 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f301036e0 0x7f8f3019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 --2- 172.21.15.37:0/4238295517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f30102650 0x7f8f30199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 >> 172.21.15.37:0/4238295517 conn(0x7f8f300fdfe0 msgr2=0x7f8f300ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 shutdown_connections 2024-09-21T01:15:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:27.720+0000 7f8f34c07640 1 -- 172.21.15.37:0/4238295517 wait complete. 2024-09-21T01:15:28.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T01:15:28.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:28 smithi037 ceph-mon[31105]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:28.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:28 smithi137 ceph-mon[34607]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:28.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:28 smithi144 ceph-mon[34818]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 -- 172.21.15.37:0/3946082522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 msgr2=0x7fc1d0108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 --2- 172.21.15.37:0/3946082522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d0108d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009900 tx=0x7fc1bc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 -- 172.21.15.37:0/3946082522 shutdown_connections 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 --2- 172.21.15.37:0/3946082522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d01094a0 0x7fc1d010b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 --2- 172.21.15.37:0/3946082522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d0108d80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 --2- 172.21.15.37:0/3946082522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d006c600 0x7fc1d0106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 -- 172.21.15.37:0/3946082522 >> 172.21.15.37:0/3946082522 conn(0x7fc1d00fdfe0 msgr2=0x7fc1d0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 -- 172.21.15.37:0/3946082522 shutdown_connections 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.166+0000 7fc1d7166640 1 -- 172.21.15.37:0/3946082522 wait complete. 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 Processor -- start 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 -- start start 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d006c600 0x7fc1d019c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d01094a0 0x7fc1d019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d010f410 con 0x7fc1d0106960 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d010f290 con 0x7fc1d01094a0 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1d7166640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d010f590 con 0x7fc1d006c600 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d019c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52566/0 (socket says 172.21.15.37:52566) 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.167+0000 7fc1cffff640 1 -- 172.21.15.37:0/332348946 learned_addr learned my addr 172.21.15.37:0/332348946 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1d4f02640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d006c600 0x7fc1d019c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1d5703640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d01094a0 0x7fc1d019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cffff640 1 -- 172.21.15.37:0/332348946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d006c600 msgr2=0x7fc1d019c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cffff640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d006c600 0x7fc1d019c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cffff640 1 -- 172.21.15.37:0/332348946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d01094a0 msgr2=0x7fc1d019d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cffff640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d01094a0 0x7fc1d019d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cffff640 1 -- 172.21.15.37:0/332348946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d019dc70 con 0x7fc1d0106960 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1d5703640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d01094a0 0x7fc1d019d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cffff640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d019c8b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc006010 tx=0x7fc1bc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc03f030 con 0x7fc1d0106960 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1bc003cb0 con 0x7fc1d0106960 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.168+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d019df00 con 0x7fc1d0106960 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.169+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc035070 con 0x7fc1d0106960 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.169+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d01a4510 con 0x7fc1d0106960 2024-09-21T01:15:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.170+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d01a47c0 con 0x7fc1d0106960 2024-09-21T01:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.171+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc1bc042030 con 0x7fc1d0106960 2024-09-21T01:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.172+0000 7fc1cdffb640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c00b6510 0x7fc1c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.172+0000 7fc1d4f02640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c00b6510 0x7fc1c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.172+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc1bc107b30 con 0x7fc1d0106960 2024-09-21T01:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.173+0000 7fc1d4f02640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c00b6510 0x7fc1c00b8a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40058c0 tx=0x7fc1c400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.177+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1bc0ce380 con 0x7fc1d0106960 2024-09-21T01:15:29.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.374+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc1d010b390 con 0x7fc1c00b6510 2024-09-21T01:15:29.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:29 smithi037 ceph-mon[31105]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.388+0000 7fc1cdffb640 1 -- 172.21.15.37:0/332348946 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7fc1d010b390 con 0x7fc1c00b6510 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (111s) 22s ago 111s 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 8cf5976f2e6c 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi137 running (109s) 42s ago 108s 94.0M - 19.3.0-5120-g18432218 ddce307e1f32 8b6428249525 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi144 running (2m) 42s ago 2m 88.0M - 19.3.0-5120-g18432218 ddce307e1f32 1fba584d2053 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (2m) 22s ago 2m 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 c9a7e8a873d5 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi137 running (2m) 42s ago 2m 86.2M - 19.3.0-5120-g18432218 ddce307e1f32 f72a4e880f50 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi144 running (2m) 42s ago 2m 87.9M - 19.3.0-5120-g18432218 ddce307e1f32 7d8ea037f972 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (115s) 22s ago 115s 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 70a929329e57 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi137 running (2m) 42s ago 2m 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 457d3d215bf6 2024-09-21T01:15:29.390 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi144 running (118s) 42s ago 117s 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 20efc98198f1 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (2m) 22s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 3542e55098d4 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi137 running (2m) 42s ago 2m 84.0M - 19.3.0-5120-g18432218 ddce307e1f32 8748a8fb9914 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi144 running (2m) 42s ago 2m 84.8M - 19.3.0-5120-g18432218 ddce307e1f32 d1f106e72099 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (9m) 22s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 c3925f9af261 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi137 *:8443,8765 running (8m) 42s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 b2b3dbcc6196 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi144 *:8443,8765 running (8m) 42s ago 8m 523M - 19.3.0-5120-g18432218 ddce307e1f32 d50286b96127 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (10m) 22s ago 10m 124M 2048M 19.3.0-5120-g18432218 ddce307e1f32 274f4ca53207 2024-09-21T01:15:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi137 running (8m) 42s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 d7f3fcde4b79 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi144 running (8m) 42s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 3aa7a3dee8d7 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (7m) 22s ago 7m 112M 4273M 19.3.0-5120-g18432218 ddce307e1f32 5fdf206c10e3 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi137 running (6m) 42s ago 6m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2f0c7d4721e1 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi144 running (6m) 42s ago 6m 126M 4272M 19.3.0-5120-g18432218 ddce307e1f32 5ed4cdd8603b 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (6m) 22s ago 6m 120M 4273M 19.3.0-5120-g18432218 ddce307e1f32 a693e5fb6b56 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi137 running (5m) 42s ago 5m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 156d638e8f9e 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi144 running (5m) 42s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ae54ac663419 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (4m) 22s ago 4m 119M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7e4284fcae5f 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi137 running (4m) 42s ago 4m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4a5261818a4a 2024-09-21T01:15:29.392 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi144 running (3m) 42s ago 3m 118M 4272M 19.3.0-5120-g18432218 ddce307e1f32 fcdaaa2d8e6e 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (3m) 22s ago 3m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 017047f4aec9 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi137 running (3m) 42s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a1977db1fb14 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi144 running (2m) 42s ago 2m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9d3b9981f380 2024-09-21T01:15:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.390+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c00b6510 msgr2=0x7fc1c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.390+0000 7fc1d7166640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c00b6510 0x7fc1c00b8a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40058c0 tx=0x7fc1c400a2d0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.390+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 msgr2=0x7fc1d019c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d019c8b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc006010 tx=0x7fc1bc0043b0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 shutdown_connections 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c00b6510 0x7fc1c00b8a20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d01094a0 0x7fc1d019d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d0106960 0x7fc1d019c8b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 --2- 172.21.15.37:0/332348946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d006c600 0x7fc1d019c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 >> 172.21.15.37:0/332348946 conn(0x7fc1d00fdfe0 msgr2=0x7fc1d0100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 shutdown_connections 2024-09-21T01:15:29.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:29.391+0000 7fc1d7166640 1 -- 172.21.15.37:0/332348946 wait complete. 2024-09-21T01:15:29.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:29 smithi137 ceph-mon[34607]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:29.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:29 smithi144 ceph-mon[34818]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:30.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T01:15:30.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:30 smithi037 ceph-mon[31105]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T01:15:30.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:30 smithi037 ceph-mon[31105]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:30.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:30 smithi137 ceph-mon[34607]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T01:15:30.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:30 smithi137 ceph-mon[34607]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:30.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:30 smithi144 ceph-mon[34818]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-21T01:15:30.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:30 smithi144 ceph-mon[34818]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:31.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 -- 172.21.15.37:0/2397326742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc444105180 msgr2=0x7fc44410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2397326742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc444105180 0x7fc44410bb20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009ca0 tx=0x7fc43c02a950 comp rx=0 tx=0).stop 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 -- 172.21.15.37:0/2397326742 shutdown_connections 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2397326742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc444105180 0x7fc44410bb20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2397326742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4441047e0 0x7fc444104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2397326742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc444103750 0x7fc444103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 -- 172.21.15.37:0/2397326742 >> 172.21.15.37:0/2397326742 conn(0x7fc4440ff0c0 msgr2=0x7fc444101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 -- 172.21.15.37:0/2397326742 shutdown_connections 2024-09-21T01:15:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.035+0000 7fc44a44b640 1 -- 172.21.15.37:0/2397326742 wait complete. 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 Processor -- start 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 -- start start 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc444103750 0x7fc444199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 0x7fc44419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc444105180 0x7fc44419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc44410f380 con 0x7fc4441047e0 2024-09-21T01:15:31.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc44410f200 con 0x7fc444103750 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc44a44b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc44410f500 con 0x7fc444105180 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc43bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 0x7fc44419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc443fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc444103750 0x7fc444199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc43bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 0x7fc44419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52586/0 (socket says 172.21.15.37:52586) 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.036+0000 7fc43bfff640 1 -- 172.21.15.37:0/2113168482 learned_addr learned my addr 172.21.15.37:0/2113168482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc4489e8640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc444105180 0x7fc44419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc43bfff640 1 -- 172.21.15.37:0/2113168482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc444105180 msgr2=0x7fc44419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc43bfff640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc444105180 0x7fc44419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc43bfff640 1 -- 172.21.15.37:0/2113168482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc444103750 msgr2=0x7fc444199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc43bfff640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc444103750 0x7fc444199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc43bfff640 1 -- 172.21.15.37:0/2113168482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44419b9a0 con 0x7fc4441047e0 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc4489e8640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc444105180 0x7fc44419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc43bfff640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 0x7fc44419a5e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00bf20 tx=0x7fc42c00dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:31.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c018070 con 0x7fc4441047e0 2024-09-21T01:15:31.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc42c009c30 con 0x7fc4441047e0 2024-09-21T01:15:31.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44419bc90 con 0x7fc4441047e0 2024-09-21T01:15:31.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c01b910 con 0x7fc4441047e0 2024-09-21T01:15:31.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.037+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4440757c0 con 0x7fc4441047e0 2024-09-21T01:15:31.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.038+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc444103bc0 con 0x7fc4441047e0 2024-09-21T01:15:31.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.040+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc42c01bab0 con 0x7fc4441047e0 2024-09-21T01:15:31.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.041+0000 7fc441ffb640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4300b6510 0x7fc4300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:31.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.041+0000 7fc443fff640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4300b6510 0x7fc4300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:31.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.041+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc42c0eb160 con 0x7fc4441047e0 2024-09-21T01:15:31.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.041+0000 7fc443fff640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4300b6510 0x7fc4300b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc43400bbe0 tx=0x7fc43400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:31.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.044+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc42c009de0 con 0x7fc4441047e0 2024-09-21T01:15:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.241+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fc444063800 con 0x7fc4300b6510 2024-09-21T01:15:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.247+0000 7fc441ffb640 1 -- 172.21.15.37:0/2113168482 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fc444063800 con 0x7fc4300b6510 2024-09-21T01:15:31.248 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T01:15:31.248 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 44s ago 2m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi137=b;smithi137=e;smithi137=h;smithi137=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T01:15:31.249 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 44s ago 8m smithi037=x;smithi137=y;smithi144=z;count:3 2024-09-21T01:15:31.249 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 44s ago 8m smithi037:172.21.15.37=a;smithi137:172.21.15.137=b;smithi144:172.21.15.144=c;count:3 2024-09-21T01:15:31.249 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 44s ago - 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4300b6510 msgr2=0x7fc4300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4300b6510 0x7fc4300b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc43400bbe0 tx=0x7fc43400b390 comp rx=0 tx=0).stop 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 msgr2=0x7fc44419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 0x7fc44419a5e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00bf20 tx=0x7fc42c00dd60 comp rx=0 tx=0).stop 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 shutdown_connections 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4300b6510 0x7fc4300b8a20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc444105180 0x7fc44419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4441047e0 0x7fc44419a5e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 --2- 172.21.15.37:0/2113168482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc444103750 0x7fc444199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 >> 172.21.15.37:0/2113168482 conn(0x7fc4440ff0c0 msgr2=0x7fc444107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.249+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 shutdown_connections 2024-09-21T01:15:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:31.250+0000 7fc44a44b640 1 -- 172.21.15.37:0/2113168482 wait complete. 2024-09-21T01:15:31.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T01:15:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:32.560 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:32 smithi037 ceph-mon[31105]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:15:32.560 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:32 smithi037 ceph-mon[31105]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:32.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:32 smithi137 ceph-mon[34607]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:15:32.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:32 smithi137 ceph-mon[34607]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:32.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:32 smithi144 ceph-mon[34818]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T01:15:32.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:32 smithi144 ceph-mon[34818]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 -- 172.21.15.37:0/1228669710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc102640 msgr2=0x7fcabc102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 --2- 172.21.15.37:0/1228669710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc102640 0x7fcabc102ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009900 tx=0x7fcaac02a480 comp rx=0 tx=0).stop 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 -- 172.21.15.37:0/1228669710 shutdown_connections 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 --2- 172.21.15.37:0/1228669710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 0x7fcabc10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 --2- 172.21.15.37:0/1228669710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcabc1036d0 0x7fcabc103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 --2- 172.21.15.37:0/1228669710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc102640 0x7fcabc102ab0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 -- 172.21.15.37:0/1228669710 >> 172.21.15.37:0/1228669710 conn(0x7fcabc0fdfb0 msgr2=0x7fcabc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 -- 172.21.15.37:0/1228669710 shutdown_connections 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.655+0000 7fcac26e3640 1 -- 172.21.15.37:0/1228669710 wait complete. 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 Processor -- start 2024-09-21T01:15:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 -- start start 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcabc102640 0x7fcabc19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 0x7fcabc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 0x7fcabc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc10e2e0 con 0x7fcabc1036d0 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc10e160 con 0x7fcabc104070 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac26e3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc10e460 con 0x7fcabc102640 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcabb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 0x7fcabc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcabb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 0x7fcabc19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52618/0 (socket says 172.21.15.37:52618) 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcabb7fe640 1 -- 172.21.15.37:0/3879624176 learned_addr learned my addr 172.21.15.37:0/3879624176 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcac0c80640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 0x7fcabc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.656+0000 7fcabbfff640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcabc102640 0x7fcabc19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcabb7fe640 1 -- 172.21.15.37:0/3879624176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcabc102640 msgr2=0x7fcabc19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcabb7fe640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcabc102640 0x7fcabc19a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcabb7fe640 1 -- 172.21.15.37:0/3879624176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 msgr2=0x7fcabc19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcabb7fe640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 0x7fcabc19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcabb7fe640 1 -- 172.21.15.37:0/3879624176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcabc19ba30 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcac0c80640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 0x7fcabc19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcabb7fe640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 0x7fcabc19a670 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b4a0 tx=0x7fcab000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0014070 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcab0010ac0 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcabc19bd20 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0017c30 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.657+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcabc1a2420 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.658+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcabc1a2650 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.660+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcab0017070 con 0x7fcabc1036d0 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.660+0000 7fcab97fa640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcaa40b6510 0x7fcaa40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.661+0000 7fcabbfff640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcaa40b6510 0x7fcaa40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.661+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fcab00e6a40 con 0x7fcabc1036d0 2024-09-21T01:15:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.661+0000 7fcabbfff640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcaa40b6510 0x7fcaa40b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcaac031440 tx=0x7fcaac0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.664+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcab00ad2d0 con 0x7fcabc1036d0 2024-09-21T01:15:32.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.859+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fcabc06b570 con 0x7fcaa40b6510 2024-09-21T01:15:32.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.861+0000 7fcab97fa640 1 -- 172.21.15.37:0/3879624176 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fcabc06b570 con 0x7fcaa40b6510 2024-09-21T01:15:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-09-21T01:15:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-09-21T01:15:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:smithi137 172.21.15.137 2024-09-21T01:15:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:smithi144 172.21.15.144 2024-09-21T01:15:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-09-21T01:15:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcaa40b6510 msgr2=0x7fcaa40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:32.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcaa40b6510 0x7fcaa40b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcaac031440 tx=0x7fcaac0314a0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 msgr2=0x7fcabc19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 0x7fcabc19a670 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b4a0 tx=0x7fcab000b960 comp rx=0 tx=0).stop 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 shutdown_connections 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcaa40b6510 0x7fcaa40b8a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcabc104070 0x7fcabc19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcabc1036d0 0x7fcabc19a670 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 --2- 172.21.15.37:0/3879624176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcabc102640 0x7fcabc19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 >> 172.21.15.37:0/3879624176 conn(0x7fcabc0fdfb0 msgr2=0x7fcabc06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 shutdown_connections 2024-09-21T01:15:32.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:32.863+0000 7fcac26e3640 1 -- 172.21.15.37:0/3879624176 wait complete. 2024-09-21T01:15:33.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T01:15:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:34.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 -- 172.21.15.37:0/3312347251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d01068e0 msgr2=0x7fd0d0108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/3312347251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d01068e0 0x7fd0d0108d40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009900 tx=0x7fd0c002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 -- 172.21.15.37:0/3312347251 shutdown_connections 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/3312347251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d0109480 0x7fd0d010b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/3312347251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d01068e0 0x7fd0d0108d40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/3312347251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d006c600 0x7fd0d01063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 -- 172.21.15.37:0/3312347251 >> 172.21.15.37:0/3312347251 conn(0x7fd0d00fdfa0 msgr2=0x7fd0d0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 -- 172.21.15.37:0/3312347251 shutdown_connections 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.389+0000 7fd0d7c51640 1 -- 172.21.15.37:0/3312347251 wait complete. 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 Processor -- start 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 -- start start 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 0x7fd0d0199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d01068e0 0x7fd0d019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d0109480 0x7fd0d019b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d010f390 con 0x7fd0d006c600 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d010f210 con 0x7fd0d01068e0 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d7c51640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d010f510 con 0x7fd0d0109480 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d59ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 0x7fd0d0199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d59ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 0x7fd0d0199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52636/0 (socket says 172.21.15.37:52636) 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d59ed640 1 -- 172.21.15.37:0/601414970 learned_addr learned my addr 172.21.15.37:0/601414970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d51ec640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d01068e0 0x7fd0d019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d61ee640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d0109480 0x7fd0d019b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d59ed640 1 -- 172.21.15.37:0/601414970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d0109480 msgr2=0x7fd0d019b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d59ed640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d0109480 0x7fd0d019b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.390+0000 7fd0d59ed640 1 -- 172.21.15.37:0/601414970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d01068e0 msgr2=0x7fd0d019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0d59ed640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d01068e0 0x7fd0d019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0d59ed640 1 -- 172.21.15.37:0/601414970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d019b9e0 con 0x7fd0d006c600 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0d59ed640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 0x7fd0d0199fb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00d950 tx=0x7fd0cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc017070 con 0x7fd0d006c600 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d019bcd0 con 0x7fd0d006c600 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0cc009c30 con 0x7fd0d006c600 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc00f620 con 0x7fd0d006c600 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.391+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d01a23d0 con 0x7fd0d006c600 2024-09-21T01:15:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.392+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d00ffac0 con 0x7fd0d006c600 2024-09-21T01:15:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.394+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd0cc010460 con 0x7fd0d006c600 2024-09-21T01:15:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.394+0000 7fd0c6ffd640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0bc0b6510 0x7fd0bc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.395+0000 7fd0d51ec640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0bc0b6510 0x7fd0bc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.395+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd0cc0e6f20 con 0x7fd0d006c600 2024-09-21T01:15:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.395+0000 7fd0d51ec640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0bc0b6510 0x7fd0bc0b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0000c00 tx=0x7fd0c0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:34.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.399+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0cc0ad7b0 con 0x7fd0d006c600 2024-09-21T01:15:34.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.598+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd0d0063800 con 0x7fd0bc0b6510 2024-09-21T01:15:34.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:34 smithi037 ceph-mon[31105]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:34.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:34 smithi037 ceph-mon[31105]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.600+0000 7fd0c6ffd640 1 -- 172.21.15.37:0/601414970 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd0d0063800 con 0x7fd0bc0b6510 2024-09-21T01:15:34.607 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T01:15:34.607 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T01:15:34.607 INFO:teuthology.orchestra.run.smithi037.stdout:smithi137 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233004A400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T01:15:34.607 INFO:teuthology.orchestra.run.smithi037.stdout:smithi144 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050085400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T01:15:34.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0bc0b6510 msgr2=0x7fd0bc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0bc0b6510 0x7fd0bc0b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0000c00 tx=0x7fd0c0031400 comp rx=0 tx=0).stop 2024-09-21T01:15:34.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 msgr2=0x7fd0d0199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:34.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 0x7fd0d0199fb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00d950 tx=0x7fd0cc00de10 comp rx=0 tx=0).stop 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 shutdown_connections 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0bc0b6510 0x7fd0bc0b8a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0d0109480 0x7fd0d019b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0d01068e0 0x7fd0d019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 --2- 172.21.15.37:0/601414970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d006c600 0x7fd0d0199fb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.602+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 >> 172.21.15.37:0/601414970 conn(0x7fd0d00fdfa0 msgr2=0x7fd0d0104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.603+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 shutdown_connections 2024-09-21T01:15:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:34.603+0000 7fd0d7c51640 1 -- 172.21.15.37:0/601414970 wait complete. 2024-09-21T01:15:34.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:34 smithi137 ceph-mon[34607]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:34.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:34 smithi137 ceph-mon[34607]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:34 smithi144 ceph-mon[34818]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:34 smithi144 ceph-mon[34818]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:35.394 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:15:35.409 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:15:35.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T01:15:35.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:35 smithi137 ceph-mon[34607]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:35.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:35 smithi144 ceph-mon[34818]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:35.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:35 smithi037 ceph-mon[31105]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 -- 172.21.15.37:0/3175567906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510102670 msgr2=0x7f8510102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 --2- 172.21.15.37:0/3175567906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510102670 0x7f8510102ae0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8500009900 tx=0x7f850002a480 comp rx=0 tx=0).stop 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 -- 172.21.15.37:0/3175567906 shutdown_connections 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 --2- 172.21.15.37:0/3175567906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85101040a0 0x7f851010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 --2- 172.21.15.37:0/3175567906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510103700 0x7f8510103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 --2- 172.21.15.37:0/3175567906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8510102670 0x7f8510102ae0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 -- 172.21.15.37:0/3175567906 >> 172.21.15.37:0/3175567906 conn(0x7f85100fdfe0 msgr2=0x7f8510100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:36.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 -- 172.21.15.37:0/3175567906 shutdown_connections 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.187+0000 7f851700b640 1 -- 172.21.15.37:0/3175567906 wait complete. 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 Processor -- start 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 -- start start 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8510102670 0x7f8510106260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510103700 0x7f8510104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 0x7f8510105070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f851010e310 con 0x7f85101040a0 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f851010e190 con 0x7f8510102670 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f851700b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f851010e490 con 0x7f8510103700 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 0x7f8510105070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 0x7f8510105070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49922/0 (socket says 172.21.15.37:49922) 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 -- 172.21.15.37:0/1595399323 learned_addr learned my addr 172.21.15.37:0/1595399323 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f8514da7640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8510102670 0x7f8510106260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:36.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f850ffff640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510103700 0x7f8510104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 -- 172.21.15.37:0/1595399323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510103700 msgr2=0x7f8510104b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510103700 0x7f8510104b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 -- 172.21.15.37:0/1595399323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8510102670 msgr2=0x7f8510106260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8510102670 0x7f8510106260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f85155a8640 1 -- 172.21.15.37:0/1595399323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8510105770 con 0x7f85101040a0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.188+0000 7f8514da7640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8510102670 0x7f8510106260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.189+0000 7f85155a8640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 0x7f8510105070 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f850800eaa0 tx=0x7f850800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.189+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850800cdb0 con 0x7f85101040a0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.189+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8508005020 con 0x7f85101040a0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.189+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85101a4120 con 0x7f85101040a0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.189+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85080116d0 con 0x7f85101040a0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.189+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85101a4600 con 0x7f85101040a0 2024-09-21T01:15:36.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.190+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85101a4890 con 0x7f85101040a0 2024-09-21T01:15:36.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.192+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f85080051d0 con 0x7f85101040a0 2024-09-21T01:15:36.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.192+0000 7f850dffb640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84f80b6510 0x7f84f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:36.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.192+0000 7f8514da7640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84f80b6510 0x7f84f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:36.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.192+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f85080e7950 con 0x7f85101040a0 2024-09-21T01:15:36.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.193+0000 7f8514da7640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84f80b6510 0x7f84f80b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8500031440 tx=0x7f8500005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:36.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.196+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8508016030 con 0x7f85101040a0 2024-09-21T01:15:36.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.421+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f85101a4a60 con 0x7f85101040a0 2024-09-21T01:15:36.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:36 smithi037 ceph-mon[31105]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:36.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.422+0000 7f850dffb640 1 -- 172.21.15.37:0/1595399323 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3130 (secure 0 0 0) 0x7f85080ae1e0 con 0x7f85101040a0 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:e27 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:btime 2024-09-21T01:14:02:645787+0000 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 27 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-21T01:13:51.265572+0000 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-21T01:14:02.645763+0000 2024-09-21T01:15:36.424 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 5 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:in 0,1,2,3,4 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24635,1=24631,2=24610,3=24605,4=24604} 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-09-21T01:15:36.425 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24635 members: 24635,24610,24631,24605,24604 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24635} state up:active seq 4 addr [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{0:24575} state up:standby-replay seq 1 addr [v2:172.21.15.137:6834/2865149890,v1:172.21.15.137:6835/2865149890] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{1:24631} state up:active seq 8 addr [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{1:24562} state up:standby-replay seq 1 addr [v2:172.21.15.144:6832/299841905,v1:172.21.15.144:6833/299841905] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{2:24610} state up:active seq 10 addr [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.426 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{2:24554} state up:standby-replay seq 1 addr [v2:172.21.15.137:6832/1167918014,v1:172.21.15.137:6833/1167918014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{3:24605} state up:active seq 9 addr [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{3:14820} state up:standby-replay seq 1 addr [v2:172.21.15.37:6840/3072910125,v1:172.21.15.37:6841/3072910125] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{4:24604} state up:active seq 11 addr [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{4:14808} state up:standby-replay seq 1 addr [v2:172.21.15.37:6838/3638461031,v1:172.21.15.37:6839/3638461031] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14748} state up:standby seq 1 addr [v2:172.21.15.37:6834/417404458,v1:172.21.15.37:6835/417404458] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14760} state up:standby seq 1 addr [v2:172.21.15.37:6836/2567414723,v1:172.21.15.37:6837/2567414723] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84f80b6510 msgr2=0x7f84f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84f80b6510 0x7f84f80b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8500031440 tx=0x7f8500005d50 comp rx=0 tx=0).stop 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 msgr2=0x7f8510105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 0x7f8510105070 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f850800eaa0 tx=0x7f850800ef60 comp rx=0 tx=0).stop 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 shutdown_connections 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84f80b6510 0x7f84f80b8a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85101040a0 0x7f8510105070 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510103700 0x7f8510104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 --2- 172.21.15.37:0/1595399323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8510102670 0x7f8510106260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.424+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 >> 172.21.15.37:0/1595399323 conn(0x7f85100fdfe0 msgr2=0x7f85100ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.425+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 shutdown_connections 2024-09-21T01:15:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:36.425+0000 7f851700b640 1 -- 172.21.15.37:0/1595399323 wait complete. 2024-09-21T01:15:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:36 smithi137 ceph-mon[34607]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:36.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:36 smithi144 ceph-mon[34818]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:37.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T01:15:37.444 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:37.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:37 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1595399323' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:15:37.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:37 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1595399323' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:15:37.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:37 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1595399323' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:15:37.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 -- 172.21.15.37:0/2883821731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac103750 msgr2=0x7f36ac103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:37.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 --2- 172.21.15.37:0/2883821731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac103750 0x7f36ac103bc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f369c009900 tx=0x7f369c02a480 comp rx=0 tx=0).stop 2024-09-21T01:15:37.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 -- 172.21.15.37:0/2883821731 shutdown_connections 2024-09-21T01:15:37.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 --2- 172.21.15.37:0/2883821731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ac105180 0x7f36ac10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 --2- 172.21.15.37:0/2883821731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36ac1047e0 0x7f36ac104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 --2- 172.21.15.37:0/2883821731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac103750 0x7f36ac103bc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.913+0000 7f36b27e2640 1 -- 172.21.15.37:0/2883821731 >> 172.21.15.37:0/2883821731 conn(0x7f36ac0ff0c0 msgr2=0x7f36ac101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.914+0000 7f36b27e2640 1 -- 172.21.15.37:0/2883821731 shutdown_connections 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.914+0000 7f36b27e2640 1 -- 172.21.15.37:0/2883821731 wait complete. 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.914+0000 7f36b27e2640 1 Processor -- start 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.914+0000 7f36b27e2640 1 -- start start 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b27e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36ac103750 0x7f36ac19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b27e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 0x7f36ac19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b27e2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ac105180 0x7f36ac19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b27e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10f390 con 0x7f36ac1047e0 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b27e2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10f210 con 0x7f36ac103750 2024-09-21T01:15:37.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b27e2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10f510 con 0x7f36ac105180 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 0x7f36ac19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 0x7f36ac19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49940/0 (socket says 172.21.15.37:49940) 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 -- 172.21.15.37:0/1346083413 learned_addr learned my addr 172.21.15.37:0/1346083413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36abfff640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36ac103750 0x7f36ac19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36b0d7f640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ac105180 0x7f36ac19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 -- 172.21.15.37:0/1346083413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ac105180 msgr2=0x7f36ac19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ac105180 0x7f36ac19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 -- 172.21.15.37:0/1346083413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36ac103750 msgr2=0x7f36ac19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36ac103750 0x7f36ac19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 -- 172.21.15.37:0/1346083413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac19b9d0 con 0x7f36ac1047e0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36ab7fe640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 0x7f36ac19a680 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c890 tx=0x7f36a000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004220 con 0x7f36ac1047e0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.915+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a00043c0 con 0x7f36ac1047e0 2024-09-21T01:15:37.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.916+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac19bcc0 con 0x7f36ac1047e0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.916+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0004a00 con 0x7f36ac1047e0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.916+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac1a23c0 con 0x7f36ac1047e0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.916+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac10a930 con 0x7f36ac1047e0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.918+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f36a00079b0 con 0x7f36ac1047e0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.919+0000 7f36a97fa640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f36940b6590 0x7f36940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.919+0000 7f36abfff640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f36940b6590 0x7f36940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.919+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f36a00e73d0 con 0x7f36ac1047e0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.920+0000 7f36abfff640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f36940b6590 0x7f36940b8aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f369c000c00 tx=0x7f369c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:37.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:37.922+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36a0014030 con 0x7f36ac1047e0 2024-09-21T01:15:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.114+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f36ac02e640 con 0x7f36ac1047e0 2024-09-21T01:15:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.115+0000 7f36a97fa640 1 -- 172.21.15.37:0/1346083413 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v76) ==== 56+0+5307 (secure 0 0 0) 0x7f36a00adce0 con 0x7f36ac1047e0 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 76 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-21T01:05:18.978360+0000 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-21T01:14:17.917717+0000 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 26 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-09-21T01:15:38.117 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/3448292591,v1:172.21.15.37:6803/3448292591] [v2:172.21.15.37:6804/3448292591,v1:172.21.15.37:6805/3448292591] exists,up af3439a3-c611-4fe4-9cc0-1070e5c3f4e8 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 13 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6800/806118255,v1:172.21.15.137:6801/806118255] [v2:172.21.15.137:6802/806118255,v1:172.21.15.137:6803/806118255] exists,up 55683e3d-91c3-4a7e-8fd6-e493edcec0f4 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 18 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/4236488029,v1:172.21.15.144:6801/4236488029] [v2:172.21.15.144:6802/4236488029,v1:172.21.15.144:6803/4236488029] exists,up d343aa5f-854c-4241-81bb-623964d18857 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 24 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/261274699,v1:172.21.15.37:6811/261274699] [v2:172.21.15.37:6812/261274699,v1:172.21.15.37:6813/261274699] exists,up 4a3a46d7-bbc4-4211-a85c-450533a40330 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 30 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6808/2853866210,v1:172.21.15.137:6809/2853866210] [v2:172.21.15.137:6810/2853866210,v1:172.21.15.137:6811/2853866210] exists,up 365b5737-c951-435b-b661-abdfcdc9a3dd 2024-09-21T01:15:38.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 35 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/2563342587,v1:172.21.15.144:6809/2563342587] [v2:172.21.15.144:6810/2563342587,v1:172.21.15.144:6811/2563342587] exists,up 020d2837-a187-4fe7-8f77-52d15b00ae13 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 41 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/1539811253,v1:172.21.15.37:6819/1539811253] [v2:172.21.15.37:6820/1539811253,v1:172.21.15.37:6821/1539811253] exists,up d35918e8-efad-4939-a7c3-5fdf10f4a93b 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 46 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6816/1960224257,v1:172.21.15.137:6817/1960224257] [v2:172.21.15.137:6818/1960224257,v1:172.21.15.137:6819/1960224257] exists,up 28fefcbb-3ceb-434b-8919-9c47207921ff 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 51 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/2167195424,v1:172.21.15.144:6817/2167195424] [v2:172.21.15.144:6818/2167195424,v1:172.21.15.144:6819/2167195424] exists,up e2931d04-84ea-4aa9-811f-b8dcee437c33 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 57 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/3861420573,v1:172.21.15.37:6827/3861420573] [v2:172.21.15.37:6828/3861420573,v1:172.21.15.37:6829/3861420573] exists,up 01ba8830-71d3-4ca1-9c59-caf80641e235 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 62 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6824/1223382537,v1:172.21.15.137:6825/1223382537] [v2:172.21.15.137:6826/1223382537,v1:172.21.15.137:6827/1223382537] exists,up 75ec1bb2-7dfc-404e-857e-214123b35827 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 68 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6824/679956163,v1:172.21.15.144:6825/679956163] [v2:172.21.15.144:6826/679956163,v1:172.21.15.144:6827/679956163] exists,up 8b9554ef-fc14-4188-8222-c391333fbf97 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.0 [8,1] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.13 [2,11] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.0 [4,8] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.5 [3,9] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.6 [4,7] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.e [4,6] 2024-09-21T01:15:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.11 [5,9] 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.20 [5,9] 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2383418046 expires 2024-09-22T01:06:16.751077+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/3976496410 expires 2024-09-22T01:06:16.751077+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/3304055550 expires 2024-09-22T01:05:50.424453+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/3304055550 expires 2024-09-22T01:05:50.424453+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2530616561 expires 2024-09-22T01:05:50.424453+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2065066033 expires 2024-09-22T01:06:16.751077+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1699078547 expires 2024-09-22T01:05:50.424453+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/3976496410 expires 2024-09-22T01:06:16.751077+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3851858190 expires 2024-09-22T01:06:16.751077+0000 2024-09-21T01:15:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/863846747 expires 2024-09-22T01:05:50.424453+0000 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f36940b6590 msgr2=0x7f36940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f36940b6590 0x7f36940b8aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f369c000c00 tx=0x7f369c031400 comp rx=0 tx=0).stop 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 msgr2=0x7f36ac19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 0x7f36ac19a680 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c890 tx=0x7f36a000cd50 comp rx=0 tx=0).stop 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 shutdown_connections 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f36940b6590 0x7f36940b8aa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ac105180 0x7f36ac19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36ac1047e0 0x7f36ac19a680 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 --2- 172.21.15.37:0/1346083413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f36ac103750 0x7f36ac19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 >> 172.21.15.37:0/1346083413 conn(0x7f36ac0ff0c0 msgr2=0x7f36ac107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 shutdown_connections 2024-09-21T01:15:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:38.118+0000 7f36b27e2640 1 -- 172.21.15.37:0/1346083413 wait complete. 2024-09-21T01:15:38.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:38 smithi037 ceph-mon[31105]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:38 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1346083413' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:15:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:38 smithi137 ceph-mon[34607]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:38 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1346083413' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:15:38.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:38 smithi144 ceph-mon[34818]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:38 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1346083413' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:15:38.884 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T01:15:38.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 -- 172.21.15.37:0/1759921147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c103b60 msgr2=0x7ff69c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/1759921147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c103b60 0x7ff69c103f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009900 tx=0x7ff68c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 -- 172.21.15.37:0/1759921147 shutdown_connections 2024-09-21T01:15:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/1759921147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c109df0 0x7ff69c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/1759921147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff69c1094a0 0x7ff69c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/1759921147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c103b60 0x7ff69c103f70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 -- 172.21.15.37:0/1759921147 >> 172.21.15.37:0/1759921147 conn(0x7ff69c07b850 msgr2=0x7ff69c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 -- 172.21.15.37:0/1759921147 shutdown_connections 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.706+0000 7ff6a29d8640 1 -- 172.21.15.37:0/1759921147 wait complete. 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.707+0000 7ff6a29d8640 1 Processor -- start 2024-09-21T01:15:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.707+0000 7ff6a29d8640 1 -- start start 2024-09-21T01:15:39.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a29d8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff69c103b60 0x7ff69c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:39.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a29d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 0x7ff69c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:39.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a29d8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c109df0 0x7ff69c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a29d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c113ab0 con 0x7ff69c1094a0 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a29d8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c113930 con 0x7ff69c103b60 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a29d8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c113c30 con 0x7ff69c109df0 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 0x7ff69c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 0x7ff69c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49964/0 (socket says 172.21.15.37:49964) 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 -- 172.21.15.37:0/196934660 learned_addr learned my addr 172.21.15.37:0/196934660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69bfff640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff69c103b60 0x7ff69c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6a0f75640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c109df0 0x7ff69c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 -- 172.21.15.37:0/196934660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c109df0 msgr2=0x7ff69c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c109df0 0x7ff69c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 -- 172.21.15.37:0/196934660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff69c103b60 msgr2=0x7ff69c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff69c103b60 0x7ff69c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 -- 172.21.15.37:0/196934660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1a03b0 con 0x7ff69c1094a0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff69b7fe640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 0x7ff69c19aaa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d740 tx=0x7ff69000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.708+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690017070 con 0x7ff69c1094a0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.709+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69000de50 con 0x7ff69c1094a0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.709+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1a06a0 con 0x7ff69c1094a0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.709+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69000f620 con 0x7ff69c1094a0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.709+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1a6ec0 con 0x7ff69c1094a0 2024-09-21T01:15:39.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.710+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c103f70 con 0x7ff69c1094a0 2024-09-21T01:15:39.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.711+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff69001a070 con 0x7ff69c1094a0 2024-09-21T01:15:39.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.712+0000 7ff6997fa640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6840b65c0 0x7ff6840b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:39.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.712+0000 7ff69bfff640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6840b65c0 0x7ff6840b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:39.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.713+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff6900e6c10 con 0x7ff69c1094a0 2024-09-21T01:15:39.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.713+0000 7ff69bfff640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6840b65c0 0x7ff6840b8ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff68c031440 tx=0x7ff68c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:39.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.716+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6900ad520 con 0x7ff69c1094a0 2024-09-21T01:15:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.943+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff69c10bbc0 con 0x7ff69c1094a0 2024-09-21T01:15:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.943+0000 7ff6997fa640 1 -- 172.21.15.37:0/196934660 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11976 (secure 0 0 0) 0x7ff6900b1900 con 0x7ff69c1094a0 2024-09-21T01:15:39.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:39.945 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:14:02.645763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:15:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6840b65c0 msgr2=0x7ff6840b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6840b65c0 0x7ff6840b8ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff68c031440 tx=0x7ff68c009560 comp rx=0 tx=0).stop 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 msgr2=0x7ff69c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 0x7ff69c19aaa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d740 tx=0x7ff69000dc00 comp rx=0 tx=0).stop 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 shutdown_connections 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6840b65c0 0x7ff6840b8ad0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c109df0 0x7ff69c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c1094a0 0x7ff69c19aaa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 --2- 172.21.15.37:0/196934660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff69c103b60 0x7ff69c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 >> 172.21.15.37:0/196934660 conn(0x7ff69c07b850 msgr2=0x7ff69c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.946+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 shutdown_connections 2024-09-21T01:15:39.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:39.947+0000 7ff6a29d8640 1 -- 172.21.15.37:0/196934660 wait complete. 2024-09-21T01:15:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:40 smithi137 ceph-mon[34607]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:40 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/196934660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:40 smithi144 ceph-mon[34818]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:40 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/196934660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:40.703 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:40 smithi037 ceph-mon[31105]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:40.704 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:40 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/196934660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:40.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.498+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2012234817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20103b60 msgr2=0x7f6b20103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.498+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2012234817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20103b60 0x7f6b20103f70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009900 tx=0x7f6b1c02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2012234817 shutdown_connections 2024-09-21T01:15:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2012234817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 0x7f6b20110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2012234817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b201094a0 0x7f6b201098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2012234817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20103b60 0x7f6b20103f70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2012234817 >> 172.21.15.37:0/2012234817 conn(0x7f6b2007b850 msgr2=0x7f6b2007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2012234817 shutdown_connections 2024-09-21T01:15:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2012234817 wait complete. 2024-09-21T01:15:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 Processor -- start 2024-09-21T01:15:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.499+0000 7f6b26ebd640 1 -- start start 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b26ebd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b20103b60 0x7f6b2019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b26ebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 0x7f6b2019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b26ebd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 0x7f6b201a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b26ebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b20113ab0 con 0x7f6b201094a0 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b26ebd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6b20113930 con 0x7f6b20103b60 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b26ebd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b20113c30 con 0x7f6b20109df0 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 0x7f6b2019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 0x7f6b2019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49972/0 (socket says 172.21.15.37:49972) 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 -- 172.21.15.37:0/2071318335 learned_addr learned my addr 172.21.15.37:0/2071318335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b24c59640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b20103b60 0x7f6b2019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b2545a640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 0x7f6b201a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 -- 172.21.15.37:0/2071318335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 msgr2=0x7f6b201a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 0x7f6b201a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 -- 172.21.15.37:0/2071318335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b20103b60 msgr2=0x7f6b2019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b20103b60 0x7f6b2019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 -- 172.21.15.37:0/2071318335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b201a2570 con 0x7f6b201094a0 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b24c59640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b20103b60 0x7f6b2019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b2545a640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 0x7f6b201a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.500+0000 7f6b17fff640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 0x7f6b2019cc60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c8c0 tx=0x7f6b1000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.501+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10007bb0 con 0x7f6b201094a0 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.501+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b10007d50 con 0x7f6b201094a0 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.501+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b201a2860 con 0x7f6b201094a0 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.501+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b100187c0 con 0x7f6b201094a0 2024-09-21T01:15:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.501+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b201a9080 con 0x7f6b201094a0 2024-09-21T01:15:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.502+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b20103f70 con 0x7f6b201094a0 2024-09-21T01:15:41.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.504+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6b1000fa20 con 0x7f6b201094a0 2024-09-21T01:15:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.505+0000 7f6b15ffb640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b080b6540 0x7f6b080b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.505+0000 7f6b24c59640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b080b6540 0x7f6b080b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.505+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6b100e7710 con 0x7f6b201094a0 2024-09-21T01:15:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.506+0000 7f6b24c59640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b080b6540 0x7f6b080b8a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c031440 tx=0x7f6b1c009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.508+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b10014030 con 0x7f6b201094a0 2024-09-21T01:15:41.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.738+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b2019d7f0 con 0x7f6b201094a0 2024-09-21T01:15:41.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.739+0000 7f6b15ffb640 1 -- 172.21.15.37:0/2071318335 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11976 (secure 0 0 0) 0x7f6b2019d7f0 con 0x7f6b201094a0 2024-09-21T01:15:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:41.740 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"btime":"2024-09-21T01:14:02:645787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:14:02.645763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:15:41.741 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-09-21T01:15:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b080b6540 msgr2=0x7f6b080b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b080b6540 0x7f6b080b8a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c031440 tx=0x7f6b1c009680 comp rx=0 tx=0).stop 2024-09-21T01:15:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 msgr2=0x7f6b2019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 0x7f6b2019cc60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c8c0 tx=0x7f6b1000cd80 comp rx=0 tx=0).stop 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 shutdown_connections 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6b080b6540 0x7f6b080b8a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b20109df0 0x7f6b201a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201094a0 0x7f6b2019cc60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 --2- 172.21.15.37:0/2071318335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6b20103b60 0x7f6b2019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 >> 172.21.15.37:0/2071318335 conn(0x7f6b2007b850 msgr2=0x7f6b201072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 shutdown_connections 2024-09-21T01:15:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:41.742+0000 7f6b26ebd640 1 -- 172.21.15.37:0/2071318335 wait complete. 2024-09-21T01:15:42.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:15:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:42 smithi137 ceph-mon[34607]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:42 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2071318335' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:42.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:42 smithi144 ceph-mon[34818]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:42.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:42 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2071318335' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:42.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:42 smithi037 ceph-mon[31105]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:42.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:42 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2071318335' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 -- 172.21.15.37:0/1292780908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781052a0 msgr2=0x7fb27810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/1292780908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781052a0 0x7fb27810d930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb260009900 tx=0x7fb26002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 -- 172.21.15.37:0/1292780908 shutdown_connections 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/1292780908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 0x7fb278110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/1292780908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781052a0 0x7fb27810d930 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/1292780908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781048c0 0x7fb278104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 -- 172.21.15.37:0/1292780908 >> 172.21.15.37:0/1292780908 conn(0x7fb278079760 msgr2=0x7fb278079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 -- 172.21.15.37:0/1292780908 shutdown_connections 2024-09-21T01:15:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.199+0000 7fb27dd8d640 1 -- 172.21.15.37:0/1292780908 wait complete. 2024-09-21T01:15:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.200+0000 7fb27dd8d640 1 Processor -- start 2024-09-21T01:15:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.200+0000 7fb27dd8d640 1 -- start start 2024-09-21T01:15:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb27dd8d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 0x7fb2781027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb27dd8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781052a0 0x7fb278102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb27dd8d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 0x7fb278103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb27dd8d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb278113ab0 con 0x7fb2781048c0 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb27dd8d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb278113930 con 0x7fb2781052a0 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb27dd8d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb278113c30 con 0x7fb27810de70 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 0x7fb2781027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 0x7fb2781027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50000/0 (socket says 172.21.15.37:50000) 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 -- 172.21.15.37:0/3782410822 learned_addr learned my addr 172.21.15.37:0/3782410822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb277fff640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 0x7fb278103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb26effd640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781052a0 0x7fb278102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 -- 172.21.15.37:0/3782410822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 msgr2=0x7fb278103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 0x7fb278103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 -- 172.21.15.37:0/3782410822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781052a0 msgr2=0x7fb278102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781052a0 0x7fb278102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 -- 172.21.15.37:0/3782410822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2781a87c0 con 0x7fb2781048c0 2024-09-21T01:15:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb277fff640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 0x7fb278103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb26effd640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781052a0 0x7fb278102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.201+0000 7fb2777fe640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 0x7fb2781027d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb26800d770 tx=0x7fb26800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.202+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268017070 con 0x7fb2781048c0 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.202+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb268009c30 con 0x7fb2781048c0 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.202+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2781a8ab0 con 0x7fb2781048c0 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.202+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268003cc0 con 0x7fb2781048c0 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.202+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2781a8fc0 con 0x7fb2781048c0 2024-09-21T01:15:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.203+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27806c190 con 0x7fb2781048c0 2024-09-21T01:15:43.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.204+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb268010460 con 0x7fb2781048c0 2024-09-21T01:15:43.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.205+0000 7fb2757fa640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb2640b6510 0x7fb2640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:43.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.205+0000 7fb26effd640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb2640b6510 0x7fb2640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:43.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.205+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb2680e6de0 con 0x7fb2781048c0 2024-09-21T01:15:43.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.206+0000 7fb26effd640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb2640b6510 0x7fb2640b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb260009230 tx=0x7fb260000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:43.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.210+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb268009de0 con 0x7fb2781048c0 2024-09-21T01:15:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.399+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb27802e640 con 0x7fb2781048c0 2024-09-21T01:15:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.401+0000 7fb2757fa640 1 -- 172.21.15.37:0/3782410822 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7fb2680ad630 con 0x7fb2781048c0 2024-09-21T01:15:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:43.403 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.403+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb2640b6510 msgr2=0x7fb2640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.403+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb2640b6510 0x7fb2640b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb260009230 tx=0x7fb260000bc0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.403+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 msgr2=0x7fb2781027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.403+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 0x7fb2781027d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb26800d770 tx=0x7fb26800dc30 comp rx=0 tx=0).stop 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.403+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 shutdown_connections 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb2640b6510 0x7fb2640b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb27810de70 0x7fb278103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2781052a0 0x7fb278102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 --2- 172.21.15.37:0/3782410822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2781048c0 0x7fb2781027d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 >> 172.21.15.37:0/3782410822 conn(0x7fb278079760 msgr2=0x7fb2780ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 shutdown_connections 2024-09-21T01:15:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:43.404+0000 7fb27dd8d640 1 -- 172.21.15.37:0/3782410822 wait complete. 2024-09-21T01:15:44.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:13:51.265572+0000', 'modified': '2024-09-21T01:14:02.645763+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24635, 'mds_1': 24631, 'mds_2': 24610, 'mds_3': 24605, 'mds_4': 24604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14808': {'gid': 14808, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/3638461031', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 3638461031}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 3638461031}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14820': {'gid': 14820, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/3072910125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 3072910125}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 3072910125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24554': {'gid': 24554, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6833/1167918014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6832', 'nonce': 1167918014}, {'type': 'v1', 'addr': '172.21.15.137:6833', 'nonce': 1167918014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6833/299841905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6832', 'nonce': 299841905}, {'type': 'v1', 'addr': '172.21.15.144:6833', 'nonce': 299841905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24575': {'gid': 24575, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.137:6835/2865149890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 2865149890}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 2865149890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24604': {'gid': 24604, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.144:6835/3565351680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3565351680}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3565351680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24605': {'gid': 24605, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.137:6837/234673492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 234673492}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 234673492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.144:6837/3444337683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 3444337683}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 3444337683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.144:6839/2711377630', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 2711377630}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 2711377630}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24635': {'gid': 24635, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6839/302617634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6838', 'nonce': 302617634}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 302617634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24635, 'qdb_cluster': [24635, 24610, 24631, 24605, 24604]} 2024-09-21T01:15:44.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T01:15:44.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T01:15:44.423 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:44.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:44 smithi037 ceph-mon[31105]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:44.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:44 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3782410822' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:44 smithi137 ceph-mon[34607]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:44 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3782410822' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:44 smithi144 ceph-mon[34818]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:44 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3782410822' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.883+0000 7f2145817640 1 -- 172.21.15.37:0/2265997958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21401094a0 msgr2=0x7f21401098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.883+0000 7f2145817640 1 --2- 172.21.15.37:0/2265997958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21401094a0 0x7f21401098b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2128009900 tx=0x7f212802a410 comp rx=0 tx=0).stop 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 -- 172.21.15.37:0/2265997958 shutdown_connections 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 --2- 172.21.15.37:0/2265997958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2140109df0 0x7f2140110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 --2- 172.21.15.37:0/2265997958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21401094a0 0x7f21401098b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 --2- 172.21.15.37:0/2265997958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2140103b60 0x7f2140103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 -- 172.21.15.37:0/2265997958 >> 172.21.15.37:0/2265997958 conn(0x7f214007b850 msgr2=0x7f214007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 -- 172.21.15.37:0/2265997958 shutdown_connections 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 -- 172.21.15.37:0/2265997958 wait complete. 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 Processor -- start 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.884+0000 7f2145817640 1 -- start start 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f2145817640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 0x7f214019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f2145817640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21401094a0 0x7f214019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f2145817640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2140109df0 0x7f214019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f2145817640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2140113ab0 con 0x7f2140103b60 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f2145817640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2140113930 con 0x7f2140109df0 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f2145817640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2140113c30 con 0x7f21401094a0 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 0x7f214019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 0x7f214019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50010/0 (socket says 172.21.15.37:50010) 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 -- 172.21.15.37:0/3466565690 learned_addr learned my addr 172.21.15.37:0/3466565690 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213f7fe640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2140109df0 0x7f214019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f21367fc640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21401094a0 0x7f214019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 -- 172.21.15.37:0/3466565690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21401094a0 msgr2=0x7f214019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21401094a0 0x7f214019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 -- 172.21.15.37:0/3466565690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2140109df0 msgr2=0x7f214019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2140109df0 0x7f214019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 -- 172.21.15.37:0/3466565690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21401a0390 con 0x7f2140103b60 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.885+0000 7f213effd640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 0x7f214019a4e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f213000c920 tx=0x7f213000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.886+0000 7f2144815640 1 -- 172.21.15.37:0/3466565690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130007c70 con 0x7f2140103b60 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.886+0000 7f2144815640 1 -- 172.21.15.37:0/3466565690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2130007e10 con 0x7f2140103b60 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.886+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21401a0680 con 0x7f2140103b60 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.886+0000 7f2144815640 1 -- 172.21.15.37:0/3466565690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2130018820 con 0x7f2140103b60 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.886+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21401a6ea0 con 0x7f2140103b60 2024-09-21T01:15:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 Processor -- start 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 -- start start 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1961ff60 0x55ca199c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f2144815640 1 -- 172.21.15.37:0/3466565690 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f213000f450 con 0x7f2140103b60 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ca1993dc10 con 0x55ca195ff280 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ca1992d040 con 0x55ca1961ff60 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f214bd8b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca19930e50 con 0x55ca195f70a0 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.889+0000 7f21367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50014/0 (socket says 172.21.15.37:50014) 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 -- 172.21.15.37:0/1958972215 learned_addr learned my addr 172.21.15.37:0/1958972215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f213effd640 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f213f7fe640 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1961ff60 0x55ca199c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 -- 172.21.15.37:0/1958972215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 msgr2=0x55ca199c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 -- 172.21.15.37:0/1958972215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1961ff60 msgr2=0x55ca199c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1961ff60 0x55ca199c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 -- 172.21.15.37:0/1958972215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca1968b540 con 0x55ca195ff280 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f21367fc640 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199c6980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2128000c00 tx=0x7f2128032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55651fbe6e7b06c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f2135ffb640 1 -- 172.21.15.37:0/1958972215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212803f070 con 0x55ca195ff280 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f2135ffb640 1 -- 172.21.15.37:0/1958972215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21280316a0 con 0x55ca195ff280 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f2135ffb640 1 -- 172.21.15.37:0/1958972215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128035070 con 0x55ca195ff280 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.890+0000 7f2144815640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f212c0b6540 0x7f212c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f213f7fe640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f212c0b6540 0x7f212c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f2144815640 1 -- 172.21.15.37:0/3466565690 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f21300e7420 con 0x7f2140103b60 2024-09-21T01:15:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 -- 172.21.15.37:0/1958972215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 msgr2=0x55ca199c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f213f7fe640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f212c0b6540 0x7f212c0b8a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2138005fd0 tx=0x7f2138009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199c6980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2128000c00 tx=0x7f2128032ce0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 -- 172.21.15.37:0/1958972215 shutdown_connections 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199c6980 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1958972215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca1961ff60 0x55ca199c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 -- 172.21.15.37:0/1958972215 >> 172.21.15.37:0/1958972215 conn(0x55ca19614350 msgr2=0x55ca199c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 -- 172.21.15.37:0/1958972215 shutdown_connections 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.891+0000 7f214bd8b740 1 -- 172.21.15.37:0/1958972215 wait complete. 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 -- start start 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 Processor -- start 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca1961ff60 0x55ca199dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ca1978e5f0 con 0x55ca195ff280 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ca198c8010 con 0x55ca195f70a0 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca199d4680 con 0x55ca1961ff60 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f214bd8b740 10 client.0 _ll_register_callbacks cb 0x55ca19927340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.892+0000 7f21367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199d1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50016/0 (socket says 172.21.15.37:50016) 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 -- 172.21.15.37:0/375771540 learned_addr learned my addr 172.21.15.37:0/375771540 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f213f7fe640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca1961ff60 0x55ca199dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f213effd640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 -- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca1961ff60 msgr2=0x55ca199dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca1961ff60 0x55ca199dd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 -- 172.21.15.37:0/375771540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 msgr2=0x55ca199d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 -- 172.21.15.37:0/375771540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca198f5a00 con 0x55ca195ff280 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f21367fc640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199d1f90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2128031440 tx=0x7f2128031590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33406d07c86b542f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f211effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f211effd640 1 -- 172.21.15.37:0/375771540 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212804a070 con 0x55ca195ff280 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f211effd640 1 -- 172.21.15.37:0/375771540 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f21280035f0 con 0x55ca195ff280 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21280316a0 con 0x55ca195ff280 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f211effd640 1 -- 172.21.15.37:0/375771540 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2128056050 con 0x55ca195ff280 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f214bd8b740 10 client.15357 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.893+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca199e0640 con 0x55ca195ff280 2024-09-21T01:15:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f211effd640 1 -- 172.21.15.37:0/375771540 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21280316a0 con 0x55ca195ff280 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f211effd640 1 -- 172.21.15.37:0/375771540 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f212803b8e0 con 0x55ca195ff280 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f214bd8b740 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f214bd8b740 10 client.15357 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f214bd8b740 20 client.15357 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f214bd8b740 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195de8e0 0x55ca199e3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f214bd8b740 4 client.15357 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca1993fb60 con 0x55ca195de8e0 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.894+0000 7f213effd640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195de8e0 0x55ca199e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.895+0000 7f211effd640 10 client.15357 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.895+0000 7f213effd640 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195de8e0 0x55ca199e3be0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2590703c452fcf2c server_cookie=67ba1e8c39702b1c in_seq=0 out_seq=0 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.895+0000 7f211effd640 1 -- 172.21.15.37:0/375771540 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca1993fb60 con 0x55ca195de8e0 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.895+0000 7f211effd640 10 client.15357 handle_command_reply: tid=0 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.895+0000 7f214bd8b740 1 client.15357 shutdown 2024-09-21T01:15:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 msgr2=0x55ca199d1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199d1f90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2128031440 tx=0x7f2128031590 comp rx=0 tx=0).stop 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 shutdown_connections 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195de8e0 0x55ca199e3be0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca1961ff60 0x55ca199dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca195ff280 0x55ca199d1f90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 --2- 172.21.15.37:0/375771540 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 >> 172.21.15.37:0/375771540 conn(0x55ca19614350 msgr2=0x55ca199c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f211effd640 0 client.15357 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 shutdown_connections 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 1 -- 172.21.15.37:0/375771540 wait complete. 2024-09-21T01:15:44.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.896+0000 7f214bd8b740 20 client.15357 trim_cache size 0 max 16384 2024-09-21T01:15:44.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 Processor -- start 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 -- start start 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195ff280 0x55ca199ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ca199e1f20 con 0x55ca1961ff60 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ca199e25f0 con 0x55ca195ff280 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f214bd8b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca199e2cc0 con 0x55ca195f70a0 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.914+0000 7f213f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199ec7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50028/0 (socket says 172.21.15.37:50028) 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 -- 172.21.15.37:0/1570130971 learned_addr learned my addr 172.21.15.37:0/1570130971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213effd640 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f21367fc640 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195ff280 0x55ca199ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 -- 172.21.15.37:0/1570130971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 msgr2=0x55ca199cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 -- 172.21.15.37:0/1570130971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195ff280 msgr2=0x55ca199ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195ff280 0x55ca199ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 -- 172.21.15.37:0/1570130971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca199be080 con 0x55ca1961ff60 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f213f7fe640 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199ec7f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2138003ca0 tx=0x7f2138019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a354d5459faf476 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f21357fa640 1 -- 172.21.15.37:0/1570130971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138004d20 con 0x55ca1961ff60 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f21357fa640 1 -- 172.21.15.37:0/1570130971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2138003e10 con 0x55ca1961ff60 2024-09-21T01:15:44.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.915+0000 7f21357fa640 1 -- 172.21.15.37:0/1570130971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138005450 con 0x55ca1961ff60 2024-09-21T01:15:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 -- 172.21.15.37:0/1570130971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 msgr2=0x55ca199ec7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199ec7f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2138003ca0 tx=0x7f2138019000 comp rx=0 tx=0).stop 2024-09-21T01:15:44.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 -- 172.21.15.37:0/1570130971 shutdown_connections 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199ec7f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195ff280 0x55ca199ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 --2- 172.21.15.37:0/1570130971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195f70a0 0x55ca199cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 -- 172.21.15.37:0/1570130971 >> 172.21.15.37:0/1570130971 conn(0x55ca19614350 msgr2=0x55ca199d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 -- 172.21.15.37:0/1570130971 shutdown_connections 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 -- 172.21.15.37:0/1570130971 wait complete. 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.916+0000 7f214bd8b740 1 -- start start 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 Processor -- start 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195ff280 0x55ca199dd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ca199e3a60 con 0x55ca1961ff60 2024-09-21T01:15:44.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ca199e3390 con 0x55ca195f70a0 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca199e4130 con 0x55ca195ff280 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f214bd8b740 10 client.0 _ll_register_callbacks cb 0x7f2128032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f213f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f213f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199dd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50042/0 (socket says 172.21.15.37:50042) 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f213f7fe640 1 -- 172.21.15.37:0/924293015 learned_addr learned my addr 172.21.15.37:0/924293015 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f21367fc640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195ff280 0x55ca199dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.917+0000 7f213effd640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f213f7fe640 1 -- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195ff280 msgr2=0x55ca199dd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f213f7fe640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195ff280 0x55ca199dd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f213f7fe640 1 -- 172.21.15.37:0/924293015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 msgr2=0x55ca199e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f213f7fe640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f213f7fe640 1 -- 172.21.15.37:0/924293015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca199de130 con 0x55ca1961ff60 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f213f7fe640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199dd9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2138012ca0 tx=0x7f2138004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6e6cac238b3366 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:44.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f211effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f211effd640 1 -- 172.21.15.37:0/924293015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138036020 con 0x55ca1961ff60 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f211effd640 1 -- 172.21.15.37:0/924293015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2138027690 con 0x55ca1961ff60 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2138003e10 con 0x55ca1961ff60 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f211effd640 1 -- 172.21.15.37:0/924293015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2138027890 con 0x55ca1961ff60 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f214bd8b740 10 client.15363 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ca19a52fe0 con 0x55ca1961ff60 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.918+0000 7f211effd640 1 -- 172.21.15.37:0/924293015 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2138003e10 con 0x55ca1961ff60 2024-09-21T01:15:44.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f211effd640 1 -- 172.21.15.37:0/924293015 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f213800f040 con 0x55ca1961ff60 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f214bd8b740 10 client.15363 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f214bd8b740 10 client.15363 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f214bd8b740 20 client.15363 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f214bd8b740 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195b3c90 0x55ca19a565b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f214bd8b740 4 client.15363 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "status"}) -- 0x55ca1993b610 con 0x55ca195b3c90 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f213effd640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195b3c90 0x55ca19a565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:44.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f213effd640 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195b3c90 0x55ca19a565b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d744ecb97f12c76c server_cookie=4f8993dce4702d11 in_seq=0 out_seq=0 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.919+0000 7f211effd640 10 client.15363 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f211effd640 1 -- 172.21.15.37:0/924293015 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55ca1993b610 con 0x55ca195b3c90 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f211effd640 10 client.15363 handle_command_reply: tid=0 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 client.15363 shutdown 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 msgr2=0x55ca199dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199dd9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2138012ca0 tx=0x7f2138004d50 comp rx=0 tx=0).stop 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 shutdown_connections 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ca195b3c90 0x55ca19a565b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ca1961ff60 0x55ca199dd9c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca195ff280 0x55ca199dd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 --2- 172.21.15.37:0/924293015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ca195f70a0 0x55ca199e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 >> 172.21.15.37:0/924293015 conn(0x55ca19614350 msgr2=0x55ca199c3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:44.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f211effd640 0 client.15363 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:15:44.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 shutdown_connections 2024-09-21T01:15:44.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 1 -- 172.21.15.37:0/924293015 wait complete. 2024-09-21T01:15:44.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.920+0000 7f214bd8b740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T01:15:44.928 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24604, 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 103.28031468, 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:44.929 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:44.930 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 141.082590173 2024-09-21T01:15:44.930 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:44.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f212c0b6540 msgr2=0x7f212c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f212c0b6540 0x7f212c0b8a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2138005fd0 tx=0x7f2138009600 comp rx=0 tx=0).stop 2024-09-21T01:15:44.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 msgr2=0x7f214019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 0x7f214019a4e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f213000c920 tx=0x7f213000cde0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 shutdown_connections 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f212c0b6540 0x7f212c0b8a50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2140109df0 0x7f214019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21401094a0 0x7f214019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 --2- 172.21.15.37:0/3466565690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2140103b60 0x7f214019a4e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 >> 172.21.15.37:0/3466565690 conn(0x7f214007b850 msgr2=0x7f21401075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 shutdown_connections 2024-09-21T01:15:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:44.921+0000 7f2145817640 1 -- 172.21.15.37:0/3466565690 wait complete. 2024-09-21T01:15:45.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T01:15:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:46.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:46 smithi037 ceph-mon[31105]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:46.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 -- 172.21.15.37:0/1239363655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 msgr2=0x7f919c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/1239363655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c110630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9194009ca0 tx=0x7f919402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 -- 172.21.15.37:0/1239363655 shutdown_connections 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/1239363655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c110630 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/1239363655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 0x7f919c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/1239363655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f919c103b70 0x7f919c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 -- 172.21.15.37:0/1239363655 >> 172.21.15.37:0/1239363655 conn(0x7f919c0ff5e0 msgr2=0x7f919c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.569+0000 7f91a2eb7640 1 -- 172.21.15.37:0/1239363655 shutdown_connections 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.570+0000 7f91a2eb7640 1 -- 172.21.15.37:0/1239363655 wait complete. 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.570+0000 7f91a2eb7640 1 Processor -- start 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 -- start start 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f919c103b70 0x7f919c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 0x7f919c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f919c113ac0 con 0x7f919c109e00 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f919c113940 con 0x7f919c1094b0 2024-09-21T01:15:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a2eb7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f919c113c40 con 0x7f919c103b70 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a1454640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a1454640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39726/0 (socket says 172.21.15.37:39726) 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a1454640 1 -- 172.21.15.37:0/2782551288 learned_addr learned my addr 172.21.15.37:0/2782551288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f91a0c53640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f919c103b70 0x7f919c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.571+0000 7f919bfff640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 0x7f919c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a1454640 1 -- 172.21.15.37:0/2782551288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f919c103b70 msgr2=0x7f919c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a1454640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f919c103b70 0x7f919c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a1454640 1 -- 172.21.15.37:0/2782551288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 msgr2=0x7f919c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a1454640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 0x7f919c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a1454640 1 -- 172.21.15.37:0/2782551288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c1a03a0 con 0x7f919c109e00 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f919bfff640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 0x7f919c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a1454640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c19fc70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f91940098d0 tx=0x7f91940317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f9199ffb640 1 -- 172.21.15.37:0/2782551288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194003b70 con 0x7f919c109e00 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f9199ffb640 1 -- 172.21.15.37:0/2782551288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9194003d10 con 0x7f919c109e00 2024-09-21T01:15:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c1a0630 con 0x7f919c109e00 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f9199ffb640 1 -- 172.21.15.37:0/2782551288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919402fa20 con 0x7f919c109e00 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.572+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c1a6df0 con 0x7f919c109e00 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 Processor -- start 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f9199ffb640 1 -- 172.21.15.37:0/2782551288 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f919402fc20 con 0x7f919c109e00 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 -- start start 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b55f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b56440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b56980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab12acdc10 con 0x55ab127aff60 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab12abd040 con 0x55ab127870a0 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f91a942b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab12ac0e50 con 0x55ab1278f280 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b55f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b55f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39734/0 (socket says 172.21.15.37:39734) 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.575+0000 7f919bfff640 1 -- 172.21.15.37:0/2747621677 learned_addr learned my addr 172.21.15.37:0/2747621677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b56980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f91a0c53640 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b56440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 -- 172.21.15.37:0/2747621677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 msgr2=0x55ab12b56980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b56980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 -- 172.21.15.37:0/2747621677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 msgr2=0x55ab12b56440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b56440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f9199ffb640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f918c0b6510 0x7f918c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 -- 172.21.15.37:0/2747621677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab1281b540 con 0x55ab127aff60 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f91a1454640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f918c0b6510 0x7f918c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f919bfff640 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b55f00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9188013bb0 tx=0x7f9188009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9698ef3ccaa3c4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f9199ffb640 1 -- 172.21.15.37:0/2782551288 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9194108530 con 0x7f919c109e00 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f9186ffd640 1 -- 172.21.15.37:0/2747621677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188011c70 con 0x55ab127aff60 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f9186ffd640 1 -- 172.21.15.37:0/2747621677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9188011e10 con 0x55ab127aff60 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.576+0000 7f9186ffd640 1 -- 172.21.15.37:0/2747621677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188003850 con 0x55ab127aff60 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 -- 172.21.15.37:0/2747621677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 msgr2=0x55ab12b55f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a1454640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f918c0b6510 0x7f918c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91940ce3c0 tx=0x7f9194097340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b55f00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9188013bb0 tx=0x7f9188009c00 comp rx=0 tx=0).stop 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 -- 172.21.15.37:0/2747621677 shutdown_connections 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b56980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b56440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 --2- 172.21.15.37:0/2747621677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b55f00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 -- 172.21.15.37:0/2747621677 >> 172.21.15.37:0/2747621677 conn(0x55ab127a4350 msgr2=0x55ab12b53df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 -- 172.21.15.37:0/2747621677 shutdown_connections 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.577+0000 7f91a942b740 1 -- 172.21.15.37:0/2747621677 wait complete. 2024-09-21T01:15:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 -- start start 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 Processor -- start 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b65de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b66320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b71d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab1291e5f0 con 0x55ab127aff60 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab12a58010 con 0x55ab127870a0 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b689e0 con 0x55ab1278f280 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f91a942b740 10 client.0 _ll_register_callbacks cb 0x55ab12ab7340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b71d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b71d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39748/0 (socket says 172.21.15.37:39748) 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.578+0000 7f919bfff640 1 -- 172.21.15.37:0/2165590966 learned_addr learned my addr 172.21.15.37:0/2165590966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f91a0c53640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b66320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b65de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 -- 172.21.15.37:0/2165590966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 msgr2=0x55ab12b66320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b66320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 -- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 msgr2=0x55ab12b65de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b65de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 -- 172.21.15.37:0/2165590966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab12a85a00 con 0x55ab127aff60 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f91a0c53640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b66320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f919bfff640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b71d70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91880045e0 tx=0x7f91880044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db45c4c015e4426 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f917bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f917bfff640 1 -- 172.21.15.37:0/2165590966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188021de0 con 0x55ab127aff60 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f917bfff640 1 -- 172.21.15.37:0/2165590966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9188013030 con 0x55ab127aff60 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9188011e10 con 0x55ab127aff60 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f917bfff640 1 -- 172.21.15.37:0/2165590966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9188013230 con 0x55ab127aff60 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f91a942b740 10 client.15375 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab12b74970 con 0x55ab127aff60 2024-09-21T01:15:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.579+0000 7f917bfff640 1 -- 172.21.15.37:0/2165590966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9188011e10 con 0x55ab127aff60 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f917bfff640 1 -- 172.21.15.37:0/2165590966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9188012450 con 0x55ab127aff60 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a942b740 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a942b740 10 client.15375 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a942b740 20 client.15375 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a942b740 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab1276e8e0 0x55ab12b78120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a942b740 4 client.15375 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab12acfb60 con 0x55ab1276e8e0 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.580+0000 7f91a0c53640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab1276e8e0 0x55ab12b78120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.581+0000 7f917bfff640 10 client.15375 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.581+0000 7f91a0c53640 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab1276e8e0 0x55ab12b78120 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e34181d03668213 server_cookie=f5aa87efc6dee981 in_seq=0 out_seq=0 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.581+0000 7f917bfff640 1 -- 172.21.15.37:0/2165590966 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab12acfb60 con 0x55ab1276e8e0 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.581+0000 7f917bfff640 10 client.15375 handle_command_reply: tid=0 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 client.15375 shutdown 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 msgr2=0x55ab12b71d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b71d70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91880045e0 tx=0x7f91880044e0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 shutdown_connections 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab1276e8e0 0x55ab12b78120 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127aff60 0x55ab12b71d70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b66320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f917bfff640 0 client.15375 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 --2- 172.21.15.37:0/2165590966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127870a0 0x55ab12b65de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 >> 172.21.15.37:0/2165590966 conn(0x55ab127a4350 msgr2=0x55ab12b578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 shutdown_connections 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 1 -- 172.21.15.37:0/2165590966 wait complete. 2024-09-21T01:15:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.582+0000 7f91a942b740 20 client.15375 trim_cache size 0 max 16384 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 Processor -- start 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 -- start start 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b71ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b72220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b65dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b76460 con 0x55ab127870a0 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b76b30 con 0x55ab127aff60 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.600+0000 7f91a942b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b77200 con 0x55ab1278f280 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b71ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b71ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39762/0 (socket says 172.21.15.37:39762) 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 -- 172.21.15.37:0/634419725 learned_addr learned my addr 172.21.15.37:0/634419725 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b65dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f91a0c53640 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b72220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 -- 172.21.15.37:0/634419725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 msgr2=0x55ab12b72220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b72220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 -- 172.21.15.37:0/634419725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 msgr2=0x55ab12b65dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b65dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 -- 172.21.15.37:0/634419725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab12b58cc0 con 0x55ab127870a0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f919bfff640 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b71ce0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f91880134f0 tx=0x7f9188005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f709a28256f590c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f91867fc640 1 -- 172.21.15.37:0/634419725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188012eb0 con 0x55ab127870a0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f91867fc640 1 -- 172.21.15.37:0/634419725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f918802b040 con 0x55ab127870a0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.601+0000 7f91867fc640 1 -- 172.21.15.37:0/634419725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918800ea70 con 0x55ab127870a0 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 -- 172.21.15.37:0/634419725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 msgr2=0x55ab12b71ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b71ce0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f91880134f0 tx=0x7f9188005b90 comp rx=0 tx=0).stop 2024-09-21T01:15:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 -- 172.21.15.37:0/634419725 shutdown_connections 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b65dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b72220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 --2- 172.21.15.37:0/634419725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b71ce0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 -- 172.21.15.37:0/634419725 >> 172.21.15.37:0/634419725 conn(0x55ab127a4350 msgr2=0x55ab12b5b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 -- 172.21.15.37:0/634419725 shutdown_connections 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.602+0000 7f91a942b740 1 -- 172.21.15.37:0/634419725 wait complete. 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 -- start start 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 Processor -- start 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b80a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b79f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b7a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b77fa0 con 0x55ab127870a0 2024-09-21T01:15:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b778d0 con 0x55ab127aff60 2024-09-21T01:15:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab12b78670 con 0x55ab1278f280 2024-09-21T01:15:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f91a942b740 10 client.0 _ll_register_callbacks cb 0x7f91880135a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b80a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f919bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b80a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39766/0 (socket says 172.21.15.37:39766) 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.603+0000 7f919bfff640 1 -- 172.21.15.37:0/3062896067 learned_addr learned my addr 172.21.15.37:0/3062896067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b7a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f91a0c53640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b79f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 -- 172.21.15.37:0/3062896067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 msgr2=0x55ab12b79f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b79f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 -- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 msgr2=0x55ab12b7a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b7a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 -- 172.21.15.37:0/3062896067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab12b7aa80 con 0x55ab127870a0 2024-09-21T01:15:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f919bfff640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b80a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9188021730 tx=0x7f9188013a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda28ea2dffe6a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f917bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f917bfff640 1 -- 172.21.15.37:0/3062896067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188012c10 con 0x55ab127870a0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f917bfff640 1 -- 172.21.15.37:0/3062896067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9188005110 con 0x55ab127870a0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918802b040 con 0x55ab127870a0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f917bfff640 1 -- 172.21.15.37:0/3062896067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9188005310 con 0x55ab127870a0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f91a942b740 10 client.15381 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.604+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab12b80480 con 0x55ab127870a0 2024-09-21T01:15:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f917bfff640 1 -- 172.21.15.37:0/3062896067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f918802b040 con 0x55ab127870a0 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f917bfff640 1 -- 172.21.15.37:0/3062896067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9188003bc0 con 0x55ab127870a0 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a942b740 10 client.15381 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a942b740 10 client.15381 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a942b740 20 client.15381 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a942b740 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab12743c90 0x55ab12be6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a942b740 4 client.15381 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "status"}) -- 0x55ab12acb610 con 0x55ab12743c90 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.605+0000 7f91a0c53640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab12743c90 0x55ab12be6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a0c53640 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab12743c90 0x55ab12be6ae0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ab7f85f3d48c24b server_cookie=b051c9ecd1fae45 in_seq=0 out_seq=0 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f917bfff640 10 client.15381 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f917bfff640 1 -- 172.21.15.37:0/3062896067 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ab12acb610 con 0x55ab12743c90 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f917bfff640 10 client.15381 handle_command_reply: tid=0 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 client.15381 shutdown 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 msgr2=0x55ab12b80a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b80a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9188021730 tx=0x7f9188013a80 comp rx=0 tx=0).stop 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 shutdown_connections 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55ab12743c90 0x55ab12be6ae0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f917bfff640 0 client.15381 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab127aff60 0x55ab12b7a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab1278f280 0x55ab12b79f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 --2- 172.21.15.37:0/3062896067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab127870a0 0x55ab12b80a50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 >> 172.21.15.37:0/3062896067 conn(0x55ab127a4350 msgr2=0x55ab12b5b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 shutdown_connections 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.606+0000 7f91a942b740 1 -- 172.21.15.37:0/3062896067 wait complete. 2024-09-21T01:15:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a942b740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T01:15:46.622 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:46.622 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:46.622 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-09-21T01:15:46.623 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24605, 2024-09-21T01:15:46.623 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:46.623 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:46.623 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:46.623 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 105.981365778, 2024-09-21T01:15:46.623 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:46.624 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:46.624 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:46.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 137.58018216400001 2024-09-21T01:15:46.624 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f918c0b6510 msgr2=0x7f918c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f918c0b6510 0x7f918c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91940ce3c0 tx=0x7f9194097340 comp rx=0 tx=0).stop 2024-09-21T01:15:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 msgr2=0x7f919c19fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c19fc70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f91940098d0 tx=0x7f91940317b0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 shutdown_connections 2024-09-21T01:15:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f918c0b6510 0x7f918c0b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f919c109e00 0x7f919c19fc70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f919c1094b0 0x7f919c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 --2- 172.21.15.37:0/2782551288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f919c103b70 0x7f919c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.607+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 >> 172.21.15.37:0/2782551288 conn(0x7f919c0ff5e0 msgr2=0x7f919c106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.608+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 shutdown_connections 2024-09-21T01:15:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:46.608+0000 7f91a2eb7640 1 -- 172.21.15.37:0/2782551288 wait complete. 2024-09-21T01:15:46.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:46 smithi144 ceph-mon[34818]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:46 smithi137 ceph-mon[34607]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:47.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T01:15:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 -- 172.21.15.37:0/547295938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 msgr2=0x7f01ec102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 --2- 172.21.15.37:0/547295938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec102ef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009900 tx=0x7f01dc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 -- 172.21.15.37:0/547295938 shutdown_connections 2024-09-21T01:15:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 --2- 172.21.15.37:0/547295938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec108d20 0x7f01ec10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 --2- 172.21.15.37:0/547295938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01ec1083d0 0x7f01ec1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 --2- 172.21.15.37:0/547295938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec102ef0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 -- 172.21.15.37:0/547295938 >> 172.21.15.37:0/547295938 conn(0x7f01ec079760 msgr2=0x7f01ec079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 -- 172.21.15.37:0/547295938 shutdown_connections 2024-09-21T01:15:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.115+0000 7f01f2387640 1 -- 172.21.15.37:0/547295938 wait complete. 2024-09-21T01:15:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.116+0000 7f01f2387640 1 Processor -- start 2024-09-21T01:15:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.116+0000 7f01f2387640 1 -- start start 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.116+0000 7f01f2387640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.116+0000 7f01f2387640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec1083d0 0x7f01ec19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.116+0000 7f01f2387640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01ec108d20 0x7f01ec19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01f2387640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec112a10 con 0x7f01ec102ae0 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01f2387640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec112890 con 0x7f01ec1083d0 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01f2387640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec112b90 con 0x7f01ec108d20 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01eb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec1083d0 0x7f01ec19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01eb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec1083d0 0x7f01ec19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41072/0 (socket says 172.21.15.37:41072) 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01eb7fe640 1 -- 172.21.15.37:0/3845061569 learned_addr learned my addr 172.21.15.37:0/3845061569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01f0924640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01ec108d20 0x7f01ec19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 -- 172.21.15.37:0/3845061569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01ec108d20 msgr2=0x7f01ec19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01ec108d20 0x7f01ec19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 -- 172.21.15.37:0/3845061569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec1083d0 msgr2=0x7f01ec19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec1083d0 0x7f01ec19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 -- 172.21.15.37:0/3845061569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec1a0480 con 0x7f01ec102ae0 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.117+0000 7f01ebfff640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec19a510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f01dc02a930 tx=0x7f01dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.118+0000 7f01e97fa640 1 -- 172.21.15.37:0/3845061569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc03f030 con 0x7f01ec102ae0 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.118+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec1a0710 con 0x7f01ec102ae0 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.118+0000 7f01e97fa640 1 -- 172.21.15.37:0/3845061569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01dc003aa0 con 0x7f01ec102ae0 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.118+0000 7f01e97fa640 1 -- 172.21.15.37:0/3845061569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc035070 con 0x7f01ec102ae0 2024-09-21T01:15:48.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.118+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec104160 con 0x7f01ec102ae0 2024-09-21T01:15:48.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.120+0000 7f01e97fa640 1 -- 172.21.15.37:0/3845061569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f01dc042030 con 0x7f01ec102ae0 2024-09-21T01:15:48.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 Processor -- start 2024-09-21T01:15:48.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 -- start start 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c4ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c4f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c4f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562127bc6c10 con 0x5621278800a0 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562127bb6040 con 0x5621278a8f60 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f88fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562127bb9e50 con 0x562127888280 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c4f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c4f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39790/0 (socket says 172.21.15.37:39790) 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01ebfff640 1 -- 172.21.15.37:0/3564461337 learned_addr learned my addr 172.21.15.37:0/3564461337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:48.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01f0924640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c4ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01e97fa640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01d40b6590 0x7f01d40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.121+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c4f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 -- 172.21.15.37:0/3564461337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 msgr2=0x562127c4f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c4f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 -- 172.21.15.37:0/3564461337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 msgr2=0x562127c4f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c4f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 -- 172.21.15.37:0/3564461337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562127914540 con 0x5621278a8f60 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01ebfff640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c4f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:48.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c4f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01e97fa640 1 -- 172.21.15.37:0/3845061569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f01dc107850 con 0x7f01ec102ae0 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01d40b6590 0x7f01d40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c4ef00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01e400a400 tx=0x7f01e400a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa08b64f3bd33417 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01f0924640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01d40b6590 0x7f01d40b8aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f01e4020000 tx=0x7f01e4021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01d27fc640 1 -- 172.21.15.37:0/3564461337 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4017720 con 0x5621278a8f60 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01d27fc640 1 -- 172.21.15.37:0/3564461337 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01e4017d70 con 0x5621278a8f60 2024-09-21T01:15:48.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.122+0000 7f01d27fc640 1 -- 172.21.15.37:0/3564461337 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4016cf0 con 0x5621278a8f60 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 -- 172.21.15.37:0/3564461337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 msgr2=0x562127c4ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c4ef00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01e400a400 tx=0x7f01e400a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 -- 172.21.15.37:0/3564461337 shutdown_connections 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c4f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c4f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 --2- 172.21.15.37:0/3564461337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c4ef00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 -- 172.21.15.37:0/3564461337 >> 172.21.15.37:0/3564461337 conn(0x56212789d350 msgr2=0x562127c4cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 -- 172.21.15.37:0/3564461337 shutdown_connections 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.123+0000 7f01f88fb740 1 -- 172.21.15.37:0/3564461337 wait complete. 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 -- start start 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 Processor -- start 2024-09-21T01:15:48.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c5aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562127888280 0x562127c5af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278a8f60 0x562127c66a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562127a175f0 con 0x5621278800a0 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562127b51010 con 0x562127888280 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562127c5d6e0 con 0x5621278a8f60 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01f88fb740 10 client.0 _ll_register_callbacks cb 0x562127bb0340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c5aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c5aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39792/0 (socket says 172.21.15.37:39792) 2024-09-21T01:15:48.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.124+0000 7f01ebfff640 1 -- 172.21.15.37:0/1565103150 learned_addr learned my addr 172.21.15.37:0/1565103150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:48.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01f0924640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278a8f60 0x562127c66a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562127888280 0x562127c5af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01ebfff640 1 -- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278a8f60 msgr2=0x562127c66a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01ebfff640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278a8f60 0x562127c66a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01ebfff640 1 -- 172.21.15.37:0/1565103150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562127888280 msgr2=0x562127c5af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01ebfff640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562127888280 0x562127c5af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01ebfff640 1 -- 172.21.15.37:0/1565103150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562127b7ea00 con 0x5621278800a0 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562127888280 0x562127c5af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01ebfff640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c5aa10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0cd750 tx=0x7f01dc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21793dfd37c507c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01cb7fe640 1 -- 172.21.15.37:0/1565103150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc049070 con 0x5621278800a0 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01cb7fe640 1 -- 172.21.15.37:0/1565103150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f01dc0c9050 con 0x5621278800a0 2024-09-21T01:15:48.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e4017d70 con 0x5621278800a0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01cb7fe640 1 -- 172.21.15.37:0/1565103150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f01dc0cd3a0 con 0x5621278800a0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01f88fb740 10 client.15393 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.125+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562127c69610 con 0x5621278800a0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01cb7fe640 1 -- 172.21.15.37:0/1565103150 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01e4017d70 con 0x5621278800a0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01cb7fe640 1 -- 172.21.15.37:0/1565103150 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f01dc0c9cc0 con 0x5621278800a0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01f88fb740 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01f88fb740 10 client.15393 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01f88fb740 20 client.15393 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01f88fb740 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5621278678e0 0x562127c6d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01f88fb740 4 client.15393 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562127bc8b60 con 0x5621278678e0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.126+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5621278678e0 0x562127c6d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.127+0000 7f01cb7fe640 10 client.15393 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.127+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5621278678e0 0x562127c6d100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e9b13f3b40a0194 server_cookie=686f44ad20501460 in_seq=0 out_seq=0 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01cb7fe640 1 -- 172.21.15.37:0/1565103150 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562127bc8b60 con 0x5621278678e0 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01cb7fe640 10 client.15393 handle_command_reply: tid=0 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 client.15393 shutdown 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 msgr2=0x562127c5aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c5aa10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0cd750 tx=0x7f01dc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 shutdown_connections 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5621278678e0 0x562127c6d100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278a8f60 0x562127c66a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562127888280 0x562127c5af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 --2- 172.21.15.37:0/1565103150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c5aa10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 >> 172.21.15.37:0/1565103150 conn(0x56212789d350 msgr2=0x562127c52090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:48.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01cb7fe640 0 client.15393 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:48.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 shutdown_connections 2024-09-21T01:15:48.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 1 -- 172.21.15.37:0/1565103150 wait complete. 2024-09-21T01:15:48.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.128+0000 7f01f88fb740 20 client.15393 trim_cache size 0 max 16384 2024-09-21T01:15:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 Processor -- start 2024-09-21T01:15:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 -- start start 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278800a0 0x562127c66970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 0x562127c66eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562127c6b440 con 0x562127888280 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562127c6bb10 con 0x5621278a8f60 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01f88fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562127c6c1e0 con 0x5621278800a0 2024-09-21T01:15:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.165+0000 7f01eb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 0x562127c66eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 0x562127c66eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39800/0 (socket says 172.21.15.37:39800) 2024-09-21T01:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 -- 172.21.15.37:0/838763063 learned_addr learned my addr 172.21.15.37:0/838763063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01ebfff640 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278800a0 0x562127c66970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01f0924640 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 -- 172.21.15.37:0/838763063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278800a0 msgr2=0x562127c66970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278800a0 0x562127c66970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 -- 172.21.15.37:0/838763063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 msgr2=0x562127c559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 -- 172.21.15.37:0/838763063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562127c48520 con 0x562127888280 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01f0924640 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 0x562127c66eb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01e000f6c0 tx=0x7f01e000f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb236cb6790b8af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01d1ffb640 1 -- 172.21.15.37:0/838763063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0005220 con 0x562127888280 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01d1ffb640 1 -- 172.21.15.37:0/838763063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01e0026030 con 0x562127888280 2024-09-21T01:15:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.166+0000 7f01d1ffb640 1 -- 172.21.15.37:0/838763063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e001c780 con 0x562127888280 2024-09-21T01:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.167+0000 7f01f88fb740 1 -- 172.21.15.37:0/838763063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 msgr2=0x562127c66eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.167+0000 7f01f88fb740 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 0x562127c66eb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01e000f6c0 tx=0x7f01e000f820 comp rx=0 tx=0).stop 2024-09-21T01:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 -- 172.21.15.37:0/838763063 shutdown_connections 2024-09-21T01:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562127888280 0x562127c66eb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 --2- 172.21.15.37:0/838763063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621278800a0 0x562127c66970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 -- 172.21.15.37:0/838763063 >> 172.21.15.37:0/838763063 conn(0x56212789d350 msgr2=0x562127c5a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 -- 172.21.15.37:0/838763063 shutdown_connections 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 -- 172.21.15.37:0/838763063 wait complete. 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.168+0000 7f01f88fb740 1 -- start start 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 Processor -- start 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c75960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c6eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c6f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562127c6cf80 con 0x5621278800a0 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562127c6c8b0 con 0x5621278a8f60 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562127c6d650 con 0x562127888280 2024-09-21T01:15:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c75960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f88fb740 10 client.0 _ll_register_callbacks cb 0x7f01dc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c75960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39802/0 (socket says 172.21.15.37:39802) 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01ebfff640 1 -- 172.21.15.37:0/4144162453 learned_addr learned my addr 172.21.15.37:0/4144162453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.169+0000 7f01f0924640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c6f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c6eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01ebfff640 1 -- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 msgr2=0x562127c6eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01ebfff640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c6eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01ebfff640 1 -- 172.21.15.37:0/4144162453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 msgr2=0x562127c6f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01ebfff640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c6f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01ebfff640 1 -- 172.21.15.37:0/4144162453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562127c6f960 con 0x5621278800a0 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01f0924640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c6f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01ebfff640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c75960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0d7530 tx=0x7f01dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f3e9a61d12cc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01cb7fe640 1 -- 172.21.15.37:0/4144162453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc049070 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01cb7fe640 1 -- 172.21.15.37:0/4144162453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f01dc0037f0 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e0026030 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01cb7fe640 1 -- 172.21.15.37:0/4144162453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f01dc0cd1c0 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.170+0000 7f01f88fb740 10 client.15399 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562127c6f960 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01cb7fe640 1 -- 172.21.15.37:0/4144162453 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01e0026030 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01cb7fe640 1 -- 172.21.15.37:0/4144162453 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f01dc0cccb0 con 0x5621278800a0 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 10 client.15399 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 10 client.15399 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 20 client.15399 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:48.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x56212783cc90 0x562127cdb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 4 client.15399 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "status"}) -- 0x562127bc4610 con 0x56212783cc90 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.171+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x56212783cc90 0x562127cdb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.172+0000 7f01cb7fe640 10 client.15399 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.172+0000 7f01eb7fe640 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x56212783cc90 0x562127cdb900 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56ccce5464ca418f server_cookie=8dd58269c1760c06 in_seq=0 out_seq=0 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.172+0000 7f01cb7fe640 1 -- 172.21.15.37:0/4144162453 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562127bc4610 con 0x56212783cc90 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.172+0000 7f01cb7fe640 10 client.15399 handle_command_reply: tid=0 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.172+0000 7f01f88fb740 1 client.15399 shutdown 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 msgr2=0x562127c75960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c75960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0d7530 tx=0x7f01dc000bc0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 shutdown_connections 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x56212783cc90 0x562127cdb900 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5621278a8f60 0x562127c6f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562127888280 0x562127c6eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 --2- 172.21.15.37:0/4144162453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621278800a0 0x562127c75960 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 >> 172.21.15.37:0/4144162453 conn(0x56212789d350 msgr2=0x562127c5a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01cb7fe640 0 client.15399 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 shutdown_connections 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 1 -- 172.21.15.37:0/4144162453 wait complete. 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.173+0000 7f01f88fb740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-09-21T01:15:48.184 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24610, 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 108.55530482899999, 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 141.79525633599999 2024-09-21T01:15:48.185 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01d40b6590 msgr2=0x7f01d40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01d40b6590 0x7f01d40b8aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f01e4020000 tx=0x7f01e4021000 comp rx=0 tx=0).stop 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 msgr2=0x7f01ec19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec19a510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f01dc02a930 tx=0x7f01dc004270 comp rx=0 tx=0).stop 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 shutdown_connections 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01d40b6590 0x7f01d40b8aa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01ec108d20 0x7f01ec19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01ec1083d0 0x7f01ec19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 --2- 172.21.15.37:0/3845061569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec102ae0 0x7f01ec19a510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 >> 172.21.15.37:0/3845061569 conn(0x7f01ec079760 msgr2=0x7f01ec101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 shutdown_connections 2024-09-21T01:15:48.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:48.174+0000 7f01f2387640 1 -- 172.21.15.37:0/3845061569 wait complete. 2024-09-21T01:15:48.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:48 smithi137 ceph-mon[34607]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:48.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:48 smithi144 ceph-mon[34818]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:48.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:48 smithi037 ceph-mon[31105]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:48.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T01:15:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 -- 172.21.15.37:0/2413460625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71101052b0 msgr2=0x7f711010d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 --2- 172.21.15.37:0/2413460625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71101052b0 0x7f711010d8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7100009900 tx=0x7f710002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 -- 172.21.15.37:0/2413460625 shutdown_connections 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 --2- 172.21.15.37:0/2413460625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f711010de30 0x7f7110110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 --2- 172.21.15.37:0/2413460625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71101052b0 0x7f711010d8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 --2- 172.21.15.37:0/2413460625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7110104880 0x7f7110104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 -- 172.21.15.37:0/2413460625 >> 172.21.15.37:0/2413460625 conn(0x7f7110079730 msgr2=0x7f7110079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 -- 172.21.15.37:0/2413460625 shutdown_connections 2024-09-21T01:15:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.632+0000 7f7116f3c640 1 -- 172.21.15.37:0/2413460625 wait complete. 2024-09-21T01:15:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 Processor -- start 2024-09-21T01:15:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 -- start start 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7110104880 0x7f711019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71101052b0 0x7f711019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 0x7f711019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7110113ad0 con 0x7f711010de30 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7110113950 con 0x7f71101052b0 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.633+0000 7f7116f3c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7110113c50 con 0x7f7110104880 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 0x7f711019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 0x7f711019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39820/0 (socket says 172.21.15.37:39820) 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 -- 172.21.15.37:0/399422505 learned_addr learned my addr 172.21.15.37:0/399422505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f7114cd8640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7110104880 0x7f711019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f7107fff640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71101052b0 0x7f711019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 -- 172.21.15.37:0/399422505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7110104880 msgr2=0x7f711019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7110104880 0x7f711019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 -- 172.21.15.37:0/399422505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71101052b0 msgr2=0x7f711019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71101052b0 0x7f711019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 -- 172.21.15.37:0/399422505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71101a04d0 con 0x7f711010de30 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f71154d9640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 0x7f711019fda0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f710800eaa0 tx=0x7f710800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f7105ffb640 1 -- 172.21.15.37:0/399422505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108004d20 con 0x7f711010de30 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f7105ffb640 1 -- 172.21.15.37:0/399422505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7108005020 con 0x7f711010de30 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71101a07c0 con 0x7f711010de30 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.634+0000 7f7105ffb640 1 -- 172.21.15.37:0/399422505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080116b0 con 0x7f711010de30 2024-09-21T01:15:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.635+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71101a6f20 con 0x7f711010de30 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f7105ffb640 1 -- 172.21.15.37:0/399422505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f71080051d0 con 0x7f711010de30 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 Processor -- start 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 -- start start 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d84df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d84e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d84e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55628d7c5c10 con 0x55628d47f0a0 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55628d7b5040 con 0x55628d4a7f60 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.637+0000 7f711d4b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55628d7b8e50 con 0x55628d487280 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d84e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d84e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39834/0 (socket says 172.21.15.37:39834) 2024-09-21T01:15:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 -- 172.21.15.37:0/840448862 learned_addr learned my addr 172.21.15.37:0/840448862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7107fff640 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d84df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7107fff640 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d84e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 -- 172.21.15.37:0/840448862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 msgr2=0x55628d84e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d84e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 -- 172.21.15.37:0/840448862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 msgr2=0x55628d84df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d84df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 -- 172.21.15.37:0/840448862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55628d513540 con 0x55628d47f0a0 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7107fff640 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d84df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7105ffb640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70f80b6590 0x7f70f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7107fff640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70f80b6590 0x7f70f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7114cd8640 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d84e440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f710c009a40 tx=0x7f710c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5321e1d55e5ce416 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f7105ffb640 1 -- 172.21.15.37:0/399422505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f71080e7480 con 0x7f711010de30 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.638+0000 7f70f6ffd640 1 -- 172.21.15.37:0/840448862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c017070 con 0x55628d47f0a0 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f70f6ffd640 1 -- 172.21.15.37:0/840448862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f710c013470 con 0x55628d47f0a0 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f70f6ffd640 1 -- 172.21.15.37:0/840448862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c012630 con 0x55628d47f0a0 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 -- 172.21.15.37:0/840448862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 msgr2=0x55628d84e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d84e440 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f710c009a40 tx=0x7f710c009f00 comp rx=0 tx=0).stop 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f7107fff640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70f80b6590 0x7f70f80b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7100000c00 tx=0x7f71000058b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 -- 172.21.15.37:0/840448862 shutdown_connections 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d84e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d84e440 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 --2- 172.21.15.37:0/840448862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d84df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.639+0000 7f711d4b0740 1 -- 172.21.15.37:0/840448862 >> 172.21.15.37:0/840448862 conn(0x55628d49c350 msgr2=0x55628d84bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.640+0000 7f711d4b0740 1 -- 172.21.15.37:0/840448862 shutdown_connections 2024-09-21T01:15:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.640+0000 7f711d4b0740 1 -- 172.21.15.37:0/840448862 wait complete. 2024-09-21T01:15:49.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.640+0000 7f711d4b0740 1 -- start start 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.640+0000 7f711d4b0740 1 Processor -- start 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d859780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d859d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d865a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55628d6165f0 con 0x55628d47f0a0 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55628d750010 con 0x55628d4a7f60 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55628d85c6e0 con 0x55628d487280 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 10 client.0 _ll_register_callbacks cb 0x55628d7af340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d859780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d859780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39836/0 (socket says 172.21.15.37:39836) 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 -- 172.21.15.37:0/1004952263 learned_addr learned my addr 172.21.15.37:0/1004952263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:49.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7107fff640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d859d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f71154d9640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d865a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 -- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 msgr2=0x55628d859d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d859d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 -- 172.21.15.37:0/1004952263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 msgr2=0x55628d865a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d865a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 -- 172.21.15.37:0/1004952263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55628d77da00 con 0x55628d47f0a0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f71154d9640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d865a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7107fff640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d859d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f7114cd8640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d859780 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f710c013d80 tx=0x7f710c013620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc3ac232fa910b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f70effff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f70effff640 1 -- 172.21.15.37:0/1004952263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c017050 con 0x55628d47f0a0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f70effff640 1 -- 172.21.15.37:0/1004952263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f710c01c450 con 0x55628d47f0a0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.641+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f710c013470 con 0x55628d47f0a0 2024-09-21T01:15:49.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f70effff640 1 -- 172.21.15.37:0/1004952263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f710c01c650 con 0x55628d47f0a0 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 10 client.15411 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55628d8685a0 con 0x55628d47f0a0 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f70effff640 1 -- 172.21.15.37:0/1004952263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f710c013470 con 0x55628d47f0a0 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f70effff640 1 -- 172.21.15.37:0/1004952263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f710c026900 con 0x55628d47f0a0 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 10 client.15411 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 20 client.15411 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4668e0 0x55628d86bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 4 client.15411 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.642+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55628d7c7b60 con 0x55628d4668e0 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.643+0000 7f7107fff640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4668e0 0x55628d86bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.643+0000 7f70effff640 10 client.15411 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.643+0000 7f7107fff640 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4668e0 0x55628d86bc30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ff3436d77d451a4 server_cookie=52b2ccbde675c459 in_seq=0 out_seq=0 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f70effff640 1 -- 172.21.15.37:0/1004952263 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55628d7c7b60 con 0x55628d4668e0 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f70effff640 10 client.15411 handle_command_reply: tid=0 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 client.15411 shutdown 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 msgr2=0x55628d859780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d859780 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f710c013d80 tx=0x7f710c013620 comp rx=0 tx=0).stop 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 shutdown_connections 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4668e0 0x55628d86bc30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4a7f60 0x55628d865a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d859d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1004952263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d859780 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f70effff640 0 client.15411 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 >> 172.21.15.37:0/1004952263 conn(0x55628d49c350 msgr2=0x55628d851090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 shutdown_connections 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 1 -- 172.21.15.37:0/1004952263 wait complete. 2024-09-21T01:15:49.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.644+0000 7f711d4b0740 20 client.15411 trim_cache size 0 max 16384 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.662+0000 7f711d4b0740 1 Processor -- start 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.662+0000 7f711d4b0740 1 -- start start 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d4668e0 0x55628d854020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d47f0a0 0x55628d865970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 0x55628d865eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f711d4b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55628d869f70 con 0x55628d487280 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f711d4b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55628d86a640 con 0x55628d47f0a0 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f711d4b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55628d86ad10 con 0x55628d4668e0 2024-09-21T01:15:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 0x55628d865eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 0x55628d865eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39840/0 (socket says 172.21.15.37:39840) 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 -- 172.21.15.37:0/1206768455 learned_addr learned my addr 172.21.15.37:0/1206768455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f7107fff640 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d47f0a0 0x55628d865970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f7114cd8640 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d4668e0 0x55628d854020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 -- 172.21.15.37:0/1206768455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d4668e0 msgr2=0x55628d854020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d4668e0 0x55628d854020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 -- 172.21.15.37:0/1206768455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d47f0a0 msgr2=0x55628d865970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d47f0a0 0x55628d865970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 -- 172.21.15.37:0/1206768455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55628d855010 con 0x55628d487280 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f71154d9640 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 0x55628d865eb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f710800efd0 tx=0x7f71080ace40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b9cd7b07de1c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.663+0000 7f70f67fc640 1 -- 172.21.15.37:0/1206768455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710801f040 con 0x55628d487280 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f70f67fc640 1 -- 172.21.15.37:0/1206768455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71080b20f0 con 0x55628d487280 2024-09-21T01:15:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f70f67fc640 1 -- 172.21.15.37:0/1206768455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710800caf0 con 0x55628d487280 2024-09-21T01:15:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 -- 172.21.15.37:0/1206768455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 msgr2=0x55628d865eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 0x55628d865eb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f710800efd0 tx=0x7f71080ace40 comp rx=0 tx=0).stop 2024-09-21T01:15:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 -- 172.21.15.37:0/1206768455 shutdown_connections 2024-09-21T01:15:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d487280 0x55628d865eb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d47f0a0 0x55628d865970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 --2- 172.21.15.37:0/1206768455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d4668e0 0x55628d854020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 -- 172.21.15.37:0/1206768455 >> 172.21.15.37:0/1206768455 conn(0x55628d49c350 msgr2=0x55628d859530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 -- 172.21.15.37:0/1206768455 shutdown_connections 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.664+0000 7f711d4b0740 1 -- 172.21.15.37:0/1206768455 wait complete. 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 -- start start 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 Processor -- start 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4668e0 0x55628d874820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d86dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d86e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55628d86bab0 con 0x55628d47f0a0 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55628d86b3e0 con 0x55628d4668e0 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55628d86c180 con 0x55628d487280 2024-09-21T01:15:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.665+0000 7f711d4b0740 10 client.0 _ll_register_callbacks cb 0x7f710c009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d86dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d86dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39846/0 (socket says 172.21.15.37:39846) 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 -- 172.21.15.37:0/3519359078 learned_addr learned my addr 172.21.15.37:0/3519359078 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f71154d9640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d86e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7114cd8640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4668e0 0x55628d874820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 -- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 msgr2=0x55628d86e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d86e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 -- 172.21.15.37:0/3519359078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4668e0 msgr2=0x55628d874820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4668e0 0x55628d874820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 -- 172.21.15.37:0/3519359078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55628d86eb50 con 0x55628d47f0a0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f7107fff640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d86dd20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f711006ad30 tx=0x7f7100031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2046beaf08074ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f70effff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f70effff640 1 -- 172.21.15.37:0/3519359078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100035040 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f70effff640 1 -- 172.21.15.37:0/3519359078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7100004040 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71080b20f0 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.666+0000 7f70effff640 1 -- 172.21.15.37:0/3519359078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7100004240 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 10 client.15417 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55628d8d71f0 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f70effff640 1 -- 172.21.15.37:0/3519359078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71080b20f0 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f70effff640 1 -- 172.21.15.37:0/3519359078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f710003a040 con 0x55628d47f0a0 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 10 client.15417 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 10 client.15417 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 20 client.15417 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4a7f60 0x55628d8dab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 4 client.15417 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "status"}) -- 0x55628d7c3610 con 0x55628d4a7f60 2024-09-21T01:15:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.667+0000 7f7114cd8640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4a7f60 0x55628d8dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f7114cd8640 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4a7f60 0x55628d8dab10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87e67d2ebab151e2 server_cookie=56dd539addc3db81 in_seq=0 out_seq=0 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f70effff640 10 client.15417 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f70effff640 1 -- 172.21.15.37:0/3519359078 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55628d7c3610 con 0x55628d4a7f60 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f70effff640 10 client.15417 handle_command_reply: tid=0 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 client.15417 shutdown 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 msgr2=0x55628d86dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d86dd20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f711006ad30 tx=0x7f7100031400 comp rx=0 tx=0).stop 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 shutdown_connections 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55628d4a7f60 0x55628d8dab10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55628d487280 0x55628d86e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55628d47f0a0 0x55628d86dd20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 --2- 172.21.15.37:0/3519359078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55628d4668e0 0x55628d874820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 >> 172.21.15.37:0/3519359078 conn(0x55628d49c350 msgr2=0x55628d84b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f70effff640 0 client.15417 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 shutdown_connections 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.668+0000 7f711d4b0740 1 -- 172.21.15.37:0/3519359078 wait complete. 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f711d4b0740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24631, 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:49.675 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 111.063457619, 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 138.07772264299999 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:49.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70f80b6590 msgr2=0x7f70f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70f80b6590 0x7f70f80b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7100000c00 tx=0x7f71000058b0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 msgr2=0x7f711019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 0x7f711019fda0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f710800eaa0 tx=0x7f710800eea0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 shutdown_connections 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70f80b6590 0x7f70f80b8aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f711010de30 0x7f711019fda0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71101052b0 0x7f711019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 --2- 172.21.15.37:0/399422505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7110104880 0x7f711019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 >> 172.21.15.37:0/399422505 conn(0x7f7110079730 msgr2=0x7f7110106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 shutdown_connections 2024-09-21T01:15:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:49.669+0000 7f7116f3c640 1 -- 172.21.15.37:0/399422505 wait complete. 2024-09-21T01:15:50.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:15:50.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:50 smithi137 ceph-mon[34607]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:50.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:50 smithi144 ceph-mon[34818]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:50 smithi037 ceph-mon[31105]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 -- 172.21.15.37:0/4152146167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc103b60 msgr2=0x7fa4cc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 --2- 172.21.15.37:0/4152146167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc103b60 0x7fa4cc103f70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009900 tx=0x7fa4bc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 -- 172.21.15.37:0/4152146167 shutdown_connections 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 --2- 172.21.15.37:0/4152146167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc109df0 0x7fa4cc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 --2- 172.21.15.37:0/4152146167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc1094a0 0x7fa4cc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 --2- 172.21.15.37:0/4152146167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc103b60 0x7fa4cc103f70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 -- 172.21.15.37:0/4152146167 >> 172.21.15.37:0/4152146167 conn(0x7fa4cc07b850 msgr2=0x7fa4cc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:51.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 -- 172.21.15.37:0/4152146167 shutdown_connections 2024-09-21T01:15:51.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.308+0000 7fa4d11db640 1 -- 172.21.15.37:0/4152146167 wait complete. 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.309+0000 7fa4d11db640 1 Processor -- start 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.309+0000 7fa4d11db640 1 -- start start 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.309+0000 7fa4d11db640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc103b60 0x7fa4cc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.309+0000 7fa4d11db640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc1094a0 0x7fa4cc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4d11db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 0x7fa4cc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4d11db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113b00 con 0x7fa4cc109df0 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4d11db640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113980 con 0x7fa4cc103b60 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4d11db640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113c80 con 0x7fa4cc1094a0 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 0x7fa4cc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 0x7fa4cc19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39872/0 (socket says 172.21.15.37:39872) 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 -- 172.21.15.37:0/2731738066 learned_addr learned my addr 172.21.15.37:0/2731738066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc103b60 0x7fa4cc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc1094a0 0x7fa4cc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 -- 172.21.15.37:0/2731738066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc1094a0 msgr2=0x7fa4cc19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc1094a0 0x7fa4cc19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 -- 172.21.15.37:0/2731738066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc103b60 msgr2=0x7fa4cc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc103b60 0x7fa4cc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 -- 172.21.15.37:0/2731738066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc1a0420 con 0x7fa4cc109df0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc1094a0 0x7fa4cc19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 0x7fa4cc19fcf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400cad0 tx=0x7fa4c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.310+0000 7fa4b3fff640 1 -- 172.21.15.37:0/2731738066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400ae20 con 0x7fa4cc109df0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.311+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc1a0710 con 0x7fa4cc109df0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.311+0000 7fa4b3fff640 1 -- 172.21.15.37:0/2731738066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c4005020 con 0x7fa4cc109df0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.311+0000 7fa4b3fff640 1 -- 172.21.15.37:0/2731738066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400f6b0 con 0x7fa4cc109df0 2024-09-21T01:15:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.311+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc1a6e70 con 0x7fa4cc109df0 2024-09-21T01:15:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.313+0000 7fa4d774f740 1 Processor -- start 2024-09-21T01:15:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.313+0000 7fa4b3fff640 1 -- 172.21.15.37:0/2731738066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa4c400f850 con 0x7fa4cc109df0 2024-09-21T01:15:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.313+0000 7fa4d774f740 1 -- start start 2024-09-21T01:15:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e6368bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632bd0a0 0x558e6368c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 0x558e6368c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4d774f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e63603c10 con 0x558e632c5280 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4d774f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558e635f3040 con 0x558e632bd0a0 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4d774f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558e635f6e50 con 0x558e632e5f60 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 0x558e6368c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 0x558e6368c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39878/0 (socket says 172.21.15.37:39878) 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 -- 172.21.15.37:0/1100794040 learned_addr learned my addr 172.21.15.37:0/1100794040 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e6368bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632bd0a0 0x558e6368c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 -- 172.21.15.37:0/1100794040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 msgr2=0x558e6368bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e6368bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 -- 172.21.15.37:0/1100794040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632bd0a0 msgr2=0x558e6368c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632bd0a0 0x558e6368c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 -- 172.21.15.37:0/1100794040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e63351540 con 0x558e632c5280 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632bd0a0 0x558e6368c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4b3fff640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4b40b6550 0x7fa4b40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4b40b6550 0x7fa4b40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.314+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 0x558e6368c980 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc06c9f0 tx=0x7fa4c000b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3791d561b08e644 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.315+0000 7fa4b3fff640 1 -- 172.21.15.37:0/2731738066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4c40e7330 con 0x7fa4cc109df0 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.315+0000 7fa4b17fa640 1 -- 172.21.15.37:0/1100794040 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0018030 con 0x558e632c5280 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.315+0000 7fa4b17fa640 1 -- 172.21.15.37:0/1100794040 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c0005020 con 0x558e632c5280 2024-09-21T01:15:51.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.315+0000 7fa4b17fa640 1 -- 172.21.15.37:0/1100794040 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0004b20 con 0x558e632c5280 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 -- 172.21.15.37:0/1100794040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 msgr2=0x558e6368c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 0x558e6368c980 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc06c9f0 tx=0x7fa4c000b640 comp rx=0 tx=0).stop 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4b40b6550 0x7fa4b40b8a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005ab0 tx=0x7fa4bc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 -- 172.21.15.37:0/1100794040 shutdown_connections 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632c5280 0x558e6368c980 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632bd0a0 0x558e6368c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 --2- 172.21.15.37:0/1100794040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e6368bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 -- 172.21.15.37:0/1100794040 >> 172.21.15.37:0/1100794040 conn(0x558e632da350 msgr2=0x558e63689df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 -- 172.21.15.37:0/1100794040 shutdown_connections 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 -- 172.21.15.37:0/1100794040 wait complete. 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 -- start start 2024-09-21T01:15:51.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.316+0000 7fa4d774f740 1 Processor -- start 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632c5280 0x558e63697fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632e5f60 0x558e636a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e634545f0 con 0x558e632bd0a0 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558e6358e010 con 0x558e632e5f60 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558e6369a6e0 con 0x558e632c5280 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4d774f740 10 client.0 _ll_register_callbacks cb 0x558e635ed340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39892/0 (socket says 172.21.15.37:39892) 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 -- 172.21.15.37:0/3620867420 learned_addr learned my addr 172.21.15.37:0/3620867420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632c5280 0x558e63697fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632e5f60 0x558e636a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 -- 172.21.15.37:0/3620867420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632c5280 msgr2=0x558e63697fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632c5280 0x558e63697fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 -- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632e5f60 msgr2=0x558e636a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632e5f60 0x558e636a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 -- 172.21.15.37:0/3620867420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e635bba00 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc033000 tx=0x7fa4bc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3762bc8789086a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4aeff5640 1 -- 172.21.15.37:0/3620867420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc04e070 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.317+0000 7fa4aeff5640 1 -- 172.21.15.37:0/3620867420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4bc0316a0 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4c0005020 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4aeff5640 1 -- 172.21.15.37:0/3620867420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4bc05a050 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 10 client.15429 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e636a66a0 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4aeff5640 1 -- 172.21.15.37:0/3620867420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c0005020 con 0x558e632bd0a0 2024-09-21T01:15:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4aeff5640 1 -- 172.21.15.37:0/3620867420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa4bc04a860 con 0x558e632bd0a0 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 10 client.15429 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 20 client.15429 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e632a48e0 0x558e636aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 4 client.15429 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.318+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e63605b60 con 0x558e632a48e0 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.319+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e632a48e0 0x558e636aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.319+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e632a48e0 0x558e636aa1b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0e3e9f062d3b3b server_cookie=b408dca5937b3e33 in_seq=0 out_seq=0 2024-09-21T01:15:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.319+0000 7fa4aeff5640 10 client.15429 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4aeff5640 1 -- 172.21.15.37:0/3620867420 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e63605b60 con 0x558e632a48e0 2024-09-21T01:15:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4aeff5640 10 client.15429 handle_command_reply: tid=0 2024-09-21T01:15:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 client.15429 shutdown 2024-09-21T01:15:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 msgr2=0x558e63697a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc033000 tx=0x7fa4bc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 shutdown_connections 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e632a48e0 0x558e636aa1b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632e5f60 0x558e636a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632c5280 0x558e63697fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4aeff5640 0 client.15429 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 --2- 172.21.15.37:0/3620867420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 >> 172.21.15.37:0/3620867420 conn(0x558e632da350 msgr2=0x558e6368f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 shutdown_connections 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.320+0000 7fa4d774f740 1 -- 172.21.15.37:0/3620867420 wait complete. 2024-09-21T01:15:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.321+0000 7fa4d774f740 20 client.15429 trim_cache size 0 max 16384 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 Processor -- start 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 -- start start 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63697f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e636929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e636a84f0 con 0x558e632bd0a0 2024-09-21T01:15:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558e636a8bc0 con 0x558e632c5280 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4d774f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558e636a9290 con 0x558e632e5f60 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39906/0 (socket says 172.21.15.37:39906) 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.339+0000 7fa4cad9d640 1 -- 172.21.15.37:0/532109370 learned_addr learned my addr 172.21.15.37:0/532109370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63697f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e636929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cad9d640 1 -- 172.21.15.37:0/532109370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 msgr2=0x558e636929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e636929a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cad9d640 1 -- 172.21.15.37:0/532109370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 msgr2=0x558e63697f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63697f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cad9d640 1 -- 172.21.15.37:0/532109370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6368e1f0 con 0x558e632bd0a0 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63697f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e636929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc04ac80 tx=0x7fa4bc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1913680faddca000 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4b0ff9640 1 -- 172.21.15.37:0/532109370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc04e070 con 0x558e632bd0a0 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4b0ff9640 1 -- 172.21.15.37:0/532109370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4bc03d5e0 con 0x558e632bd0a0 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.340+0000 7fa4b0ff9640 1 -- 172.21.15.37:0/532109370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc035040 con 0x558e632bd0a0 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 -- 172.21.15.37:0/532109370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 msgr2=0x558e63697a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc04ac80 tx=0x7fa4bc005fd0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 -- 172.21.15.37:0/532109370 shutdown_connections 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632e5f60 0x558e636929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63697f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 --2- 172.21.15.37:0/532109370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632bd0a0 0x558e63697a40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 -- 172.21.15.37:0/532109370 >> 172.21.15.37:0/532109370 conn(0x558e632da350 msgr2=0x558e636a3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 -- 172.21.15.37:0/532109370 shutdown_connections 2024-09-21T01:15:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 -- 172.21.15.37:0/532109370 wait complete. 2024-09-21T01:15:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 -- start start 2024-09-21T01:15:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.341+0000 7fa4d774f740 1 Processor -- start 2024-09-21T01:15:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632bd0a0 0x558e637107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63710d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 0x558e63711270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e636aa030 con 0x558e632e5f60 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558e636a9960 con 0x558e632c5280 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558e636aa700 con 0x558e632bd0a0 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4d774f740 10 client.0 _ll_register_callbacks cb 0x7fa4bc004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 0x558e63711270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 0x558e63711270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39912/0 (socket says 172.21.15.37:39912) 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 -- 172.21.15.37:0/919583034 learned_addr learned my addr 172.21.15.37:0/919583034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632bd0a0 0x558e637107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63710d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 -- 172.21.15.37:0/919583034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632bd0a0 msgr2=0x558e637107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632bd0a0 0x558e637107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 -- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 msgr2=0x558e63710d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63710d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4cb59e640 1 -- 172.21.15.37:0/919583034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e636b2500 con 0x558e632e5f60 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.342+0000 7fa4ca59c640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63710d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4cb59e640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 0x558e63711270 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40a9a90 tx=0x7fa4c40ad110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4f7ec3e8daa5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4aeff5640 1 -- 172.21.15.37:0/919583034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c401d050 con 0x558e632e5f60 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4aeff5640 1 -- 172.21.15.37:0/919583034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4c400fb40 con 0x558e632e5f60 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4bc03d5e0 con 0x558e632e5f60 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4aeff5640 1 -- 172.21.15.37:0/919583034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa4c40b6ee0 con 0x558e632e5f60 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 10 client.15435 fetch_fsmap learned FSMap version 27 2024-09-21T01:15:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e63719dd0 con 0x558e632e5f60 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4aeff5640 1 -- 172.21.15.37:0/919583034 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4bc03d5e0 con 0x558e632e5f60 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4aeff5640 1 -- 172.21.15.37:0/919583034 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa4c40e6030 con 0x558e632e5f60 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 10 client.15435 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 20 client.15435 populate_metadata read hostname 'smithi037' 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e63279c90 0x558e6371d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 4 client.15435 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.343+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "status"}) -- 0x558e63601610 con 0x558e63279c90 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.344+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e63279c90 0x558e6371d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.344+0000 7fa4cad9d640 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e63279c90 0x558e6371d6e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b23d74fcf9edd5 server_cookie=a4f86af14e8af312 in_seq=0 out_seq=0 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.344+0000 7fa4aeff5640 10 client.15435 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.344+0000 7fa4aeff5640 1 -- 172.21.15.37:0/919583034 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x558e63601610 con 0x558e63279c90 2024-09-21T01:15:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.344+0000 7fa4aeff5640 10 client.15435 handle_command_reply: tid=0 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.344+0000 7fa4d774f740 1 client.15435 shutdown 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 msgr2=0x558e63711270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 0x558e63711270 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40a9a90 tx=0x7fa4c40ad110 comp rx=0 tx=0).stop 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 shutdown_connections 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558e63279c90 0x558e6371d6e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e632e5f60 0x558e63711270 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558e632c5280 0x558e63710d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 --2- 172.21.15.37:0/919583034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e632bd0a0 0x558e637107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 >> 172.21.15.37:0/919583034 conn(0x558e632da350 msgr2=0x558e636a3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4aeff5640 0 client.15435 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 shutdown_connections 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 1 -- 172.21.15.37:0/919583034 wait complete. 2024-09-21T01:15:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d774f740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "6bc9e062-77b5-11ef-baf5-efdc52797490", 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24635, 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 119.788338678, 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 130.788915616 2024-09-21T01:15:51.353 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4b40b6550 msgr2=0x7fa4b40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4b40b6550 0x7fa4b40b8a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005ab0 tx=0x7fa4bc000bc0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 msgr2=0x7fa4cc19fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 0x7fa4cc19fcf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400cad0 tx=0x7fa4c400cf90 comp rx=0 tx=0).stop 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 shutdown_connections 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4b40b6550 0x7fa4b40b8a60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4cc109df0 0x7fa4cc19fcf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc1094a0 0x7fa4cc19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 --2- 172.21.15.37:0/2731738066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc103b60 0x7fa4cc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.345+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 >> 172.21.15.37:0/2731738066 conn(0x7fa4cc07b850 msgr2=0x7fa4cc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.346+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 shutdown_connections 2024-09-21T01:15:51.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:51.346+0000 7fa4d11db640 1 -- 172.21.15.37:0/2731738066 wait complete. 2024-09-21T01:15:52.042 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T01:15:52.065 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T01:15:52.066 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T01:15:52.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:52.066 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T01:15:52.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:52.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-21T01:15:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-09-21T01:15:52.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:15:52.154 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T01:15:52.154 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:15:52.154 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:15:52.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T01:15:52.450 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:52.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:52 smithi037 ceph-mon[31105]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:52 smithi137 ceph-mon[34607]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:52.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:52 smithi144 ceph-mon[34818]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 -- 172.21.15.37:0/2065888446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 msgr2=0x7fcd501098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 --2- 172.21.15.37:0/2065888446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd501098b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009900 tx=0x7fcd4002a3f0 comp rx=0 tx=0).stop 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 -- 172.21.15.37:0/2065888446 shutdown_connections 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 --2- 172.21.15.37:0/2065888446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd50109df0 0x7fcd50110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 --2- 172.21.15.37:0/2065888446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd501098b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 --2- 172.21.15.37:0/2065888446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd50103b60 0x7fcd50103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 -- 172.21.15.37:0/2065888446 >> 172.21.15.37:0/2065888446 conn(0x7fcd5007b850 msgr2=0x7fcd5007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 -- 172.21.15.37:0/2065888446 shutdown_connections 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 -- 172.21.15.37:0/2065888446 wait complete. 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.950+0000 7fcd58660640 1 Processor -- start 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 -- start start 2024-09-21T01:15:52.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd50103b60 0x7fcd5019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd5019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd50109df0 0x7fcd5019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50113ab0 con 0x7fcd501094a0 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50113930 con 0x7fcd50103b60 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd58660640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50113c30 con 0x7fcd50109df0 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd5019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd5019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39934/0 (socket says 172.21.15.37:39934) 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 -- 172.21.15.37:0/3370667255 learned_addr learned my addr 172.21.15.37:0/3370667255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd563fc640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd50103b60 0x7fcd5019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd56bfd640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd50109df0 0x7fcd5019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 -- 172.21.15.37:0/3370667255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd50109df0 msgr2=0x7fcd5019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd50109df0 0x7fcd5019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 -- 172.21.15.37:0/3370667255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd50103b60 msgr2=0x7fcd5019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd50103b60 0x7fcd5019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.951+0000 7fcd55bfb640 1 -- 172.21.15.37:0/3370667255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd501a0370 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.952+0000 7fcd55bfb640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd5019aa60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd4002a910 tx=0x7fcd40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.952+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4003f030 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.952+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd501a0600 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.952+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd40003aa0 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.952+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40035070 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.952+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd501a0ae0 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.953+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd50103f70 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.954+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcd40042030 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.955+0000 7fcd477fe640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd3c0b6540 0x7fcd3c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.955+0000 7fcd563fc640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd3c0b6540 0x7fcd3c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.955+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fcd40107de0 con 0x7fcd501094a0 2024-09-21T01:15:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.956+0000 7fcd563fc640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd3c0b6540 0x7fcd3c0b8a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00abe0 tx=0x7fcd4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:52.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:52.959+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd400ce630 con 0x7fcd501094a0 2024-09-21T01:15:53.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.187+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcd5019b5f0 con 0x7fcd501094a0 2024-09-21T01:15:53.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.188+0000 7fcd477fe640 1 -- 172.21.15.37:0/3370667255 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fcd5019b5f0 con 0x7fcd501094a0 2024-09-21T01:15:53.189 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:15:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd3c0b6540 msgr2=0x7fcd3c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd3c0b6540 0x7fcd3c0b8a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00abe0 tx=0x7fcd4c00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 msgr2=0x7fcd5019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd5019aa60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd4002a910 tx=0x7fcd40004270 comp rx=0 tx=0).stop 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 shutdown_connections 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd3c0b6540 0x7fcd3c0b8a50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd50109df0 0x7fcd5019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd501094a0 0x7fcd5019aa60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 --2- 172.21.15.37:0/3370667255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd50103b60 0x7fcd5019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 >> 172.21.15.37:0/3370667255 conn(0x7fcd5007b850 msgr2=0x7fcd50105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 shutdown_connections 2024-09-21T01:15:53.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53.190+0000 7fcd58660640 1 -- 172.21.15.37:0/3370667255 wait complete. 2024-09-21T01:15:53.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:53 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3370667255' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:15:53.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:53 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3370667255' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:15:53.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:53 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3370667255' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:15:53.851 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:15:53.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:53.852 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-21T01:15:53.868 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:15:53.868 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:15:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42150sec preferred_lft 42150sec 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:15:53.870 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-21T01:15:53.871 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T01:15:53.871 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T01:15:53.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:15:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:54.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:54.069 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:15:54.096 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-21T01:15:54.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:54.098 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-21T01:15:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-21T01:15:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:15:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T01:15:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T01:15:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:15:54.167 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:15:54.167 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T01:15:54.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T01:15:54.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T01:15:54.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T01:15:54.167 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T01:15:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:15:54.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:54.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:54.482 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T01:15:54.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:54.498 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-21T01:15:54.554 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:15:54.554 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T01:15:54.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:15:54.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T01:15:54.555 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T01:15:54.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:15:54.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:54 smithi037 ceph-mon[31105]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:54.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:54 smithi137 ceph-mon[34607]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:54.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:54 smithi144 ceph-mon[34818]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:54.674 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T01:15:54.674 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:15:54.674 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T01:15:54.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T01:15:54.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T01:15:54.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T01:15:54.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T01:15:54.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T01:15:54.675 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T01:15:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:15:54.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:54.805 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:15:54.806 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-21T01:15:54.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-21T01:15:54.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T01:15:54.806 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-21T01:15:54.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:15:54.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:54.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:15:54.886 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T01:15:54.902 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:15:54.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:15:54.903 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:15:54.956 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T01:15:54.956 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T01:15:54.956 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/b1d22a8f-7fd5-4fd3-9d6d-b69ea0b2bfdf 2024-09-21T01:15:54.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:54.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/b1d22a8f-7fd5-4fd3-9d6d-b69ea0b2bfdf /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T01:15:55.070 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T01:15:55.070 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T01:15:55.208 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T01:15:55.209 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T01:15:55.209 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.137:3300,172.21.15.144:3300" 2024-09-21T01:15:55.209 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@6bc9e062-77b5-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/b1d22a8f-7fd5-4fd3-9d6d-b69ea0b2bfdf 2024-09-21T01:15:55.209 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.37:3300/172.21.15.137:3300/172.21.15.144:3300" will pass to kernel 2024-09-21T01:15:55.210 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T01:15:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:15:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:15:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:15:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:15:55.211 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:15:55.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:15:55.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:15:55.243 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:15:55.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:15:55.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:55.342 INFO:teuthology.orchestra.run.smithi037.stdout:client25118 2024-09-21T01:15:55.342 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:15:55.342 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:15:55.360 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:15:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:15:55.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:55.458 INFO:teuthology.orchestra.run.smithi037.stdout:client25118 2024-09-21T01:15:55.458 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:15:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:15:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:55.516 INFO:teuthology.orchestra.run.smithi037.stdout:client25118 2024-09-21T01:15:55.516 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490.client25118/status') 2024-09-21T01:15:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:15:55.576 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.25118 (3)172.21.15.37:0/2071311430 2024-09-21T01:15:55.577 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-09-21T01:15:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-09-21T01:15:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-09-21T01:15:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:71 bytes copied, 2.617e-05 s, 2.7 MB/s 2024-09-21T01:15:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:15:55.584 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T01:15:55.595 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T01:15:55.595 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:15:55.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T01:15:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.708+0000 7f2b1a89b640 1 -- 172.21.15.37:0/2203278896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b141025d0 msgr2=0x7f2b14102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.708+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/2203278896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b141025d0 0x7f2b14102a40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009900 tx=0x7f2b0402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 -- 172.21.15.37:0/2203278896 shutdown_connections 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/2203278896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 0x7f2b1410a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/2203278896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b14103650 0x7f2b14103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/2203278896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b141025d0 0x7f2b14102a40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 -- 172.21.15.37:0/2203278896 >> 172.21.15.37:0/2203278896 conn(0x7f2b140fdf30 msgr2=0x7f2b141003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 -- 172.21.15.37:0/2203278896 shutdown_connections 2024-09-21T01:15:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 -- 172.21.15.37:0/2203278896 wait complete. 2024-09-21T01:15:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 Processor -- start 2024-09-21T01:15:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.709+0000 7f2b1a89b640 1 -- start start 2024-09-21T01:15:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b1a89b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b141025d0 0x7f2b14198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b1a89b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 0x7f2b14199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b1a89b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 0x7f2b1419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b1a89b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1410e260 con 0x7f2b14103650 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b1a89b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1410e0e0 con 0x7f2b141025d0 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b1a89b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1410e3e0 con 0x7f2b14103ff0 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 0x7f2b14199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 0x7f2b14199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56142/0 (socket says 172.21.15.37:56142) 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 -- 172.21.15.37:0/1687790210 learned_addr learned my addr 172.21.15.37:0/1687790210 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b13fff640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b141025d0 0x7f2b14198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b18e38640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 0x7f2b1419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 -- 172.21.15.37:0/1687790210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 msgr2=0x7f2b1419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 0x7f2b1419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 -- 172.21.15.37:0/1687790210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b141025d0 msgr2=0x7f2b14198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b141025d0 0x7f2b14198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 -- 172.21.15.37:0/1687790210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1419a8d0 con 0x7f2b14103650 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b18e38640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 0x7f2b1419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b13fff640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b141025d0 0x7f2b14198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b137fe640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 0x7f2b14199500 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800d950 tx=0x7f2b0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.710+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08017070 con 0x7f2b14103650 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.711+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1419abc0 con 0x7f2b14103650 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.711+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b08009c30 con 0x7f2b14103650 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.711+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800f620 con 0x7f2b14103650 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.711+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b141a12b0 con 0x7f2b14103650 2024-09-21T01:15:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.711+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b141097a0 con 0x7f2b14103650 2024-09-21T01:15:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.713+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2b08010460 con 0x7f2b14103650 2024-09-21T01:15:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.714+0000 7f2b117fa640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2afc0b6510 0x7f2afc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.714+0000 7f2b13fff640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2afc0b6510 0x7f2afc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.714+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2b080e6fd0 con 0x7f2b14103650 2024-09-21T01:15:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.715+0000 7f2b13fff640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2afc0b6510 0x7f2afc0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b04000c00 tx=0x7f2b04031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.718+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b080ad860 con 0x7f2b14103650 2024-09-21T01:15:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:55.945+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f2b1402e640 con 0x7f2b14103650 2024-09-21T01:15:56.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.399+0000 7f2b117fa640 1 -- 172.21.15.37:0/1687790210 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f2b08009de0 con 0x7f2b14103650 2024-09-21T01:15:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2afc0b6510 msgr2=0x7f2afc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2afc0b6510 0x7f2afc0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b04000c00 tx=0x7f2b04031400 comp rx=0 tx=0).stop 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 msgr2=0x7f2b14199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 0x7f2b14199500 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800d950 tx=0x7f2b0800de10 comp rx=0 tx=0).stop 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 shutdown_connections 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2afc0b6510 0x7f2afc0b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14103ff0 0x7f2b1419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b14103650 0x7f2b14199500 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 --2- 172.21.15.37:0/1687790210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b141025d0 0x7f2b14198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 >> 172.21.15.37:0/1687790210 conn(0x7f2b140fdf30 msgr2=0x7f2b14106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 shutdown_connections 2024-09-21T01:15:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.401+0000 7f2b1a89b640 1 -- 172.21.15.37:0/1687790210 wait complete. 2024-09-21T01:15:56.415 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T01:15:56.426 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T01:15:56.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:15:56.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.554+0000 7f93023a1640 1 -- 172.21.15.37:0/3871049322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 msgr2=0x7f92fc103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.554+0000 7f93023a1640 1 --2- 172.21.15.37:0/3871049322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc103a00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009900 tx=0x7f92e402a410 comp rx=0 tx=0).stop 2024-09-21T01:15:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 -- 172.21.15.37:0/3871049322 shutdown_connections 2024-09-21T01:15:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 --2- 172.21.15.37:0/3871049322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc103f90 0x7f92fc10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 --2- 172.21.15.37:0/3871049322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc103a00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 --2- 172.21.15.37:0/3871049322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc102570 0x7f92fc1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 -- 172.21.15.37:0/3871049322 >> 172.21.15.37:0/3871049322 conn(0x7f92fc0fdeb0 msgr2=0x7f92fc100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 -- 172.21.15.37:0/3871049322 shutdown_connections 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 -- 172.21.15.37:0/3871049322 wait complete. 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 Processor -- start 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.555+0000 7f93023a1640 1 -- start start 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f93023a1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc102570 0x7f92fc106160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f93023a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc104a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f93023a1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc104f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f93023a1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc10e210 con 0x7f92fc1035f0 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f93023a1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc10e090 con 0x7f92fc102570 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f93023a1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc10e390 con 0x7f92fc103f90 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc104a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc104a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56158/0 (socket says 172.21.15.37:56158) 2024-09-21T01:15:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 -- 172.21.15.37:0/4114275789 learned_addr learned my addr 172.21.15.37:0/4114275789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fbfff640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc102570 0x7f92fc106160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f930093e640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 -- 172.21.15.37:0/4114275789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 msgr2=0x7f92fc104f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc104f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 -- 172.21.15.37:0/4114275789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc102570 msgr2=0x7f92fc106160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc102570 0x7f92fc106160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 -- 172.21.15.37:0/4114275789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc105690 con 0x7f92fc1035f0 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fbfff640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc102570 0x7f92fc106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92fb7fe640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc104a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f92e4031440 tx=0x7f92e4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.556+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e403f070 con 0x7f92fc1035f0 2024-09-21T01:15:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.557+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc1a3fa0 con 0x7f92fc1035f0 2024-09-21T01:15:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.557+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e4031c50 con 0x7f92fc1035f0 2024-09-21T01:15:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.557+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4035030 con 0x7f92fc1035f0 2024-09-21T01:15:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.557+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1a4350 con 0x7f92fc1035f0 2024-09-21T01:15:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.558+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92fc1a4520 con 0x7f92fc1035f0 2024-09-21T01:15:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.559+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f92e4042070 con 0x7f92fc1035f0 2024-09-21T01:15:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.560+0000 7f92f97fa640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e80b6510 0x7f92e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.560+0000 7f92fbfff640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e80b6510 0x7f92e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.560+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f92e4108380 con 0x7f92fc1035f0 2024-09-21T01:15:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.561+0000 7f92fbfff640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e80b6510 0x7f92e80b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009c20 tx=0x7f92ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.563+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92e40cebd0 con 0x7f92fc1035f0 2024-09-21T01:15:56.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:56 smithi137 ceph-mon[34607]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:56.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:56 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1687790210' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T01:15:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:56 smithi144 ceph-mon[34818]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:56 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1687790210' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T01:15:56.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:56 smithi037 ceph-mon[31105]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-21T01:15:56.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:56 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1687790210' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T01:15:56.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.754+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92fc1a46f0 con 0x7f92fc1035f0 2024-09-21T01:15:56.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.756+0000 7f92f97fa640 1 -- 172.21.15.37:0/4114275789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7f92e40d2fb0 con 0x7f92fc1035f0 2024-09-21T01:15:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:56.757 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:15:56.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e80b6510 msgr2=0x7f92e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e80b6510 0x7f92e80b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009c20 tx=0x7f92ec005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 msgr2=0x7f92fc104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc104a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f92e4031440 tx=0x7f92e4003c10 comp rx=0 tx=0).stop 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 shutdown_connections 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e80b6510 0x7f92e80b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc104f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc104a20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 --2- 172.21.15.37:0/4114275789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc102570 0x7f92fc106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 >> 172.21.15.37:0/4114275789 conn(0x7f92fc0fdeb0 msgr2=0x7f92fc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:56.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 shutdown_connections 2024-09-21T01:15:56.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.758+0000 7f93023a1640 1 -- 172.21.15.37:0/4114275789 wait complete. 2024-09-21T01:15:56.772 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:09:09.226836+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T01:13:46.784744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T01:13:49.153488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:15:56.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:15:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 -- 172.21.15.37:0/3780972290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4103600 msgr2=0x7f7ae4103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 --2- 172.21.15.37:0/3780972290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4103600 0x7f7ae4103a10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009900 tx=0x7f7acc02a410 comp rx=0 tx=0).stop 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 -- 172.21.15.37:0/3780972290 shutdown_connections 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 --2- 172.21.15.37:0/3780972290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ae4103fa0 0x7f7ae410a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 --2- 172.21.15.37:0/3780972290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4103600 0x7f7ae4103a10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 --2- 172.21.15.37:0/3780972290 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae4102580 0x7f7ae41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 -- 172.21.15.37:0/3780972290 >> 172.21.15.37:0/3780972290 conn(0x7f7ae40fdee0 msgr2=0x7f7ae4100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 -- 172.21.15.37:0/3780972290 shutdown_connections 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 -- 172.21.15.37:0/3780972290 wait complete. 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.888+0000 7f7ae9470640 1 Processor -- start 2024-09-21T01:15:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 -- start start 2024-09-21T01:15:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 0x7f7ae4198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ae4103600 0x7f7ae4199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae4103fa0 0x7f7ae419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae410e1e0 con 0x7f7ae4102580 2024-09-21T01:15:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae410e060 con 0x7f7ae4103fa0 2024-09-21T01:15:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae9470640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae410e360 con 0x7f7ae4103600 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 0x7f7ae4198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 0x7f7ae4198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56182/0 (socket says 172.21.15.37:56182) 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1899947426 learned_addr learned my addr 172.21.15.37:0/1899947426 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae37fe640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae4103fa0 0x7f7ae419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae27fc640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ae4103600 0x7f7ae4199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1899947426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ae4103600 msgr2=0x7f7ae4199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ae4103600 0x7f7ae4199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1899947426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae4103fa0 msgr2=0x7f7ae419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae4103fa0 0x7f7ae419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.889+0000 7f7ae2ffd640 1 -- 172.21.15.37:0/1899947426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae419a870 con 0x7f7ae4102580 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.890+0000 7f7ae2ffd640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 0x7f7ae4198ea0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400db80 tx=0x7f7ad400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.890+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4017070 con 0x7f7ae4102580 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.890+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad4003b70 con 0x7f7ae4102580 2024-09-21T01:15:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.890+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae419ab60 con 0x7f7ae4102580 2024-09-21T01:15:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.890+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40106c0 con 0x7f7ae4102580 2024-09-21T01:15:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.890+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae41a1250 con 0x7f7ae4102580 2024-09-21T01:15:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.891+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae4109730 con 0x7f7ae4102580 2024-09-21T01:15:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.892+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7ad4004020 con 0x7f7ae4102580 2024-09-21T01:15:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.894+0000 7f7adbfff640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7ad00b6510 0x7f7ad00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.894+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7ad40e77e0 con 0x7f7ae4102580 2024-09-21T01:15:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.894+0000 7f7ae27fc640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7ad00b6510 0x7f7ad00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.894+0000 7f7ae27fc640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7ad00b6510 0x7f7ad00b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7acc031440 tx=0x7f7acc0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:56.897+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ad40ae030 con 0x7f7ae4102580 2024-09-21T01:15:57.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.085+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ae4063fc0 con 0x7f7ae4102580 2024-09-21T01:15:57.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.085+0000 7f7adbfff640 1 -- 172.21.15.37:0/1899947426 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f7ad40b2410 con 0x7f7ae4102580 2024-09-21T01:15:57.087 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7ad00b6510 msgr2=0x7f7ad00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7ad00b6510 0x7f7ad00b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7acc031440 tx=0x7f7acc0314a0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 msgr2=0x7f7ae4198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 0x7f7ae4198ea0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400db80 tx=0x7f7ad400b630 comp rx=0 tx=0).stop 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 shutdown_connections 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f7ad00b6510 0x7f7ad00b8a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ae4103fa0 0x7f7ae419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.087+0000 7f7ae9470640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ae4103600 0x7f7ae4199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.088+0000 7f7ae9470640 1 --2- 172.21.15.37:0/1899947426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ae4102580 0x7f7ae4198ea0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.088+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 >> 172.21.15.37:0/1899947426 conn(0x7f7ae40fdee0 msgr2=0x7f7ae4106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.088+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 shutdown_connections 2024-09-21T01:15:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.088+0000 7f7ae9470640 1 -- 172.21.15.37:0/1899947426 wait complete. 2024-09-21T01:15:57.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:15:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2413140858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 msgr2=0x7fcfd810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2413140858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd810a960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009c90 tx=0x7fcfd002a860 comp rx=0 tx=0).stop 2024-09-21T01:15:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2413140858 shutdown_connections 2024-09-21T01:15:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2413140858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd810a960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2413140858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfd8103620 0x7fcfd8103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2413140858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd81025a0 0x7fcfd8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.217+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2413140858 >> 172.21.15.37:0/2413140858 conn(0x7fcfd80fdee0 msgr2=0x7fcfd8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.218+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2413140858 shutdown_connections 2024-09-21T01:15:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.218+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2413140858 wait complete. 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.218+0000 7fcfdf36a640 1 Processor -- start 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.218+0000 7fcfdf36a640 1 -- start start 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdf36a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfd81025a0 0x7fcfd8106190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdf36a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd8103620 0x7fcfd8104a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdf36a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd8104f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdf36a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd810e220 con 0x7fcfd8103fc0 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdf36a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd810e0a0 con 0x7fcfd8103620 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdf36a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd810e3a0 con 0x7fcfd81025a0 2024-09-21T01:15:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd8104f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd8104f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56212/0 (socket says 172.21.15.37:56212) 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 -- 172.21.15.37:0/2623906487 learned_addr learned my addr 172.21.15.37:0/2623906487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd106640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfd81025a0 0x7fcfd8106190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdc905640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd8103620 0x7fcfd8104a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 -- 172.21.15.37:0/2623906487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfd81025a0 msgr2=0x7fcfd8106190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfd81025a0 0x7fcfd8106190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 -- 172.21.15.37:0/2623906487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd8103620 msgr2=0x7fcfd8104a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd8103620 0x7fcfd8104a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 -- 172.21.15.37:0/2623906487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd81056c0 con 0x7fcfd8103fc0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfdd907640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd8104f90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00318e0 tx=0x7fcfd0004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.219+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0030560 con 0x7fcfd8103fc0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.220+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd0030bb0 con 0x7fcfd8103fc0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.220+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd81a3f70 con 0x7fcfd8103fc0 2024-09-21T01:15:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.220+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd003cc60 con 0x7fcfd8103fc0 2024-09-21T01:15:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.220+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd81a4320 con 0x7fcfd8103fc0 2024-09-21T01:15:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.220+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd8102a10 con 0x7fcfd8103fc0 2024-09-21T01:15:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.222+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcfd003c410 con 0x7fcfd8103fc0 2024-09-21T01:15:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.224+0000 7fcfce7fc640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcfc40b6510 0x7fcfc40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.224+0000 7fcfdd106640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcfc40b6510 0x7fcfc40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.224+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fcfd0108550 con 0x7fcfd8103fc0 2024-09-21T01:15:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.224+0000 7fcfdd106640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcfc40b6510 0x7fcfc40b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40095f0 tx=0x7fcfd4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.226+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcfd00ceda0 con 0x7fcfd8103fc0 2024-09-21T01:15:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.420+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcfd81a4610 con 0x7fcfd8103fc0 2024-09-21T01:15:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.420+0000 7fcfce7fc640 1 -- 172.21.15.37:0/2623906487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7fcfd00d3180 con 0x7fcfd8103fc0 2024-09-21T01:15:57.422 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcfc40b6510 msgr2=0x7fcfc40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcfc40b6510 0x7fcfc40b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40095f0 tx=0x7fcfd4005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 msgr2=0x7fcfd8104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd8104f90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00318e0 tx=0x7fcfd0004cc0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 shutdown_connections 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcfc40b6510 0x7fcfc40b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8103fc0 0x7fcfd8104f90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfd8103620 0x7fcfd8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 --2- 172.21.15.37:0/2623906487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfd81025a0 0x7fcfd8106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.422+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 >> 172.21.15.37:0/2623906487 conn(0x7fcfd80fdee0 msgr2=0x7fcfd806b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.423+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 shutdown_connections 2024-09-21T01:15:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.423+0000 7fcfdf36a640 1 -- 172.21.15.37:0/2623906487 wait complete. 2024-09-21T01:15:57.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:15:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 -- 172.21.15.37:0/1663750989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103fc0 msgr2=0x7f09fc10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 --2- 172.21.15.37:0/1663750989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103fc0 0x7f09fc10a960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009c90 tx=0x7f09f402a860 comp rx=0 tx=0).stop 2024-09-21T01:15:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 -- 172.21.15.37:0/1663750989 shutdown_connections 2024-09-21T01:15:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 --2- 172.21.15.37:0/1663750989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103fc0 0x7f09fc10a960 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 --2- 172.21.15.37:0/1663750989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103620 0x7f09fc103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 --2- 172.21.15.37:0/1663750989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 0x7f09fc102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.551+0000 7f0a01b52640 1 -- 172.21.15.37:0/1663750989 >> 172.21.15.37:0/1663750989 conn(0x7f09fc0fdee0 msgr2=0x7f09fc100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.552+0000 7f0a01b52640 1 -- 172.21.15.37:0/1663750989 shutdown_connections 2024-09-21T01:15:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.552+0000 7f0a01b52640 1 -- 172.21.15.37:0/1663750989 wait complete. 2024-09-21T01:15:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.552+0000 7f0a01b52640 1 Processor -- start 2024-09-21T01:15:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.552+0000 7f0a01b52640 1 -- start start 2024-09-21T01:15:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 0x7f09fc199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 0x7f09fc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103fc0 0x7f09fc19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc10f390 con 0x7f09fc103620 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc10f210 con 0x7f09fc1025a0 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc10f510 con 0x7f09fc103fc0 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 0x7f09fc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 0x7f09fc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56228/0 (socket says 172.21.15.37:56228) 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 -- 172.21.15.37:0/682091441 learned_addr learned my addr 172.21.15.37:0/682091441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09fbfff640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103fc0 0x7f09fc19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09fb7fe640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 0x7f09fc199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 -- 172.21.15.37:0/682091441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103fc0 msgr2=0x7f09fc19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103fc0 0x7f09fc19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 -- 172.21.15.37:0/682091441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 msgr2=0x7f09fc199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 0x7f09fc199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 -- 172.21.15.37:0/682091441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc19b930 con 0x7f09fc103620 2024-09-21T01:15:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09fbfff640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103fc0 0x7f09fc19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09fb7fe640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 0x7f09fc199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09faffd640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 0x7f09fc19a560 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f09f000d770 tx=0x7f09f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0017070 con 0x7f09fc103620 2024-09-21T01:15:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09f00054d0 con 0x7f09fc103620 2024-09-21T01:15:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09fc19bc20 con 0x7f09fc103620 2024-09-21T01:15:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.553+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0004c30 con 0x7f09fc103620 2024-09-21T01:15:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.554+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09fc1a2310 con 0x7f09fc103620 2024-09-21T01:15:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.554+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09fc109750 con 0x7f09fc103620 2024-09-21T01:15:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.556+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f09f0004dd0 con 0x7f09fc103620 2024-09-21T01:15:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.557+0000 7f09f8ff9640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6510 0x7f09e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.557+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f09f00e72b0 con 0x7f09fc103620 2024-09-21T01:15:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.557+0000 7f09fb7fe640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6510 0x7f09e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.558+0000 7f09fb7fe640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6510 0x7f09e40b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009c20 tx=0x7f09ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.560+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09f00adb40 con 0x7f09fc103620 2024-09-21T01:15:57.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:57 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1687790210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T01:15:57.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:57 smithi137 ceph-mon[34607]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:15:57.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:57 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/4114275789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:57.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:57 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1899947426' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:15:57.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:57 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1687790210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T01:15:57.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:57 smithi144 ceph-mon[34818]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:15:57.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:57 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/4114275789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:57.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:57 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1899947426' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:15:57.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.749+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f09fc063fc0 con 0x7f09fc103620 2024-09-21T01:15:57.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:57 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1687790210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T01:15:57.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:57 smithi037 ceph-mon[31105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:15:57.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:57 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4114275789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:15:57.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:57 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1899947426' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:15:57.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.749+0000 7f09f8ff9640 1 -- 172.21.15.37:0/682091441 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7f09f00b1f20 con 0x7f09fc103620 2024-09-21T01:15:57.751 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-09-21T01:15:57.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.751+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6510 msgr2=0x7f09e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.751+0000 7f0a01b52640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6510 0x7f09e40b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009c20 tx=0x7f09ec005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:57.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.751+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 msgr2=0x7f09fc19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:57.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.751+0000 7f0a01b52640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 0x7f09fc19a560 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f09f000d770 tx=0x7f09f000dc30 comp rx=0 tx=0).stop 2024-09-21T01:15:57.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 shutdown_connections 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6510 0x7f09e40b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc103fc0 0x7f09fc19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc103620 0x7f09fc19a560 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 --2- 172.21.15.37:0/682091441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc1025a0 0x7f09fc199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 >> 172.21.15.37:0/682091441 conn(0x7f09fc0fdee0 msgr2=0x7f09fc106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 shutdown_connections 2024-09-21T01:15:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:57.752+0000 7f0a01b52640 1 -- 172.21.15.37:0/682091441 wait complete. 2024-09-21T01:15:57.763 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T01:15:57.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:15:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:15:58.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 -- 172.21.15.37:0/3675919909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0105320 msgr2=0x7fd9c010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/3675919909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0105320 0x7fd9c010d870 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009900 tx=0x7fd9b002a410 comp rx=0 tx=0).stop 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 -- 172.21.15.37:0/3675919909 shutdown_connections 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/3675919909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9c010de30 0x7fd9c0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/3675919909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0105320 0x7fd9c010d870 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/3675919909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c01049d0 0x7fd9c0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.505+0000 7fd9c87a5640 1 -- 172.21.15.37:0/3675919909 >> 172.21.15.37:0/3675919909 conn(0x7fd9c0079740 msgr2=0x7fd9c0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.506+0000 7fd9c87a5640 1 -- 172.21.15.37:0/3675919909 shutdown_connections 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.506+0000 7fd9c87a5640 1 -- 172.21.15.37:0/3675919909 wait complete. 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.506+0000 7fd9c87a5640 1 Processor -- start 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.506+0000 7fd9c87a5640 1 -- start start 2024-09-21T01:15:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9c01049d0 0x7fd9c019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c0105320 0x7fd9c019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 0x7fd9c019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0113a90 con 0x7fd9c010de30 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0113910 con 0x7fd9c0105320 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0113c10 con 0x7fd9c01049d0 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 0x7fd9c019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 0x7fd9c019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56244/0 (socket says 172.21.15.37:56244) 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 -- 172.21.15.37:0/1914317782 learned_addr learned my addr 172.21.15.37:0/1914317782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c5d40640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c0105320 0x7fd9c019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6541640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9c01049d0 0x7fd9c019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 -- 172.21.15.37:0/1914317782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9c01049d0 msgr2=0x7fd9c019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9c01049d0 0x7fd9c019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 -- 172.21.15.37:0/1914317782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c0105320 msgr2=0x7fd9c019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c0105320 0x7fd9c019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 -- 172.21.15.37:0/1914317782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c01a0430 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c6d42640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 0x7fd9c019fd00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800eaa0 tx=0x7fd9b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800cdb0 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9b8005020 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80116d0 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c01a0720 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.507+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c01a6e80 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.509+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c006c240 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.510+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd9b80051d0 con 0x7fd9c010de30 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.511+0000 7fd9b77fe640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd9ac0b6510 0x7fd9ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.511+0000 7fd9c6541640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd9ac0b6510 0x7fd9ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.511+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd9b80e7530 con 0x7fd9c010de30 2024-09-21T01:15:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.511+0000 7fd9c6541640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd9ac0b6510 0x7fd9ac0b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9c006c940 tx=0x7fd9bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.515+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9b8016030 con 0x7fd9c010de30 2024-09-21T01:15:58.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:58 smithi137 ceph-mon[34607]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:58.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:58 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2623906487' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:15:58.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:58 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/682091441' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:15:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:58 smithi144 ceph-mon[34818]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:58 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2623906487' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:15:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:58 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/682091441' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:15:58.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.746+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c01a7120 con 0x7fd9c010de30 2024-09-21T01:15:58.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:58 smithi037 ceph-mon[31105]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:15:58.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:58 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2623906487' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:15:58.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:58 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/682091441' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:15:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.746+0000 7fd9b77fe640 1 -- 172.21.15.37:0/1914317782 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11976 (secure 0 0 0) 0x7fd9b80addc0 con 0x7fd9c010de30 2024-09-21T01:15:58.748 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-21T01:15:56:398497+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:15:55.947622+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:15:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-21T01:15:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.750+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd9ac0b6510 msgr2=0x7fd9ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.750+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd9ac0b6510 0x7fd9ac0b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9c006c940 tx=0x7fd9bc005f90 comp rx=0 tx=0).stop 2024-09-21T01:15:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 msgr2=0x7fd9c019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 0x7fd9c019fd00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800eaa0 tx=0x7fd9b800ef60 comp rx=0 tx=0).stop 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 shutdown_connections 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd9ac0b6510 0x7fd9ac0b8a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c010de30 0x7fd9c019fd00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9c0105320 0x7fd9c019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 --2- 172.21.15.37:0/1914317782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9c01049d0 0x7fd9c019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 >> 172.21.15.37:0/1914317782 conn(0x7fd9c0079740 msgr2=0x7fd9c0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 shutdown_connections 2024-09-21T01:15:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:58.751+0000 7fd9c87a5640 1 -- 172.21.15.37:0/1914317782 wait complete. 2024-09-21T01:15:59.457 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T01:15:59.457 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T01:15:59.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:15:59.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 -- 172.21.15.37:0/1170203052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f41093e0 msgr2=0x7f07f410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 --2- 172.21.15.37:0/1170203052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f41093e0 0x7f07f410b8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009ca0 tx=0x7f07ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 -- 172.21.15.37:0/1170203052 shutdown_connections 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 --2- 172.21.15.37:0/1170203052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f41093e0 0x7f07f410b8f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 --2- 172.21.15.37:0/1170203052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f4106880 0x7f07f4108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 --2- 172.21.15.37:0/1170203052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 0x7f07f4106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 -- 172.21.15.37:0/1170203052 >> 172.21.15.37:0/1170203052 conn(0x7f07f40fdee0 msgr2=0x7f07f4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 -- 172.21.15.37:0/1170203052 shutdown_connections 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 -- 172.21.15.37:0/1170203052 wait complete. 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 Processor -- start 2024-09-21T01:15:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.577+0000 7f07faa30640 1 -- start start 2024-09-21T01:15:59.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07faa30640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 0x7f07f4103980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07faa30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 0x7f07f4102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07faa30640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41093e0 0x7f07f4102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07faa30640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07f410f370 con 0x7f07f4106880 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07faa30640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07f410f1f0 con 0x7f07f41093e0 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07faa30640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f07f410f4f0 con 0x7f07f406c3e0 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 0x7f07f4102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 0x7f07f4102240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56266/0 (socket says 172.21.15.37:56266) 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 -- 172.21.15.37:0/343156139 learned_addr learned my addr 172.21.15.37:0/343156139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f8fcd640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41093e0 0x7f07f4102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f3fff640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 0x7f07f4103980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 -- 172.21.15.37:0/343156139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 msgr2=0x7f07f4103980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 0x7f07f4103980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 -- 172.21.15.37:0/343156139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41093e0 msgr2=0x7f07f4102780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41093e0 0x7f07f4102780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 -- 172.21.15.37:0/343156139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f4102eb0 con 0x7f07f4106880 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f3fff640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 0x7f07f4103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.578+0000 7f07f37fe640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 0x7f07f4102240 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f07e8005fd0 tx=0x7f07e800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.579+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8017070 con 0x7f07f4106880 2024-09-21T01:15:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.579+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e8009c30 con 0x7f07f4106880 2024-09-21T01:15:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.579+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f41a3fb0 con 0x7f07f4106880 2024-09-21T01:15:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.579+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8003d30 con 0x7f07f4106880 2024-09-21T01:15:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.579+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f41a43c0 con 0x7f07f4106880 2024-09-21T01:15:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.580+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f40ffa00 con 0x7f07f4106880 2024-09-21T01:15:59.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.581+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f07e8003ed0 con 0x7f07f4106880 2024-09-21T01:15:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.582+0000 7f07f17fa640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f07dc0b6510 0x7f07dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.582+0000 7f07f3fff640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f07dc0b6510 0x7f07dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.582+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f07e80e7750 con 0x7f07f4106880 2024-09-21T01:15:59.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.583+0000 7f07f3fff640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f07dc0b6510 0x7f07dc0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07e40058c0 tx=0x7f07e4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:59.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.585+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07e8020030 con 0x7f07f4106880 2024-09-21T01:15:59.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:15:59 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1914317782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:59.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.772+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07f4063800 con 0x7f07dc0b6510 2024-09-21T01:15:59.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.777+0000 7f07f17fa640 1 -- 172.21.15.37:0/343156139 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259179 (secure 0 0 0) 0x7f07f4063800 con 0x7f07dc0b6510 2024-09-21T01:15:59.780 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:15:59.781 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f07dc0b6510 msgr2=0x7f07dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f07dc0b6510 0x7f07dc0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07e40058c0 tx=0x7f07e4005850 comp rx=0 tx=0).stop 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 msgr2=0x7f07f4102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 0x7f07f4102240 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f07e8005fd0 tx=0x7f07e800dde0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 shutdown_connections 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f07dc0b6510 0x7f07dc0b8a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07f41093e0 0x7f07f4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4106880 0x7f07f4102240 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 --2- 172.21.15.37:0/343156139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f406c3e0 0x7f07f4103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 >> 172.21.15.37:0/343156139 conn(0x7f07f40fdee0 msgr2=0x7f07f4104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:59.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 shutdown_connections 2024-09-21T01:15:59.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.780+0000 7f07faa30640 1 -- 172.21.15.37:0/343156139 wait complete. 2024-09-21T01:15:59.792 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-21T01:15:58.883066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668130,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1272,"num_read_kb":749,"num_write":384,"num_write_kb":2309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376172,"kb_used_data":10284,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565652,"statfs":{"total":1151940427776,"available":1151555227648,"internally_reserved":0,"allocated":10530816,"data_stored":6799362,"data_compressed":182481,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4965,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":76,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003125"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260430+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:15:17.260430+0000","last_peered":"2024-09-21T01:15:17.260430+0000","last_clean":"2024-09-21T01:15:17.260430+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:15:17.260430+0000","last_undegraded":"2024-09-21T01:15:17.260430+0000","last_fullsized":"2024-09-21T01:15:17.260430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.255604+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:15:17.255604+0000","last_peered":"2024-09-21T01:15:17.255604+0000","last_clean":"2024-09-21T01:15:17.255604+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:15:17.255604+0000","last_undegraded":"2024-09-21T01:15:17.255604+0000","last_fullsized":"2024-09-21T01:15:17.255604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.259569+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:15:17.259569+0000","last_peered":"2024-09-21T01:15:17.259569+0000","last_clean":"2024-09-21T01:15:17.259569+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:15:17.259569+0000","last_undegraded":"2024-09-21T01:15:17.259569+0000","last_fullsized":"2024-09-21T01:15:17.259569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.248568+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:15:17.248568+0000","last_peered":"2024-09-21T01:15:17.248568+0000","last_clean":"2024-09-21T01:15:17.248568+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:15:17.248568+0000","last_undegraded":"2024-09-21T01:15:17.248568+0000","last_fullsized":"2024-09-21T01:15:17.248568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.228328+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:15:17.228328+0000","last_peered":"2024-09-21T01:15:17.228328+0000","last_clean":"2024-09-21T01:15:17.228328+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:15:17.228328+0000","last_undegraded":"2024-09-21T01:15:17.228328+0000","last_fullsized":"2024-09-21T01:15:17.228328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250795+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:15:17.250795+0000","last_peered":"2024-09-21T01:15:17.250795+0000","last_clean":"2024-09-21T01:15:17.250795+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:15:17.250795+0000","last_undegraded":"2024-09-21T01:15:17.250795+0000","last_fullsized":"2024-09-21T01:15:17.250795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253863+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:15:17.253863+0000","last_peered":"2024-09-21T01:15:17.253863+0000","last_clean":"2024-09-21T01:15:17.253863+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:15:17.253863+0000","last_undegraded":"2024-09-21T01:15:17.253863+0000","last_fullsized":"2024-09-21T01:15:17.253863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251013+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:15:17.251013+0000","last_peered":"2024-09-21T01:15:17.251013+0000","last_clean":"2024-09-21T01:15:17.251013+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:15:17.251013+0000","last_undegraded":"2024-09-21T01:15:17.251013+0000","last_fullsized":"2024-09-21T01:15:17.251013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.263715+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:15:17.263715+0000","last_peered":"2024-09-21T01:15:17.263715+0000","last_clean":"2024-09-21T01:15:17.263715+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:15:17.263715+0000","last_undegraded":"2024-09-21T01:15:17.263715+0000","last_fullsized":"2024-09-21T01:15:17.263715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.247960+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:15:17.247960+0000","last_peered":"2024-09-21T01:15:17.247960+0000","last_clean":"2024-09-21T01:15:17.247960+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:15:17.247960+0000","last_undegraded":"2024-09-21T01:15:17.247960+0000","last_fullsized":"2024-09-21T01:15:17.247960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260411+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:15:17.260411+0000","last_peered":"2024-09-21T01:15:17.260411+0000","last_clean":"2024-09-21T01:15:17.260411+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:15:17.260411+0000","last_undegraded":"2024-09-21T01:15:17.260411+0000","last_fullsized":"2024-09-21T01:15:17.260411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251061+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:15:17.251061+0000","last_peered":"2024-09-21T01:15:17.251061+0000","last_clean":"2024-09-21T01:15:17.251061+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:15:17.251061+0000","last_undegraded":"2024-09-21T01:15:17.251061+0000","last_fullsized":"2024-09-21T01:15:17.251061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253108+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:15:17.253108+0000","last_peered":"2024-09-21T01:15:17.253108+0000","last_clean":"2024-09-21T01:15:17.253108+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:15:17.253108+0000","last_undegraded":"2024-09-21T01:15:17.253108+0000","last_fullsized":"2024-09-21T01:15:17.253108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254383+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:15:17.254383+0000","last_peered":"2024-09-21T01:15:17.254383+0000","last_clean":"2024-09-21T01:15:17.254383+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:15:17.254383+0000","last_undegraded":"2024-09-21T01:15:17.254383+0000","last_fullsized":"2024-09-21T01:15:17.254383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.257356+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:15:17.257356+0000","last_peered":"2024-09-21T01:15:17.257356+0000","last_clean":"2024-09-21T01:15:17.257356+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:15:17.257356+0000","last_undegraded":"2024-09-21T01:15:17.257356+0000","last_fullsized":"2024-09-21T01:15:17.257356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.263651+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:15:17.263651+0000","last_peered":"2024-09-21T01:15:17.263651+0000","last_clean":"2024-09-21T01:15:17.263651+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:15:17.263651+0000","last_undegraded":"2024-09-21T01:15:17.263651+0000","last_fullsized":"2024-09-21T01:15:17.263651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260630+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:15:17.260630+0000","last_peered":"2024-09-21T01:15:17.260630+0000","last_clean":"2024-09-21T01:15:17.260630+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:15:17.260630+0000","last_undegraded":"2024-09-21T01:15:17.260630+0000","last_fullsized":"2024-09-21T01:15:17.260630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249033+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:15:17.249033+0000","last_peered":"2024-09-21T01:15:17.249033+0000","last_clean":"2024-09-21T01:15:17.249033+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:15:17.249033+0000","last_undegraded":"2024-09-21T01:15:17.249033+0000","last_fullsized":"2024-09-21T01:15:17.249033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249434+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:15:17.249434+0000","last_peered":"2024-09-21T01:15:17.249434+0000","last_clean":"2024-09-21T01:15:17.249434+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:15:17.249434+0000","last_undegraded":"2024-09-21T01:15:17.249434+0000","last_fullsized":"2024-09-21T01:15:17.249434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.252528+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:15:17.252528+0000","last_peered":"2024-09-21T01:15:17.252528+0000","last_clean":"2024-09-21T01:15:17.252528+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:15:17.252528+0000","last_undegraded":"2024-09-21T01:15:17.252528+0000","last_fullsized":"2024-09-21T01:15:17.252528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.262296+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:15:17.262296+0000","last_peered":"2024-09-21T01:15:17.262296+0000","last_clean":"2024-09-21T01:15:17.262296+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:15:17.262296+0000","last_undegraded":"2024-09-21T01:15:17.262296+0000","last_fullsized":"2024-09-21T01:15:17.262296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264216+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:15:17.264216+0000","last_peered":"2024-09-21T01:15:17.264216+0000","last_clean":"2024-09-21T01:15:17.264216+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:15:17.264216+0000","last_undegraded":"2024-09-21T01:15:17.264216+0000","last_fullsized":"2024-09-21T01:15:17.264216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251734+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:15:17.251734+0000","last_peered":"2024-09-21T01:15:17.251734+0000","last_clean":"2024-09-21T01:15:17.251734+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:15:17.251734+0000","last_undegraded":"2024-09-21T01:15:17.251734+0000","last_fullsized":"2024-09-21T01:15:17.251734+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242434+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:15:17.242434+0000","last_peered":"2024-09-21T01:15:17.242434+0000","last_clean":"2024-09-21T01:15:17.242434+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:15:17.242434+0000","last_undegraded":"2024-09-21T01:15:17.242434+0000","last_fullsized":"2024-09-21T01:15:17.242434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250117+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:15:17.250117+0000","last_peered":"2024-09-21T01:15:17.250117+0000","last_clean":"2024-09-21T01:15:17.250117+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:15:17.250117+0000","last_undegraded":"2024-09-21T01:15:17.250117+0000","last_fullsized":"2024-09-21T01:15:17.250117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.246710+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:15:17.246710+0000","last_peered":"2024-09-21T01:15:17.246710+0000","last_clean":"2024-09-21T01:15:17.246710+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:15:17.246710+0000","last_undegraded":"2024-09-21T01:15:17.246710+0000","last_fullsized":"2024-09-21T01:15:17.246710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.245900+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:15:17.245900+0000","last_peered":"2024-09-21T01:15:17.245900+0000","last_clean":"2024-09-21T01:15:17.245900+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:15:17.245900+0000","last_undegraded":"2024-09-21T01:15:17.245900+0000","last_fullsized":"2024-09-21T01:15:17.245900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261834+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:15:17.261834+0000","last_peered":"2024-09-21T01:15:17.261834+0000","last_clean":"2024-09-21T01:15:17.261834+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:15:17.261834+0000","last_undegraded":"2024-09-21T01:15:17.261834+0000","last_fullsized":"2024-09-21T01:15:17.261834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260011+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:15:17.260011+0000","last_peered":"2024-09-21T01:15:17.260011+0000","last_clean":"2024-09-21T01:15:17.260011+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:15:17.260011+0000","last_undegraded":"2024-09-21T01:15:17.260011+0000","last_fullsized":"2024-09-21T01:15:17.260011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.258836+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:15:17.258836+0000","last_peered":"2024-09-21T01:15:17.258836+0000","last_clean":"2024-09-21T01:15:17.258836+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:15:17.258836+0000","last_undegraded":"2024-09-21T01:15:17.258836+0000","last_fullsized":"2024-09-21T01:15:17.258836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244432+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:15:17.244432+0000","last_peered":"2024-09-21T01:15:17.244432+0000","last_clean":"2024-09-21T01:15:17.244432+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:15:17.244432+0000","last_undegraded":"2024-09-21T01:15:17.244432+0000","last_fullsized":"2024-09-21T01:15:17.244432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.248382+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:15:17.248382+0000","last_peered":"2024-09-21T01:15:17.248382+0000","last_clean":"2024-09-21T01:15:17.248382+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:15:17.248382+0000","last_undegraded":"2024-09-21T01:15:17.248382+0000","last_fullsized":"2024-09-21T01:15:17.248382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244349+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:15:17.244349+0000","last_peered":"2024-09-21T01:15:17.244349+0000","last_clean":"2024-09-21T01:15:17.244349+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:15:17.244349+0000","last_undegraded":"2024-09-21T01:15:17.244349+0000","last_fullsized":"2024-09-21T01:15:17.244349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'7","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:52.817785+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:15:52.817785+0000","last_peered":"2024-09-21T01:15:52.817785+0000","last_clean":"2024-09-21T01:15:52.817785+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:15:52.817785+0000","last_undegraded":"2024-09-21T01:15:52.817785+0000","last_fullsized":"2024-09-21T01:15:52.817785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244048+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:15:17.244048+0000","last_peered":"2024-09-21T01:15:17.244048+0000","last_clean":"2024-09-21T01:15:17.244048+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:15:17.244048+0000","last_undegraded":"2024-09-21T01:15:17.244048+0000","last_fullsized":"2024-09-21T01:15:17.244048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251384+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:15:17.251384+0000","last_peered":"2024-09-21T01:15:17.251384+0000","last_clean":"2024-09-21T01:15:17.251384+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:15:17.251384+0000","last_undegraded":"2024-09-21T01:15:17.251384+0000","last_fullsized":"2024-09-21T01:15:17.251384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.246826+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:15:17.246826+0000","last_peered":"2024-09-21T01:15:17.246826+0000","last_clean":"2024-09-21T01:15:17.246826+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:15:17.246826+0000","last_undegraded":"2024-09-21T01:15:17.246826+0000","last_fullsized":"2024-09-21T01:15:17.246826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'6","reported_seq":261,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:57.824389+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:15:57.824389+0000","last_peered":"2024-09-21T01:15:57.824389+0000","last_clean":"2024-09-21T01:15:57.824389+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:15:57.824389+0000","last_undegraded":"2024-09-21T01:15:57.824389+0000","last_fullsized":"2024-09-21T01:15:57.824389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.265413+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:15:17.265413+0000","last_peered":"2024-09-21T01:15:17.265413+0000","last_clean":"2024-09-21T01:15:17.265413+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:15:17.265413+0000","last_undegraded":"2024-09-21T01:15:17.265413+0000","last_fullsized":"2024-09-21T01:15:17.265413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260696+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:15:17.260696+0000","last_peered":"2024-09-21T01:15:17.260696+0000","last_clean":"2024-09-21T01:15:17.260696+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:15:17.260696+0000","last_undegraded":"2024-09-21T01:15:17.260696+0000","last_fullsized":"2024-09-21T01:15:17.260696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264271+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:15:17.264271+0000","last_peered":"2024-09-21T01:15:17.264271+0000","last_clean":"2024-09-21T01:15:17.264271+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:15:17.264271+0000","last_undegraded":"2024-09-21T01:15:17.264271+0000","last_fullsized":"2024-09-21T01:15:17.264271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:57.823903+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:15:57.823903+0000","last_peered":"2024-09-21T01:15:57.823903+0000","last_clean":"2024-09-21T01:15:57.823903+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:15:57.823903+0000","last_undegraded":"2024-09-21T01:15:57.823903+0000","last_fullsized":"2024-09-21T01:15:57.823903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69734,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":188,"num_write":38,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242780+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:15:17.242780+0000","last_peered":"2024-09-21T01:15:17.242780+0000","last_clean":"2024-09-21T01:15:17.242780+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:15:17.242780+0000","last_undegraded":"2024-09-21T01:15:17.242780+0000","last_fullsized":"2024-09-21T01:15:17.242780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249428+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:15:17.249428+0000","last_peered":"2024-09-21T01:15:17.249428+0000","last_clean":"2024-09-21T01:15:17.249428+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:15:17.249428+0000","last_undegraded":"2024-09-21T01:15:17.249428+0000","last_fullsized":"2024-09-21T01:15:17.249428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.257920+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:15:17.257920+0000","last_peered":"2024-09-21T01:15:17.257920+0000","last_clean":"2024-09-21T01:15:17.257920+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:15:17.257920+0000","last_undegraded":"2024-09-21T01:15:17.257920+0000","last_fullsized":"2024-09-21T01:15:17.257920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:53.818205+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:15:53.818205+0000","last_peered":"2024-09-21T01:15:53.818205+0000","last_clean":"2024-09-21T01:15:53.818205+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:15:53.818205+0000","last_undegraded":"2024-09-21T01:15:53.818205+0000","last_fullsized":"2024-09-21T01:15:53.818205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254702+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:15:17.254702+0000","last_peered":"2024-09-21T01:15:17.254702+0000","last_clean":"2024-09-21T01:15:17.254702+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:15:17.254702+0000","last_undegraded":"2024-09-21T01:15:17.254702+0000","last_fullsized":"2024-09-21T01:15:17.254702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.235967+0000","last_change":"2024-09-21T01:14:18.747968+0000","last_active":"2024-09-21T01:15:17.235967+0000","last_peered":"2024-09-21T01:15:17.235967+0000","last_clean":"2024-09-21T01:15:17.235967+0000","last_became_active":"2024-09-21T01:14:18.747693+0000","last_became_peered":"2024-09-21T01:14:18.747693+0000","last_unstale":"2024-09-21T01:15:17.235967+0000","last_undegraded":"2024-09-21T01:15:17.235967+0000","last_fullsized":"2024-09-21T01:15:17.235967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:41.855089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250037+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:15:17.250037+0000","last_peered":"2024-09-21T01:15:17.250037+0000","last_clean":"2024-09-21T01:15:17.250037+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:15:17.250037+0000","last_undegraded":"2024-09-21T01:15:17.250037+0000","last_fullsized":"2024-09-21T01:15:17.250037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.252641+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:15:17.252641+0000","last_peered":"2024-09-21T01:15:17.252641+0000","last_clean":"2024-09-21T01:15:17.252641+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:15:17.252641+0000","last_undegraded":"2024-09-21T01:15:17.252641+0000","last_fullsized":"2024-09-21T01:15:17.252641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.255005+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:15:17.255005+0000","last_peered":"2024-09-21T01:15:17.255005+0000","last_clean":"2024-09-21T01:15:17.255005+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:15:17.255005+0000","last_undegraded":"2024-09-21T01:15:17.255005+0000","last_fullsized":"2024-09-21T01:15:17.255005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'7","reported_seq":150,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.852248+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:15:56.852248+0000","last_peered":"2024-09-21T01:15:56.852248+0000","last_clean":"2024-09-21T01:15:56.852248+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:15:56.852248+0000","last_undegraded":"2024-09-21T01:15:56.852248+0000","last_fullsized":"2024-09-21T01:15:56.852248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260937+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:15:17.260937+0000","last_peered":"2024-09-21T01:15:17.260937+0000","last_clean":"2024-09-21T01:15:17.260937+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:15:17.260937+0000","last_undegraded":"2024-09-21T01:15:17.260937+0000","last_fullsized":"2024-09-21T01:15:17.260937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928188+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928188+0000","last_peered":"2024-09-21T01:14:17.928188+0000","last_clean":"2024-09-21T01:14:17.928188+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928188+0000","last_undegraded":"2024-09-21T01:14:17.928188+0000","last_fullsized":"2024-09-21T01:14:17.928188+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684960+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684960+0000","last_peered":"2024-09-21T01:14:18.684960+0000","last_clean":"2024-09-21T01:14:18.684960+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684960+0000","last_undegraded":"2024-09-21T01:14:18.684960+0000","last_fullsized":"2024-09-21T01:14:18.684960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242996+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:15:17.242996+0000","last_peered":"2024-09-21T01:15:17.242996+0000","last_clean":"2024-09-21T01:15:17.242996+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:15:17.242996+0000","last_undegraded":"2024-09-21T01:15:17.242996+0000","last_fullsized":"2024-09-21T01:15:17.242996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751868+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751868+0000","last_peered":"2024-09-21T01:14:18.751868+0000","last_clean":"2024-09-21T01:14:18.751868+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751868+0000","last_undegraded":"2024-09-21T01:14:18.751868+0000","last_fullsized":"2024-09-21T01:14:18.751868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.241017+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:15:17.241017+0000","last_peered":"2024-09-21T01:15:17.241017+0000","last_clean":"2024-09-21T01:15:17.241017+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:15:17.241017+0000","last_undegraded":"2024-09-21T01:15:17.241017+0000","last_fullsized":"2024-09-21T01:15:17.241017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:55.820204+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:15:55.820204+0000","last_peered":"2024-09-21T01:15:55.820204+0000","last_clean":"2024-09-21T01:15:55.820204+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:15:55.820204+0000","last_undegraded":"2024-09-21T01:15:55.820204+0000","last_fullsized":"2024-09-21T01:15:55.820204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.247331+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:15:17.247331+0000","last_peered":"2024-09-21T01:15:17.247331+0000","last_clean":"2024-09-21T01:15:17.247331+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:15:17.247331+0000","last_undegraded":"2024-09-21T01:15:17.247331+0000","last_fullsized":"2024-09-21T01:15:17.247331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'6","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.822556+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:15:56.822556+0000","last_peered":"2024-09-21T01:15:56.822556+0000","last_clean":"2024-09-21T01:15:56.822556+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:15:56.822556+0000","last_undegraded":"2024-09-21T01:15:56.822556+0000","last_fullsized":"2024-09-21T01:15:56.822556+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253323+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:15:17.253323+0000","last_peered":"2024-09-21T01:15:17.253323+0000","last_clean":"2024-09-21T01:15:17.253323+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:15:17.253323+0000","last_undegraded":"2024-09-21T01:15:17.253323+0000","last_fullsized":"2024-09-21T01:15:17.253323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.929309+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.929309+0000","last_peered":"2024-09-21T01:14:17.929309+0000","last_clean":"2024-09-21T01:14:17.929309+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.929309+0000","last_undegraded":"2024-09-21T01:14:17.929309+0000","last_fullsized":"2024-09-21T01:14:17.929309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.243783+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:15:17.243783+0000","last_peered":"2024-09-21T01:15:17.243783+0000","last_clean":"2024-09-21T01:15:17.243783+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:15:17.243783+0000","last_undegraded":"2024-09-21T01:15:17.243783+0000","last_fullsized":"2024-09-21T01:15:17.243783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931464+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931464+0000","last_peered":"2024-09-21T01:14:17.931464+0000","last_clean":"2024-09-21T01:14:17.931464+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931464+0000","last_undegraded":"2024-09-21T01:14:17.931464+0000","last_fullsized":"2024-09-21T01:14:17.931464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244780+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:15:17.244780+0000","last_peered":"2024-09-21T01:15:17.244780+0000","last_clean":"2024-09-21T01:15:17.244780+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:15:17.244780+0000","last_undegraded":"2024-09-21T01:15:17.244780+0000","last_fullsized":"2024-09-21T01:15:17.244780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'16","reported_seq":40,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:55.581948+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:15:55.581948+0000","last_peered":"2024-09-21T01:15:55.581948+0000","last_clean":"2024-09-21T01:15:55.581948+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:15:55.581948+0000","last_undegraded":"2024-09-21T01:15:55.581948+0000","last_fullsized":"2024-09-21T01:15:55.581948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251511+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:15:17.251511+0000","last_peered":"2024-09-21T01:15:17.251511+0000","last_clean":"2024-09-21T01:15:17.251511+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:15:17.251511+0000","last_undegraded":"2024-09-21T01:15:17.251511+0000","last_fullsized":"2024-09-21T01:15:17.251511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261683+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:15:17.261683+0000","last_peered":"2024-09-21T01:15:17.261683+0000","last_clean":"2024-09-21T01:15:17.261683+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:15:17.261683+0000","last_undegraded":"2024-09-21T01:15:17.261683+0000","last_fullsized":"2024-09-21T01:15:17.261683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.206332+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:15:17.206332+0000","last_peered":"2024-09-21T01:15:17.206332+0000","last_clean":"2024-09-21T01:15:17.206332+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:15:17.206332+0000","last_undegraded":"2024-09-21T01:15:17.206332+0000","last_fullsized":"2024-09-21T01:15:17.206332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921790+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:17.921790+0000","last_peered":"2024-09-21T01:14:17.921790+0000","last_clean":"2024-09-21T01:14:17.921790+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:17.921790+0000","last_undegraded":"2024-09-21T01:14:17.921790+0000","last_fullsized":"2024-09-21T01:14:17.921790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251798+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:15:17.251798+0000","last_peered":"2024-09-21T01:15:17.251798+0000","last_clean":"2024-09-21T01:15:17.251798+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:15:17.251798+0000","last_undegraded":"2024-09-21T01:15:17.251798+0000","last_fullsized":"2024-09-21T01:15:17.251798+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922194+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.922194+0000","last_peered":"2024-09-21T01:14:17.922194+0000","last_clean":"2024-09-21T01:14:17.922194+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.922194+0000","last_undegraded":"2024-09-21T01:14:17.922194+0000","last_fullsized":"2024-09-21T01:14:17.922194+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254673+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:15:17.254673+0000","last_peered":"2024-09-21T01:15:17.254673+0000","last_clean":"2024-09-21T01:15:17.254673+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:15:17.254673+0000","last_undegraded":"2024-09-21T01:15:17.254673+0000","last_fullsized":"2024-09-21T01:15:17.254673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.262185+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:15:17.262185+0000","last_peered":"2024-09-21T01:15:17.262185+0000","last_clean":"2024-09-21T01:15:17.262185+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:15:17.262185+0000","last_undegraded":"2024-09-21T01:15:17.262185+0000","last_fullsized":"2024-09-21T01:15:17.262185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.259428+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:15:17.259428+0000","last_peered":"2024-09-21T01:15:17.259428+0000","last_clean":"2024-09-21T01:15:17.259428+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:15:17.259428+0000","last_undegraded":"2024-09-21T01:15:17.259428+0000","last_fullsized":"2024-09-21T01:15:17.259428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264980+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:15:17.264980+0000","last_peered":"2024-09-21T01:15:17.264980+0000","last_clean":"2024-09-21T01:15:17.264980+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:15:17.264980+0000","last_undegraded":"2024-09-21T01:15:17.264980+0000","last_fullsized":"2024-09-21T01:15:17.264980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'13","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931354+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931354+0000","last_peered":"2024-09-21T01:14:17.931354+0000","last_clean":"2024-09-21T01:14:17.931354+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931354+0000","last_undegraded":"2024-09-21T01:14:17.931354+0000","last_fullsized":"2024-09-21T01:14:17.931354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261447+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:15:17.261447+0000","last_peered":"2024-09-21T01:15:17.261447+0000","last_clean":"2024-09-21T01:15:17.261447+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:15:17.261447+0000","last_undegraded":"2024-09-21T01:15:17.261447+0000","last_fullsized":"2024-09-21T01:15:17.261447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922386+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:17.922386+0000","last_peered":"2024-09-21T01:14:17.922386+0000","last_clean":"2024-09-21T01:14:17.922386+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:17.922386+0000","last_undegraded":"2024-09-21T01:14:17.922386+0000","last_fullsized":"2024-09-21T01:14:17.922386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251577+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:15:17.251577+0000","last_peered":"2024-09-21T01:15:17.251577+0000","last_clean":"2024-09-21T01:15:17.251577+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:15:17.251577+0000","last_undegraded":"2024-09-21T01:15:17.251577+0000","last_fullsized":"2024-09-21T01:15:17.251577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'14","reported_seq":155,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.822047+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:15:56.822047+0000","last_peered":"2024-09-21T01:15:56.822047+0000","last_clean":"2024-09-21T01:15:56.822047+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:15:56.822047+0000","last_undegraded":"2024-09-21T01:15:56.822047+0000","last_fullsized":"2024-09-21T01:15:56.822047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1196,"num_read_kb":685,"num_write":259,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":232584,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":401373,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1061536,"data_compressed":43544,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":400820,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332151,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":401081,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495676,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":994048,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":400728,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855429,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":993418,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018954,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":400128,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":472283,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":471375,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":402291,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71794,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":72702,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":71470,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:15:59.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:15:59.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:15:59 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1914317782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:59.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:15:59 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1914317782' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2464764646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20109450 msgr2=0x7fcd2010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2464764646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20109450 0x7fcd2010b8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009ca0 tx=0x7fcd1802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2464764646 shutdown_connections 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2464764646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20109450 0x7fcd2010b8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2464764646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd20106af0 0x7fcd20108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2464764646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20101a60 0x7fcd20101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.945+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2464764646 >> 172.21.15.37:0/2464764646 conn(0x7fcd200fd660 msgr2=0x7fcd200ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:15:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.946+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2464764646 shutdown_connections 2024-09-21T01:15:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.946+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2464764646 wait complete. 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.946+0000 7fcd24c9b640 1 Processor -- start 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.946+0000 7fcd24c9b640 1 -- start start 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 0x7fcd20199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20106af0 0x7fcd2019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd20109450 0x7fcd2019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010f2d0 con 0x7fcd20101a60 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010f150 con 0x7fcd20109450 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010f450 con 0x7fcd20106af0 2024-09-21T01:15:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 0x7fcd20199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 0x7fcd20199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56284/0 (socket says 172.21.15.37:56284) 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 -- 172.21.15.37:0/2451733089 learned_addr learned my addr 172.21.15.37:0/2451733089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1dd9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20106af0 0x7fcd2019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1ed9d640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd20109450 0x7fcd2019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 -- 172.21.15.37:0/2451733089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20106af0 msgr2=0x7fcd2019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20106af0 0x7fcd2019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 -- 172.21.15.37:0/2451733089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd20109450 msgr2=0x7fcd2019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd20109450 0x7fcd2019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 -- 172.21.15.37:0/2451733089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2019b900 con 0x7fcd20101a60 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1dd9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20106af0 0x7fcd2019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd1e59c640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 0x7fcd20199ec0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c890 tx=0x7fcd1000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10004220 con 0x7fcd20101a60 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd100043c0 con 0x7fcd20101a60 2024-09-21T01:15:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10004a00 con 0x7fcd20101a60 2024-09-21T01:15:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.947+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2019bbf0 con 0x7fcd20101a60 2024-09-21T01:15:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.948+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd201a22e0 con 0x7fcd20101a60 2024-09-21T01:15:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.949+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd200ff180 con 0x7fcd20101a60 2024-09-21T01:15:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.952+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcd100079b0 con 0x7fcd20101a60 2024-09-21T01:15:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.952+0000 7fcd0f7fe640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd080b6510 0x7fcd080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:15:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.953+0000 7fcd1dd9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd080b6510 0x7fcd080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:15:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.953+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fcd100e7550 con 0x7fcd20101a60 2024-09-21T01:15:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.953+0000 7fcd1dd9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd080b6510 0x7fcd080b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd140058c0 tx=0x7fcd14005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:15:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:15:59.956+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd10014030 con 0x7fcd20101a60 2024-09-21T01:16:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.140+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd20063800 con 0x7fcd080b6510 2024-09-21T01:16:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.144+0000 7fcd0f7fe640 1 -- 172.21.15.37:0/2451733089 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259179 (secure 0 0 0) 0x7fcd20063800 con 0x7fcd080b6510 2024-09-21T01:16:00.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:16:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd080b6510 msgr2=0x7fcd080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd080b6510 0x7fcd080b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd140058c0 tx=0x7fcd14005850 comp rx=0 tx=0).stop 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 msgr2=0x7fcd20199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 0x7fcd20199ec0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c890 tx=0x7fcd1000cd50 comp rx=0 tx=0).stop 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 shutdown_connections 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcd080b6510 0x7fcd080b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd20109450 0x7fcd2019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd20106af0 0x7fcd2019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 --2- 172.21.15.37:0/2451733089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd20101a60 0x7fcd20199ec0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 >> 172.21.15.37:0/2451733089 conn(0x7fcd200fd660 msgr2=0x7fcd201078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 shutdown_connections 2024-09-21T01:16:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.148+0000 7fcd24c9b640 1 -- 172.21.15.37:0/2451733089 wait complete. 2024-09-21T01:16:00.159 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-21T01:15:58.883066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668130,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1272,"num_read_kb":749,"num_write":384,"num_write_kb":2309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376172,"kb_used_data":10284,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565652,"statfs":{"total":1151940427776,"available":1151555227648,"internally_reserved":0,"allocated":10530816,"data_stored":6799362,"data_compressed":182481,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4965,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":76,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003125"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260430+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:15:17.260430+0000","last_peered":"2024-09-21T01:15:17.260430+0000","last_clean":"2024-09-21T01:15:17.260430+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:15:17.260430+0000","last_undegraded":"2024-09-21T01:15:17.260430+0000","last_fullsized":"2024-09-21T01:15:17.260430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.255604+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:15:17.255604+0000","last_peered":"2024-09-21T01:15:17.255604+0000","last_clean":"2024-09-21T01:15:17.255604+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:15:17.255604+0000","last_undegraded":"2024-09-21T01:15:17.255604+0000","last_fullsized":"2024-09-21T01:15:17.255604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.259569+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:15:17.259569+0000","last_peered":"2024-09-21T01:15:17.259569+0000","last_clean":"2024-09-21T01:15:17.259569+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:15:17.259569+0000","last_undegraded":"2024-09-21T01:15:17.259569+0000","last_fullsized":"2024-09-21T01:15:17.259569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.248568+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:15:17.248568+0000","last_peered":"2024-09-21T01:15:17.248568+0000","last_clean":"2024-09-21T01:15:17.248568+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:15:17.248568+0000","last_undegraded":"2024-09-21T01:15:17.248568+0000","last_fullsized":"2024-09-21T01:15:17.248568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.228328+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:15:17.228328+0000","last_peered":"2024-09-21T01:15:17.228328+0000","last_clean":"2024-09-21T01:15:17.228328+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:15:17.228328+0000","last_undegraded":"2024-09-21T01:15:17.228328+0000","last_fullsized":"2024-09-21T01:15:17.228328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250795+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:15:17.250795+0000","last_peered":"2024-09-21T01:15:17.250795+0000","last_clean":"2024-09-21T01:15:17.250795+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:15:17.250795+0000","last_undegraded":"2024-09-21T01:15:17.250795+0000","last_fullsized":"2024-09-21T01:15:17.250795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253863+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:15:17.253863+0000","last_peered":"2024-09-21T01:15:17.253863+0000","last_clean":"2024-09-21T01:15:17.253863+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:15:17.253863+0000","last_undegraded":"2024-09-21T01:15:17.253863+0000","last_fullsized":"2024-09-21T01:15:17.253863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251013+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:15:17.251013+0000","last_peered":"2024-09-21T01:15:17.251013+0000","last_clean":"2024-09-21T01:15:17.251013+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:15:17.251013+0000","last_undegraded":"2024-09-21T01:15:17.251013+0000","last_fullsized":"2024-09-21T01:15:17.251013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.263715+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:15:17.263715+0000","last_peered":"2024-09-21T01:15:17.263715+0000","last_clean":"2024-09-21T01:15:17.263715+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:15:17.263715+0000","last_undegraded":"2024-09-21T01:15:17.263715+0000","last_fullsized":"2024-09-21T01:15:17.263715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.247960+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:15:17.247960+0000","last_peered":"2024-09-21T01:15:17.247960+0000","last_clean":"2024-09-21T01:15:17.247960+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:15:17.247960+0000","last_undegraded":"2024-09-21T01:15:17.247960+0000","last_fullsized":"2024-09-21T01:15:17.247960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260411+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:15:17.260411+0000","last_peered":"2024-09-21T01:15:17.260411+0000","last_clean":"2024-09-21T01:15:17.260411+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:15:17.260411+0000","last_undegraded":"2024-09-21T01:15:17.260411+0000","last_fullsized":"2024-09-21T01:15:17.260411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251061+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:15:17.251061+0000","last_peered":"2024-09-21T01:15:17.251061+0000","last_clean":"2024-09-21T01:15:17.251061+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:15:17.251061+0000","last_undegraded":"2024-09-21T01:15:17.251061+0000","last_fullsized":"2024-09-21T01:15:17.251061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253108+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:15:17.253108+0000","last_peered":"2024-09-21T01:15:17.253108+0000","last_clean":"2024-09-21T01:15:17.253108+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:15:17.253108+0000","last_undegraded":"2024-09-21T01:15:17.253108+0000","last_fullsized":"2024-09-21T01:15:17.253108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254383+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:15:17.254383+0000","last_peered":"2024-09-21T01:15:17.254383+0000","last_clean":"2024-09-21T01:15:17.254383+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:15:17.254383+0000","last_undegraded":"2024-09-21T01:15:17.254383+0000","last_fullsized":"2024-09-21T01:15:17.254383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.257356+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:15:17.257356+0000","last_peered":"2024-09-21T01:15:17.257356+0000","last_clean":"2024-09-21T01:15:17.257356+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:15:17.257356+0000","last_undegraded":"2024-09-21T01:15:17.257356+0000","last_fullsized":"2024-09-21T01:15:17.257356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.263651+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:15:17.263651+0000","last_peered":"2024-09-21T01:15:17.263651+0000","last_clean":"2024-09-21T01:15:17.263651+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:15:17.263651+0000","last_undegraded":"2024-09-21T01:15:17.263651+0000","last_fullsized":"2024-09-21T01:15:17.263651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260630+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:15:17.260630+0000","last_peered":"2024-09-21T01:15:17.260630+0000","last_clean":"2024-09-21T01:15:17.260630+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:15:17.260630+0000","last_undegraded":"2024-09-21T01:15:17.260630+0000","last_fullsized":"2024-09-21T01:15:17.260630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249033+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:15:17.249033+0000","last_peered":"2024-09-21T01:15:17.249033+0000","last_clean":"2024-09-21T01:15:17.249033+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:15:17.249033+0000","last_undegraded":"2024-09-21T01:15:17.249033+0000","last_fullsized":"2024-09-21T01:15:17.249033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249434+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:15:17.249434+0000","last_peered":"2024-09-21T01:15:17.249434+0000","last_clean":"2024-09-21T01:15:17.249434+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:15:17.249434+0000","last_undegraded":"2024-09-21T01:15:17.249434+0000","last_fullsized":"2024-09-21T01:15:17.249434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.252528+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:15:17.252528+0000","last_peered":"2024-09-21T01:15:17.252528+0000","last_clean":"2024-09-21T01:15:17.252528+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:15:17.252528+0000","last_undegraded":"2024-09-21T01:15:17.252528+0000","last_fullsized":"2024-09-21T01:15:17.252528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.262296+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:15:17.262296+0000","last_peered":"2024-09-21T01:15:17.262296+0000","last_clean":"2024-09-21T01:15:17.262296+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:15:17.262296+0000","last_undegraded":"2024-09-21T01:15:17.262296+0000","last_fullsized":"2024-09-21T01:15:17.262296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264216+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:15:17.264216+0000","last_peered":"2024-09-21T01:15:17.264216+0000","last_clean":"2024-09-21T01:15:17.264216+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:15:17.264216+0000","last_undegraded":"2024-09-21T01:15:17.264216+0000","last_fullsized":"2024-09-21T01:15:17.264216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251734+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:15:17.251734+0000","last_peered":"2024-09-21T01:15:17.251734+0000","last_clean":"2024-09-21T01:15:17.251734+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:15:17.251734+0000","last_undegraded":"2024-09-21T01:15:17.251734+0000","last_fullsized":"2024-09-21T01:15:17.251734+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242434+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:15:17.242434+0000","last_peered":"2024-09-21T01:15:17.242434+0000","last_clean":"2024-09-21T01:15:17.242434+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:15:17.242434+0000","last_undegraded":"2024-09-21T01:15:17.242434+0000","last_fullsized":"2024-09-21T01:15:17.242434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250117+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:15:17.250117+0000","last_peered":"2024-09-21T01:15:17.250117+0000","last_clean":"2024-09-21T01:15:17.250117+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:15:17.250117+0000","last_undegraded":"2024-09-21T01:15:17.250117+0000","last_fullsized":"2024-09-21T01:15:17.250117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.246710+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:15:17.246710+0000","last_peered":"2024-09-21T01:15:17.246710+0000","last_clean":"2024-09-21T01:15:17.246710+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:15:17.246710+0000","last_undegraded":"2024-09-21T01:15:17.246710+0000","last_fullsized":"2024-09-21T01:15:17.246710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.245900+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:15:17.245900+0000","last_peered":"2024-09-21T01:15:17.245900+0000","last_clean":"2024-09-21T01:15:17.245900+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:15:17.245900+0000","last_undegraded":"2024-09-21T01:15:17.245900+0000","last_fullsized":"2024-09-21T01:15:17.245900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261834+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:15:17.261834+0000","last_peered":"2024-09-21T01:15:17.261834+0000","last_clean":"2024-09-21T01:15:17.261834+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:15:17.261834+0000","last_undegraded":"2024-09-21T01:15:17.261834+0000","last_fullsized":"2024-09-21T01:15:17.261834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260011+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:15:17.260011+0000","last_peered":"2024-09-21T01:15:17.260011+0000","last_clean":"2024-09-21T01:15:17.260011+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:15:17.260011+0000","last_undegraded":"2024-09-21T01:15:17.260011+0000","last_fullsized":"2024-09-21T01:15:17.260011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.258836+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:15:17.258836+0000","last_peered":"2024-09-21T01:15:17.258836+0000","last_clean":"2024-09-21T01:15:17.258836+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:15:17.258836+0000","last_undegraded":"2024-09-21T01:15:17.258836+0000","last_fullsized":"2024-09-21T01:15:17.258836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244432+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:15:17.244432+0000","last_peered":"2024-09-21T01:15:17.244432+0000","last_clean":"2024-09-21T01:15:17.244432+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:15:17.244432+0000","last_undegraded":"2024-09-21T01:15:17.244432+0000","last_fullsized":"2024-09-21T01:15:17.244432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.248382+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:15:17.248382+0000","last_peered":"2024-09-21T01:15:17.248382+0000","last_clean":"2024-09-21T01:15:17.248382+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:15:17.248382+0000","last_undegraded":"2024-09-21T01:15:17.248382+0000","last_fullsized":"2024-09-21T01:15:17.248382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244349+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:15:17.244349+0000","last_peered":"2024-09-21T01:15:17.244349+0000","last_clean":"2024-09-21T01:15:17.244349+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:15:17.244349+0000","last_undegraded":"2024-09-21T01:15:17.244349+0000","last_fullsized":"2024-09-21T01:15:17.244349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'7","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:52.817785+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:15:52.817785+0000","last_peered":"2024-09-21T01:15:52.817785+0000","last_clean":"2024-09-21T01:15:52.817785+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:15:52.817785+0000","last_undegraded":"2024-09-21T01:15:52.817785+0000","last_fullsized":"2024-09-21T01:15:52.817785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244048+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:15:17.244048+0000","last_peered":"2024-09-21T01:15:17.244048+0000","last_clean":"2024-09-21T01:15:17.244048+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:15:17.244048+0000","last_undegraded":"2024-09-21T01:15:17.244048+0000","last_fullsized":"2024-09-21T01:15:17.244048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251384+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:15:17.251384+0000","last_peered":"2024-09-21T01:15:17.251384+0000","last_clean":"2024-09-21T01:15:17.251384+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:15:17.251384+0000","last_undegraded":"2024-09-21T01:15:17.251384+0000","last_fullsized":"2024-09-21T01:15:17.251384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.246826+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:15:17.246826+0000","last_peered":"2024-09-21T01:15:17.246826+0000","last_clean":"2024-09-21T01:15:17.246826+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:15:17.246826+0000","last_undegraded":"2024-09-21T01:15:17.246826+0000","last_fullsized":"2024-09-21T01:15:17.246826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'6","reported_seq":261,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:57.824389+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:15:57.824389+0000","last_peered":"2024-09-21T01:15:57.824389+0000","last_clean":"2024-09-21T01:15:57.824389+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:15:57.824389+0000","last_undegraded":"2024-09-21T01:15:57.824389+0000","last_fullsized":"2024-09-21T01:15:57.824389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.265413+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:15:17.265413+0000","last_peered":"2024-09-21T01:15:17.265413+0000","last_clean":"2024-09-21T01:15:17.265413+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:15:17.265413+0000","last_undegraded":"2024-09-21T01:15:17.265413+0000","last_fullsized":"2024-09-21T01:15:17.265413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260696+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:15:17.260696+0000","last_peered":"2024-09-21T01:15:17.260696+0000","last_clean":"2024-09-21T01:15:17.260696+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:15:17.260696+0000","last_undegraded":"2024-09-21T01:15:17.260696+0000","last_fullsized":"2024-09-21T01:15:17.260696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264271+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:15:17.264271+0000","last_peered":"2024-09-21T01:15:17.264271+0000","last_clean":"2024-09-21T01:15:17.264271+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:15:17.264271+0000","last_undegraded":"2024-09-21T01:15:17.264271+0000","last_fullsized":"2024-09-21T01:15:17.264271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:57.823903+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:15:57.823903+0000","last_peered":"2024-09-21T01:15:57.823903+0000","last_clean":"2024-09-21T01:15:57.823903+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:15:57.823903+0000","last_undegraded":"2024-09-21T01:15:57.823903+0000","last_fullsized":"2024-09-21T01:15:57.823903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69734,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":188,"num_write":38,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242780+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:15:17.242780+0000","last_peered":"2024-09-21T01:15:17.242780+0000","last_clean":"2024-09-21T01:15:17.242780+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:15:17.242780+0000","last_undegraded":"2024-09-21T01:15:17.242780+0000","last_fullsized":"2024-09-21T01:15:17.242780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249428+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:15:17.249428+0000","last_peered":"2024-09-21T01:15:17.249428+0000","last_clean":"2024-09-21T01:15:17.249428+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:15:17.249428+0000","last_undegraded":"2024-09-21T01:15:17.249428+0000","last_fullsized":"2024-09-21T01:15:17.249428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.257920+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:15:17.257920+0000","last_peered":"2024-09-21T01:15:17.257920+0000","last_clean":"2024-09-21T01:15:17.257920+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:15:17.257920+0000","last_undegraded":"2024-09-21T01:15:17.257920+0000","last_fullsized":"2024-09-21T01:15:17.257920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:53.818205+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:15:53.818205+0000","last_peered":"2024-09-21T01:15:53.818205+0000","last_clean":"2024-09-21T01:15:53.818205+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:15:53.818205+0000","last_undegraded":"2024-09-21T01:15:53.818205+0000","last_fullsized":"2024-09-21T01:15:53.818205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254702+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:15:17.254702+0000","last_peered":"2024-09-21T01:15:17.254702+0000","last_clean":"2024-09-21T01:15:17.254702+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:15:17.254702+0000","last_undegraded":"2024-09-21T01:15:17.254702+0000","last_fullsized":"2024-09-21T01:15:17.254702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.235967+0000","last_change":"2024-09-21T01:14:18.747968+0000","last_active":"2024-09-21T01:15:17.235967+0000","last_peered":"2024-09-21T01:15:17.235967+0000","last_clean":"2024-09-21T01:15:17.235967+0000","last_became_active":"2024-09-21T01:14:18.747693+0000","last_became_peered":"2024-09-21T01:14:18.747693+0000","last_unstale":"2024-09-21T01:15:17.235967+0000","last_undegraded":"2024-09-21T01:15:17.235967+0000","last_fullsized":"2024-09-21T01:15:17.235967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:41.855089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250037+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:15:17.250037+0000","last_peered":"2024-09-21T01:15:17.250037+0000","last_clean":"2024-09-21T01:15:17.250037+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:15:17.250037+0000","last_undegraded":"2024-09-21T01:15:17.250037+0000","last_fullsized":"2024-09-21T01:15:17.250037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.252641+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:15:17.252641+0000","last_peered":"2024-09-21T01:15:17.252641+0000","last_clean":"2024-09-21T01:15:17.252641+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:15:17.252641+0000","last_undegraded":"2024-09-21T01:15:17.252641+0000","last_fullsized":"2024-09-21T01:15:17.252641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.255005+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:15:17.255005+0000","last_peered":"2024-09-21T01:15:17.255005+0000","last_clean":"2024-09-21T01:15:17.255005+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:15:17.255005+0000","last_undegraded":"2024-09-21T01:15:17.255005+0000","last_fullsized":"2024-09-21T01:15:17.255005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'7","reported_seq":150,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.852248+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:15:56.852248+0000","last_peered":"2024-09-21T01:15:56.852248+0000","last_clean":"2024-09-21T01:15:56.852248+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:15:56.852248+0000","last_undegraded":"2024-09-21T01:15:56.852248+0000","last_fullsized":"2024-09-21T01:15:56.852248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260937+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:15:17.260937+0000","last_peered":"2024-09-21T01:15:17.260937+0000","last_clean":"2024-09-21T01:15:17.260937+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:15:17.260937+0000","last_undegraded":"2024-09-21T01:15:17.260937+0000","last_fullsized":"2024-09-21T01:15:17.260937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928188+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928188+0000","last_peered":"2024-09-21T01:14:17.928188+0000","last_clean":"2024-09-21T01:14:17.928188+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928188+0000","last_undegraded":"2024-09-21T01:14:17.928188+0000","last_fullsized":"2024-09-21T01:14:17.928188+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684960+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684960+0000","last_peered":"2024-09-21T01:14:18.684960+0000","last_clean":"2024-09-21T01:14:18.684960+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684960+0000","last_undegraded":"2024-09-21T01:14:18.684960+0000","last_fullsized":"2024-09-21T01:14:18.684960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242996+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:15:17.242996+0000","last_peered":"2024-09-21T01:15:17.242996+0000","last_clean":"2024-09-21T01:15:17.242996+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:15:17.242996+0000","last_undegraded":"2024-09-21T01:15:17.242996+0000","last_fullsized":"2024-09-21T01:15:17.242996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751868+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751868+0000","last_peered":"2024-09-21T01:14:18.751868+0000","last_clean":"2024-09-21T01:14:18.751868+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751868+0000","last_undegraded":"2024-09-21T01:14:18.751868+0000","last_fullsized":"2024-09-21T01:14:18.751868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.241017+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:15:17.241017+0000","last_peered":"2024-09-21T01:15:17.241017+0000","last_clean":"2024-09-21T01:15:17.241017+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:15:17.241017+0000","last_undegraded":"2024-09-21T01:15:17.241017+0000","last_fullsized":"2024-09-21T01:15:17.241017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:55.820204+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:15:55.820204+0000","last_peered":"2024-09-21T01:15:55.820204+0000","last_clean":"2024-09-21T01:15:55.820204+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:15:55.820204+0000","last_undegraded":"2024-09-21T01:15:55.820204+0000","last_fullsized":"2024-09-21T01:15:55.820204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.247331+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:15:17.247331+0000","last_peered":"2024-09-21T01:15:17.247331+0000","last_clean":"2024-09-21T01:15:17.247331+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:15:17.247331+0000","last_undegraded":"2024-09-21T01:15:17.247331+0000","last_fullsized":"2024-09-21T01:15:17.247331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'6","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.822556+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:15:56.822556+0000","last_peered":"2024-09-21T01:15:56.822556+0000","last_clean":"2024-09-21T01:15:56.822556+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:15:56.822556+0000","last_undegraded":"2024-09-21T01:15:56.822556+0000","last_fullsized":"2024-09-21T01:15:56.822556+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253323+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:15:17.253323+0000","last_peered":"2024-09-21T01:15:17.253323+0000","last_clean":"2024-09-21T01:15:17.253323+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:15:17.253323+0000","last_undegraded":"2024-09-21T01:15:17.253323+0000","last_fullsized":"2024-09-21T01:15:17.253323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.929309+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.929309+0000","last_peered":"2024-09-21T01:14:17.929309+0000","last_clean":"2024-09-21T01:14:17.929309+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.929309+0000","last_undegraded":"2024-09-21T01:14:17.929309+0000","last_fullsized":"2024-09-21T01:14:17.929309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.243783+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:15:17.243783+0000","last_peered":"2024-09-21T01:15:17.243783+0000","last_clean":"2024-09-21T01:15:17.243783+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:15:17.243783+0000","last_undegraded":"2024-09-21T01:15:17.243783+0000","last_fullsized":"2024-09-21T01:15:17.243783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931464+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931464+0000","last_peered":"2024-09-21T01:14:17.931464+0000","last_clean":"2024-09-21T01:14:17.931464+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931464+0000","last_undegraded":"2024-09-21T01:14:17.931464+0000","last_fullsized":"2024-09-21T01:14:17.931464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244780+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:15:17.244780+0000","last_peered":"2024-09-21T01:15:17.244780+0000","last_clean":"2024-09-21T01:15:17.244780+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:15:17.244780+0000","last_undegraded":"2024-09-21T01:15:17.244780+0000","last_fullsized":"2024-09-21T01:15:17.244780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'16","reported_seq":40,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:55.581948+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:15:55.581948+0000","last_peered":"2024-09-21T01:15:55.581948+0000","last_clean":"2024-09-21T01:15:55.581948+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:15:55.581948+0000","last_undegraded":"2024-09-21T01:15:55.581948+0000","last_fullsized":"2024-09-21T01:15:55.581948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251511+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:15:17.251511+0000","last_peered":"2024-09-21T01:15:17.251511+0000","last_clean":"2024-09-21T01:15:17.251511+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:15:17.251511+0000","last_undegraded":"2024-09-21T01:15:17.251511+0000","last_fullsized":"2024-09-21T01:15:17.251511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261683+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:15:17.261683+0000","last_peered":"2024-09-21T01:15:17.261683+0000","last_clean":"2024-09-21T01:15:17.261683+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:15:17.261683+0000","last_undegraded":"2024-09-21T01:15:17.261683+0000","last_fullsized":"2024-09-21T01:15:17.261683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.206332+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:15:17.206332+0000","last_peered":"2024-09-21T01:15:17.206332+0000","last_clean":"2024-09-21T01:15:17.206332+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:15:17.206332+0000","last_undegraded":"2024-09-21T01:15:17.206332+0000","last_fullsized":"2024-09-21T01:15:17.206332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921790+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:17.921790+0000","last_peered":"2024-09-21T01:14:17.921790+0000","last_clean":"2024-09-21T01:14:17.921790+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:17.921790+0000","last_undegraded":"2024-09-21T01:14:17.921790+0000","last_fullsized":"2024-09-21T01:14:17.921790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251798+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:15:17.251798+0000","last_peered":"2024-09-21T01:15:17.251798+0000","last_clean":"2024-09-21T01:15:17.251798+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:15:17.251798+0000","last_undegraded":"2024-09-21T01:15:17.251798+0000","last_fullsized":"2024-09-21T01:15:17.251798+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922194+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.922194+0000","last_peered":"2024-09-21T01:14:17.922194+0000","last_clean":"2024-09-21T01:14:17.922194+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.922194+0000","last_undegraded":"2024-09-21T01:14:17.922194+0000","last_fullsized":"2024-09-21T01:14:17.922194+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254673+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:15:17.254673+0000","last_peered":"2024-09-21T01:15:17.254673+0000","last_clean":"2024-09-21T01:15:17.254673+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:15:17.254673+0000","last_undegraded":"2024-09-21T01:15:17.254673+0000","last_fullsized":"2024-09-21T01:15:17.254673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.262185+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:15:17.262185+0000","last_peered":"2024-09-21T01:15:17.262185+0000","last_clean":"2024-09-21T01:15:17.262185+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:15:17.262185+0000","last_undegraded":"2024-09-21T01:15:17.262185+0000","last_fullsized":"2024-09-21T01:15:17.262185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.259428+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:15:17.259428+0000","last_peered":"2024-09-21T01:15:17.259428+0000","last_clean":"2024-09-21T01:15:17.259428+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:15:17.259428+0000","last_undegraded":"2024-09-21T01:15:17.259428+0000","last_fullsized":"2024-09-21T01:15:17.259428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264980+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:15:17.264980+0000","last_peered":"2024-09-21T01:15:17.264980+0000","last_clean":"2024-09-21T01:15:17.264980+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:15:17.264980+0000","last_undegraded":"2024-09-21T01:15:17.264980+0000","last_fullsized":"2024-09-21T01:15:17.264980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'13","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931354+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931354+0000","last_peered":"2024-09-21T01:14:17.931354+0000","last_clean":"2024-09-21T01:14:17.931354+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931354+0000","last_undegraded":"2024-09-21T01:14:17.931354+0000","last_fullsized":"2024-09-21T01:14:17.931354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261447+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:15:17.261447+0000","last_peered":"2024-09-21T01:15:17.261447+0000","last_clean":"2024-09-21T01:15:17.261447+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:15:17.261447+0000","last_undegraded":"2024-09-21T01:15:17.261447+0000","last_fullsized":"2024-09-21T01:15:17.261447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922386+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:17.922386+0000","last_peered":"2024-09-21T01:14:17.922386+0000","last_clean":"2024-09-21T01:14:17.922386+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:17.922386+0000","last_undegraded":"2024-09-21T01:14:17.922386+0000","last_fullsized":"2024-09-21T01:14:17.922386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251577+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:15:17.251577+0000","last_peered":"2024-09-21T01:15:17.251577+0000","last_clean":"2024-09-21T01:15:17.251577+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:15:17.251577+0000","last_undegraded":"2024-09-21T01:15:17.251577+0000","last_fullsized":"2024-09-21T01:15:17.251577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'14","reported_seq":155,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.822047+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:15:56.822047+0000","last_peered":"2024-09-21T01:15:56.822047+0000","last_clean":"2024-09-21T01:15:56.822047+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:15:56.822047+0000","last_undegraded":"2024-09-21T01:15:56.822047+0000","last_fullsized":"2024-09-21T01:15:56.822047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1196,"num_read_kb":685,"num_write":259,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":232584,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":401373,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1061536,"data_compressed":43544,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":400820,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332151,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":401081,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495676,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":994048,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":400728,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855429,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":993418,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018954,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":400128,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":472283,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":471375,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":402291,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71794,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":72702,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":71470,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:16:00.163 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T01:16:00.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 -- 172.21.15.37:0/2169980902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 msgr2=0x7f18c410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 --2- 172.21.15.37:0/2169980902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c410b8b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009ca0 tx=0x7f18bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 -- 172.21.15.37:0/2169980902 shutdown_connections 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 --2- 172.21.15.37:0/2169980902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c410b8b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 --2- 172.21.15.37:0/2169980902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c4106890 0x7f18c4108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 --2- 172.21.15.37:0/2169980902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c406b1b0 0x7f18c4106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 -- 172.21.15.37:0/2169980902 >> 172.21.15.37:0/2169980902 conn(0x7f18c40fdeb0 msgr2=0x7f18c4100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 -- 172.21.15.37:0/2169980902 shutdown_connections 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.313+0000 7f18ca721640 1 -- 172.21.15.37:0/2169980902 wait complete. 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 Processor -- start 2024-09-21T01:16:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 -- start start 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c406b1b0 0x7f18c4199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c4106890 0x7f18c419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c419b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18c410f300 con 0x7f18c41093a0 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18c410f180 con 0x7f18c406b1b0 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18ca721640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18c410f480 con 0x7f18c4106890 2024-09-21T01:16:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c419b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c419b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56306/0 (socket says 172.21.15.37:56306) 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 -- 172.21.15.37:0/73667950 learned_addr learned my addr 172.21.15.37:0/73667950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c3fff640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c406b1b0 0x7f18c4199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c37fe640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c4106890 0x7f18c419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 -- 172.21.15.37:0/73667950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c4106890 msgr2=0x7f18c419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c4106890 0x7f18c419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 -- 172.21.15.37:0/73667950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c406b1b0 msgr2=0x7f18c4199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c406b1b0 0x7f18c4199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.314+0000 7f18c8cbe640 1 -- 172.21.15.37:0/73667950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c419b900 con 0x7f18c41093a0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.315+0000 7f18c8cbe640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c419b0e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009430 tx=0x7f18bc0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.315+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003b70 con 0x7f18c41093a0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.315+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18bc003d10 con 0x7f18c41093a0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.315+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c419bb90 con 0x7f18c41093a0 2024-09-21T01:16:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.315+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc02fb40 con 0x7f18c41093a0 2024-09-21T01:16:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.315+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c41a22e0 con 0x7f18c41093a0 2024-09-21T01:16:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.316+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c40ff9d0 con 0x7f18c41093a0 2024-09-21T01:16:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.317+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f18bc004610 con 0x7f18c41093a0 2024-09-21T01:16:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.318+0000 7f18c17fa640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18ac0b6590 0x7f18ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.318+0000 7f18c3fff640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18ac0b6590 0x7f18ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.318+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f18bc108750 con 0x7f18c41093a0 2024-09-21T01:16:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.319+0000 7f18c3fff640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18ac0b6590 0x7f18ac0b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009bd0 tx=0x7f18b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.321+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18bc0cefa0 con 0x7f18c41093a0 2024-09-21T01:16:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.505+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 --> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18c4063800 con 0x7f18ac0b6590 2024-09-21T01:16:00.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.510+0000 7f18c17fa640 1 -- 172.21.15.37:0/73667950 <== mgr.14152 v2:172.21.15.37:6800/2729102960 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259179 (secure 0 0 0) 0x7f18c4063800 con 0x7f18ac0b6590 2024-09-21T01:16:00.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:16:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-21T01:16:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18ac0b6590 msgr2=0x7f18ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18ac0b6590 0x7f18ac0b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009bd0 tx=0x7f18b4005f90 comp rx=0 tx=0).stop 2024-09-21T01:16:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 msgr2=0x7f18c419b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c419b0e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009430 tx=0x7f18bc0316f0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 shutdown_connections 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18ac0b6590 0x7f18ac0b8aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18c41093a0 0x7f18c419b0e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c4106890 0x7f18c419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 --2- 172.21.15.37:0/73667950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18c406b1b0 0x7f18c4199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 >> 172.21.15.37:0/73667950 conn(0x7f18c40fdeb0 msgr2=0x7f18c4104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 shutdown_connections 2024-09-21T01:16:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:00.513+0000 7f18ca721640 1 -- 172.21.15.37:0/73667950 wait complete. 2024-09-21T01:16:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-21T01:15:58.883066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668130,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1272,"num_read_kb":749,"num_write":384,"num_write_kb":2309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952025,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376172,"kb_used_data":10284,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565652,"statfs":{"total":1151940427776,"available":1151555227648,"internally_reserved":0,"allocated":10530816,"data_stored":6799362,"data_compressed":182481,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4965,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":76,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003125"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260430+0000","last_change":"2024-09-21T01:13:50.556569+0000","last_active":"2024-09-21T01:15:17.260430+0000","last_peered":"2024-09-21T01:15:17.260430+0000","last_clean":"2024-09-21T01:15:17.260430+0000","last_became_active":"2024-09-21T01:13:50.555692+0000","last_became_peered":"2024-09-21T01:13:50.555692+0000","last_unstale":"2024-09-21T01:15:17.260430+0000","last_undegraded":"2024-09-21T01:15:17.260430+0000","last_fullsized":"2024-09-21T01:15:17.260430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.818873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.255604+0000","last_change":"2024-09-21T01:13:50.564615+0000","last_active":"2024-09-21T01:15:17.255604+0000","last_peered":"2024-09-21T01:15:17.255604+0000","last_clean":"2024-09-21T01:15:17.255604+0000","last_became_active":"2024-09-21T01:13:50.563692+0000","last_became_peered":"2024-09-21T01:13:50.563692+0000","last_unstale":"2024-09-21T01:15:17.255604+0000","last_undegraded":"2024-09-21T01:15:17.255604+0000","last_fullsized":"2024-09-21T01:15:17.255604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:17.519099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.259569+0000","last_change":"2024-09-21T01:13:50.559088+0000","last_active":"2024-09-21T01:15:17.259569+0000","last_peered":"2024-09-21T01:15:17.259569+0000","last_clean":"2024-09-21T01:15:17.259569+0000","last_became_active":"2024-09-21T01:13:50.556743+0000","last_became_peered":"2024-09-21T01:13:50.556743+0000","last_unstale":"2024-09-21T01:15:17.259569+0000","last_undegraded":"2024-09-21T01:15:17.259569+0000","last_fullsized":"2024-09-21T01:15:17.259569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:01.595786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.248568+0000","last_change":"2024-09-21T01:13:50.560148+0000","last_active":"2024-09-21T01:15:17.248568+0000","last_peered":"2024-09-21T01:15:17.248568+0000","last_clean":"2024-09-21T01:15:17.248568+0000","last_became_active":"2024-09-21T01:13:50.557339+0000","last_became_peered":"2024-09-21T01:13:50.557339+0000","last_unstale":"2024-09-21T01:15:17.248568+0000","last_undegraded":"2024-09-21T01:15:17.248568+0000","last_fullsized":"2024-09-21T01:15:17.248568+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:47.593241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.228328+0000","last_change":"2024-09-21T01:13:50.544442+0000","last_active":"2024-09-21T01:15:17.228328+0000","last_peered":"2024-09-21T01:15:17.228328+0000","last_clean":"2024-09-21T01:15:17.228328+0000","last_became_active":"2024-09-21T01:13:50.543750+0000","last_became_peered":"2024-09-21T01:13:50.543750+0000","last_unstale":"2024-09-21T01:15:17.228328+0000","last_undegraded":"2024-09-21T01:15:17.228328+0000","last_fullsized":"2024-09-21T01:15:17.228328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.458153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250795+0000","last_change":"2024-09-21T01:13:50.547962+0000","last_active":"2024-09-21T01:15:17.250795+0000","last_peered":"2024-09-21T01:15:17.250795+0000","last_clean":"2024-09-21T01:15:17.250795+0000","last_became_active":"2024-09-21T01:13:50.547581+0000","last_became_peered":"2024-09-21T01:13:50.547581+0000","last_unstale":"2024-09-21T01:15:17.250795+0000","last_undegraded":"2024-09-21T01:15:17.250795+0000","last_fullsized":"2024-09-21T01:15:17.250795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:35.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253863+0000","last_change":"2024-09-21T01:13:50.558957+0000","last_active":"2024-09-21T01:15:17.253863+0000","last_peered":"2024-09-21T01:15:17.253863+0000","last_clean":"2024-09-21T01:15:17.253863+0000","last_became_active":"2024-09-21T01:13:50.558595+0000","last_became_peered":"2024-09-21T01:13:50.558595+0000","last_unstale":"2024-09-21T01:15:17.253863+0000","last_undegraded":"2024-09-21T01:15:17.253863+0000","last_fullsized":"2024-09-21T01:15:17.253863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:27.552636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251013+0000","last_change":"2024-09-21T01:13:50.553883+0000","last_active":"2024-09-21T01:15:17.251013+0000","last_peered":"2024-09-21T01:15:17.251013+0000","last_clean":"2024-09-21T01:15:17.251013+0000","last_became_active":"2024-09-21T01:13:50.553435+0000","last_became_peered":"2024-09-21T01:13:50.553435+0000","last_unstale":"2024-09-21T01:15:17.251013+0000","last_undegraded":"2024-09-21T01:15:17.251013+0000","last_fullsized":"2024-09-21T01:15:17.251013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:09.817326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.263715+0000","last_change":"2024-09-21T01:13:50.566186+0000","last_active":"2024-09-21T01:15:17.263715+0000","last_peered":"2024-09-21T01:15:17.263715+0000","last_clean":"2024-09-21T01:15:17.263715+0000","last_became_active":"2024-09-21T01:13:50.565797+0000","last_became_peered":"2024-09-21T01:13:50.565797+0000","last_unstale":"2024-09-21T01:15:17.263715+0000","last_undegraded":"2024-09-21T01:15:17.263715+0000","last_fullsized":"2024-09-21T01:15:17.263715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:52.824056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.247960+0000","last_change":"2024-09-21T01:13:50.555774+0000","last_active":"2024-09-21T01:15:17.247960+0000","last_peered":"2024-09-21T01:15:17.247960+0000","last_clean":"2024-09-21T01:15:17.247960+0000","last_became_active":"2024-09-21T01:13:50.555363+0000","last_became_peered":"2024-09-21T01:13:50.555363+0000","last_unstale":"2024-09-21T01:15:17.247960+0000","last_undegraded":"2024-09-21T01:15:17.247960+0000","last_fullsized":"2024-09-21T01:15:17.247960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:24.417065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260411+0000","last_change":"2024-09-21T01:13:50.559225+0000","last_active":"2024-09-21T01:15:17.260411+0000","last_peered":"2024-09-21T01:15:17.260411+0000","last_clean":"2024-09-21T01:15:17.260411+0000","last_became_active":"2024-09-21T01:13:50.558117+0000","last_became_peered":"2024-09-21T01:13:50.558117+0000","last_unstale":"2024-09-21T01:15:17.260411+0000","last_undegraded":"2024-09-21T01:15:17.260411+0000","last_fullsized":"2024-09-21T01:15:17.260411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.779487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251061+0000","last_change":"2024-09-21T01:13:50.555898+0000","last_active":"2024-09-21T01:15:17.251061+0000","last_peered":"2024-09-21T01:15:17.251061+0000","last_clean":"2024-09-21T01:15:17.251061+0000","last_became_active":"2024-09-21T01:13:50.555529+0000","last_became_peered":"2024-09-21T01:13:50.555529+0000","last_unstale":"2024-09-21T01:15:17.251061+0000","last_undegraded":"2024-09-21T01:15:17.251061+0000","last_fullsized":"2024-09-21T01:15:17.251061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:46.487597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253108+0000","last_change":"2024-09-21T01:13:50.561866+0000","last_active":"2024-09-21T01:15:17.253108+0000","last_peered":"2024-09-21T01:15:17.253108+0000","last_clean":"2024-09-21T01:15:17.253108+0000","last_became_active":"2024-09-21T01:13:50.561273+0000","last_became_peered":"2024-09-21T01:13:50.561273+0000","last_unstale":"2024-09-21T01:15:17.253108+0000","last_undegraded":"2024-09-21T01:15:17.253108+0000","last_fullsized":"2024-09-21T01:15:17.253108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:01.076152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254383+0000","last_change":"2024-09-21T01:13:50.563387+0000","last_active":"2024-09-21T01:15:17.254383+0000","last_peered":"2024-09-21T01:15:17.254383+0000","last_clean":"2024-09-21T01:15:17.254383+0000","last_became_active":"2024-09-21T01:13:50.563028+0000","last_became_peered":"2024-09-21T01:13:50.563028+0000","last_unstale":"2024-09-21T01:15:17.254383+0000","last_undegraded":"2024-09-21T01:15:17.254383+0000","last_fullsized":"2024-09-21T01:15:17.254383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:41.694256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.257356+0000","last_change":"2024-09-21T01:13:50.565014+0000","last_active":"2024-09-21T01:15:17.257356+0000","last_peered":"2024-09-21T01:15:17.257356+0000","last_clean":"2024-09-21T01:15:17.257356+0000","last_became_active":"2024-09-21T01:13:50.563834+0000","last_became_peered":"2024-09-21T01:13:50.563834+0000","last_unstale":"2024-09-21T01:15:17.257356+0000","last_undegraded":"2024-09-21T01:15:17.257356+0000","last_fullsized":"2024-09-21T01:15:17.257356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:27.213916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.263651+0000","last_change":"2024-09-21T01:13:50.565084+0000","last_active":"2024-09-21T01:15:17.263651+0000","last_peered":"2024-09-21T01:15:17.263651+0000","last_clean":"2024-09-21T01:15:17.263651+0000","last_became_active":"2024-09-21T01:13:50.564214+0000","last_became_peered":"2024-09-21T01:13:50.564214+0000","last_unstale":"2024-09-21T01:15:17.263651+0000","last_undegraded":"2024-09-21T01:15:17.263651+0000","last_fullsized":"2024-09-21T01:15:17.263651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:39.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260630+0000","last_change":"2024-09-21T01:13:50.557111+0000","last_active":"2024-09-21T01:15:17.260630+0000","last_peered":"2024-09-21T01:15:17.260630+0000","last_clean":"2024-09-21T01:15:17.260630+0000","last_became_active":"2024-09-21T01:13:50.555277+0000","last_became_peered":"2024-09-21T01:13:50.555277+0000","last_unstale":"2024-09-21T01:15:17.260630+0000","last_undegraded":"2024-09-21T01:15:17.260630+0000","last_fullsized":"2024-09-21T01:15:17.260630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:36:49.611013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249033+0000","last_change":"2024-09-21T01:13:50.557207+0000","last_active":"2024-09-21T01:15:17.249033+0000","last_peered":"2024-09-21T01:15:17.249033+0000","last_clean":"2024-09-21T01:15:17.249033+0000","last_became_active":"2024-09-21T01:13:50.556863+0000","last_became_peered":"2024-09-21T01:13:50.556863+0000","last_unstale":"2024-09-21T01:15:17.249033+0000","last_undegraded":"2024-09-21T01:15:17.249033+0000","last_fullsized":"2024-09-21T01:15:17.249033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:10.951996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249434+0000","last_change":"2024-09-21T01:13:50.560861+0000","last_active":"2024-09-21T01:15:17.249434+0000","last_peered":"2024-09-21T01:15:17.249434+0000","last_clean":"2024-09-21T01:15:17.249434+0000","last_became_active":"2024-09-21T01:13:50.560458+0000","last_became_peered":"2024-09-21T01:13:50.560458+0000","last_unstale":"2024-09-21T01:15:17.249434+0000","last_undegraded":"2024-09-21T01:15:17.249434+0000","last_fullsized":"2024-09-21T01:15:17.249434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:02.589823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.252528+0000","last_change":"2024-09-21T01:13:50.545431+0000","last_active":"2024-09-21T01:15:17.252528+0000","last_peered":"2024-09-21T01:15:17.252528+0000","last_clean":"2024-09-21T01:15:17.252528+0000","last_became_active":"2024-09-21T01:13:50.545015+0000","last_became_peered":"2024-09-21T01:13:50.545015+0000","last_unstale":"2024-09-21T01:15:17.252528+0000","last_undegraded":"2024-09-21T01:15:17.252528+0000","last_fullsized":"2024-09-21T01:15:17.252528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:56.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.262296+0000","last_change":"2024-09-21T01:13:50.549532+0000","last_active":"2024-09-21T01:15:17.262296+0000","last_peered":"2024-09-21T01:15:17.262296+0000","last_clean":"2024-09-21T01:15:17.262296+0000","last_became_active":"2024-09-21T01:13:50.549195+0000","last_became_peered":"2024-09-21T01:13:50.549195+0000","last_unstale":"2024-09-21T01:15:17.262296+0000","last_undegraded":"2024-09-21T01:15:17.262296+0000","last_fullsized":"2024-09-21T01:15:17.262296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:40.264699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264216+0000","last_change":"2024-09-21T01:13:50.565284+0000","last_active":"2024-09-21T01:15:17.264216+0000","last_peered":"2024-09-21T01:15:17.264216+0000","last_clean":"2024-09-21T01:15:17.264216+0000","last_became_active":"2024-09-21T01:13:50.563443+0000","last_became_peered":"2024-09-21T01:13:50.563443+0000","last_unstale":"2024-09-21T01:15:17.264216+0000","last_undegraded":"2024-09-21T01:15:17.264216+0000","last_fullsized":"2024-09-21T01:15:17.264216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:41:11.393037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251734+0000","last_change":"2024-09-21T01:13:50.555760+0000","last_active":"2024-09-21T01:15:17.251734+0000","last_peered":"2024-09-21T01:15:17.251734+0000","last_clean":"2024-09-21T01:15:17.251734+0000","last_became_active":"2024-09-21T01:13:50.555420+0000","last_became_peered":"2024-09-21T01:13:50.555420+0000","last_unstale":"2024-09-21T01:15:17.251734+0000","last_undegraded":"2024-09-21T01:15:17.251734+0000","last_fullsized":"2024-09-21T01:15:17.251734+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:32.660620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242434+0000","last_change":"2024-09-21T01:13:50.544564+0000","last_active":"2024-09-21T01:15:17.242434+0000","last_peered":"2024-09-21T01:15:17.242434+0000","last_clean":"2024-09-21T01:15:17.242434+0000","last_became_active":"2024-09-21T01:13:50.543771+0000","last_became_peered":"2024-09-21T01:13:50.543771+0000","last_unstale":"2024-09-21T01:15:17.242434+0000","last_undegraded":"2024-09-21T01:15:17.242434+0000","last_fullsized":"2024-09-21T01:15:17.242434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:14.604565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250117+0000","last_change":"2024-09-21T01:13:50.555105+0000","last_active":"2024-09-21T01:15:17.250117+0000","last_peered":"2024-09-21T01:15:17.250117+0000","last_clean":"2024-09-21T01:15:17.250117+0000","last_became_active":"2024-09-21T01:13:50.554721+0000","last_became_peered":"2024-09-21T01:13:50.554721+0000","last_unstale":"2024-09-21T01:15:17.250117+0000","last_undegraded":"2024-09-21T01:15:17.250117+0000","last_fullsized":"2024-09-21T01:15:17.250117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:23.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.246710+0000","last_change":"2024-09-21T01:13:50.560291+0000","last_active":"2024-09-21T01:15:17.246710+0000","last_peered":"2024-09-21T01:15:17.246710+0000","last_clean":"2024-09-21T01:15:17.246710+0000","last_became_active":"2024-09-21T01:13:50.559882+0000","last_became_peered":"2024-09-21T01:13:50.559882+0000","last_unstale":"2024-09-21T01:15:17.246710+0000","last_undegraded":"2024-09-21T01:15:17.246710+0000","last_fullsized":"2024-09-21T01:15:17.246710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:13.089917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.245900+0000","last_change":"2024-09-21T01:13:50.552452+0000","last_active":"2024-09-21T01:15:17.245900+0000","last_peered":"2024-09-21T01:15:17.245900+0000","last_clean":"2024-09-21T01:15:17.245900+0000","last_became_active":"2024-09-21T01:13:50.552046+0000","last_became_peered":"2024-09-21T01:13:50.552046+0000","last_unstale":"2024-09-21T01:15:17.245900+0000","last_undegraded":"2024-09-21T01:15:17.245900+0000","last_fullsized":"2024-09-21T01:15:17.245900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:31.754657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261834+0000","last_change":"2024-09-21T01:13:50.549374+0000","last_active":"2024-09-21T01:15:17.261834+0000","last_peered":"2024-09-21T01:15:17.261834+0000","last_clean":"2024-09-21T01:15:17.261834+0000","last_became_active":"2024-09-21T01:13:50.548984+0000","last_became_peered":"2024-09-21T01:13:50.548984+0000","last_unstale":"2024-09-21T01:15:17.261834+0000","last_undegraded":"2024-09-21T01:15:17.261834+0000","last_fullsized":"2024-09-21T01:15:17.261834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:34:39.143384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260011+0000","last_change":"2024-09-21T01:13:50.565379+0000","last_active":"2024-09-21T01:15:17.260011+0000","last_peered":"2024-09-21T01:15:17.260011+0000","last_clean":"2024-09-21T01:15:17.260011+0000","last_became_active":"2024-09-21T01:13:50.564955+0000","last_became_peered":"2024-09-21T01:13:50.564955+0000","last_unstale":"2024-09-21T01:15:17.260011+0000","last_undegraded":"2024-09-21T01:15:17.260011+0000","last_fullsized":"2024-09-21T01:15:17.260011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:59.011569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.258836+0000","last_change":"2024-09-21T01:13:50.561626+0000","last_active":"2024-09-21T01:15:17.258836+0000","last_peered":"2024-09-21T01:15:17.258836+0000","last_clean":"2024-09-21T01:15:17.258836+0000","last_became_active":"2024-09-21T01:13:50.561238+0000","last_became_peered":"2024-09-21T01:13:50.561238+0000","last_unstale":"2024-09-21T01:15:17.258836+0000","last_undegraded":"2024-09-21T01:15:17.258836+0000","last_fullsized":"2024-09-21T01:15:17.258836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:27.044463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244432+0000","last_change":"2024-09-21T01:13:50.559980+0000","last_active":"2024-09-21T01:15:17.244432+0000","last_peered":"2024-09-21T01:15:17.244432+0000","last_clean":"2024-09-21T01:15:17.244432+0000","last_became_active":"2024-09-21T01:13:50.559489+0000","last_became_peered":"2024-09-21T01:13:50.559489+0000","last_unstale":"2024-09-21T01:15:17.244432+0000","last_undegraded":"2024-09-21T01:15:17.244432+0000","last_fullsized":"2024-09-21T01:15:17.244432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:05:01.541434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.248382+0000","last_change":"2024-09-21T01:14:17.928629+0000","last_active":"2024-09-21T01:15:17.248382+0000","last_peered":"2024-09-21T01:15:17.248382+0000","last_clean":"2024-09-21T01:15:17.248382+0000","last_became_active":"2024-09-21T01:14:17.928137+0000","last_became_peered":"2024-09-21T01:14:17.928137+0000","last_unstale":"2024-09-21T01:15:17.248382+0000","last_undegraded":"2024-09-21T01:15:17.248382+0000","last_fullsized":"2024-09-21T01:15:17.248382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:45.749457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244349+0000","last_change":"2024-09-21T01:13:50.553268+0000","last_active":"2024-09-21T01:15:17.244349+0000","last_peered":"2024-09-21T01:15:17.244349+0000","last_clean":"2024-09-21T01:15:17.244349+0000","last_became_active":"2024-09-21T01:13:50.552905+0000","last_became_peered":"2024-09-21T01:13:50.552905+0000","last_unstale":"2024-09-21T01:15:17.244349+0000","last_undegraded":"2024-09-21T01:15:17.244349+0000","last_fullsized":"2024-09-21T01:15:17.244349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:04.185056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'7","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:52.817785+0000","last_change":"2024-09-21T01:13:48.549812+0000","last_active":"2024-09-21T01:15:52.817785+0000","last_peered":"2024-09-21T01:15:52.817785+0000","last_clean":"2024-09-21T01:15:52.817785+0000","last_became_active":"2024-09-21T01:13:48.549445+0000","last_became_peered":"2024-09-21T01:13:48.549445+0000","last_unstale":"2024-09-21T01:15:52.817785+0000","last_undegraded":"2024-09-21T01:15:52.817785+0000","last_fullsized":"2024-09-21T01:15:52.817785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:30.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244048+0000","last_change":"2024-09-21T01:13:50.548252+0000","last_active":"2024-09-21T01:15:17.244048+0000","last_peered":"2024-09-21T01:15:17.244048+0000","last_clean":"2024-09-21T01:15:17.244048+0000","last_became_active":"2024-09-21T01:13:50.547763+0000","last_became_peered":"2024-09-21T01:13:50.547763+0000","last_unstale":"2024-09-21T01:15:17.244048+0000","last_undegraded":"2024-09-21T01:15:17.244048+0000","last_fullsized":"2024-09-21T01:15:17.244048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:51.183412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.924600+0000","last_change":"2024-09-21T01:13:48.543045+0000","last_active":"2024-09-21T01:14:17.924600+0000","last_peered":"2024-09-21T01:14:17.924600+0000","last_clean":"2024-09-21T01:14:17.924600+0000","last_became_active":"2024-09-21T01:13:48.542607+0000","last_became_peered":"2024-09-21T01:13:48.542607+0000","last_unstale":"2024-09-21T01:14:17.924600+0000","last_undegraded":"2024-09-21T01:14:17.924600+0000","last_fullsized":"2024-09-21T01:14:17.924600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:02.197645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926903+0000","last_change":"2024-09-21T01:13:48.535330+0000","last_active":"2024-09-21T01:14:17.926903+0000","last_peered":"2024-09-21T01:14:17.926903+0000","last_clean":"2024-09-21T01:14:17.926903+0000","last_became_active":"2024-09-21T01:13:48.534957+0000","last_became_peered":"2024-09-21T01:13:48.534957+0000","last_unstale":"2024-09-21T01:14:17.926903+0000","last_undegraded":"2024-09-21T01:14:17.926903+0000","last_fullsized":"2024-09-21T01:14:17.926903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:34.232385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251384+0000","last_change":"2024-09-21T01:13:50.545117+0000","last_active":"2024-09-21T01:15:17.251384+0000","last_peered":"2024-09-21T01:15:17.251384+0000","last_clean":"2024-09-21T01:15:17.251384+0000","last_became_active":"2024-09-21T01:13:50.544755+0000","last_became_peered":"2024-09-21T01:13:50.544755+0000","last_unstale":"2024-09-21T01:15:17.251384+0000","last_undegraded":"2024-09-21T01:15:17.251384+0000","last_fullsized":"2024-09-21T01:15:17.251384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:12.466821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925188+0000","last_change":"2024-09-21T01:13:48.543731+0000","last_active":"2024-09-21T01:14:17.925188+0000","last_peered":"2024-09-21T01:14:17.925188+0000","last_clean":"2024-09-21T01:14:17.925188+0000","last_became_active":"2024-09-21T01:13:48.543323+0000","last_became_peered":"2024-09-21T01:13:48.543323+0000","last_unstale":"2024-09-21T01:14:17.925188+0000","last_undegraded":"2024-09-21T01:14:17.925188+0000","last_fullsized":"2024-09-21T01:14:17.925188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:15.494214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.246826+0000","last_change":"2024-09-21T01:13:50.555785+0000","last_active":"2024-09-21T01:15:17.246826+0000","last_peered":"2024-09-21T01:15:17.246826+0000","last_clean":"2024-09-21T01:15:17.246826+0000","last_became_active":"2024-09-21T01:13:50.555430+0000","last_became_peered":"2024-09-21T01:13:50.555430+0000","last_unstale":"2024-09-21T01:15:17.246826+0000","last_undegraded":"2024-09-21T01:15:17.246826+0000","last_fullsized":"2024-09-21T01:15:17.246826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:27.897922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'6","reported_seq":261,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:57.824389+0000","last_change":"2024-09-21T01:13:48.538739+0000","last_active":"2024-09-21T01:15:57.824389+0000","last_peered":"2024-09-21T01:15:57.824389+0000","last_clean":"2024-09-21T01:15:57.824389+0000","last_became_active":"2024-09-21T01:13:48.538315+0000","last_became_peered":"2024-09-21T01:13:48.538315+0000","last_unstale":"2024-09-21T01:15:57.824389+0000","last_undegraded":"2024-09-21T01:15:57.824389+0000","last_fullsized":"2024-09-21T01:15:57.824389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:55.106838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.265413+0000","last_change":"2024-09-21T01:13:50.562113+0000","last_active":"2024-09-21T01:15:17.265413+0000","last_peered":"2024-09-21T01:15:17.265413+0000","last_clean":"2024-09-21T01:15:17.265413+0000","last_became_active":"2024-09-21T01:13:50.561749+0000","last_became_peered":"2024-09-21T01:13:50.561749+0000","last_unstale":"2024-09-21T01:15:17.265413+0000","last_undegraded":"2024-09-21T01:15:17.265413+0000","last_fullsized":"2024-09-21T01:15:17.265413+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:46.578056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928205+0000","last_change":"2024-09-21T01:13:48.548923+0000","last_active":"2024-09-21T01:14:17.928205+0000","last_peered":"2024-09-21T01:14:17.928205+0000","last_clean":"2024-09-21T01:14:17.928205+0000","last_became_active":"2024-09-21T01:13:48.548423+0000","last_became_peered":"2024-09-21T01:13:48.548423+0000","last_unstale":"2024-09-21T01:14:17.928205+0000","last_undegraded":"2024-09-21T01:14:17.928205+0000","last_fullsized":"2024-09-21T01:14:17.928205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:32:54.861906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260696+0000","last_change":"2024-09-21T01:13:50.564591+0000","last_active":"2024-09-21T01:15:17.260696+0000","last_peered":"2024-09-21T01:15:17.260696+0000","last_clean":"2024-09-21T01:15:17.260696+0000","last_became_active":"2024-09-21T01:13:50.564245+0000","last_became_peered":"2024-09-21T01:13:50.564245+0000","last_unstale":"2024-09-21T01:15:17.260696+0000","last_undegraded":"2024-09-21T01:15:17.260696+0000","last_fullsized":"2024-09-21T01:15:17.260696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:14.460573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927052+0000","last_change":"2024-09-21T01:13:48.760330+0000","last_active":"2024-09-21T01:14:17.927052+0000","last_peered":"2024-09-21T01:14:17.927052+0000","last_clean":"2024-09-21T01:14:17.927052+0000","last_became_active":"2024-09-21T01:13:48.759897+0000","last_became_peered":"2024-09-21T01:13:48.759897+0000","last_unstale":"2024-09-21T01:14:17.927052+0000","last_undegraded":"2024-09-21T01:14:17.927052+0000","last_fullsized":"2024-09-21T01:14:17.927052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:39.993529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264271+0000","last_change":"2024-09-21T01:13:50.557515+0000","last_active":"2024-09-21T01:15:17.264271+0000","last_peered":"2024-09-21T01:15:17.264271+0000","last_clean":"2024-09-21T01:15:17.264271+0000","last_became_active":"2024-09-21T01:13:50.557159+0000","last_became_peered":"2024-09-21T01:13:50.557159+0000","last_unstale":"2024-09-21T01:15:17.264271+0000","last_undegraded":"2024-09-21T01:15:17.264271+0000","last_fullsized":"2024-09-21T01:15:17.264271+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:54:50.014737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:57.823903+0000","last_change":"2024-09-21T01:13:48.548931+0000","last_active":"2024-09-21T01:15:57.823903+0000","last_peered":"2024-09-21T01:15:57.823903+0000","last_clean":"2024-09-21T01:15:57.823903+0000","last_became_active":"2024-09-21T01:13:48.548534+0000","last_became_peered":"2024-09-21T01:13:48.548534+0000","last_unstale":"2024-09-21T01:15:57.823903+0000","last_undegraded":"2024-09-21T01:15:57.823903+0000","last_fullsized":"2024-09-21T01:15:57.823903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:13.643359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69734,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":188,"num_write":38,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242780+0000","last_change":"2024-09-21T01:13:50.552020+0000","last_active":"2024-09-21T01:15:17.242780+0000","last_peered":"2024-09-21T01:15:17.242780+0000","last_clean":"2024-09-21T01:15:17.242780+0000","last_became_active":"2024-09-21T01:13:50.551671+0000","last_became_peered":"2024-09-21T01:13:50.551671+0000","last_unstale":"2024-09-21T01:15:17.242780+0000","last_undegraded":"2024-09-21T01:15:17.242780+0000","last_fullsized":"2024-09-21T01:15:17.242780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:27.275160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'9","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.940919+0000","last_change":"2024-09-21T01:14:17.940477+0000","last_active":"2024-09-21T01:14:17.940919+0000","last_peered":"2024-09-21T01:14:17.940919+0000","last_clean":"2024-09-21T01:14:17.940919+0000","last_became_active":"2024-09-21T01:14:17.927467+0000","last_became_peered":"2024-09-21T01:14:17.927467+0000","last_unstale":"2024-09-21T01:14:17.940919+0000","last_undegraded":"2024-09-21T01:14:17.940919+0000","last_fullsized":"2024-09-21T01:14:17.940919+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:36.308264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.249428+0000","last_change":"2024-09-21T01:13:50.552196+0000","last_active":"2024-09-21T01:15:17.249428+0000","last_peered":"2024-09-21T01:15:17.249428+0000","last_clean":"2024-09-21T01:15:17.249428+0000","last_became_active":"2024-09-21T01:13:50.551835+0000","last_became_peered":"2024-09-21T01:13:50.551835+0000","last_unstale":"2024-09-21T01:15:17.249428+0000","last_undegraded":"2024-09-21T01:15:17.249428+0000","last_fullsized":"2024-09-21T01:15:17.249428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:24.630504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.925959+0000","last_change":"2024-09-21T01:13:48.537329+0000","last_active":"2024-09-21T01:14:17.925959+0000","last_peered":"2024-09-21T01:14:17.925959+0000","last_clean":"2024-09-21T01:14:17.925959+0000","last_became_active":"2024-09-21T01:13:48.536722+0000","last_became_peered":"2024-09-21T01:13:48.536722+0000","last_unstale":"2024-09-21T01:14:17.925959+0000","last_undegraded":"2024-09-21T01:14:17.925959+0000","last_fullsized":"2024-09-21T01:14:17.925959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:17.755911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.257920+0000","last_change":"2024-09-21T01:13:50.549645+0000","last_active":"2024-09-21T01:15:17.257920+0000","last_peered":"2024-09-21T01:15:17.257920+0000","last_clean":"2024-09-21T01:15:17.257920+0000","last_became_active":"2024-09-21T01:13:50.549255+0000","last_became_peered":"2024-09-21T01:13:50.549255+0000","last_unstale":"2024-09-21T01:15:17.257920+0000","last_undegraded":"2024-09-21T01:15:17.257920+0000","last_fullsized":"2024-09-21T01:15:17.257920+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:21.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'5","reported_seq":143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:53.818205+0000","last_change":"2024-09-21T01:13:48.536170+0000","last_active":"2024-09-21T01:15:53.818205+0000","last_peered":"2024-09-21T01:15:53.818205+0000","last_clean":"2024-09-21T01:15:53.818205+0000","last_became_active":"2024-09-21T01:13:48.535753+0000","last_became_peered":"2024-09-21T01:13:48.535753+0000","last_unstale":"2024-09-21T01:15:53.818205+0000","last_undegraded":"2024-09-21T01:15:53.818205+0000","last_fullsized":"2024-09-21T01:15:53.818205+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:09.265865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254702+0000","last_change":"2024-09-21T01:13:50.560953+0000","last_active":"2024-09-21T01:15:17.254702+0000","last_peered":"2024-09-21T01:15:17.254702+0000","last_clean":"2024-09-21T01:15:17.254702+0000","last_became_active":"2024-09-21T01:13:50.560567+0000","last_became_peered":"2024-09-21T01:13:50.560567+0000","last_unstale":"2024-09-21T01:15:17.254702+0000","last_undegraded":"2024-09-21T01:15:17.254702+0000","last_fullsized":"2024-09-21T01:15:17.254702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:11.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'17","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931640+0000","last_change":"2024-09-21T01:13:48.759938+0000","last_active":"2024-09-21T01:14:17.931640+0000","last_peered":"2024-09-21T01:14:17.931640+0000","last_clean":"2024-09-21T01:14:17.931640+0000","last_became_active":"2024-09-21T01:13:48.759322+0000","last_became_peered":"2024-09-21T01:13:48.759322+0000","last_unstale":"2024-09-21T01:14:17.931640+0000","last_undegraded":"2024-09-21T01:14:17.931640+0000","last_fullsized":"2024-09-21T01:14:17.931640+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.907247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.235967+0000","last_change":"2024-09-21T01:14:18.747968+0000","last_active":"2024-09-21T01:15:17.235967+0000","last_peered":"2024-09-21T01:15:17.235967+0000","last_clean":"2024-09-21T01:15:17.235967+0000","last_became_active":"2024-09-21T01:14:18.747693+0000","last_became_peered":"2024-09-21T01:14:18.747693+0000","last_unstale":"2024-09-21T01:15:17.235967+0000","last_undegraded":"2024-09-21T01:15:17.235967+0000","last_fullsized":"2024-09-21T01:15:17.235967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:41.855089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931319+0000","last_change":"2024-09-21T01:13:48.546262+0000","last_active":"2024-09-21T01:14:17.931319+0000","last_peered":"2024-09-21T01:14:17.931319+0000","last_clean":"2024-09-21T01:14:17.931319+0000","last_became_active":"2024-09-21T01:13:48.545169+0000","last_became_peered":"2024-09-21T01:13:48.545169+0000","last_unstale":"2024-09-21T01:14:17.931319+0000","last_undegraded":"2024-09-21T01:14:17.931319+0000","last_fullsized":"2024-09-21T01:14:17.931319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:56.653059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.250037+0000","last_change":"2024-09-21T01:14:17.928882+0000","last_active":"2024-09-21T01:15:17.250037+0000","last_peered":"2024-09-21T01:15:17.250037+0000","last_clean":"2024-09-21T01:15:17.250037+0000","last_became_active":"2024-09-21T01:14:17.928410+0000","last_became_peered":"2024-09-21T01:14:17.928410+0000","last_unstale":"2024-09-21T01:15:17.250037+0000","last_undegraded":"2024-09-21T01:15:17.250037+0000","last_fullsized":"2024-09-21T01:15:17.250037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:06.008644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'5","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.927566+0000","last_change":"2024-09-21T01:13:48.548809+0000","last_active":"2024-09-21T01:14:17.927566+0000","last_peered":"2024-09-21T01:14:17.927566+0000","last_clean":"2024-09-21T01:14:17.927566+0000","last_became_active":"2024-09-21T01:13:48.548330+0000","last_became_peered":"2024-09-21T01:13:48.548330+0000","last_unstale":"2024-09-21T01:14:17.927566+0000","last_undegraded":"2024-09-21T01:14:17.927566+0000","last_fullsized":"2024-09-21T01:14:17.927566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:47.638055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.252641+0000","last_change":"2024-09-21T01:13:50.554472+0000","last_active":"2024-09-21T01:15:17.252641+0000","last_peered":"2024-09-21T01:15:17.252641+0000","last_clean":"2024-09-21T01:15:17.252641+0000","last_became_active":"2024-09-21T01:13:50.554067+0000","last_became_peered":"2024-09-21T01:13:50.554067+0000","last_unstale":"2024-09-21T01:15:17.252641+0000","last_undegraded":"2024-09-21T01:15:17.252641+0000","last_fullsized":"2024-09-21T01:15:17.252641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:30.469951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.926931+0000","last_change":"2024-09-21T01:13:48.540165+0000","last_active":"2024-09-21T01:14:17.926931+0000","last_peered":"2024-09-21T01:14:17.926931+0000","last_clean":"2024-09-21T01:14:17.926931+0000","last_became_active":"2024-09-21T01:13:48.539704+0000","last_became_peered":"2024-09-21T01:13:48.539704+0000","last_unstale":"2024-09-21T01:14:17.926931+0000","last_undegraded":"2024-09-21T01:14:17.926931+0000","last_fullsized":"2024-09-21T01:14:17.926931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.096844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.255005+0000","last_change":"2024-09-21T01:13:50.559943+0000","last_active":"2024-09-21T01:15:17.255005+0000","last_peered":"2024-09-21T01:15:17.255005+0000","last_clean":"2024-09-21T01:15:17.255005+0000","last_became_active":"2024-09-21T01:13:50.559557+0000","last_became_peered":"2024-09-21T01:13:50.559557+0000","last_unstale":"2024-09-21T01:15:17.255005+0000","last_undegraded":"2024-09-21T01:15:17.255005+0000","last_fullsized":"2024-09-21T01:15:17.255005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:41.906174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'7","reported_seq":150,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.852248+0000","last_change":"2024-09-21T01:13:48.981159+0000","last_active":"2024-09-21T01:15:56.852248+0000","last_peered":"2024-09-21T01:15:56.852248+0000","last_clean":"2024-09-21T01:15:56.852248+0000","last_became_active":"2024-09-21T01:13:48.980735+0000","last_became_peered":"2024-09-21T01:13:48.980735+0000","last_unstale":"2024-09-21T01:15:56.852248+0000","last_undegraded":"2024-09-21T01:15:56.852248+0000","last_fullsized":"2024-09-21T01:15:56.852248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:23.241328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.260937+0000","last_change":"2024-09-21T01:13:50.558172+0000","last_active":"2024-09-21T01:15:17.260937+0000","last_peered":"2024-09-21T01:15:17.260937+0000","last_clean":"2024-09-21T01:15:17.260937+0000","last_became_active":"2024-09-21T01:13:50.557814+0000","last_became_peered":"2024-09-21T01:13:50.557814+0000","last_unstale":"2024-09-21T01:15:17.260937+0000","last_undegraded":"2024-09-21T01:15:17.260937+0000","last_fullsized":"2024-09-21T01:15:17.260937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:44:08.254500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.928188+0000","last_change":"2024-09-21T01:12:35.053624+0000","last_active":"2024-09-21T01:14:17.928188+0000","last_peered":"2024-09-21T01:14:17.928188+0000","last_clean":"2024-09-21T01:14:17.928188+0000","last_became_active":"2024-09-21T01:12:35.048692+0000","last_became_peered":"2024-09-21T01:12:35.048692+0000","last_unstale":"2024-09-21T01:14:17.928188+0000","last_undegraded":"2024-09-21T01:14:17.928188+0000","last_fullsized":"2024-09-21T01:14:17.928188+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:09:09.524983+0000","last_clean_scrub_stamp":"2024-09-21T01:09:09.524983+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:32.122595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'6","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.684960+0000","last_change":"2024-09-21T01:13:48.537945+0000","last_active":"2024-09-21T01:14:18.684960+0000","last_peered":"2024-09-21T01:14:18.684960+0000","last_clean":"2024-09-21T01:14:18.684960+0000","last_became_active":"2024-09-21T01:13:48.537560+0000","last_became_peered":"2024-09-21T01:13:48.537560+0000","last_unstale":"2024-09-21T01:14:18.684960+0000","last_undegraded":"2024-09-21T01:14:18.684960+0000","last_fullsized":"2024-09-21T01:14:18.684960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:49.778822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.242996+0000","last_change":"2024-09-21T01:13:50.556943+0000","last_active":"2024-09-21T01:15:17.242996+0000","last_peered":"2024-09-21T01:15:17.242996+0000","last_clean":"2024-09-21T01:15:17.242996+0000","last_became_active":"2024-09-21T01:13:50.556275+0000","last_became_peered":"2024-09-21T01:13:50.556275+0000","last_unstale":"2024-09-21T01:15:17.242996+0000","last_undegraded":"2024-09-21T01:15:17.242996+0000","last_fullsized":"2024-09-21T01:15:17.242996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:44.313880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'4","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.751868+0000","last_change":"2024-09-21T01:14:18.751275+0000","last_active":"2024-09-21T01:14:18.751868+0000","last_peered":"2024-09-21T01:14:18.751868+0000","last_clean":"2024-09-21T01:14:18.751868+0000","last_became_active":"2024-09-21T01:14:18.748195+0000","last_became_peered":"2024-09-21T01:14:18.748195+0000","last_unstale":"2024-09-21T01:14:18.751868+0000","last_undegraded":"2024-09-21T01:14:18.751868+0000","last_fullsized":"2024-09-21T01:14:18.751868+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:32:53.013383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1],"acting":[7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.241017+0000","last_change":"2024-09-21T01:13:50.558952+0000","last_active":"2024-09-21T01:15:17.241017+0000","last_peered":"2024-09-21T01:15:17.241017+0000","last_clean":"2024-09-21T01:15:17.241017+0000","last_became_active":"2024-09-21T01:13:50.557344+0000","last_became_peered":"2024-09-21T01:13:50.557344+0000","last_unstale":"2024-09-21T01:15:17.241017+0000","last_undegraded":"2024-09-21T01:15:17.241017+0000","last_fullsized":"2024-09-21T01:15:17.241017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:45.056387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'5","reported_seq":144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:55.820204+0000","last_change":"2024-09-21T01:13:48.759610+0000","last_active":"2024-09-21T01:15:55.820204+0000","last_peered":"2024-09-21T01:15:55.820204+0000","last_clean":"2024-09-21T01:15:55.820204+0000","last_became_active":"2024-09-21T01:13:48.758920+0000","last_became_peered":"2024-09-21T01:13:48.758920+0000","last_unstale":"2024-09-21T01:15:55.820204+0000","last_undegraded":"2024-09-21T01:15:55.820204+0000","last_fullsized":"2024-09-21T01:15:55.820204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:04.307671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.247331+0000","last_change":"2024-09-21T01:14:17.933986+0000","last_active":"2024-09-21T01:15:17.247331+0000","last_peered":"2024-09-21T01:15:17.247331+0000","last_clean":"2024-09-21T01:15:17.247331+0000","last_became_active":"2024-09-21T01:14:17.933554+0000","last_became_peered":"2024-09-21T01:14:17.933554+0000","last_unstale":"2024-09-21T01:15:17.247331+0000","last_undegraded":"2024-09-21T01:15:17.247331+0000","last_fullsized":"2024-09-21T01:15:17.247331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:23:01.863742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'6","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.822556+0000","last_change":"2024-09-21T01:13:48.540909+0000","last_active":"2024-09-21T01:15:56.822556+0000","last_peered":"2024-09-21T01:15:56.822556+0000","last_clean":"2024-09-21T01:15:56.822556+0000","last_became_active":"2024-09-21T01:13:48.540529+0000","last_became_peered":"2024-09-21T01:13:48.540529+0000","last_unstale":"2024-09-21T01:15:56.822556+0000","last_undegraded":"2024-09-21T01:15:56.822556+0000","last_fullsized":"2024-09-21T01:15:56.822556+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:22.280127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.253323+0000","last_change":"2024-09-21T01:13:50.553290+0000","last_active":"2024-09-21T01:15:17.253323+0000","last_peered":"2024-09-21T01:15:17.253323+0000","last_clean":"2024-09-21T01:15:17.253323+0000","last_became_active":"2024-09-21T01:13:50.551105+0000","last_became_peered":"2024-09-21T01:13:50.551105+0000","last_unstale":"2024-09-21T01:15:17.253323+0000","last_undegraded":"2024-09-21T01:15:17.253323+0000","last_fullsized":"2024-09-21T01:15:17.253323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:42.367578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"74'1","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.929309+0000","last_change":"2024-09-21T01:14:17.928492+0000","last_active":"2024-09-21T01:14:17.929309+0000","last_peered":"2024-09-21T01:14:17.929309+0000","last_clean":"2024-09-21T01:14:17.929309+0000","last_became_active":"2024-09-21T01:14:17.928028+0000","last_became_peered":"2024-09-21T01:14:17.928028+0000","last_unstale":"2024-09-21T01:14:17.929309+0000","last_undegraded":"2024-09-21T01:14:17.929309+0000","last_fullsized":"2024-09-21T01:14:17.929309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:18.998708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.243783+0000","last_change":"2024-09-21T01:14:17.933251+0000","last_active":"2024-09-21T01:15:17.243783+0000","last_peered":"2024-09-21T01:15:17.243783+0000","last_clean":"2024-09-21T01:15:17.243783+0000","last_became_active":"2024-09-21T01:14:17.928420+0000","last_became_peered":"2024-09-21T01:14:17.928420+0000","last_unstale":"2024-09-21T01:15:17.243783+0000","last_undegraded":"2024-09-21T01:15:17.243783+0000","last_fullsized":"2024-09-21T01:15:17.243783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:15.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'4","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931464+0000","last_change":"2024-09-21T01:13:48.759720+0000","last_active":"2024-09-21T01:14:17.931464+0000","last_peered":"2024-09-21T01:14:17.931464+0000","last_clean":"2024-09-21T01:14:17.931464+0000","last_became_active":"2024-09-21T01:13:48.759227+0000","last_became_peered":"2024-09-21T01:13:48.759227+0000","last_unstale":"2024-09-21T01:14:17.931464+0000","last_undegraded":"2024-09-21T01:14:17.931464+0000","last_fullsized":"2024-09-21T01:14:17.931464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:28.095164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.244780+0000","last_change":"2024-09-21T01:13:50.557138+0000","last_active":"2024-09-21T01:15:17.244780+0000","last_peered":"2024-09-21T01:15:17.244780+0000","last_clean":"2024-09-21T01:15:17.244780+0000","last_became_active":"2024-09-21T01:13:50.556779+0000","last_became_peered":"2024-09-21T01:13:50.556779+0000","last_unstale":"2024-09-21T01:15:17.244780+0000","last_undegraded":"2024-09-21T01:15:17.244780+0000","last_fullsized":"2024-09-21T01:15:17.244780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:29.877376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'16","reported_seq":40,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:55.581948+0000","last_change":"2024-09-21T01:13:48.540692+0000","last_active":"2024-09-21T01:15:55.581948+0000","last_peered":"2024-09-21T01:15:55.581948+0000","last_clean":"2024-09-21T01:15:55.581948+0000","last_became_active":"2024-09-21T01:13:48.540312+0000","last_became_peered":"2024-09-21T01:13:48.540312+0000","last_unstale":"2024-09-21T01:15:55.581948+0000","last_undegraded":"2024-09-21T01:15:55.581948+0000","last_fullsized":"2024-09-21T01:15:55.581948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:47.998761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251511+0000","last_change":"2024-09-21T01:13:50.551245+0000","last_active":"2024-09-21T01:15:17.251511+0000","last_peered":"2024-09-21T01:15:17.251511+0000","last_clean":"2024-09-21T01:15:17.251511+0000","last_became_active":"2024-09-21T01:13:50.550851+0000","last_became_peered":"2024-09-21T01:13:50.550851+0000","last_unstale":"2024-09-21T01:15:17.251511+0000","last_undegraded":"2024-09-21T01:15:17.251511+0000","last_fullsized":"2024-09-21T01:15:17.251511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:07.318234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.685290+0000","last_change":"2024-09-21T01:13:48.981208+0000","last_active":"2024-09-21T01:14:18.685290+0000","last_peered":"2024-09-21T01:14:18.685290+0000","last_clean":"2024-09-21T01:14:18.685290+0000","last_became_active":"2024-09-21T01:13:48.980872+0000","last_became_peered":"2024-09-21T01:13:48.980872+0000","last_unstale":"2024-09-21T01:14:18.685290+0000","last_undegraded":"2024-09-21T01:14:18.685290+0000","last_fullsized":"2024-09-21T01:14:18.685290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:16.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261683+0000","last_change":"2024-09-21T01:14:17.930043+0000","last_active":"2024-09-21T01:15:17.261683+0000","last_peered":"2024-09-21T01:15:17.261683+0000","last_clean":"2024-09-21T01:15:17.261683+0000","last_became_active":"2024-09-21T01:14:17.929636+0000","last_became_peered":"2024-09-21T01:14:17.929636+0000","last_unstale":"2024-09-21T01:15:17.261683+0000","last_undegraded":"2024-09-21T01:15:17.261683+0000","last_fullsized":"2024-09-21T01:15:17.261683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:43.046354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:18.747180+0000","last_change":"2024-09-21T01:13:48.759864+0000","last_active":"2024-09-21T01:14:18.747180+0000","last_peered":"2024-09-21T01:14:18.747180+0000","last_clean":"2024-09-21T01:14:18.747180+0000","last_became_active":"2024-09-21T01:13:48.759408+0000","last_became_peered":"2024-09-21T01:13:48.759408+0000","last_unstale":"2024-09-21T01:14:18.747180+0000","last_undegraded":"2024-09-21T01:14:18.747180+0000","last_fullsized":"2024-09-21T01:14:18.747180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:47.618033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.206332+0000","last_change":"2024-09-21T01:13:50.561424+0000","last_active":"2024-09-21T01:15:17.206332+0000","last_peered":"2024-09-21T01:15:17.206332+0000","last_clean":"2024-09-21T01:15:17.206332+0000","last_became_active":"2024-09-21T01:13:50.560952+0000","last_became_peered":"2024-09-21T01:13:50.560952+0000","last_unstale":"2024-09-21T01:15:17.206332+0000","last_undegraded":"2024-09-21T01:15:17.206332+0000","last_fullsized":"2024-09-21T01:15:17.206332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:23.763267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'7","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.921790+0000","last_change":"2024-09-21T01:13:48.536895+0000","last_active":"2024-09-21T01:14:17.921790+0000","last_peered":"2024-09-21T01:14:17.921790+0000","last_clean":"2024-09-21T01:14:17.921790+0000","last_became_active":"2024-09-21T01:13:48.536360+0000","last_became_peered":"2024-09-21T01:13:48.536360+0000","last_unstale":"2024-09-21T01:14:17.921790+0000","last_undegraded":"2024-09-21T01:14:17.921790+0000","last_fullsized":"2024-09-21T01:14:17.921790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:57.612071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251798+0000","last_change":"2024-09-21T01:13:50.557534+0000","last_active":"2024-09-21T01:15:17.251798+0000","last_peered":"2024-09-21T01:15:17.251798+0000","last_clean":"2024-09-21T01:15:17.251798+0000","last_became_active":"2024-09-21T01:13:50.557139+0000","last_became_peered":"2024-09-21T01:13:50.557139+0000","last_unstale":"2024-09-21T01:15:17.251798+0000","last_undegraded":"2024-09-21T01:15:17.251798+0000","last_fullsized":"2024-09-21T01:15:17.251798+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.718740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922194+0000","last_change":"2024-09-21T01:13:48.545429+0000","last_active":"2024-09-21T01:14:17.922194+0000","last_peered":"2024-09-21T01:14:17.922194+0000","last_clean":"2024-09-21T01:14:17.922194+0000","last_became_active":"2024-09-21T01:13:48.545023+0000","last_became_peered":"2024-09-21T01:13:48.545023+0000","last_unstale":"2024-09-21T01:14:17.922194+0000","last_undegraded":"2024-09-21T01:14:17.922194+0000","last_fullsized":"2024-09-21T01:14:17.922194+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:35.392691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.254673+0000","last_change":"2024-09-21T01:13:50.554119+0000","last_active":"2024-09-21T01:15:17.254673+0000","last_peered":"2024-09-21T01:15:17.254673+0000","last_clean":"2024-09-21T01:15:17.254673+0000","last_became_active":"2024-09-21T01:13:50.553699+0000","last_became_peered":"2024-09-21T01:13:50.553699+0000","last_unstale":"2024-09-21T01:15:17.254673+0000","last_undegraded":"2024-09-21T01:15:17.254673+0000","last_fullsized":"2024-09-21T01:15:17.254673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:22.103736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.930995+0000","last_change":"2024-09-21T01:13:48.548755+0000","last_active":"2024-09-21T01:14:17.930995+0000","last_peered":"2024-09-21T01:14:17.930995+0000","last_clean":"2024-09-21T01:14:17.930995+0000","last_became_active":"2024-09-21T01:13:48.548367+0000","last_became_peered":"2024-09-21T01:13:48.548367+0000","last_unstale":"2024-09-21T01:14:17.930995+0000","last_undegraded":"2024-09-21T01:14:17.930995+0000","last_fullsized":"2024-09-21T01:14:17.930995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:27.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.262185+0000","last_change":"2024-09-21T01:13:50.556740+0000","last_active":"2024-09-21T01:15:17.262185+0000","last_peered":"2024-09-21T01:15:17.262185+0000","last_clean":"2024-09-21T01:15:17.262185+0000","last_became_active":"2024-09-21T01:13:50.556392+0000","last_became_peered":"2024-09-21T01:13:50.556392+0000","last_unstale":"2024-09-21T01:15:17.262185+0000","last_undegraded":"2024-09-21T01:15:17.262185+0000","last_fullsized":"2024-09-21T01:15:17.262185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:47.357760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.259428+0000","last_change":"2024-09-21T01:13:50.556651+0000","last_active":"2024-09-21T01:15:17.259428+0000","last_peered":"2024-09-21T01:15:17.259428+0000","last_clean":"2024-09-21T01:15:17.259428+0000","last_became_active":"2024-09-21T01:13:50.556304+0000","last_became_peered":"2024-09-21T01:13:50.556304+0000","last_unstale":"2024-09-21T01:15:17.259428+0000","last_undegraded":"2024-09-21T01:15:17.259428+0000","last_fullsized":"2024-09-21T01:15:17.259428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:57:18.809665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'5","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931204+0000","last_change":"2024-09-21T01:13:48.546414+0000","last_active":"2024-09-21T01:14:17.931204+0000","last_peered":"2024-09-21T01:14:17.931204+0000","last_clean":"2024-09-21T01:14:17.931204+0000","last_became_active":"2024-09-21T01:13:48.545922+0000","last_became_peered":"2024-09-21T01:13:48.545922+0000","last_unstale":"2024-09-21T01:14:17.931204+0000","last_undegraded":"2024-09-21T01:14:17.931204+0000","last_fullsized":"2024-09-21T01:14:17.931204+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:38:49.567325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.264980+0000","last_change":"2024-09-21T01:13:50.561271+0000","last_active":"2024-09-21T01:15:17.264980+0000","last_peered":"2024-09-21T01:15:17.264980+0000","last_clean":"2024-09-21T01:15:17.264980+0000","last_became_active":"2024-09-21T01:13:50.560920+0000","last_became_peered":"2024-09-21T01:13:50.560920+0000","last_unstale":"2024-09-21T01:15:17.264980+0000","last_undegraded":"2024-09-21T01:15:17.264980+0000","last_fullsized":"2024-09-21T01:15:17.264980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:08.258170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'13","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.931354+0000","last_change":"2024-09-21T01:13:48.548816+0000","last_active":"2024-09-21T01:14:17.931354+0000","last_peered":"2024-09-21T01:14:17.931354+0000","last_clean":"2024-09-21T01:14:17.931354+0000","last_became_active":"2024-09-21T01:13:48.548410+0000","last_became_peered":"2024-09-21T01:13:48.548410+0000","last_unstale":"2024-09-21T01:14:17.931354+0000","last_undegraded":"2024-09-21T01:14:17.931354+0000","last_fullsized":"2024-09-21T01:14:17.931354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:21.521251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.261447+0000","last_change":"2024-09-21T01:13:50.555689+0000","last_active":"2024-09-21T01:15:17.261447+0000","last_peered":"2024-09-21T01:15:17.261447+0000","last_clean":"2024-09-21T01:15:17.261447+0000","last_became_active":"2024-09-21T01:13:50.555323+0000","last_became_peered":"2024-09-21T01:13:50.555323+0000","last_unstale":"2024-09-21T01:15:17.261447+0000","last_undegraded":"2024-09-21T01:15:17.261447+0000","last_fullsized":"2024-09-21T01:15:17.261447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:13.406807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:14:17.922386+0000","last_change":"2024-09-21T01:13:48.759346+0000","last_active":"2024-09-21T01:14:17.922386+0000","last_peered":"2024-09-21T01:14:17.922386+0000","last_clean":"2024-09-21T01:14:17.922386+0000","last_became_active":"2024-09-21T01:13:48.758914+0000","last_became_peered":"2024-09-21T01:13:48.758914+0000","last_unstale":"2024-09-21T01:14:17.922386+0000","last_undegraded":"2024-09-21T01:14:17.922386+0000","last_fullsized":"2024-09-21T01:14:17.922386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:37.252837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:17.251577+0000","last_change":"2024-09-21T01:13:50.555068+0000","last_active":"2024-09-21T01:15:17.251577+0000","last_peered":"2024-09-21T01:15:17.251577+0000","last_clean":"2024-09-21T01:15:17.251577+0000","last_became_active":"2024-09-21T01:13:50.554724+0000","last_became_peered":"2024-09-21T01:13:50.554724+0000","last_unstale":"2024-09-21T01:15:17.251577+0000","last_undegraded":"2024-09-21T01:15:17.251577+0000","last_fullsized":"2024-09-21T01:15:17.251577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:49.526947+0000","last_clean_scrub_stamp":"2024-09-21T01:13:49.526947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:30.096735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'14","reported_seq":155,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T01:15:56.822047+0000","last_change":"2024-09-21T01:13:48.543260+0000","last_active":"2024-09-21T01:15:56.822047+0000","last_peered":"2024-09-21T01:15:56.822047+0000","last_clean":"2024-09-21T01:15:56.822047+0000","last_became_active":"2024-09-21T01:13:48.542814+0000","last_became_peered":"2024-09-21T01:13:48.542814+0000","last_unstale":"2024-09-21T01:15:56.822047+0000","last_undegraded":"2024-09-21T01:15:56.822047+0000","last_fullsized":"2024-09-21T01:15:56.822047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:13:47.513974+0000","last_clean_scrub_stamp":"2024-09-21T01:13:47.513974+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:51.368009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1196,"num_read_kb":685,"num_write":259,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":232584,"data_compressed":5706,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282188,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":401373,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1061536,"data_compressed":43544,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":400820,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332151,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":401081,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495676,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":994048,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":400728,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855429,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":993418,"data_compressed":41642,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018954,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":400281,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":400128,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":472283,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":471375,"data_compressed":7663,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":402291,"data_compressed":5761,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34261,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35881,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71794,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":72702,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":71470,"data_compressed":1902,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:16:00.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:16:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:00 smithi037 ceph-mon[31105]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T01:16:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:00 smithi137 ceph-mon[34607]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T01:16:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:00 smithi144 ceph-mon[34818]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T01:16:01.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 -- 172.21.15.37:0/80490848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102a60 msgr2=0x7f0e58102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/80490848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102a60 0x7f0e58102e70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009900 tx=0x7f0e4802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 -- 172.21.15.37:0/80490848 shutdown_connections 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/80490848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e58108cf0 0x7f0e5810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/80490848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e581083a0 0x7f0e581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/80490848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58102a60 0x7f0e58102e70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 -- 172.21.15.37:0/80490848 >> 172.21.15.37:0/80490848 conn(0x7f0e58079730 msgr2=0x7f0e58079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 -- 172.21.15.37:0/80490848 shutdown_connections 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.341+0000 7f0e5cd93640 1 -- 172.21.15.37:0/80490848 wait complete. 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 Processor -- start 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 -- start start 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e58102a60 0x7f0e5810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e581083a0 0x7f0e581104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 0x7f0e58110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58113ab0 con 0x7f0e58108cf0 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58113930 con 0x7f0e581083a0 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e5cd93640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0e58113c30 con 0x7f0e58102a60 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 0x7f0e58110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.342+0000 7f0e56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 0x7f0e58110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56324/0 (socket says 172.21.15.37:56324) 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 -- 172.21.15.37:0/3442758847 learned_addr learned my addr 172.21.15.37:0/3442758847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e5659c640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e58102a60 0x7f0e5810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e55d9b640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e581083a0 0x7f0e581104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 -- 172.21.15.37:0/3442758847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e58102a60 msgr2=0x7f0e5810ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e58102a60 0x7f0e5810ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 -- 172.21.15.37:0/3442758847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e581083a0 msgr2=0x7f0e581104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e581083a0 0x7f0e581104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 -- 172.21.15.37:0/3442758847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e581a86b0 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e56d9d640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 0x7f0e58110a30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c970 tx=0x7f0e5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50007bb0 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e581a89a0 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e50007d50 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50018770 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.343+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e581a8eb0 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.344+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e58102e70 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.346+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0e5000f990 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.347+0000 7f0e477fe640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b6510 0x7f0e400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.347+0000 7f0e5659c640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b6510 0x7f0e400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.347+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0e500e73d0 con 0x7f0e58108cf0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.347+0000 7f0e5659c640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b6510 0x7f0e400b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005ab0 tx=0x7f0e48005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.350+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e50014030 con 0x7f0e58108cf0 2024-09-21T01:16:01.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:01 smithi037 ceph-mon[31105]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:01 smithi037 ceph-mon[31105]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:01 smithi037 ceph-mon[31105]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.576+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e5802e640 con 0x7f0e58108cf0 2024-09-21T01:16:01.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.577+0000 7f0e477fe640 1 -- 172.21.15.37:0/3442758847 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11976 (secure 0 0 0) 0x7f0e500adcf0 con 0x7f0e58108cf0 2024-09-21T01:16:01.577 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:16:01.577 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-21T01:15:56:398497+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:15:55.947622+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:16:01.577 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-21T01:16:01.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b6510 msgr2=0x7f0e400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b6510 0x7f0e400b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005ab0 tx=0x7f0e48005a20 comp rx=0 tx=0).stop 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 msgr2=0x7f0e58110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 0x7f0e58110a30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c970 tx=0x7f0e5000ce30 comp rx=0 tx=0).stop 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 shutdown_connections 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e400b6510 0x7f0e400b8a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e58108cf0 0x7f0e58110a30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e581083a0 0x7f0e581104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 --2- 172.21.15.37:0/3442758847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e58102a60 0x7f0e5810ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 >> 172.21.15.37:0/3442758847 conn(0x7f0e58079730 msgr2=0x7f0e58101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 shutdown_connections 2024-09-21T01:16:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:01.579+0000 7f0e5cd93640 1 -- 172.21.15.37:0/3442758847 wait complete. 2024-09-21T01:16:01.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:01 smithi137 ceph-mon[34607]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:01 smithi137 ceph-mon[34607]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:01 smithi137 ceph-mon[34607]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:01 smithi144 ceph-mon[34818]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:01 smithi144 ceph-mon[34818]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:01.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:01 smithi144 ceph-mon[34818]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:16:02.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:16:02.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:02 smithi037 ceph-mon[31105]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:02.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:02 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3442758847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:02.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:02 smithi137 ceph-mon[34607]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:02.822 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:02 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3442758847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:02.822 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:02 smithi144 ceph-mon[34818]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:02.822 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:02 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3442758847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 -- 172.21.15.37:0/1808603667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c104a30 msgr2=0x7eff4c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 --2- 172.21.15.37:0/1808603667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c104a30 0x7eff4c104e40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009900 tx=0x7eff3c02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 -- 172.21.15.37:0/1808603667 shutdown_connections 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 --2- 172.21.15.37:0/1808603667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c10de60 0x7eff4c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 --2- 172.21.15.37:0/1808603667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c105380 0x7eff4c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 --2- 172.21.15.37:0/1808603667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c104a30 0x7eff4c104e40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 -- 172.21.15.37:0/1808603667 >> 172.21.15.37:0/1808603667 conn(0x7eff4c079760 msgr2=0x7eff4c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 -- 172.21.15.37:0/1808603667 shutdown_connections 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 -- 172.21.15.37:0/1808603667 wait complete. 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.068+0000 7eff51451640 1 Processor -- start 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 -- start start 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c104a30 0x7eff4c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c105380 0x7eff4c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 0x7eff4c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c113b10 con 0x7eff4c10de60 2024-09-21T01:16:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c113990 con 0x7eff4c104a30 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff51451640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c113c90 con 0x7eff4c105380 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 0x7eff4c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 0x7eff4c1031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56354/0 (socket says 172.21.15.37:56354) 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 -- 172.21.15.37:0/33163465 learned_addr learned my addr 172.21.15.37:0/33163465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4affd640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c104a30 0x7eff4c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4a7fc640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c105380 0x7eff4c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 -- 172.21.15.37:0/33163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c105380 msgr2=0x7eff4c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c105380 0x7eff4c102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 -- 172.21.15.37:0/33163465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c104a30 msgr2=0x7eff4c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c104a30 0x7eff4c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.069+0000 7eff4b7fe640 1 -- 172.21.15.37:0/33163465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c1a8840 con 0x7eff4c10de60 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.070+0000 7eff4b7fe640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 0x7eff4c1031f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e970 tx=0x7eff4400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.070+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4400ccc0 con 0x7eff4c10de60 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.070+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4c1a8b30 con 0x7eff4c10de60 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.070+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff4400ce60 con 0x7eff4c10de60 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.070+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44010430 con 0x7eff4c10de60 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.070+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4c1a9040 con 0x7eff4c10de60 2024-09-21T01:16:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.071+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4c06c1f0 con 0x7eff4c10de60 2024-09-21T01:16:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.073+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7eff44004f70 con 0x7eff4c10de60 2024-09-21T01:16:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.073+0000 7eff33fff640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff340b6510 0x7eff340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.074+0000 7eff4affd640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff340b6510 0x7eff340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.074+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7eff440e7830 con 0x7eff4c10de60 2024-09-21T01:16:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.074+0000 7eff4affd640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff340b6510 0x7eff340b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff3c031440 tx=0x7eff3c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.077+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff44056710 con 0x7eff4c10de60 2024-09-21T01:16:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.267+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff4c103a70 con 0x7eff4c10de60 2024-09-21T01:16:03.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.268+0000 7eff33fff640 1 -- 172.21.15.37:0/33163465 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7eff440ae0c0 con 0x7eff4c10de60 2024-09-21T01:16:03.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:16:03.269 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff340b6510 msgr2=0x7eff340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff340b6510 0x7eff340b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff3c031440 tx=0x7eff3c005a20 comp rx=0 tx=0).stop 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 msgr2=0x7eff4c1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 0x7eff4c1031f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7eff4400e970 tx=0x7eff4400ed70 comp rx=0 tx=0).stop 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 shutdown_connections 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff340b6510 0x7eff340b8a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4c10de60 0x7eff4c1031f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c105380 0x7eff4c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 --2- 172.21.15.37:0/33163465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff4c104a30 0x7eff4c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 >> 172.21.15.37:0/33163465 conn(0x7eff4c079760 msgr2=0x7eff4c107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 shutdown_connections 2024-09-21T01:16:03.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:03.271+0000 7eff51451640 1 -- 172.21.15.37:0/33163465 wait complete. 2024-09-21T01:16:03.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:03 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/33163465' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:03.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:03 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/33163465' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:03.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:03 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/33163465' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:16:03.941 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T01:16:03.941 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T01:16:03.956 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:16:03.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T01:16:03.957 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T01:16:03.957 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:16:03.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:16:03.959 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T01:16:03.976 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:16:03.976 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T01:16:03.976 INFO:tasks.workunit:timeout=3h 2024-09-21T01:16:03.976 INFO:tasks.workunit:cleanup=True 2024-09-21T01:16:03.977 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T01:16:03.995 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-21 01:14:09.886678523 +0000 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-21 01:14:09.886678523 +0000 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-21 01:15:55.234565833 +0000 2024-09-21T01:16:03.996 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-21 01:14:09.886678523 +0000 2024-09-21T01:16:03.996 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T01:16:03.996 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T01:16:04.069 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:16:04.126 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T01:16:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:04.648 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:04 smithi037 ceph-mon[31105]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 -- 172.21.15.37:0/3207794760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44105300 msgr2=0x7eff4410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3207794760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44105300 0x7eff4410d850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7eff34009900 tx=0x7eff3402a410 comp rx=0 tx=0).stop 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 -- 172.21.15.37:0/3207794760 shutdown_connections 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3207794760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4410de10 0x7eff44110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3207794760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44105300 0x7eff4410d850 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3207794760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff441049b0 0x7eff44104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 -- 172.21.15.37:0/3207794760 >> 172.21.15.37:0/3207794760 conn(0x7eff44079730 msgr2=0x7eff44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 -- 172.21.15.37:0/3207794760 shutdown_connections 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 -- 172.21.15.37:0/3207794760 wait complete. 2024-09-21T01:16:04.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.745+0000 7eff4aea6640 1 Processor -- start 2024-09-21T01:16:04.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 -- start start 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff441049b0 0x7eff441026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44105300 0x7eff44102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 0x7eff44103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff44113a70 con 0x7eff4410de10 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff441138f0 con 0x7eff44105300 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff4aea6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff44113bf0 con 0x7eff441049b0 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 0x7eff44103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 0x7eff44103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56376/0 (socket says 172.21.15.37:56376) 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 -- 172.21.15.37:0/3932599736 learned_addr learned my addr 172.21.15.37:0/3932599736 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff3bfff640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44105300 0x7eff44102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff48c42640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff441049b0 0x7eff441026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 -- 172.21.15.37:0/3932599736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff441049b0 msgr2=0x7eff441026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff441049b0 0x7eff441026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 -- 172.21.15.37:0/3932599736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44105300 msgr2=0x7eff44102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44105300 0x7eff44102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.746+0000 7eff49443640 1 -- 172.21.15.37:0/3932599736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff441a86b0 con 0x7eff4410de10 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.747+0000 7eff49443640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 0x7eff44103170 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00cce0 tx=0x7eff3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.747+0000 7eff39ffb640 1 -- 172.21.15.37:0/3932599736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00f450 con 0x7eff4410de10 2024-09-21T01:16:04.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.747+0000 7eff39ffb640 1 -- 172.21.15.37:0/3932599736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff3c00faa0 con 0x7eff4410de10 2024-09-21T01:16:04.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.747+0000 7eff39ffb640 1 -- 172.21.15.37:0/3932599736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c018b70 con 0x7eff4410de10 2024-09-21T01:16:04.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.747+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff441a89a0 con 0x7eff4410de10 2024-09-21T01:16:04.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.747+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff441a8eb0 con 0x7eff4410de10 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff39ffb640 1 -- 172.21.15.37:0/3932599736 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7eff3c018d10 con 0x7eff4410de10 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 Processor -- start 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 -- start start 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f41430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 0x55a591f41970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f41eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a591eb7e60 con 0x55a591b71490 2024-09-21T01:16:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a591ea7290 con 0x55a591b9a350 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff5141a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a591eab0a0 con 0x55a591b79670 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff48c42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 0x55a591f41970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff48c42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 0x55a591f41970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56378/0 (socket says 172.21.15.37:56378) 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff48c42640 1 -- 172.21.15.37:0/697811476 learned_addr learned my addr 172.21.15.37:0/697811476 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.750+0000 7eff3bfff640 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff3bfff640 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f41eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff48c42640 1 -- 172.21.15.37:0/697811476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 msgr2=0x55a591f41eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff48c42640 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f41eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff48c42640 1 -- 172.21.15.37:0/697811476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 msgr2=0x55a591f41430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff48c42640 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f41430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff48c42640 1 -- 172.21.15.37:0/697811476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a591c05930 con 0x55a591b71490 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff39ffb640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff2c0b6590 0x7eff2c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff3bfff640 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f41eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff3bfff640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff2c0b6590 0x7eff2c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff39ffb640 1 -- 172.21.15.37:0/3932599736 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7eff3c0e7640 con 0x7eff4410de10 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff48c42640 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 0x55a591f41970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7eff4000bc70 tx=0x7eff400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb133e208c5df7b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff2affd640 1 -- 172.21.15.37:0/697811476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40004020 con 0x55a591b71490 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff2affd640 1 -- 172.21.15.37:0/697811476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff400041c0 con 0x55a591b71490 2024-09-21T01:16:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.751+0000 7eff2affd640 1 -- 172.21.15.37:0/697811476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40011660 con 0x55a591b71490 2024-09-21T01:16:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 -- 172.21.15.37:0/697811476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 msgr2=0x55a591f41970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 0x55a591f41970 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7eff4000bc70 tx=0x7eff400107a0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff3bfff640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff2c0b6590 0x7eff2c0b8aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff34009230 tx=0x7eff34000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 -- 172.21.15.37:0/697811476 shutdown_connections 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f41eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b71490 0x55a591f41970 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 --2- 172.21.15.37:0/697811476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 -- 172.21.15.37:0/697811476 >> 172.21.15.37:0/697811476 conn(0x55a591b8e740 msgr2=0x55a591f3f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 -- 172.21.15.37:0/697811476 shutdown_connections 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.752+0000 7eff5141a740 1 -- 172.21.15.37:0/697811476 wait complete. 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 -- start start 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 Processor -- start 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f4d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f4d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 0x55a591f58f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a591d08890 con 0x55a591b9a350 2024-09-21T01:16:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a591e41d40 con 0x55a591b71490 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a591f4fc10 con 0x55a591b79670 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff5141a740 10 client.0 _ll_register_callbacks cb 0x55a591ea5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff49443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 0x55a591f58f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.753+0000 7eff49443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 0x55a591f58f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56380/0 (socket says 172.21.15.37:56380) 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 -- 172.21.15.37:0/808194931 learned_addr learned my addr 172.21.15.37:0/808194931 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff48c42640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f4d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff3bfff640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f4d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 -- 172.21.15.37:0/808194931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 msgr2=0x55a591f4d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f4d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 -- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 msgr2=0x55a591f4d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f4d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 -- 172.21.15.37:0/808194931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a591f59550 con 0x55a591b9a350 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff49443640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 0x55a591f58f60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ad760 tx=0x7eff3c0ad1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c45a5466fdbc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff23fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff23fff640 1 -- 172.21.15.37:0/808194931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0b22b0 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff23fff640 1 -- 172.21.15.37:0/808194931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7eff3c0aca30 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff400041c0 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff23fff640 1 -- 172.21.15.37:0/808194931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff3c0b71f0 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff5141a740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.754+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a591f5bdd0 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff23fff640 1 -- 172.21.15.37:0/808194931 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff400041c0 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff23fff640 1 -- 172.21.15.37:0/808194931 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff3c0ac4a0 con 0x55a591b9a350 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff5141a740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff5141a740 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff5141a740 20 client.15519 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff5141a740 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b58cd0 0x55a591f5f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff5141a740 4 client.15519 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a591eb9db0 con 0x55a591b58cd0 2024-09-21T01:16:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.755+0000 7eff48c42640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b58cd0 0x55a591f5f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.756+0000 7eff23fff640 10 client.15519 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.756+0000 7eff48c42640 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b58cd0 0x55a591f5f2a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e751361c6c2df926 server_cookie=5563d540c4fd45fa in_seq=0 out_seq=0 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff23fff640 1 -- 172.21.15.37:0/808194931 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a591eb9db0 con 0x55a591b58cd0 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff23fff640 10 client.15519 handle_command_reply: tid=0 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 client.15519 shutdown 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 msgr2=0x55a591f58f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 0x55a591f58f60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ad760 tx=0x7eff3c0ad1e0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 shutdown_connections 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b58cd0 0x55a591f5f2a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b9a350 0x55a591f58f60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b79670 0x55a591f4d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff23fff640 0 client.15519 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 --2- 172.21.15.37:0/808194931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f4d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 >> 172.21.15.37:0/808194931 conn(0x55a591b8e740 msgr2=0x55a591f445c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 shutdown_connections 2024-09-21T01:16:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 1 -- 172.21.15.37:0/808194931 wait complete. 2024-09-21T01:16:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.757+0000 7eff5141a740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.775+0000 7eff5141a740 1 Processor -- start 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.775+0000 7eff5141a740 1 -- start start 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.775+0000 7eff5141a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f46bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.775+0000 7eff5141a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f42e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff5141a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b9a350 0x55a591f4c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff5141a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff441b14a0 con 0x55a591b79670 2024-09-21T01:16:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff5141a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff441b2fe0 con 0x55a591b71490 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff5141a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff441b1b70 con 0x55a591b9a350 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f42e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f42e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56396/0 (socket says 172.21.15.37:56396) 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 -- 172.21.15.37:0/4081438314 learned_addr learned my addr 172.21.15.37:0/4081438314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff48c42640 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f46bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff49443640 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b9a350 0x55a591f4c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 -- 172.21.15.37:0/4081438314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b9a350 msgr2=0x55a591f4c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b9a350 0x55a591f4c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 -- 172.21.15.37:0/4081438314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 msgr2=0x55a591f46bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f46bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 -- 172.21.15.37:0/4081438314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a591f3fc10 con 0x55a591b79670 2024-09-21T01:16:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff49443640 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b9a350 0x55a591f4c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff3bfff640 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f42e20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7eff34009900 tx=0x7eff3403f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86edc15f2aafd868 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.776+0000 7eff2a7fc640 1 -- 172.21.15.37:0/4081438314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34043070 con 0x55a591b79670 2024-09-21T01:16:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff2a7fc640 1 -- 172.21.15.37:0/4081438314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff34004240 con 0x55a591b79670 2024-09-21T01:16:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff2a7fc640 1 -- 172.21.15.37:0/4081438314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34035040 con 0x55a591b79670 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 -- 172.21.15.37:0/4081438314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 msgr2=0x55a591f42e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f42e20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7eff34009900 tx=0x7eff3403f070 comp rx=0 tx=0).stop 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 -- 172.21.15.37:0/4081438314 shutdown_connections 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b9a350 0x55a591f4c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f42e20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 --2- 172.21.15.37:0/4081438314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b71490 0x55a591f46bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 -- 172.21.15.37:0/4081438314 >> 172.21.15.37:0/4081438314 conn(0x55a591b8e740 msgr2=0x55a591f4e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 -- 172.21.15.37:0/4081438314 shutdown_connections 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.777+0000 7eff5141a740 1 -- 172.21.15.37:0/4081438314 wait complete. 2024-09-21T01:16:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 -- start start 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 Processor -- start 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b71490 0x55a591f55540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f51a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f51f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff441b2910 con 0x55a591b79670 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff441b2240 con 0x55a591b9a350 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff441af460 con 0x55a591b71490 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.778+0000 7eff5141a740 10 client.0 _ll_register_callbacks cb 0x7eff3c018510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f51a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f51a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56410/0 (socket says 172.21.15.37:56410) 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 -- 172.21.15.37:0/2580973266 learned_addr learned my addr 172.21.15.37:0/2580973266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff48c42640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b71490 0x55a591f55540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff49443640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f51f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 -- 172.21.15.37:0/2580973266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b71490 msgr2=0x55a591f55540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b71490 0x55a591f55540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 -- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 msgr2=0x55a591f51f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f51f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 -- 172.21.15.37:0/2580973266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a591f52580 con 0x55a591b79670 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff48c42640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b71490 0x55a591f55540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff3bfff640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f51a00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7eff3402a930 tx=0x7eff34032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4731fffb2dd607 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff23fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff23fff640 1 -- 172.21.15.37:0/2580973266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34043070 con 0x55a591b79670 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff23fff640 1 -- 172.21.15.37:0/2580973266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7eff340035f0 con 0x55a591b79670 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.779+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff34004240 con 0x55a591b79670 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff23fff640 1 -- 172.21.15.37:0/2580973266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff34035040 con 0x55a591b79670 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 10 client.15525 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a591fca9f0 con 0x55a591b79670 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff23fff640 1 -- 172.21.15.37:0/2580973266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff34004240 con 0x55a591b79670 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff23fff640 1 -- 172.21.15.37:0/2580973266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff3403dc50 con 0x55a591b79670 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 10 client.15525 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 20 client.15525 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b2e080 0x55a591fcd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 4 client.15525 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a591eb5860 con 0x55a591b2e080 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.780+0000 7eff48c42640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b2e080 0x55a591fcd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.781+0000 7eff23fff640 10 client.15525 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.781+0000 7eff48c42640 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b2e080 0x55a591fcd170 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8efd6591803b2ec6 server_cookie=85331c6fa8582b7 in_seq=0 out_seq=0 2024-09-21T01:16:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.782+0000 7eff23fff640 1 -- 172.21.15.37:0/2580973266 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a591eb5860 con 0x55a591b2e080 2024-09-21T01:16:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.782+0000 7eff23fff640 10 client.15525 handle_command_reply: tid=0 2024-09-21T01:16:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.782+0000 7eff5141a740 1 client.15525 shutdown 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.782+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 msgr2=0x55a591f51a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.782+0000 7eff5141a740 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f51a00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7eff3402a930 tx=0x7eff34032d00 comp rx=0 tx=0).stop 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 shutdown_connections 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a591b2e080 0x55a591fcd170 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a591b9a350 0x55a591f51f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a591b79670 0x55a591f51a00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 --2- 172.21.15.37:0/2580973266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a591b71490 0x55a591f55540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff23fff640 0 client.15525 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 >> 172.21.15.37:0/2580973266 conn(0x55a591b8e740 msgr2=0x55a591f42ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 shutdown_connections 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 1 -- 172.21.15.37:0/2580973266 wait complete. 2024-09-21T01:16:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.783+0000 7eff5141a740 20 client.15525 trim_cache size 0 max 16384 2024-09-21T01:16:04.788 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:16:04.788 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:16:04.788 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "5136e175-0609-4bc5-a7ad-e169b15fc747", 2024-09-21T01:16:04.788 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:16:04.788 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:16:04.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff2c0b6590 msgr2=0x7eff2c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff2c0b6590 0x7eff2c0b8aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff34009230 tx=0x7eff34000bc0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 msgr2=0x7eff44103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 0x7eff44103170 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00cce0 tx=0x7eff3c00a620 comp rx=0 tx=0).stop 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 shutdown_connections 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7eff2c0b6590 0x7eff2c0b8aa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff4410de10 0x7eff44103170 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44105300 0x7eff44102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 --2- 172.21.15.37:0/3932599736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff441049b0 0x7eff441026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 >> 172.21.15.37:0/3932599736 conn(0x7eff44079730 msgr2=0x7eff44100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 shutdown_connections 2024-09-21T01:16:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:04.784+0000 7eff4aea6640 1 -- 172.21.15.37:0/3932599736 wait complete. 2024-09-21T01:16:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:04 smithi137 ceph-mon[34607]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:04.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:04 smithi144 ceph-mon[34818]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:05.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:16:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 -- 172.21.15.37:0/1823227598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c1083d0 msgr2=0x7fd30c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 --2- 172.21.15.37:0/1823227598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c1083d0 0x7fd30c1087e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd300009900 tx=0x7fd30002a410 comp rx=0 tx=0).stop 2024-09-21T01:16:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 -- 172.21.15.37:0/1823227598 shutdown_connections 2024-09-21T01:16:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 --2- 172.21.15.37:0/1823227598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd30c108d20 0x7fd30c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 --2- 172.21.15.37:0/1823227598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c1083d0 0x7fd30c1087e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 --2- 172.21.15.37:0/1823227598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c102ae0 0x7fd30c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 -- 172.21.15.37:0/1823227598 >> 172.21.15.37:0/1823227598 conn(0x7fd30c079760 msgr2=0x7fd30c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 -- 172.21.15.37:0/1823227598 shutdown_connections 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.242+0000 7fd312046640 1 -- 172.21.15.37:0/1823227598 wait complete. 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 Processor -- start 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 -- start start 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd30c102ae0 0x7fd30c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c1083d0 0x7fd30c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 0x7fd30c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1129d0 con 0x7fd30c108d20 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c112850 con 0x7fd30c1083d0 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd312046640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c112b50 con 0x7fd30c102ae0 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd30bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 0x7fd30c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd30bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 0x7fd30c19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57496/0 (socket says 172.21.15.37:57496) 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.243+0000 7fd30bfff640 1 -- 172.21.15.37:0/1763553561 learned_addr learned my addr 172.21.15.37:0/1763553561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30affd640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c1083d0 0x7fd30c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd30c102ae0 0x7fd30c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30bfff640 1 -- 172.21.15.37:0/1763553561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd30c102ae0 msgr2=0x7fd30c19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30bfff640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd30c102ae0 0x7fd30c19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30bfff640 1 -- 172.21.15.37:0/1763553561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c1083d0 msgr2=0x7fd30c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30bfff640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c1083d0 0x7fd30c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30bfff640 1 -- 172.21.15.37:0/1763553561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c1a04e0 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30affd640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c1083d0 0x7fd30c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd30bfff640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 0x7fd30c19fdb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b970 tx=0x7fd30400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd308ff9640 1 -- 172.21.15.37:0/1763553561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304019070 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c1a07d0 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd308ff9640 1 -- 172.21.15.37:0/1763553561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd304014440 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd308ff9640 1 -- 172.21.15.37:0/1763553561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3040075d0 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.244+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c1a6f30 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 Processor -- start 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd308ff9640 1 -- 172.21.15.37:0/1763553561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd30401c070 con 0x7fd30c108d20 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 -- start start 2024-09-21T01:16:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735ad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 0x5644735adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564473523e50 con 0x5644731dd1b0 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564473513280 con 0x564473206070 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd3185ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564473517090 con 0x5644731e5390 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd30b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 0x5644735adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd30b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 0x5644735adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57500/0 (socket says 172.21.15.37:57500) 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.247+0000 7fd30b7fe640 1 -- 172.21.15.37:0/3666999861 learned_addr learned my addr 172.21.15.37:0/3666999861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30affd640 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30affd640 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30b7fe640 1 -- 172.21.15.37:0/3666999861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 msgr2=0x5644735ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd308ff9640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd2f40b6510 0x7fd2f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd308ff9640 1 -- 172.21.15.37:0/1763553561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd3040e6870 con 0x7fd30c108d20 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30b7fe640 1 -- 172.21.15.37:0/3666999861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 msgr2=0x5644735ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735ad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.248+0000 7fd30b7fe640 1 -- 172.21.15.37:0/3666999861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564473271650 con 0x5644731dd1b0 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd30bfff640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd2f40b6510 0x7fd2f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd30affd640 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:06.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 0x5644735adb90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00cbf0 tx=0x7fd2fc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150ebd08a0fe5535 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:06.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd2f1ffb640 1 -- 172.21.15.37:0/3666999861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc010630 con 0x5644731dd1b0 2024-09-21T01:16:06.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd30bfff640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd2f40b6510 0x7fd2f40b8a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd304014d40 tx=0x7fd304004b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:06.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd2f1ffb640 1 -- 172.21.15.37:0/3666999861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc010c80 con 0x5644731dd1b0 2024-09-21T01:16:06.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.249+0000 7fd2f1ffb640 1 -- 172.21.15.37:0/3666999861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc019b70 con 0x5644731dd1b0 2024-09-21T01:16:06.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 -- 172.21.15.37:0/3666999861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 msgr2=0x5644735adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 0x5644735adb90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00cbf0 tx=0x7fd2fc00e720 comp rx=0 tx=0).stop 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 -- 172.21.15.37:0/3666999861 shutdown_connections 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731dd1b0 0x5644735adb90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 --2- 172.21.15.37:0/3666999861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 -- 172.21.15.37:0/3666999861 >> 172.21.15.37:0/3666999861 conn(0x5644731fa460 msgr2=0x5644735ab540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 -- 172.21.15.37:0/3666999861 shutdown_connections 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.250+0000 7fd3185ba740 1 -- 172.21.15.37:0/3666999861 wait complete. 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 -- start start 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 Processor -- start 2024-09-21T01:16:06.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731dd1b0 0x5644735b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564473374700 con 0x5644731e5390 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644734ae110 con 0x564473206070 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644735bbe30 con 0x5644731dd1b0 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd3185ba740 10 client.0 _ll_register_callbacks cb 0x5644734c7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd30b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd30b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735b92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57512/0 (socket says 172.21.15.37:57512) 2024-09-21T01:16:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.251+0000 7fd30b7fe640 1 -- 172.21.15.37:0/843495492 learned_addr learned my addr 172.21.15.37:0/843495492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30affd640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731dd1b0 0x5644735b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30affd640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30b7fe640 1 -- 172.21.15.37:0/843495492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731dd1b0 msgr2=0x5644735b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731dd1b0 0x5644735b8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30b7fe640 1 -- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 msgr2=0x5644735c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30b7fe640 1 -- 172.21.15.37:0/843495492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644734dbc40 con 0x5644731e5390 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735b92d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c960 tx=0x7fd2fc005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4fb30d75ab64d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd2eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd2eaffd640 1 -- 172.21.15.37:0/843495492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc02a060 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd2eaffd640 1 -- 172.21.15.37:0/843495492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd2fc005040 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2fc010c80 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd2eaffd640 1 -- 172.21.15.37:0/843495492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2fc019e40 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.252+0000 7fd3185ba740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644735c7b10 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd2eaffd640 1 -- 172.21.15.37:0/843495492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc010c80 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd2eaffd640 1 -- 172.21.15.37:0/843495492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2fc02f070 con 0x5644731e5390 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 20 client.15537 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5644731c49f0 0x5644735caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 4 client.15537 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564473525da0 con 0x5644731c49f0 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.253+0000 7fd30affd640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5644731c49f0 0x5644735caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.254+0000 7fd2eaffd640 10 client.15537 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.254+0000 7fd30affd640 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5644731c49f0 0x5644735caf20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e91a3d1bcede7db0 server_cookie=1fde139f5a3cacf2 in_seq=0 out_seq=0 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd2eaffd640 1 -- 172.21.15.37:0/843495492 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564473525da0 con 0x5644731c49f0 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd2eaffd640 10 client.15537 handle_command_reply: tid=0 2024-09-21T01:16:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 client.15537 shutdown 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 msgr2=0x5644735b92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735b92d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c960 tx=0x7fd2fc005ce0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 shutdown_connections 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5644731c49f0 0x5644735caf20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd2eaffd640 0 client.15537 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564473206070 0x5644735c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735b92d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 --2- 172.21.15.37:0/843495492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731dd1b0 0x5644735b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 >> 172.21.15.37:0/843495492 conn(0x5644731fa460 msgr2=0x5644735b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 shutdown_connections 2024-09-21T01:16:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 1 -- 172.21.15.37:0/843495492 wait complete. 2024-09-21T01:16:06.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.255+0000 7fd3185ba740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T01:16:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 Processor -- start 2024-09-21T01:16:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 -- start start 2024-09-21T01:16:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 0x5644735c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1af4b0 con 0x5644731c49f0 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b0ff0 con 0x5644731dd1b0 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd3185ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1afb80 con 0x5644731e5390 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd30affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 0x5644735c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd30affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 0x5644735c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57520/0 (socket says 172.21.15.37:57520) 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd30affd640 1 -- 172.21.15.37:0/434371901 learned_addr learned my addr 172.21.15.37:0/434371901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.273+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd30affd640 1 -- 172.21.15.37:0/434371901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 msgr2=0x5644735b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd30affd640 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd30affd640 1 -- 172.21.15.37:0/434371901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 msgr2=0x5644735b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd30affd640 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd30affd640 1 -- 172.21.15.37:0/434371901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644735ba050 con 0x5644731c49f0 2024-09-21T01:16:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd30affd640 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 0x5644735c50c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd30c06b680 tx=0x7fd300005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e14cc33d82486 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd2f17fa640 1 -- 172.21.15.37:0/434371901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300000e60 con 0x5644731c49f0 2024-09-21T01:16:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd2f17fa640 1 -- 172.21.15.37:0/434371901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3000054d0 con 0x5644731c49f0 2024-09-21T01:16:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.274+0000 7fd2f17fa640 1 -- 172.21.15.37:0/434371901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300035040 con 0x5644731c49f0 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 -- 172.21.15.37:0/434371901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 msgr2=0x5644735c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 0x5644735c50c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd30c06b680 tx=0x7fd300005f30 comp rx=0 tx=0).stop 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 -- 172.21.15.37:0/434371901 shutdown_connections 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731e5390 0x5644735b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 --2- 172.21.15.37:0/434371901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731c49f0 0x5644735c50c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 -- 172.21.15.37:0/434371901 >> 172.21.15.37:0/434371901 conn(0x5644731fa460 msgr2=0x5644735b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 -- 172.21.15.37:0/434371901 shutdown_connections 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 -- 172.21.15.37:0/434371901 wait complete. 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 -- start start 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.275+0000 7fd3185ba740 1 Processor -- start 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731c49f0 0x5644735ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b0920 con 0x5644731e5390 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b0250 con 0x5644731dd1b0 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1ad470 con 0x5644731c49f0 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd3185ba740 10 client.0 _ll_register_callbacks cb 0x7fd2fc014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57524/0 (socket says 172.21.15.37:57524) 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30affd640 1 -- 172.21.15.37:0/1350981043 learned_addr learned my addr 172.21.15.37:0/1350981043 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30affd640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731c49f0 0x5644735ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30b7fe640 1 -- 172.21.15.37:0/1350981043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731c49f0 msgr2=0x5644735ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731c49f0 0x5644735ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30b7fe640 1 -- 172.21.15.37:0/1350981043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 msgr2=0x5644735cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30b7fe640 1 -- 172.21.15.37:0/1350981043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644736346a0 con 0x5644731dd1b0 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.276+0000 7fd30affd640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd30b7fe640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735cbda0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0058c0 tx=0x7fd2fc00c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f7ee9a88c4167d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd2eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd2eaffd640 1 -- 172.21.15.37:0/1350981043 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc035030 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3000054d0 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd2eaffd640 1 -- 172.21.15.37:0/1350981043 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd2fc021070 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd2eaffd640 1 -- 172.21.15.37:0/1350981043 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2fc02a040 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd3185ba740 10 client.25214 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564473635780 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.277+0000 7fd2eaffd640 1 -- 172.21.15.37:0/1350981043 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3000054d0 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd2eaffd640 1 -- 172.21.15.37:0/1350981043 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2fc02f040 con 0x5644731dd1b0 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd3185ba740 10 client.25214 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd3185ba740 10 client.25214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd3185ba740 20 client.25214 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd3185ba740 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564473206070 0x564473637f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd3185ba740 4 client.25214 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564473521850 con 0x564473206070 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd30affd640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564473206070 0x564473637f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd2eaffd640 10 client.25214 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.278+0000 7fd30affd640 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564473206070 0x564473637f00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e319cebe5a44b801 server_cookie=4167b25e7840f2db in_seq=0 out_seq=0 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd2eaffd640 1 -- 172.21.15.37:0/1350981043 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x564473521850 con 0x564473206070 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd2eaffd640 10 client.25214 handle_command_reply: tid=0 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 client.25214 shutdown 2024-09-21T01:16:06.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 msgr2=0x5644735cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735cbda0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0058c0 tx=0x7fd2fc00c310 comp rx=0 tx=0).stop 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 shutdown_connections 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564473206070 0x564473637f00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644731e5390 0x5644735cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644731dd1b0 0x5644735cbda0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 --2- 172.21.15.37:0/1350981043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644731c49f0 0x5644735ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 >> 172.21.15.37:0/1350981043 conn(0x5644731fa460 msgr2=0x5644735ba220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd2eaffd640 0 client.25214 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 shutdown_connections 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 1 -- 172.21.15.37:0/1350981043 wait complete. 2024-09-21T01:16:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.279+0000 7fd3185ba740 20 client.25214 trim_cache size 0 max 16384 2024-09-21T01:16:06.286 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:16:06.286 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:16:06.286 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:16:06.286 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:16:06.286 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:16:06.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "5136e175-0609-4bc5-a7ad-e169b15fc747", 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:16:06.287 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd2f40b6510 msgr2=0x7fd2f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd2f40b6510 0x7fd2f40b8a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd304014d40 tx=0x7fd304004b50 comp rx=0 tx=0).stop 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 msgr2=0x7fd30c19fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 0x7fd30c19fdb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b970 tx=0x7fd30400be30 comp rx=0 tx=0).stop 2024-09-21T01:16:06.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 shutdown_connections 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd2f40b6510 0x7fd2f40b8a20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd30c108d20 0x7fd30c19fdb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd30c1083d0 0x7fd30c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 --2- 172.21.15.37:0/1763553561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd30c102ae0 0x7fd30c19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 >> 172.21.15.37:0/1763553561 conn(0x7fd30c079760 msgr2=0x7fd30c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 shutdown_connections 2024-09-21T01:16:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:06.280+0000 7fd312046640 1 -- 172.21.15.37:0/1763553561 wait complete. 2024-09-21T01:16:06.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:06 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:16:06.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:06 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:06.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:06 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:16:06.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:06 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:06.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:06 smithi037 ceph-mon[31105]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T01:16:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:06 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:06 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:06 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:06 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:06 smithi137 ceph-mon[34607]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:06 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:06 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:06 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:16:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:06 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:06.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:06 smithi144 ceph-mon[34818]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T01:16:06.982 INFO:tasks.cephfs.filesystem:scrub status for tag:5136e175-0609-4bc5-a7ad-e169b15fc747 - {'path': '/', 'tag': '5136e175-0609-4bc5-a7ad-e169b15fc747', 'options': 'recursive,force'} 2024-09-21T01:16:08.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:08 smithi144 ceph-mon[34818]: pgmap v361: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:08.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:16:08.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:08.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:08 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:08.742 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:08 smithi037 ceph-mon[31105]: pgmap v361: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:08.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:16:08.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:08.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:08 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:08.799 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:08 smithi137 ceph-mon[34607]: pgmap v361: 97 pgs: 97 active+clean; 652 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-21T01:16:08.799 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:16:08.799 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:08.799 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:08 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-21T01:16:10.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:16:10.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:16:10.422 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:16:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:16:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:12 smithi137 ceph-mon[34607]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:12.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:12 smithi144 ceph-mon[34818]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:12.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:12 smithi037 ceph-mon[31105]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:14.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:14 smithi137 ceph-mon[34607]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:14.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:14 smithi144 ceph-mon[34818]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:14.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:14 smithi037 ceph-mon[31105]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:16.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:16 smithi137 ceph-mon[34607]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T01:16:16.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:16 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:16:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:16 smithi144 ceph-mon[34818]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T01:16:16.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:16 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:16:16.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:16 smithi037 ceph-mon[31105]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-21T01:16:16.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:16 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:16:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.120+0000 7fd3c71c6640 1 -- 172.21.15.37:0/3056109664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c0104750 msgr2=0x7fd3c0104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.120+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/3056109664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c0104750 0x7fd3c0104b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009900 tx=0x7fd3ac02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 -- 172.21.15.37:0/3056109664 shutdown_connections 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/3056109664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3c01050f0 0x7fd3c010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/3056109664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c0104750 0x7fd3c0104b60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/3056109664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c01036d0 0x7fd3c0103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 -- 172.21.15.37:0/3056109664 >> 172.21.15.37:0/3056109664 conn(0x7fd3c00ff030 msgr2=0x7fd3c01014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 -- 172.21.15.37:0/3056109664 shutdown_connections 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 -- 172.21.15.37:0/3056109664 wait complete. 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 Processor -- start 2024-09-21T01:16:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.121+0000 7fd3c71c6640 1 -- start start 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c71c6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c01036d0 0x7fd3c0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c71c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3c0104750 0x7fd3c019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c71c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 0x7fd3c019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c71c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c010f350 con 0x7fd3c01050f0 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c71c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c010f1d0 con 0x7fd3c0104750 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c71c6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c010f4d0 con 0x7fd3c01036d0 2024-09-21T01:16:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 0x7fd3c019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 0x7fd3c019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45220/0 (socket says 172.21.15.37:45220) 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 -- 172.21.15.37:0/4286366423 learned_addr learned my addr 172.21.15.37:0/4286366423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c01036d0 0x7fd3c0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3bffff640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3c0104750 0x7fd3c019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 -- 172.21.15.37:0/4286366423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c01036d0 msgr2=0x7fd3c0199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c01036d0 0x7fd3c0199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 -- 172.21.15.37:0/4286366423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3c0104750 msgr2=0x7fd3c019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3c0104750 0x7fd3c019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 -- 172.21.15.37:0/4286366423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c019b910 con 0x7fd3c01050f0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.122+0000 7fd3c5763640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 0x7fd3c019b180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800cce0 tx=0x7fd3b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.123+0000 7fd3bdffb640 1 -- 172.21.15.37:0/4286366423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800f450 con 0x7fd3c01050f0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.123+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c019bc00 con 0x7fd3c01050f0 2024-09-21T01:16:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.123+0000 7fd3bdffb640 1 -- 172.21.15.37:0/4286366423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3b800faa0 con 0x7fd3c01050f0 2024-09-21T01:16:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.123+0000 7fd3bdffb640 1 -- 172.21.15.37:0/4286366423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8018b70 con 0x7fd3c01050f0 2024-09-21T01:16:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.123+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c01a2380 con 0x7fd3c01050f0 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.125+0000 7fd3bdffb640 1 -- 172.21.15.37:0/4286366423 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd3b8018d10 con 0x7fd3c01050f0 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 Processor -- start 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 -- start start 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b85a001b0 0x559b85da7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85da84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85da9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b85d1a6f0 con 0x559b859d72f0 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b85d09b20 con 0x559b85a001b0 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3ce219740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559b85d0d930 con 0x559b859df4d0 2024-09-21T01:16:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3c4f62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85da84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3c4f62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85da84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45232/0 (socket says 172.21.15.37:45232) 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3c4f62640 1 -- 172.21.15.37:0/2335317119 learned_addr learned my addr 172.21.15.37:0/2335317119 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3bdffb640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd3b00b6510 0x7fd3b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.126+0000 7fd3bffff640 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85da9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3bffff640 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b85a001b0 0x559b85da7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c4f62640 1 -- 172.21.15.37:0/2335317119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 msgr2=0x559b85da9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85da9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c4f62640 1 -- 172.21.15.37:0/2335317119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b85a001b0 msgr2=0x559b85da7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b85a001b0 0x559b85da7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c4f62640 1 -- 172.21.15.37:0/2335317119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b85ccf530 con 0x559b859d72f0 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c5763640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd3b00b6510 0x7fd3b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3bffff640 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b85a001b0 0x559b85da7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3bdffb640 1 -- 172.21.15.37:0/4286366423 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd3b80e7690 con 0x7fd3c01050f0 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85da84c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400ac20 tx=0x7fd3b400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309e9f7fb9790e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3aaffd640 1 -- 172.21.15.37:0/2335317119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b401d070 con 0x559b859d72f0 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3aaffd640 1 -- 172.21.15.37:0/2335317119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3b4018af0 con 0x559b859d72f0 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.127+0000 7fd3aaffd640 1 -- 172.21.15.37:0/2335317119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4010aa0 con 0x559b859d72f0 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 -- 172.21.15.37:0/2335317119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 msgr2=0x559b85da84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3c5763640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd3b00b6510 0x7fd3b00b8a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ad7b0 tx=0x7fd3b80772c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85da84c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400ac20 tx=0x7fd3b400f790 comp rx=0 tx=0).stop 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 -- 172.21.15.37:0/2335317119 shutdown_connections 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85da9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85da84c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 --2- 172.21.15.37:0/2335317119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b85a001b0 0x559b85da7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 -- 172.21.15.37:0/2335317119 >> 172.21.15.37:0/2335317119 conn(0x559b859f4300 msgr2=0x559b85da38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 -- 172.21.15.37:0/2335317119 shutdown_connections 2024-09-21T01:16:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 -- 172.21.15.37:0/2335317119 wait complete. 2024-09-21T01:16:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.128+0000 7fd3ce219740 1 -- start start 2024-09-21T01:16:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 Processor -- start 2024-09-21T01:16:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85db2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b85c41ab0 con 0x559b859d72f0 2024-09-21T01:16:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b85caf730 con 0x559b859df4d0 2024-09-21T01:16:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559b85da9b30 con 0x559b85a001b0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3ce219740 10 client.0 _ll_register_callbacks cb 0x559b85d036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45236/0 (socket says 172.21.15.37:45236) 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3bffff640 1 -- 172.21.15.37:0/1279771018 learned_addr learned my addr 172.21.15.37:0/1279771018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85db2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.129+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3bffff640 1 -- 172.21.15.37:0/1279771018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 msgr2=0x559b85db2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85db2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3bffff640 1 -- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 msgr2=0x559b85db1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3bffff640 1 -- 172.21.15.37:0/1279771018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b85a6b790 con 0x559b859d72f0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db15e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac000c00 tx=0x7fd3ac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfe3354abc0ba88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd39ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd39ffff640 1 -- 172.21.15.37:0/1279771018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac035040 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd39ffff640 1 -- 172.21.15.37:0/1279771018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd3ac0315a0 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b4018af0 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd39ffff640 1 -- 172.21.15.37:0/1279771018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3ac0317a0 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3ce219740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b85ae4620 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.130+0000 7fd39ffff640 1 -- 172.21.15.37:0/1279771018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3b4018af0 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd39ffff640 1 -- 172.21.15.37:0/1279771018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3ac04c030 con 0x559b859d72f0 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3ce219740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3ce219740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3ce219740 20 client.15555 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859bed80 0x559b85dbec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3ce219740 4 client.15555 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b85d1c640 con 0x559b859bed80 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.131+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859bed80 0x559b85dbec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.132+0000 7fd39ffff640 10 client.15555 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.132+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859bed80 0x559b85dbec00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=656856ceb4967374 server_cookie=5e63b2f74d67c976 in_seq=0 out_seq=0 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd39ffff640 1 -- 172.21.15.37:0/1279771018 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b85d1c640 con 0x559b859bed80 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd39ffff640 10 client.15555 handle_command_reply: tid=0 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 client.15555 shutdown 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 msgr2=0x559b85db15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db15e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac000c00 tx=0x7fd3ac02a410 comp rx=0 tx=0).stop 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 shutdown_connections 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859bed80 0x559b85dbec00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85db2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd39ffff640 0 client.15555 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1279771018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db15e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 >> 172.21.15.37:0/1279771018 conn(0x559b859f4300 msgr2=0x559b85da1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 shutdown_connections 2024-09-21T01:16:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 1 -- 172.21.15.37:0/1279771018 wait complete. 2024-09-21T01:16:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.133+0000 7fd3ce219740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T01:16:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 Processor -- start 2024-09-21T01:16:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 -- start start 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85da1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01aaf20 con 0x559b859d72f0 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01aca60 con 0x559b859df4d0 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3ce219740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01ab5f0 con 0x559b85a001b0 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45242/0 (socket says 172.21.15.37:45242) 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.148+0000 7fd3bffff640 1 -- 172.21.15.37:0/1534344887 learned_addr learned my addr 172.21.15.37:0/1534344887 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3bffff640 1 -- 172.21.15.37:0/1534344887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 msgr2=0x559b85da1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85da1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3bffff640 1 -- 172.21.15.37:0/1534344887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 msgr2=0x559b85db0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3bffff640 1 -- 172.21.15.37:0/1534344887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b85db2b80 con 0x559b859d72f0 2024-09-21T01:16:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3bffff640 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db0200 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac006010 tx=0x7fd3ac0037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627eba5751fe0f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3aa7fc640 1 -- 172.21.15.37:0/1534344887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac042030 con 0x559b859d72f0 2024-09-21T01:16:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3aa7fc640 1 -- 172.21.15.37:0/1534344887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3ac004290 con 0x559b859d72f0 2024-09-21T01:16:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.149+0000 7fd3aa7fc640 1 -- 172.21.15.37:0/1534344887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac035040 con 0x559b859d72f0 2024-09-21T01:16:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 -- 172.21.15.37:0/1534344887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 msgr2=0x559b85db0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db0200 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac006010 tx=0x7fd3ac0037c0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 -- 172.21.15.37:0/1534344887 shutdown_connections 2024-09-21T01:16:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b85a001b0 0x559b85da1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859df4d0 0x559b85db0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 --2- 172.21.15.37:0/1534344887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b859d72f0 0x559b85db0200 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 -- 172.21.15.37:0/1534344887 >> 172.21.15.37:0/1534344887 conn(0x559b859f4300 msgr2=0x559b85dafaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 -- 172.21.15.37:0/1534344887 shutdown_connections 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 -- 172.21.15.37:0/1534344887 wait complete. 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 -- start start 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.150+0000 7fd3ce219740 1 Processor -- start 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859d72f0 0x559b85db8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85db7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 0x559b85db8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01ac390 con 0x559b85a001b0 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01abcc0 con 0x559b859d72f0 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01a8ee0 con 0x559b859df4d0 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3ce219740 10 client.0 _ll_register_callbacks cb 0x7fd3ac009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 0x559b85db8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 0x559b85db8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45250/0 (socket says 172.21.15.37:45250) 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 -- 172.21.15.37:0/3077603670 learned_addr learned my addr 172.21.15.37:0/3077603670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85db7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859d72f0 0x559b85db8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 -- 172.21.15.37:0/3077603670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 msgr2=0x559b85db7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85db7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 -- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859d72f0 msgr2=0x559b85db8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859d72f0 0x559b85db8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.151+0000 7fd3bffff640 1 -- 172.21.15.37:0/3077603670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b85db8800 con 0x559b85a001b0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3bffff640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 0x559b85db8090 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac03de40 tx=0x7fd3ac03db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5bcbf961ea0056 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd39ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd39ffff640 1 -- 172.21.15.37:0/3077603670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac05a020 con 0x559b85a001b0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd39ffff640 1 -- 172.21.15.37:0/3077603670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd3ac048070 con 0x559b85a001b0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559b85d180f0 con 0x559b85a001b0 2024-09-21T01:16:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd39ffff640 1 -- 172.21.15.37:0/3077603670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3ac035030 con 0x559b85a001b0 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 10 client.15561 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559b85e29600 con 0x559b85a001b0 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd39ffff640 1 -- 172.21.15.37:0/3077603670 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559b85d180f0 con 0x559b85a001b0 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd39ffff640 1 -- 172.21.15.37:0/3077603670 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3ac062030 con 0x559b85a001b0 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 10 client.15561 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 20 client.15561 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859941c0 0x559b85e2bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 4 client.15561 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.152+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b85d15520 con 0x559b859941c0 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.153+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859941c0 0x559b85e2bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.153+0000 7fd39ffff640 10 client.15561 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.153+0000 7fd3c4f62640 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859941c0 0x559b85e2bf10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8c0e775fe6b966 server_cookie=ad9c5dbfb32ed720 in_seq=0 out_seq=0 2024-09-21T01:16:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.164+0000 7fd39ffff640 1 -- 172.21.15.37:0/3077603670 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b85d15520 con 0x559b859941c0 2024-09-21T01:16:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.164+0000 7fd39ffff640 10 client.15561 handle_command_reply: tid=0 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.164+0000 7fd3ce219740 1 client.15561 shutdown 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 msgr2=0x559b85db8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 0x559b85db8090 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac03de40 tx=0x7fd3ac03db30 comp rx=0 tx=0).stop 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 shutdown_connections 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559b859941c0 0x559b85e2bf10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b85a001b0 0x559b85db8090 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b859df4d0 0x559b85db7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd39ffff640 0 client.15561 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 --2- 172.21.15.37:0/3077603670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b859d72f0 0x559b85db8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 >> 172.21.15.37:0/3077603670 conn(0x559b859f4300 msgr2=0x559b85dabf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 shutdown_connections 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 1 -- 172.21.15.37:0/3077603670 wait complete. 2024-09-21T01:16:17.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.165+0000 7fd3ce219740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T01:16:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:16:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:16:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:16:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd3b00b6510 msgr2=0x7fd3b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd3b00b6510 0x7fd3b00b8a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ad7b0 tx=0x7fd3b80772c0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 msgr2=0x7fd3c019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 0x7fd3c019b180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800cce0 tx=0x7fd3b800a620 comp rx=0 tx=0).stop 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 shutdown_connections 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd3b00b6510 0x7fd3b00b8a20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c01050f0 0x7fd3c019b180 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3c0104750 0x7fd3c019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 --2- 172.21.15.37:0/4286366423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c01036d0 0x7fd3c0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 >> 172.21.15.37:0/4286366423 conn(0x7fd3c00ff030 msgr2=0x7fd3c0107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 shutdown_connections 2024-09-21T01:16:17.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:17.166+0000 7fd3c71c6640 1 -- 172.21.15.37:0/4286366423 wait complete. 2024-09-21T01:16:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:18 smithi137 ceph-mon[34607]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:18.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:18 smithi144 ceph-mon[34818]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:18.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:18 smithi037 ceph-mon[31105]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T01:16:20.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:20 smithi037 ceph-mon[31105]: pgmap v367: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-21T01:16:20.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:20 smithi137 ceph-mon[34607]: pgmap v367: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-21T01:16:20.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:20 smithi144 ceph-mon[34818]: pgmap v367: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-21T01:16:22.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:22 smithi037 ceph-mon[31105]: pgmap v368: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:22.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:22 smithi137 ceph-mon[34607]: pgmap v368: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:22.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:22 smithi144 ceph-mon[34818]: pgmap v368: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:24.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:24 smithi037 ceph-mon[31105]: pgmap v369: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:24.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:24 smithi137 ceph-mon[34607]: pgmap v369: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:24.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:24 smithi144 ceph-mon[34818]: pgmap v369: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:26.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:26 smithi037 ceph-mon[31105]: pgmap v370: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T01:16:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:26 smithi137 ceph-mon[34607]: pgmap v370: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T01:16:26.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:26 smithi144 ceph-mon[34818]: pgmap v370: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T01:16:28.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:28 smithi037 ceph-mon[31105]: pgmap v371: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:28.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:28 smithi137 ceph-mon[34607]: pgmap v371: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:28.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:28 smithi144 ceph-mon[34818]: pgmap v371: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-21T01:16:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.267+0000 7f00d10cc640 1 -- 172.21.15.37:0/2242346971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc103fc0 msgr2=0x7f00cc10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.267+0000 7f00d10cc640 1 --2- 172.21.15.37:0/2242346971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc103fc0 0x7f00cc10a960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009c90 tx=0x7f00c402a860 comp rx=0 tx=0).stop 2024-09-21T01:16:30.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 -- 172.21.15.37:0/2242346971 shutdown_connections 2024-09-21T01:16:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 --2- 172.21.15.37:0/2242346971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc103fc0 0x7f00cc10a960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 --2- 172.21.15.37:0/2242346971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00cc103620 0x7f00cc103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 --2- 172.21.15.37:0/2242346971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00cc1025a0 0x7f00cc102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 -- 172.21.15.37:0/2242346971 >> 172.21.15.37:0/2242346971 conn(0x7f00cc0fdee0 msgr2=0x7f00cc100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 -- 172.21.15.37:0/2242346971 shutdown_connections 2024-09-21T01:16:30.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 -- 172.21.15.37:0/2242346971 wait complete. 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.268+0000 7f00d10cc640 1 Processor -- start 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 -- start start 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 0x7f00cc199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00cc103620 0x7f00cc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00cc103fc0 0x7f00cc19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc10e240 con 0x7f00cc1025a0 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc10e0c0 con 0x7f00cc103fc0 2024-09-21T01:16:30.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00d10cc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc10e3c0 con 0x7f00cc103620 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 0x7f00cc199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 0x7f00cc199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38582/0 (socket says 172.21.15.37:38582) 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 -- 172.21.15.37:0/491120625 learned_addr learned my addr 172.21.15.37:0/491120625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cb59e640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00cc103fc0 0x7f00cc19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00ca59c640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00cc103620 0x7f00cc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 -- 172.21.15.37:0/491120625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00cc103620 msgr2=0x7f00cc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00cc103620 0x7f00cc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 -- 172.21.15.37:0/491120625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00cc103fc0 msgr2=0x7f00cc19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00cc103fc0 0x7f00cc19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.269+0000 7f00cad9d640 1 -- 172.21.15.37:0/491120625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc19b970 con 0x7f00cc1025a0 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.270+0000 7f00cad9d640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 0x7f00cc199f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00e9f0 tx=0x7f00bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.270+0000 7f00b3fff640 1 -- 172.21.15.37:0/491120625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00cd80 con 0x7f00cc1025a0 2024-09-21T01:16:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.270+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc19bc60 con 0x7f00cc1025a0 2024-09-21T01:16:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.270+0000 7f00b3fff640 1 -- 172.21.15.37:0/491120625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00bc0054d0 con 0x7f00cc1025a0 2024-09-21T01:16:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.270+0000 7f00b3fff640 1 -- 172.21.15.37:0/491120625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc010690 con 0x7f00cc1025a0 2024-09-21T01:16:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.270+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc1a2350 con 0x7f00cc1025a0 2024-09-21T01:16:30.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.273+0000 7f00b3fff640 1 -- 172.21.15.37:0/491120625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f00bc004e90 con 0x7f00cc1025a0 2024-09-21T01:16:30.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.273+0000 7f00d8039740 1 Processor -- start 2024-09-21T01:16:30.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 -- start start 2024-09-21T01:16:30.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00b3fff640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f00b40b6510 0x7f00b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00cb59e640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f00b40b6510 0x7f00b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605401b0 0x55f6608e7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00b3fff640 1 -- 172.21.15.37:0/491120625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f00bc0e76f0 con 0x7f00cc1025a0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f66085a6f0 con 0x55f66051f4d0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f660849b20 con 0x55f6605172f0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00d8039740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f66084d930 con 0x55f6605401b0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608e84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:55522/0 (socket says 172.21.15.37:55522) 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 -- 172.21.15.37:0/3620248101 learned_addr learned my addr 172.21.15.37:0/3620248101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00cad9d640 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605401b0 0x55f6608e7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 -- 172.21.15.37:0/3620248101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605401b0 msgr2=0x55f6608e7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605401b0 0x55f6608e7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 -- 172.21.15.37:0/3620248101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 msgr2=0x55f6608e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.274+0000 7f00ca59c640 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00ca59c640 1 -- 172.21.15.37:0/3620248101 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66080f530 con 0x55f6605172f0 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00cb59e640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f00b40b6510 0x7f00b40b8a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00c402ae50 tx=0x7f00c4031c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00cad9d640 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605401b0 0x55f6608e7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00ca59c640 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608e84c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00c000bd10 tx=0x7f00c00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74724849a408416f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00b17fa640 1 -- 172.21.15.37:0/3620248101 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0004030 con 0x55f6605172f0 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00b17fa640 1 -- 172.21.15.37:0/3620248101 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c00035f0 con 0x55f6605172f0 2024-09-21T01:16:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.275+0000 7f00b17fa640 1 -- 172.21.15.37:0/3620248101 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0011680 con 0x55f6605172f0 2024-09-21T01:16:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 -- 172.21.15.37:0/3620248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 msgr2=0x55f6608e84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608e84c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00c000bd10 tx=0x7f00c00107a0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 -- 172.21.15.37:0/3620248101 shutdown_connections 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608e84c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 --2- 172.21.15.37:0/3620248101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605401b0 0x55f6608e7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 -- 172.21.15.37:0/3620248101 >> 172.21.15.37:0/3620248101 conn(0x55f660534300 msgr2=0x55f6608e38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 -- 172.21.15.37:0/3620248101 shutdown_connections 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.276+0000 7f00d8039740 1 -- 172.21.15.37:0/3620248101 wait complete. 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 -- start start 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 Processor -- start 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 0x55f6608f1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605401b0 0x55f6608f2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f660781ab0 con 0x55f6605172f0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f6607ef730 con 0x55f6605401b0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f6608e9b30 con 0x55f66051f4d0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00d8039740 10 client.0 _ll_register_callbacks cb 0x55f6608436b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.277+0000 7f00cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 0x55f6608f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 0x55f6608f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38594/0 (socket says 172.21.15.37:38594) 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 -- 172.21.15.37:0/1010184157 learned_addr learned my addr 172.21.15.37:0/1010184157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00ca59c640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cb59e640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605401b0 0x55f6608f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 -- 172.21.15.37:0/1010184157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 msgr2=0x55f6608f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 -- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605401b0 msgr2=0x55f6608f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605401b0 0x55f6608f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 -- 172.21.15.37:0/1010184157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6605ab790 con 0x55f6605172f0 2024-09-21T01:16:30.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cb59e640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605401b0 0x55f6608f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00cad9d640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 0x55f6608f1610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0a9930 tx=0x7f00bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4a9982d8223075 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00aeff5640 1 -- 172.21.15.37:0/1010184157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0aedb0 con 0x55f6605172f0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00aeff5640 1 -- 172.21.15.37:0/1010184157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f00bc0acae0 con 0x55f6605172f0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00c00035f0 con 0x55f6605172f0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00aeff5640 1 -- 172.21.15.37:0/1010184157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00bc0ad390 con 0x55f6605172f0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00d8039740 10 client.15573 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.278+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f660624620 con 0x55f6605172f0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00aeff5640 1 -- 172.21.15.37:0/1010184157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c00035f0 con 0x55f6605172f0 2024-09-21T01:16:30.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00aeff5640 1 -- 172.21.15.37:0/1010184157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f00bc0d4030 con 0x55f6605172f0 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00d8039740 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00d8039740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00d8039740 20 client.15573 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00d8039740 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6604fed80 0x55f6608fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00d8039740 4 client.15573 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f66085c640 con 0x55f6604fed80 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.279+0000 7f00ca59c640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6604fed80 0x55f6608fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.280+0000 7f00aeff5640 10 client.15573 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.280+0000 7f00ca59c640 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6604fed80 0x55f6608fed00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66206f919e79658f server_cookie=5279bb0721e60038 in_seq=0 out_seq=0 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.280+0000 7f00aeff5640 1 -- 172.21.15.37:0/1010184157 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f66085c640 con 0x55f6604fed80 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.280+0000 7f00aeff5640 10 client.15573 handle_command_reply: tid=0 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.280+0000 7f00d8039740 1 client.15573 shutdown 2024-09-21T01:16:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 msgr2=0x55f6608f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 0x55f6608f1610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0a9930 tx=0x7f00bc0048f0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 shutdown_connections 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6604fed80 0x55f6608fed00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605401b0 0x55f6608f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00aeff5640 0 client.15573 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 --2- 172.21.15.37:0/1010184157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6605172f0 0x55f6608f1610 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 >> 172.21.15.37:0/1010184157 conn(0x55f660534300 msgr2=0x55f6608e1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 shutdown_connections 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 1 -- 172.21.15.37:0/1010184157 wait complete. 2024-09-21T01:16:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.281+0000 7f00d8039740 20 client.15573 trim_cache size 0 max 16384 2024-09-21T01:16:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.308+0000 7f00d8039740 1 Processor -- start 2024-09-21T01:16:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.308+0000 7f00d8039740 1 -- start start 2024-09-21T01:16:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00d8039740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6604fed80 0x55f6608f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00d8039740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605172f0 0x55f6608e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00d8039740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00d8039740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1aafb0 con 0x55f66051f4d0 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00d8039740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1acaf0 con 0x55f6604fed80 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00d8039740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1ab680 con 0x55f6605172f0 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38596/0 (socket says 172.21.15.37:38596) 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 -- 172.21.15.37:0/2345531461 learned_addr learned my addr 172.21.15.37:0/2345531461 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00ca59c640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605172f0 0x55f6608e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cad9d640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6604fed80 0x55f6608f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 -- 172.21.15.37:0/2345531461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605172f0 msgr2=0x55f6608e3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605172f0 0x55f6608e3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 -- 172.21.15.37:0/2345531461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6604fed80 msgr2=0x55f6608f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6604fed80 0x55f6608f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 -- 172.21.15.37:0/2345531461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6608f2bb0 con 0x55f66051f4d0 2024-09-21T01:16:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00ca59c640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605172f0 0x55f6608e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cad9d640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6604fed80 0x55f6608f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.309+0000 7f00cb59e640 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e3d40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f00c4035000 tx=0x7f00c4049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0677cb9d2bfabd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.310+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2345531461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4030560 con 0x55f66051f4d0 2024-09-21T01:16:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.310+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2345531461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c4036040 con 0x55f66051f4d0 2024-09-21T01:16:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.310+0000 7f00b0ff9640 1 -- 172.21.15.37:0/2345531461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c40559d0 con 0x55f66051f4d0 2024-09-21T01:16:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- 172.21.15.37:0/2345531461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 msgr2=0x55f6608e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e3d40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f00c4035000 tx=0x7f00c4049000 comp rx=0 tx=0).stop 2024-09-21T01:16:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- 172.21.15.37:0/2345531461 shutdown_connections 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f66051f4d0 0x55f6608e3d40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6605172f0 0x55f6608e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- 172.21.15.37:0/2345531461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6604fed80 0x55f6608f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- 172.21.15.37:0/2345531461 >> 172.21.15.37:0/2345531461 conn(0x55f660534300 msgr2=0x55f6608efb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- 172.21.15.37:0/2345531461 shutdown_connections 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- 172.21.15.37:0/2345531461 wait complete. 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- start start 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 Processor -- start 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 0x55f6608f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1ac420 con 0x55f6604fed80 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1abd50 con 0x55f6605172f0 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc1a8f70 con 0x55f66051f4d0 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.311+0000 7f00d8039740 10 client.0 _ll_register_callbacks cb 0x7f00bc004990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 0x55f6608f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 0x55f6608f84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38598/0 (socket says 172.21.15.37:38598) 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 -- 172.21.15.37:0/1661851876 learned_addr learned my addr 172.21.15.37:0/1661851876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00ca59c640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cb59e640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 -- 172.21.15.37:0/1661851876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 msgr2=0x55f6608f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 -- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 msgr2=0x55f6608f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 -- 172.21.15.37:0/1661851876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6608f7160 con 0x55f6604fed80 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00cad9d640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 0x55f6608f84f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0aceb0 tx=0x7f00bc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff6ef3b99cd3dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00aeff5640 1 -- 172.21.15.37:0/1661851876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0a9720 con 0x55f6604fed80 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00aeff5640 1 -- 172.21.15.37:0/1661851876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f00bc0a93d0 con 0x55f6604fed80 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.312+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00c4036040 con 0x55f6604fed80 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00aeff5640 1 -- 172.21.15.37:0/1661851876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00bc0ad650 con 0x55f6604fed80 2024-09-21T01:16:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 10 client.15579 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f660969ac0 con 0x55f6604fed80 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00aeff5640 1 -- 172.21.15.37:0/1661851876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c4036040 con 0x55f6604fed80 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00aeff5640 1 -- 172.21.15.37:0/1661851876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f00bc0d4070 con 0x55f6604fed80 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 10 client.15579 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 20 client.15579 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6605401b0 0x55f66096c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 4 client.15579 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f6608580f0 con 0x55f6605401b0 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.313+0000 7f00ca59c640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6605401b0 0x55f66096c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.314+0000 7f00aeff5640 10 client.15579 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:30.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.314+0000 7f00ca59c640 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6605401b0 0x55f66096c4b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c6ce468905d372b server_cookie=c49a3c4ac172e730 in_seq=0 out_seq=0 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.319+0000 7f00aeff5640 1 -- 172.21.15.37:0/1661851876 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f6608580f0 con 0x55f6605401b0 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.319+0000 7f00aeff5640 10 client.15579 handle_command_reply: tid=0 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.319+0000 7f00d8039740 1 client.15579 shutdown 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 msgr2=0x55f6608f84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 0x55f6608f84f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0aceb0 tx=0x7f00bc00c840 comp rx=0 tx=0).stop 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 shutdown_connections 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6605401b0 0x55f66096c4b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f66051f4d0 0x55f6608f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6605172f0 0x55f6608f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00aeff5640 0 client.15579 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 --2- 172.21.15.37:0/1661851876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6604fed80 0x55f6608f84f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 >> 172.21.15.37:0/1661851876 conn(0x55f660534300 msgr2=0x55f6608ebf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 shutdown_connections 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 1 -- 172.21.15.37:0/1661851876 wait complete. 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d8039740 20 client.15579 trim_cache size 0 max 16384 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:16:30.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:16:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f00b40b6510 msgr2=0x7f00b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d10cc640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f00b40b6510 0x7f00b40b8a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00c402ae50 tx=0x7f00c4031c70 comp rx=0 tx=0).stop 2024-09-21T01:16:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 msgr2=0x7f00cc199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:30.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.320+0000 7f00d10cc640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 0x7f00cc199f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00e9f0 tx=0x7f00bc00edf0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 shutdown_connections 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f00b40b6510 0x7f00b40b8a20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00cc103fc0 0x7f00cc19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00cc103620 0x7f00cc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 --2- 172.21.15.37:0/491120625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00cc1025a0 0x7f00cc199f30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 >> 172.21.15.37:0/491120625 conn(0x7f00cc0fdee0 msgr2=0x7f00cc0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 shutdown_connections 2024-09-21T01:16:30.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:30.321+0000 7f00d10cc640 1 -- 172.21.15.37:0/491120625 wait complete. 2024-09-21T01:16:30.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:30 smithi037 ceph-mon[31105]: pgmap v372: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T01:16:30.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:30 smithi137 ceph-mon[34607]: pgmap v372: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T01:16:30.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:30 smithi144 ceph-mon[34818]: pgmap v372: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-09-21T01:16:32.473 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:32 smithi137 ceph-mon[34607]: pgmap v373: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T01:16:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:32 smithi144 ceph-mon[34818]: pgmap v373: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T01:16:32.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:32 smithi037 ceph-mon[31105]: pgmap v373: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T01:16:34.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:34 smithi037 ceph-mon[31105]: pgmap v374: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:16:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:34 smithi137 ceph-mon[34607]: pgmap v374: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:16:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:34 smithi144 ceph-mon[34818]: pgmap v374: 97 pgs: 97 active+clean; 660 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T01:16:36.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:36 smithi037 ceph-mon[31105]: pgmap v375: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:16:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:36 smithi137 ceph-mon[34607]: pgmap v375: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:16:36.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:36 smithi144 ceph-mon[34818]: pgmap v375: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:16:36.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:16:37.264 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.813+0000 7fdc342c2640 1 -- 172.21.15.37:0/3636194758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c10de60 msgr2=0x7fdc2c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.813+0000 7fdc342c2640 1 --2- 172.21.15.37:0/3636194758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c10de60 0x7fdc2c110330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009ca0 tx=0x7fdc2402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 -- 172.21.15.37:0/3636194758 shutdown_connections 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 --2- 172.21.15.37:0/3636194758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c10de60 0x7fdc2c110330 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 --2- 172.21.15.37:0/3636194758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc2c105380 0x7fdc2c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 --2- 172.21.15.37:0/3636194758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c104a30 0x7fdc2c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 -- 172.21.15.37:0/3636194758 >> 172.21.15.37:0/3636194758 conn(0x7fdc2c079790 msgr2=0x7fdc2c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 -- 172.21.15.37:0/3636194758 shutdown_connections 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.814+0000 7fdc342c2640 1 -- 172.21.15.37:0/3636194758 wait complete. 2024-09-21T01:16:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 Processor -- start 2024-09-21T01:16:37.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 -- start start 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 0x7fdc2c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c105380 0x7fdc2c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc2c10de60 0x7fdc2c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c113aa0 con 0x7fdc2c104a30 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c113920 con 0x7fdc2c10de60 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc342c2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c113c20 con 0x7fdc2c105380 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc3205e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 0x7fdc2c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc3205e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 0x7fdc2c19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59224/0 (socket says 172.21.15.37:59224) 2024-09-21T01:16:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc3205e640 1 -- 172.21.15.37:0/223351978 learned_addr learned my addr 172.21.15.37:0/223351978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc3285f640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc2c10de60 0x7fdc2c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.815+0000 7fdc3185d640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c105380 0x7fdc2c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3205e640 1 -- 172.21.15.37:0/223351978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c105380 msgr2=0x7fdc2c19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3205e640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c105380 0x7fdc2c19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3205e640 1 -- 172.21.15.37:0/223351978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc2c10de60 msgr2=0x7fdc2c19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3205e640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc2c10de60 0x7fdc2c19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3205e640 1 -- 172.21.15.37:0/223351978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c1a0380 con 0x7fdc2c104a30 2024-09-21T01:16:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3185d640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c105380 0x7fdc2c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc3205e640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 0x7fdc2c19a410 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800d950 tx=0x7fdc2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc237fe640 1 -- 172.21.15.37:0/223351978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28017070 con 0x7fdc2c104a30 2024-09-21T01:16:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc237fe640 1 -- 172.21.15.37:0/223351978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc28009c30 con 0x7fdc2c104a30 2024-09-21T01:16:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c1a0670 con 0x7fdc2c104a30 2024-09-21T01:16:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc237fe640 1 -- 172.21.15.37:0/223351978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800f620 con 0x7fdc2c104a30 2024-09-21T01:16:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.816+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c1a6dd0 con 0x7fdc2c104a30 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.820+0000 7fdc3a836740 1 Processor -- start 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.820+0000 7fdc3a836740 1 -- start start 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b454a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b454acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3a836740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5610b44c0e50 con 0x5610b41a3070 2024-09-21T01:16:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3a836740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5610b44b0280 con 0x5610b417a1b0 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3a836740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5610b44b4090 con 0x5610b4182390 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc237fe640 1 -- 172.21.15.37:0/223351978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdc28010460 con 0x7fdc2c104a30 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3205e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b454a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3185d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b454acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3185d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b454acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40610/0 (socket says 172.21.15.37:40610) 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.821+0000 7fdc3185d640 1 -- 172.21.15.37:0/389249504 learned_addr learned my addr 172.21.15.37:0/389249504 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.822+0000 7fdc3185d640 1 -- 172.21.15.37:0/389249504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 msgr2=0x5610b454a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.822+0000 7fdc3185d640 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.822+0000 7fdc3185d640 1 -- 172.21.15.37:0/389249504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 msgr2=0x5610b454a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc237fe640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdc180b6590 0x7fdc180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc3185d640 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b454a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc3185d640 1 -- 172.21.15.37:0/389249504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610b420e650 con 0x5610b4182390 2024-09-21T01:16:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc237fe640 1 -- 172.21.15.37:0/223351978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fdc280e6f00 con 0x7fdc2c104a30 2024-09-21T01:16:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc3285f640 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b454a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc3205e640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdc180b6590 0x7fdc180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc3185d640 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b454acf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00bc30 tx=0x7fdc1c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc762ceb933908b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.823+0000 7fdc20d9a640 1 -- 172.21.15.37:0/389249504 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c004030 con 0x5610b4182390 2024-09-21T01:16:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.824+0000 7fdc20d9a640 1 -- 172.21.15.37:0/389249504 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc1c0054d0 con 0x5610b4182390 2024-09-21T01:16:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.824+0000 7fdc20d9a640 1 -- 172.21.15.37:0/389249504 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c004b60 con 0x5610b4182390 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 -- 172.21.15.37:0/389249504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 msgr2=0x5610b454acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b454acf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00bc30 tx=0x7fdc1c00f730 comp rx=0 tx=0).stop 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3205e640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdc180b6590 0x7fdc180b8aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdc280acfe0 tx=0x7fdc280ea940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 -- 172.21.15.37:0/389249504 shutdown_connections 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b454acf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 --2- 172.21.15.37:0/389249504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b454a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 -- 172.21.15.37:0/389249504 >> 172.21.15.37:0/389249504 conn(0x5610b4197460 msgr2=0x5610b4548160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 -- 172.21.15.37:0/389249504 shutdown_connections 2024-09-21T01:16:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.825+0000 7fdc3a836740 1 -- 172.21.15.37:0/389249504 wait complete. 2024-09-21T01:16:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 -- start start 2024-09-21T01:16:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 Processor -- start 2024-09-21T01:16:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 0x5610b4555890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4555dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b41a3070 0x5610b4556310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5610b4311700 con 0x5610b417a1b0 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5610b444b110 con 0x5610b41a3070 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5610b4558a50 con 0x5610b4182390 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3a836740 10 client.0 _ll_register_callbacks cb 0x5610b4464990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 0x5610b4555890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 0x5610b4555890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59252/0 (socket says 172.21.15.37:59252) 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.826+0000 7fdc3285f640 1 -- 172.21.15.37:0/2803974485 learned_addr learned my addr 172.21.15.37:0/2803974485 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3285f640 1 -- 172.21.15.37:0/2803974485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 msgr2=0x5610b4555dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3285f640 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4555dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3285f640 1 -- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b41a3070 msgr2=0x5610b4556310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3285f640 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b41a3070 0x5610b4556310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3285f640 1 -- 172.21.15.37:0/2803974485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610b4478c40 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3285f640 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 0x5610b4555890 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdc24031680 tx=0x7fdc240316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311b5acf3160e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc15ffb640 1 -- 172.21.15.37:0/2803974485 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24003970 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc15ffb640 1 -- 172.21.15.37:0/2803974485 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fdc24003b10 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.827+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc1c0054d0 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc15ffb640 1 -- 172.21.15.37:0/2803974485 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc24003d10 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 10 client.15591 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610b4568aa0 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc15ffb640 1 -- 172.21.15.37:0/2803974485 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc1c0054d0 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc15ffb640 1 -- 172.21.15.37:0/2803974485 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdc2404e020 con 0x5610b417a1b0 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 10 client.15591 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 20 client.15591 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b41619f0 0x5610b456c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 4 client.15591 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.828+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610b44c2da0 con 0x5610b41619f0 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.829+0000 7fdc3185d640 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b41619f0 0x5610b456c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.830+0000 7fdc3185d640 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b41619f0 0x5610b456c010 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98760f91fc1a9e22 server_cookie=8a4d49ed872dbd5 in_seq=0 out_seq=0 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.830+0000 7fdc15ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.830+0000 7fdc15ffb640 1 -- 172.21.15.37:0/2803974485 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5610b44c2da0 con 0x5610b41619f0 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.830+0000 7fdc15ffb640 10 client.15591 handle_command_reply: tid=0 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.830+0000 7fdc3a836740 1 client.15591 shutdown 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 msgr2=0x5610b4555890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 0x5610b4555890 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdc24031680 tx=0x7fdc240316b0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 shutdown_connections 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b41619f0 0x5610b456c010 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b41a3070 0x5610b4556310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4555dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 --2- 172.21.15.37:0/2803974485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b417a1b0 0x5610b4555890 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 >> 172.21.15.37:0/2803974485 conn(0x5610b4197460 msgr2=0x5610b454d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc15ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 shutdown_connections 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 1 -- 172.21.15.37:0/2803974485 wait complete. 2024-09-21T01:16:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.831+0000 7fdc3a836740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T01:16:37.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.866+0000 7fdc3a836740 1 Processor -- start 2024-09-21T01:16:37.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.866+0000 7fdc3a836740 1 -- start start 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4557770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b4561370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3a836740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1ad290 con 0x5610b41a3070 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3a836740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1aedd0 con 0x5610b417a1b0 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3a836740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1ad960 con 0x5610b4182390 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b4561370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b4561370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59260/0 (socket says 172.21.15.37:59260) 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 -- 172.21.15.37:0/1307869396 learned_addr learned my addr 172.21.15.37:0/1307869396 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:37.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3185d640 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4557770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 -- 172.21.15.37:0/1307869396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 msgr2=0x5610b4557770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4557770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 -- 172.21.15.37:0/1307869396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 msgr2=0x5610b454bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3285f640 1 -- 172.21.15.37:0/1307869396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610b4161c20 con 0x5610b41a3070 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.867+0000 7fdc3185d640 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4557770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.868+0000 7fdc3285f640 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b4561370 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdc240049d0 tx=0x7fdc2403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbbaa2076529a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.868+0000 7fdc17fff640 1 -- 172.21.15.37:0/1307869396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24003970 con 0x5610b41a3070 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.868+0000 7fdc17fff640 1 -- 172.21.15.37:0/1307869396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc24036050 con 0x5610b41a3070 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.868+0000 7fdc17fff640 1 -- 172.21.15.37:0/1307869396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2402fd80 con 0x5610b41a3070 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.869+0000 7fdc3a836740 1 -- 172.21.15.37:0/1307869396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 msgr2=0x5610b4561370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.869+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b4561370 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdc240049d0 tx=0x7fdc2403e040 comp rx=0 tx=0).stop 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.869+0000 7fdc3a836740 1 -- 172.21.15.37:0/1307869396 shutdown_connections 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.869+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b41a3070 0x5610b4561370 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.869+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b4182390 0x5610b4557770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.869+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1307869396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b454bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.870+0000 7fdc3a836740 1 -- 172.21.15.37:0/1307869396 >> 172.21.15.37:0/1307869396 conn(0x5610b4197460 msgr2=0x5610b4560c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.870+0000 7fdc3a836740 1 -- 172.21.15.37:0/1307869396 shutdown_connections 2024-09-21T01:16:37.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.870+0000 7fdc3a836740 1 -- 172.21.15.37:0/1307869396 wait complete. 2024-09-21T01:16:37.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.870+0000 7fdc3a836740 1 -- start start 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.870+0000 7fdc3a836740 1 Processor -- start 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b455e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 0x5610b455e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b41a3070 0x5610b4559740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3185d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 0x5610b455e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b455e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3285f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b455e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36002/0 (socket says 172.21.15.37:36002) 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3185d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 0x5610b455e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59266/0 (socket says 172.21.15.37:59266) 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1ae700 con 0x5610b4182390 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1ae030 con 0x5610b417a1b0 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1ab270 con 0x5610b41a3070 2024-09-21T01:16:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.871+0000 7fdc3a836740 10 client.0 _ll_register_callbacks cb 0x7fdc24009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:37.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3285f640 1 -- 172.21.15.37:0/1139743258 learned_addr learned my addr 172.21.15.37:0/1139743258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3185d640 1 -- 172.21.15.37:0/1139743258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b41a3070 msgr2=0x5610b4559740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3185d640 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b41a3070 0x5610b4559740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3185d640 1 -- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 msgr2=0x5610b455e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3185d640 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b455e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3185d640 1 -- 172.21.15.37:0/1139743258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610b4559ed0 con 0x5610b4182390 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc3185d640 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 0x5610b455e6a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c005d00 tx=0x7fdc1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39083a35322af1c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.872+0000 7fdc15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc15ffb640 1 -- 172.21.15.37:0/1139743258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c028430 con 0x5610b4182390 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc15ffb640 1 -- 172.21.15.37:0/1139743258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fdc1c0285d0 con 0x5610b4182390 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc24036050 con 0x5610b4182390 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc15ffb640 1 -- 172.21.15.37:0/1139743258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdc1c0287d0 con 0x5610b4182390 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc3a836740 10 client.15597 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610b45d6580 con 0x5610b4182390 2024-09-21T01:16:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.873+0000 7fdc15ffb640 1 -- 172.21.15.37:0/1139743258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc24036050 con 0x5610b4182390 2024-09-21T01:16:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc15ffb640 1 -- 172.21.15.37:0/1139743258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdc1c01b8f0 con 0x5610b4182390 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc3a836740 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc3a836740 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc3a836740 20 client.15597 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b4136da0 0x5610b45d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc3a836740 4 client.15597 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.874+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5610b44be850 con 0x5610b4136da0 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.875+0000 7fdc3285f640 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b4136da0 0x5610b45d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.875+0000 7fdc3285f640 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b4136da0 0x5610b45d89b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75248b9b10026c35 server_cookie=f6c4158aabb82a70 in_seq=0 out_seq=0 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.875+0000 7fdc15ffb640 10 client.15597 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.875+0000 7fdc15ffb640 1 -- 172.21.15.37:0/1139743258 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x5610b44be850 con 0x5610b4136da0 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.875+0000 7fdc15ffb640 10 client.15597 handle_command_reply: tid=0 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.875+0000 7fdc3a836740 1 client.15597 shutdown 2024-09-21T01:16:37.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 msgr2=0x5610b455e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 0x5610b455e6a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c005d00 tx=0x7fdc1c0046c0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 shutdown_connections 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5610b4136da0 0x5610b45d89b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5610b41a3070 0x5610b4559740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610b4182390 0x5610b455e6a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 --2- 172.21.15.37:0/1139743258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610b417a1b0 0x5610b455e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 >> 172.21.15.37:0/1139743258 conn(0x5610b4197460 msgr2=0x5610b4560c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc15ffb640 0 client.15597 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 shutdown_connections 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 1 -- 172.21.15.37:0/1139743258 wait complete. 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.876+0000 7fdc3a836740 20 client.15597 trim_cache size 0 max 16384 2024-09-21T01:16:37.879 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:37.880 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:16:37.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdc180b6590 msgr2=0x7fdc180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdc180b6590 0x7fdc180b8aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdc280acfe0 tx=0x7fdc280ea940 comp rx=0 tx=0).stop 2024-09-21T01:16:37.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 msgr2=0x7fdc2c19a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:37.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 0x7fdc2c19a410 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800d950 tx=0x7fdc2800de10 comp rx=0 tx=0).stop 2024-09-21T01:16:37.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 shutdown_connections 2024-09-21T01:16:37.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdc180b6590 0x7fdc180b8aa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc2c10de60 0x7fdc2c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c105380 0x7fdc2c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 --2- 172.21.15.37:0/223351978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc2c104a30 0x7fdc2c19a410 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 >> 172.21.15.37:0/223351978 conn(0x7fdc2c079790 msgr2=0x7fdc2c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 shutdown_connections 2024-09-21T01:16:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:37.877+0000 7fdc342c2640 1 -- 172.21.15.37:0/223351978 wait complete. 2024-09-21T01:16:38.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:38 smithi037 ceph-mon[31105]: pgmap v376: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:38 smithi137 ceph-mon[34607]: pgmap v376: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:38 smithi144 ceph-mon[34818]: pgmap v376: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:38.819 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:16:38.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:16:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.693+0000 7f5e85ffb640 1 -- 172.21.15.37:0/3785811385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780318a0 con 0x7f5e88102a60 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/3785811385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88102a60 msgr2=0x7f5e88102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/3785811385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88102a60 0x7f5e88102e70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009900 tx=0x7f5e7802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/3785811385 shutdown_connections 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/3785811385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 0x7f5e8810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/3785811385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e881083a0 0x7f5e881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/3785811385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88102a60 0x7f5e88102e70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.694+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/3785811385 >> 172.21.15.37:0/3785811385 conn(0x7f5e88079730 msgr2=0x7f5e88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.695+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/3785811385 shutdown_connections 2024-09-21T01:16:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.695+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/3785811385 wait complete. 2024-09-21T01:16:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.695+0000 7f5e8d5ce640 1 Processor -- start 2024-09-21T01:16:39.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 -- start start 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e88102a60 0x7f5e8810f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e881083a0 0x7f5e8810b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 0x7f5e8810b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88111850 con 0x7f5e881083a0 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881116d0 con 0x7f5e88108cf0 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e8d5ce640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881119d0 con 0x7f5e88102a60 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e867fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e881083a0 0x7f5e8810b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e867fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e881083a0 0x7f5e8810b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59276/0 (socket says 172.21.15.37:59276) 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.696+0000 7f5e867fc640 1 -- 172.21.15.37:0/1477147221 learned_addr learned my addr 172.21.15.37:0/1477147221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e88102a60 0x7f5e8810f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e877fe640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 0x7f5e8810b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 -- 172.21.15.37:0/1477147221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 msgr2=0x7f5e8810b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 0x7f5e8810b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 -- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e881083a0 msgr2=0x7f5e8810b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e881083a0 0x7f5e8810b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 -- 172.21.15.37:0/1477147221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8810bf50 con 0x7f5e88102a60 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e877fe640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 0x7f5e8810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.697+0000 7f5e86ffd640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e88102a60 0x7f5e8810f0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5e7802a930 tx=0x7f5e78004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.698+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7803f030 con 0x7f5e88102a60 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.698+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8810c1e0 con 0x7f5e88102a60 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.698+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e881ad250 con 0x7f5e88102a60 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.698+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e78003aa0 con 0x7f5e88102a60 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.698+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78049060 con 0x7f5e88102a60 2024-09-21T01:16:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.699+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e740052c0 con 0x7f5e88102a60 2024-09-21T01:16:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.702+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5e78042030 con 0x7f5e88102a60 2024-09-21T01:16:39.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.703+0000 7f5e6ffff640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e700b6510 0x7f5e700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:39.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.703+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5e78107220 con 0x7f5e88102a60 2024-09-21T01:16:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.703+0000 7f5e867fc640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e700b6510 0x7f5e700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.704+0000 7f5e867fc640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e700b6510 0x7f5e700b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5e88100c50 tx=0x7f5e7c00b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:39.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.705+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e780d1e90 con 0x7f5e88102a60 2024-09-21T01:16:39.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.988+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e740055b0 con 0x7f5e88102a60 2024-09-21T01:16:39.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.989+0000 7f5e6ffff640 1 -- 172.21.15.37:0/1477147221 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11976 (secure 0 0 0) 0x7f5e780d6dd0 con 0x7f5e88102a60 2024-09-21T01:16:39.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:16:39.991 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-09-21T01:15:56:398497+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:15:55.947622+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:16:39.991 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.991+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e700b6510 msgr2=0x7f5e700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.991+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e700b6510 0x7f5e700b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5e88100c50 tx=0x7f5e7c00b480 comp rx=0 tx=0).stop 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.991+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e88102a60 msgr2=0x7f5e8810f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.991+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e88102a60 0x7f5e8810f0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5e7802a930 tx=0x7f5e78004060 comp rx=0 tx=0).stop 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 shutdown_connections 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e700b6510 0x7f5e700b8a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e88108cf0 0x7f5e8810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e881083a0 0x7f5e8810b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 --2- 172.21.15.37:0/1477147221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e88102a60 0x7f5e8810f0f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:39.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 >> 172.21.15.37:0/1477147221 conn(0x7f5e88079730 msgr2=0x7f5e881013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:39.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 shutdown_connections 2024-09-21T01:16:39.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:39.992+0000 7f5e8d5ce640 1 -- 172.21.15.37:0/1477147221 wait complete. 2024-09-21T01:16:40.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:40 smithi037 ceph-mon[31105]: pgmap v377: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:16:40.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:40 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1477147221' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:40 smithi137 ceph-mon[34607]: pgmap v377: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:16:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:40 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1477147221' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:40 smithi144 ceph-mon[34818]: pgmap v377: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:16:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:40 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1477147221' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:16:40.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:16:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 -- 172.21.15.37:0/3690075516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 msgr2=0x7f70b01066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 --2- 172.21.15.37:0/3690075516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b01066e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f709c009900 tx=0x7f709c02a3f0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 -- 172.21.15.37:0/3690075516 shutdown_connections 2024-09-21T01:16:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 --2- 172.21.15.37:0/3690075516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70b0106c20 0x7f70b0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 --2- 172.21.15.37:0/3690075516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b01066e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 --2- 172.21.15.37:0/3690075516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101ff0 0x7f70b0102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 -- 172.21.15.37:0/3690075516 >> 172.21.15.37:0/3690075516 conn(0x7f70b0077cc0 msgr2=0x7f70b0078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 -- 172.21.15.37:0/3690075516 shutdown_connections 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.594+0000 7f70b7042640 1 -- 172.21.15.37:0/3690075516 wait complete. 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 Processor -- start 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 -- start start 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101ff0 0x7f70b019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70b0106c20 0x7f70b019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0113ac0 con 0x7f70b01062d0 2024-09-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0113940 con 0x7f70b0101ff0 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70b7042640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0113c40 con 0x7f70b0106c20 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59284/0 (socket says 172.21.15.37:59284) 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.595+0000 7f70affff640 1 -- 172.21.15.37:0/514251347 learned_addr learned my addr 172.21.15.37:0/514251347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70b55df640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70b0106c20 0x7f70b019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70b4dde640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101ff0 0x7f70b019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70affff640 1 -- 172.21.15.37:0/514251347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70b0106c20 msgr2=0x7f70b019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70affff640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70b0106c20 0x7f70b019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70affff640 1 -- 172.21.15.37:0/514251347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101ff0 msgr2=0x7f70b019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70affff640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101ff0 0x7f70b019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70affff640 1 -- 172.21.15.37:0/514251347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b01a0420 con 0x7f70b01062d0 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70affff640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b019aa50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f709c02a910 tx=0x7f709c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70adffb640 1 -- 172.21.15.37:0/514251347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c03f030 con 0x7f70b01062d0 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b01a06b0 con 0x7f70b01062d0 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70adffb640 1 -- 172.21.15.37:0/514251347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709c003aa0 con 0x7f70b01062d0 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.596+0000 7f70adffb640 1 -- 172.21.15.37:0/514251347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c035070 con 0x7f70b01062d0 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.597+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b01a6e70 con 0x7f70b01062d0 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 Processor -- start 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 -- start start 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f955070 0x564d9fcfc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fcfc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f934390 0x564d9fcfcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d9fc72ea0 con 0x564d9f955070 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d9fc622d0 con 0x564d9f92c1b0 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.600+0000 7f70bd5b6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564d9fc660e0 con 0x564d9f934390 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b55df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f955070 0x564d9fcfc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b55df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f955070 0x564d9fcfc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59296/0 (socket says 172.21.15.37:59296) 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b55df640 1 -- 172.21.15.37:0/4193836564 learned_addr learned my addr 172.21.15.37:0/4193836564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b4dde640 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fcfc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70adffb640 1 -- 172.21.15.37:0/514251347 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f709c042030 con 0x7f70b01062d0 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b4dde640 1 -- 172.21.15.37:0/4193836564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f934390 msgr2=0x564d9fcfcd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b4dde640 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f934390 0x564d9fcfcd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b4dde640 1 -- 172.21.15.37:0/4193836564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f955070 msgr2=0x564d9fcfc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b4dde640 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f955070 0x564d9fcfc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.601+0000 7f70b4dde640 1 -- 172.21.15.37:0/4193836564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9f9c0650 con 0x564d9f92c1b0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.602+0000 7f70b4dde640 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fcfc7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009ac0 tx=0x7f70a4009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea7fef4b40a34a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.602+0000 7f709affd640 1 -- 172.21.15.37:0/4193836564 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4016070 con 0x564d9f92c1b0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.602+0000 7f709affd640 1 -- 172.21.15.37:0/4193836564 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a40054d0 con 0x564d9f92c1b0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.602+0000 7f709affd640 1 -- 172.21.15.37:0/4193836564 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4004dd0 con 0x564d9f92c1b0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.603+0000 7f70adffb640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70a00b6590 0x7f70a00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.603+0000 7f70b55df640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70a00b6590 0x7f70a00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.603+0000 7f70adffb640 1 -- 172.21.15.37:0/514251347 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f709c107790 con 0x7f70b01062d0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 -- 172.21.15.37:0/4193836564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 msgr2=0x564d9fcfc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fcfc7d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009ac0 tx=0x7f70a4009f80 comp rx=0 tx=0).stop 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70b55df640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70a00b6590 0x7f70a00b8aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f70a8005f40 tx=0x7f70a8009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 -- 172.21.15.37:0/4193836564 shutdown_connections 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f934390 0x564d9fcfcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fcfc7d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/4193836564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f955070 0x564d9fcfc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 -- 172.21.15.37:0/4193836564 >> 172.21.15.37:0/4193836564 conn(0x564d9f949460 msgr2=0x564d9fcfa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 -- 172.21.15.37:0/4193836564 shutdown_connections 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 -- 172.21.15.37:0/4193836564 wait complete. 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.604+0000 7f70bd5b6740 1 -- start start 2024-09-21T01:16:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.605+0000 7f70bd5b6740 1 Processor -- start 2024-09-21T01:16:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.605+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 0x564d9fd0e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.605+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd0bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.605+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f955070 0x564d9fd0c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 0x564d9fd0e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 0x564d9fd0e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40666/0 (socket says 172.21.15.37:40666) 2024-09-21T01:16:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd0bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd0bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59304/0 (socket says 172.21.15.37:59304) 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 -- 172.21.15.37:0/3221191990 learned_addr learned my addr 172.21.15.37:0/3221191990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b55df640 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f955070 0x564d9fd0c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d9fac3700 con 0x564d9f934390 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d9fbfd160 con 0x564d9f955070 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564d9fd0eda0 con 0x564d9f92c1b0 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70bd5b6740 10 client.0 _ll_register_callbacks cb 0x564d9fc169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 -- 172.21.15.37:0/3221191990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f955070 msgr2=0x564d9fd0c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f955070 0x564d9fd0c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 -- 172.21.15.37:0/3221191990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 msgr2=0x564d9fd0bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd0bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70b4dde640 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9fc2ac90 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.606+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a40054d0 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f70b4dde640 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 0x564d9fd0e490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70a4004d40 tx=0x7f70a4004d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbb56706b666365 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f708ffff640 10 client.25219 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f708ffff640 1 -- 172.21.15.37:0/3221191990 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4039060 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f708ffff640 1 -- 172.21.15.37:0/3221191990 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f70a40050a0 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f708ffff640 1 -- 172.21.15.37:0/3221191990 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70a4016040 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f70bd5b6740 10 client.25219 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.607+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564d9fd106f0 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f708ffff640 1 -- 172.21.15.37:0/3221191990 <== mon.1 v2:172.21.15.144:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70a400f040 con 0x564d9f92c1b0 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70bd5b6740 10 client.25219 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70bd5b6740 10 client.25219 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:16:41.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70bd5b6740 20 client.25219 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f9139f0 0x564d9fd13a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70bd5b6740 4 client.25219 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d9fc74df0 con 0x564d9f9139f0 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.608+0000 7f70affff640 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f9139f0 0x564d9fd13a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.609+0000 7f70affff640 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f9139f0 0x564d9fd13a50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=392a0a5d097553d1 server_cookie=69bd7d1587c9dd6c in_seq=0 out_seq=0 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.609+0000 7f708ffff640 10 client.25219 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f708ffff640 1 -- 172.21.15.37:0/3221191990 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d9fc74df0 con 0x564d9f9139f0 2024-09-21T01:16:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f708ffff640 10 client.25219 handle_command_reply: tid=0 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 client.25219 shutdown 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 msgr2=0x564d9fd0e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 0x564d9fd0e490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70a4004d40 tx=0x7f70a4004d70 comp rx=0 tx=0).stop 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 shutdown_connections 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f9139f0 0x564d9fd13a50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f708ffff640 0 client.25219 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f955070 0x564d9fd0c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd0bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/3221191990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f92c1b0 0x564d9fd0e490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 >> 172.21.15.37:0/3221191990 conn(0x564d9f949460 msgr2=0x564d9fcf8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 shutdown_connections 2024-09-21T01:16:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.610+0000 7f70bd5b6740 1 -- 172.21.15.37:0/3221191990 wait complete. 2024-09-21T01:16:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.611+0000 7f70bd5b6740 20 client.25219 trim_cache size 0 max 16384 2024-09-21T01:16:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 Processor -- start 2024-09-21T01:16:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 -- start start 2024-09-21T01:16:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd05430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fd22ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd23010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01ad200 con 0x564d9f934390 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01aed40 con 0x564d9f92c1b0 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70bd5b6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01ad8d0 con 0x564d9f9139f0 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70b55df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd23010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70b55df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd23010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59320/0 (socket says 172.21.15.37:59320) 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70b55df640 1 -- 172.21.15.37:0/309992927 learned_addr learned my addr 172.21.15.37:0/309992927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70b4dde640 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd05430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.637+0000 7f70affff640 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fd22ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f70b4dde640 1 -- 172.21.15.37:0/309992927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 msgr2=0x564d9fd22ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f70b4dde640 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fd22ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f70b4dde640 1 -- 172.21.15.37:0/309992927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 msgr2=0x564d9fd23010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f70b4dde640 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd23010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f70b4dde640 1 -- 172.21.15.37:0/309992927 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9fcfab00 con 0x564d9f9139f0 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f70b4dde640 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd05430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f70a4001eb0 tx=0x7f70a4030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0168bd550162290 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f709a7fc640 1 -- 172.21.15.37:0/309992927 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4011470 con 0x564d9f9139f0 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f709a7fc640 1 -- 172.21.15.37:0/309992927 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a40054d0 con 0x564d9f9139f0 2024-09-21T01:16:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.638+0000 7f709a7fc640 1 -- 172.21.15.37:0/309992927 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a403edc0 con 0x564d9f9139f0 2024-09-21T01:16:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.639+0000 7f70bd5b6740 1 -- 172.21.15.37:0/309992927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 msgr2=0x564d9fd05430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd05430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f70a4001eb0 tx=0x7f70a4030000 comp rx=0 tx=0).stop 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 -- 172.21.15.37:0/309992927 shutdown_connections 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f934390 0x564d9fd23010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f92c1b0 0x564d9fd22ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/309992927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd05430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 -- 172.21.15.37:0/309992927 >> 172.21.15.37:0/309992927 conn(0x564d9f949460 msgr2=0x564d9fcfdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 -- 172.21.15.37:0/309992927 shutdown_connections 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.640+0000 7f70bd5b6740 1 -- 172.21.15.37:0/309992927 wait complete. 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.641+0000 7f70bd5b6740 1 -- start start 2024-09-21T01:16:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.641+0000 7f70bd5b6740 1 Processor -- start 2024-09-21T01:16:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd02db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 0x564d9fd032f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70bd5b6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f934390 0x564d9fd82b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70b4dde640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd02db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70b4dde640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd02db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40694/0 (socket says 172.21.15.37:40694) 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 0x564d9fd032f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 0x564d9fd032f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59332/0 (socket says 172.21.15.37:59332) 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.642+0000 7f70b4dde640 1 -- 172.21.15.37:0/2647580196 learned_addr learned my addr 172.21.15.37:0/2647580196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01ae670 con 0x564d9f92c1b0 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01adfa0 con 0x564d9f934390 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70b55df640 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f934390 0x564d9fd82b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01ab1c0 con 0x564d9f9139f0 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70affff640 1 -- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 msgr2=0x564d9fd02db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70affff640 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd02db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70affff640 1 -- 172.21.15.37:0/2647580196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f934390 msgr2=0x564d9fd82b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70affff640 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f934390 0x564d9fd82b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.643+0000 7f70affff640 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9fd03bc0 con 0x564d9f92c1b0 2024-09-21T01:16:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f70affff640 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 0x564d9fd032f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f709c031440 tx=0x7f709c0c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff6d274cb0e8d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f708ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f70bd5b6740 10 client.0 _ll_register_callbacks cb 0x7f70a4009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a40054d0 con 0x564d9f92c1b0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f708ffff640 1 -- 172.21.15.37:0/2647580196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c049040 con 0x564d9f92c1b0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f708ffff640 1 -- 172.21.15.37:0/2647580196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f709c0d2050 con 0x564d9f92c1b0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f708ffff640 1 -- 172.21.15.37:0/2647580196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f709c0d23c0 con 0x564d9f92c1b0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f70bd5b6740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.644+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564d9fd83ff0 con 0x564d9f92c1b0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f708ffff640 1 -- 172.21.15.37:0/2647580196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f709c0c9b50 con 0x564d9f92c1b0 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70bd5b6740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70bd5b6740 10 client.15621 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70bd5b6740 20 client.15621 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f955070 0x564d9fd86560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70bd5b6740 4 client.15621 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f70a40054d0 con 0x564d9f955070 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.645+0000 7f70b4dde640 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f955070 0x564d9fd86560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f708ffff640 10 client.15621 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:16:41.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f70b4dde640 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f955070 0x564d9fd86560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3be595284bb197f2 server_cookie=adb902d7e3f219d3 in_seq=0 out_seq=0 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f708ffff640 1 -- 172.21.15.37:0/2647580196 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f70a40054d0 con 0x564d9f955070 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f708ffff640 10 client.15621 handle_command_reply: tid=0 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f70bd5b6740 1 client.15621 shutdown 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 msgr2=0x564d9fd032f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 0x564d9fd032f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f709c031440 tx=0x7f709c0c9040 comp rx=0 tx=0).stop 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 shutdown_connections 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.646+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x564d9f955070 0x564d9fd86560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d9f934390 0x564d9fd82b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f708ffff640 0 client.15621 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d9f92c1b0 0x564d9fd032f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 1 --2- 172.21.15.37:0/2647580196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d9f9139f0 0x564d9fd02db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 >> 172.21.15.37:0/2647580196 conn(0x564d9f949460 msgr2=0x564d9fcfda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 shutdown_connections 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 1 -- 172.21.15.37:0/2647580196 wait complete. 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.647+0000 7f70bd5b6740 20 client.15621 trim_cache size 0 max 16384 2024-09-21T01:16:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:16:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70a00b6590 msgr2=0x7f70a00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70a00b6590 0x7f70a00b8aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f70a8005f40 tx=0x7f70a8009600 comp rx=0 tx=0).stop 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 msgr2=0x7f70b019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b019aa50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f709c02a910 tx=0x7f709c004270 comp rx=0 tx=0).stop 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 shutdown_connections 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f70a00b6590 0x7f70a00b8aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70b0106c20 0x7f70b019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70b01062d0 0x7f70b019aa50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 --2- 172.21.15.37:0/514251347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0101ff0 0x7f70b019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.648+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 >> 172.21.15.37:0/514251347 conn(0x7f70b0077cc0 msgr2=0x7f70b0107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.649+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 shutdown_connections 2024-09-21T01:16:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:41.649+0000 7f70b7042640 1 -- 172.21.15.37:0/514251347 wait complete. 2024-09-21T01:16:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:42 smithi037 ceph-mon[31105]: pgmap v378: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:42.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:16:42.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:42 smithi137 ceph-mon[34607]: pgmap v378: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:42.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:42 smithi144 ceph-mon[34818]: pgmap v378: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 -- 172.21.15.37:0/2359181867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 msgr2=0x7f8bdc110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 --2- 172.21.15.37:0/2359181867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc110310 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009ca0 tx=0x7f8bd402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 -- 172.21.15.37:0/2359181867 shutdown_connections 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 --2- 172.21.15.37:0/2359181867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc110310 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 --2- 172.21.15.37:0/2359181867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc105310 0x7f8bdc10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 --2- 172.21.15.37:0/2359181867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bdc1049c0 0x7f8bdc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 -- 172.21.15.37:0/2359181867 >> 172.21.15.37:0/2359181867 conn(0x7f8bdc079730 msgr2=0x7f8bdc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.400+0000 7f8be29cf640 1 -- 172.21.15.37:0/2359181867 shutdown_connections 2024-09-21T01:16:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.401+0000 7f8be29cf640 1 -- 172.21.15.37:0/2359181867 wait complete. 2024-09-21T01:16:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.402+0000 7f8be29cf640 1 Processor -- start 2024-09-21T01:16:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.402+0000 7f8be29cf640 1 -- start start 2024-09-21T01:16:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.403+0000 7f8be29cf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc1049c0 0x7f8bdc19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.403+0000 7f8be29cf640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bdc105310 0x7f8bdc19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.403+0000 7f8be29cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc1049c0 0x7f8bdc19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8bdb7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bdc105310 0x7f8bdc19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc1049c0 0x7f8bdc19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36090/0 (socket says 172.21.15.37:36090) 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc1a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59344/0 (socket says 172.21.15.37:59344) 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8bdbfff640 1 -- 172.21.15.37:0/3048474343 learned_addr learned my addr 172.21.15.37:0/3048474343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc1033a0 con 0x7f8bdc10de20 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc103220 con 0x7f8bdc1049c0 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.404+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc103520 con 0x7f8bdc105310 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.405+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3048474343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bdc105310 msgr2=0x7f8bdc19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.405+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bdc105310 0x7f8bdc19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.405+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3048474343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc1049c0 msgr2=0x7f8bdc19c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.405+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc1049c0 0x7f8bdc19c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.405+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3048474343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc1a2380 con 0x7f8bdc10de20 2024-09-21T01:16:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.405+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc1a1c50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005cc0 tx=0x7f8bd4031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.406+0000 7f8bd97fa640 1 -- 172.21.15.37:0/3048474343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4051070 con 0x7f8bdc10de20 2024-09-21T01:16:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.406+0000 7f8bd97fa640 1 -- 172.21.15.37:0/3048474343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd4003e20 con 0x7f8bdc10de20 2024-09-21T01:16:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.406+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc1a2610 con 0x7f8bdc10de20 2024-09-21T01:16:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.406+0000 7f8bd97fa640 1 -- 172.21.15.37:0/3048474343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd402f660 con 0x7f8bdc10de20 2024-09-21T01:16:43.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.407+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc112ce0 con 0x7f8bdc10de20 2024-09-21T01:16:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.411+0000 7f8be8f43740 1 Processor -- start 2024-09-21T01:16:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.412+0000 7f8bd97fa640 1 -- 172.21.15.37:0/3048474343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8bd4054070 con 0x7f8bdc10de20 2024-09-21T01:16:43.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.412+0000 7f8be8f43740 1 -- start start 2024-09-21T01:16:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c41a390 0x55645c7e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8be8f43740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55645c758ea0 con 0x55645c41a390 2024-09-21T01:16:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8be8f43740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55645c7482d0 con 0x55645c4121b0 2024-09-21T01:16:43.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8be8f43740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55645c74c0e0 con 0x55645c43b070 2024-09-21T01:16:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8bdb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c41a390 0x55645c7e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36102/0 (socket says 172.21.15.37:36102) 2024-09-21T01:16:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.413+0000 7f8bdbfff640 1 -- 172.21.15.37:0/4277741538 learned_addr learned my addr 172.21.15.37:0/4277741538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bdb7fe640 1 -- 172.21.15.37:0/4277741538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 msgr2=0x55645c7e22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bdb7fe640 1 -- 172.21.15.37:0/4277741538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 msgr2=0x55645c7e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bdb7fe640 1 -- 172.21.15.37:0/4277741538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55645c4a6650 con 0x55645c41a390 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c41a390 0x55645c7e2d40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc06b2a0 tx=0x7f8bd00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1556fa4fad3ba2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.414+0000 7f8bd97fa640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8bc40b6590 0x7f8bc40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.415+0000 7f8bd97fa640 1 -- 172.21.15.37:0/3048474343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8bd410ff90 con 0x7f8bdc10de20 2024-09-21T01:16:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.415+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8bc40b6590 0x7f8bc40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.415+0000 7f8bc27fc640 1 -- 172.21.15.37:0/4277741538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0004220 con 0x55645c41a390 2024-09-21T01:16:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.415+0000 7f8bc27fc640 1 -- 172.21.15.37:0/4277741538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd0015070 con 0x55645c41a390 2024-09-21T01:16:43.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.415+0000 7f8bc27fc640 1 -- 172.21.15.37:0/4277741538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0011710 con 0x55645c41a390 2024-09-21T01:16:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.416+0000 7f8be8f43740 1 -- 172.21.15.37:0/4277741538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c41a390 msgr2=0x55645c7e2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.416+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8bc40b6590 0x7f8bc40b8aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55645c7e0f40 tx=0x7f8bcc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.416+0000 7f8be8f43740 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c41a390 0x55645c7e2d40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc06b2a0 tx=0x7f8bd00107a0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 -- 172.21.15.37:0/4277741538 shutdown_connections 2024-09-21T01:16:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c41a390 0x55645c7e2d40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 --2- 172.21.15.37:0/4277741538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 -- 172.21.15.37:0/4277741538 >> 172.21.15.37:0/4277741538 conn(0x55645c42f460 msgr2=0x55645c7e01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 -- 172.21.15.37:0/4277741538 shutdown_connections 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 -- 172.21.15.37:0/4277741538 wait complete. 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.417+0000 7f8be8f43740 1 -- start start 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 Processor -- start 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c7eda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c7edf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c80ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55645c5a9700 con 0x55645c43b070 2024-09-21T01:16:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55645c6e3160 con 0x55645c3f99f0 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55645c7f0aa0 con 0x55645c4121b0 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be8f43740 10 client.0 _ll_register_callbacks cb 0x55645c6fc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.418+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c80ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c80ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36116/0 (socket says 172.21.15.37:36116) 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 -- 172.21.15.37:0/2287382945 learned_addr learned my addr 172.21.15.37:0/2287382945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c7edf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c7eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 -- 172.21.15.37:0/2287382945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 msgr2=0x55645c7eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c7eda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 -- 172.21.15.37:0/2287382945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 msgr2=0x55645c7edf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c7edf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8be0f6c640 1 -- 172.21.15.37:0/2287382945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55645c710c90 con 0x55645c3f99f0 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.419+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c7edf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c80ada0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004af0 tx=0x7f8bd40d5890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=427c126e354ce897 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8bbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/2287382945 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40d6820 con 0x55645c3f99f0 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd0015070 con 0x55645c3f99f0 2024-09-21T01:16:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/2287382945 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8bd40d5380 con 0x55645c3f99f0 2024-09-21T01:16:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/2287382945 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8bd40dac00 con 0x55645c3f99f0 2024-09-21T01:16:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8be8f43740 10 client.25286 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55645c80d890 con 0x55645c3f99f0 2024-09-21T01:16:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.420+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/2287382945 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd0015070 con 0x55645c3f99f0 2024-09-21T01:16:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/2287382945 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8bd40d1a70 con 0x55645c3f99f0 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8be8f43740 10 client.25286 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8be8f43740 10 client.25286 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8be8f43740 20 client.25286 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8be8f43740 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c3ceda0 0x55645c810d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8be8f43740 4 client.25286 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55645c75adf0 con 0x55645c3ceda0 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.422+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c3ceda0 0x55645c810d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.423+0000 7f8bbb7fe640 10 client.25286 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.423+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c3ceda0 0x55645c810d50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=82f88f498d2e59a2 server_cookie=e2db9136eeca9816 in_seq=0 out_seq=0 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.423+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/2287382945 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55645c75adf0 con 0x55645c3ceda0 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.423+0000 7f8bbb7fe640 10 client.25286 handle_command_reply: tid=0 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.423+0000 7f8be8f43740 1 client.25286 shutdown 2024-09-21T01:16:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 msgr2=0x55645c80ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c80ada0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004af0 tx=0x7f8bd40d5890 comp rx=0 tx=0).stop 2024-09-21T01:16:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 shutdown_connections 2024-09-21T01:16:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c3ceda0 0x55645c810d50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c80ada0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c7edf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 --2- 172.21.15.37:0/2287382945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c7eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 >> 172.21.15.37:0/2287382945 conn(0x55645c42f460 msgr2=0x55645c7e5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8bbb7fe640 0 client.25286 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:16:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 shutdown_connections 2024-09-21T01:16:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 1 -- 172.21.15.37:0/2287382945 wait complete. 2024-09-21T01:16:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.424+0000 7f8be8f43740 20 client.25286 trim_cache size 0 max 16384 2024-09-21T01:16:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.451+0000 7f8be8f43740 1 Processor -- start 2024-09-21T01:16:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.451+0000 7f8be8f43740 1 -- start start 2024-09-21T01:16:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c3f99f0 0x55645c80ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be8f43740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc071140 con 0x55645c3f99f0 2024-09-21T01:16:43.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be8f43740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc072c80 con 0x55645c4121b0 2024-09-21T01:16:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be8f43740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc071810 con 0x55645c43b070 2024-09-21T01:16:43.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40734/0 (socket says 172.21.15.37:40734) 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3449969063 learned_addr learned my addr 172.21.15.37:0/3449969063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c3f99f0 0x55645c80ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3449969063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 msgr2=0x55645c7e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.452+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3449969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c3f99f0 msgr2=0x55645c80ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.453+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c3f99f0 0x55645c80ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.453+0000 7f8be0f6c640 1 -- 172.21.15.37:0/3449969063 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55645c7e45b0 con 0x55645c43b070 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.453+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c3f99f0 0x55645c80ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:43.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.453+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e5900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40d3390 tx=0x7f8bd40d59c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d07af7fd32d8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.453+0000 7f8bc1ffb640 1 -- 172.21.15.37:0/3449969063 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40d6820 con 0x55645c43b070 2024-09-21T01:16:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.454+0000 7f8bc1ffb640 1 -- 172.21.15.37:0/3449969063 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd4036030 con 0x55645c43b070 2024-09-21T01:16:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.454+0000 7f8bc1ffb640 1 -- 172.21.15.37:0/3449969063 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40d5170 con 0x55645c43b070 2024-09-21T01:16:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 -- 172.21.15.37:0/3449969063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 msgr2=0x55645c7e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e5900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40d3390 tx=0x7f8bd40d59c0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 -- 172.21.15.37:0/3449969063 shutdown_connections 2024-09-21T01:16:43.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c43b070 0x55645c7e5900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c4121b0 0x55645c7e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 --2- 172.21.15.37:0/3449969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c3f99f0 0x55645c80ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 -- 172.21.15.37:0/3449969063 >> 172.21.15.37:0/3449969063 conn(0x55645c42f460 msgr2=0x55645c7ec2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 -- 172.21.15.37:0/3449969063 shutdown_connections 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 -- 172.21.15.37:0/3449969063 wait complete. 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.455+0000 7f8be8f43740 1 -- start start 2024-09-21T01:16:43.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.456+0000 7f8be8f43740 1 Processor -- start 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.456+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c807750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.456+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c802c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.456+0000 7f8be8f43740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c803380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c803380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8be0f6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c803380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59378/0 (socket says 172.21.15.37:59378) 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8be0f6c640 1 -- 172.21.15.37:0/309658393 learned_addr learned my addr 172.21.15.37:0/309658393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8bdb7fe640 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c802c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c807750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc0725b0 con 0x55645c43b070 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc071ee0 con 0x55645c3f99f0 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.457+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc06f100 con 0x55645c4121b0 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be0f6c640 1 -- 172.21.15.37:0/309658393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 msgr2=0x55645c802c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c802c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be0f6c640 1 -- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 msgr2=0x55645c807750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c807750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be0f6c640 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55645c87a6f0 con 0x55645c43b070 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be8f43740 10 client.0 _ll_register_callbacks cb 0x7f8bd40048e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:43.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd4036030 con 0x55645c43b070 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8be0f6c640 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c803380 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004af0 tx=0x7f8bd40d5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184ce0395cf697b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.458+0000 7f8bbb7fe640 10 client.15636 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.459+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/309658393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40d6820 con 0x55645c43b070 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.459+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/309658393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8bd40f9aa0 con 0x55645c43b070 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.459+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/309658393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8bd40f9d40 con 0x55645c43b070 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.459+0000 7f8be8f43740 10 client.15636 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.459+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55645c87a6f0 con 0x55645c43b070 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.459+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/309658393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8bd40dbd90 con 0x55645c43b070 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8be8f43740 10 client.15636 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8be8f43740 10 client.15636 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8be8f43740 20 client.15636 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8be8f43740 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c87b6b0 0x55645c87db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8be8f43740 4 client.15636 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:43.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55645c7568a0 con 0x55645c87b6b0 2024-09-21T01:16:43.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.460+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c87b6b0 0x55645c87db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8bbb7fe640 10 client.15636 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8bdbfff640 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c87b6b0 0x55645c87db60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=60b2e90080f44714 server_cookie=4f00a10928977f3c in_seq=0 out_seq=0 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8bbb7fe640 1 -- 172.21.15.37:0/309658393 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55645c7568a0 con 0x55645c87b6b0 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8bbb7fe640 10 client.15636 handle_command_reply: tid=0 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 client.15636 shutdown 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 msgr2=0x55645c803380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c803380 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4004af0 tx=0x7f8bd40d5890 comp rx=0 tx=0).stop 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 shutdown_connections 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55645c87b6b0 0x55645c87db60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55645c43b070 0x55645c803380 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8bbb7fe640 0 client.15636 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55645c4121b0 0x55645c802c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 --2- 172.21.15.37:0/309658393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55645c3f99f0 0x55645c807750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.461+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 >> 172.21.15.37:0/309658393 conn(0x55645c42f460 msgr2=0x55645c7e53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.462+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 shutdown_connections 2024-09-21T01:16:43.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.462+0000 7f8be8f43740 1 -- 172.21.15.37:0/309658393 wait complete. 2024-09-21T01:16:43.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.462+0000 7f8be8f43740 20 client.15636 trim_cache size 0 max 16384 2024-09-21T01:16:43.466 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:16:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.463+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8bc40b6590 msgr2=0x7f8bc40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.463+0000 7f8be29cf640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8bc40b6590 0x7f8bc40b8aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55645c7e0f40 tx=0x7f8bcc005f90 comp rx=0 tx=0).stop 2024-09-21T01:16:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.463+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 msgr2=0x7f8bdc1a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.463+0000 7f8be29cf640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc1a1c50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005cc0 tx=0x7f8bd4031a40 comp rx=0 tx=0).stop 2024-09-21T01:16:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 shutdown_connections 2024-09-21T01:16:43.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8bc40b6590 0x7f8bc40b8aa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bdc10de20 0x7f8bdc1a1c50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bdc105310 0x7f8bdc19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 --2- 172.21.15.37:0/3048474343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bdc1049c0 0x7f8bdc19c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 >> 172.21.15.37:0/3048474343 conn(0x7f8bdc079730 msgr2=0x7f8bdc10f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 shutdown_connections 2024-09-21T01:16:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:43.464+0000 7f8be29cf640 1 -- 172.21.15.37:0/3048474343 wait complete. 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 -- 172.21.15.37:0/3264641602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 msgr2=0x7f63ac102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 --2- 172.21.15.37:0/3264641602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac102a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63a800d910 tx=0x7f63a802c390 comp rx=0 tx=0).stop 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 -- 172.21.15.37:0/3264641602 shutdown_connections 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 --2- 172.21.15.37:0/3264641602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ac103fc0 0x7f63ac10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 --2- 172.21.15.37:0/3264641602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63ac103620 0x7f63ac103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 --2- 172.21.15.37:0/3264641602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac102a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 -- 172.21.15.37:0/3264641602 >> 172.21.15.37:0/3264641602 conn(0x7f63ac0fdee0 msgr2=0x7f63ac100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 -- 172.21.15.37:0/3264641602 shutdown_connections 2024-09-21T01:16:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.481+0000 7f63b389b640 1 -- 172.21.15.37:0/3264641602 wait complete. 2024-09-21T01:16:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.482+0000 7f63b389b640 1 Processor -- start 2024-09-21T01:16:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.482+0000 7f63b389b640 1 -- start start 2024-09-21T01:16:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b389b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b389b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ac103620 0x7f63ac1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b389b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63ac103fc0 0x7f63ac198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b389b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac10d180 con 0x7f63ac103620 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b389b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac10d000 con 0x7f63ac103fc0 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b389b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac10d300 con 0x7f63ac1025a0 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40768/0 (socket says 172.21.15.37:40768) 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 -- 172.21.15.37:0/3094168052 learned_addr learned my addr 172.21.15.37:0/3094168052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1e38640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63ac103fc0 0x7f63ac198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b0e36640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ac103620 0x7f63ac1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 -- 172.21.15.37:0/3094168052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63ac103fc0 msgr2=0x7f63ac198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63ac103fc0 0x7f63ac198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 -- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ac103620 msgr2=0x7f63ac1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ac103620 0x7f63ac1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.483+0000 7f63b1637640 1 -- 172.21.15.37:0/3094168052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac199800 con 0x7f63ac1025a0 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.484+0000 7f63b1637640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac197e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f63a8003940 tx=0x7f63a8003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.484+0000 7f63a27fc640 1 -- 172.21.15.37:0/3094168052 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8005320 con 0x7f63ac1025a0 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.484+0000 7f63a27fc640 1 -- 172.21.15.37:0/3094168052 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63a8042070 con 0x7f63ac1025a0 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.484+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac199a90 con 0x7f63ac1025a0 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.484+0000 7f63a27fc640 1 -- 172.21.15.37:0/3094168052 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a800ca00 con 0x7f63ac1025a0 2024-09-21T01:16:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.484+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac1a0080 con 0x7f63ac1025a0 2024-09-21T01:16:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 Processor -- start 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 -- start start 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63a27fc640 1 -- 172.21.15.37:0/3094168052 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f63a803c070 con 0x7f63ac1025a0 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 0x558c281dae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e0a2f0 0x558c281db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281dc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558c2814d6f0 con 0x558c27e331b0 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558c2813cb20 con 0x558c27e124d0 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.488+0000 7f63ba80c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558c28140930 con 0x558c27e0a2f0 2024-09-21T01:16:43.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 0x558c281dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1637640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e0a2f0 0x558c281db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 0x558c281dae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59392/0 (socket says 172.21.15.37:59392) 2024-09-21T01:16:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 -- 172.21.15.37:0/3613778677 learned_addr learned my addr 172.21.15.37:0/3613778677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b0e36640 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 -- 172.21.15.37:0/3613778677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e0a2f0 msgr2=0x558c281db4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e0a2f0 0x558c281db4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 -- 172.21.15.37:0/3613778677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 msgr2=0x558c281dc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281dc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b1e38640 1 -- 172.21.15.37:0/3613778677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c28102530 con 0x558c27e331b0 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.489+0000 7f63b0e36640 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.490+0000 7f63b1e38640 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 0x558c281dae50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011440 tx=0x7f63a4011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd1d830004c81e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.490+0000 7f63a27fc640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f63980b6610 0x7f63980b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.490+0000 7f63977fe640 1 -- 172.21.15.37:0/3613778677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4004d70 con 0x558c27e331b0 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.490+0000 7f63977fe640 1 -- 172.21.15.37:0/3613778677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63a4004050 con 0x558c27e331b0 2024-09-21T01:16:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.490+0000 7f63977fe640 1 -- 172.21.15.37:0/3613778677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a400f7a0 con 0x558c27e331b0 2024-09-21T01:16:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.490+0000 7f63a27fc640 1 -- 172.21.15.37:0/3094168052 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f63a8108d20 con 0x7f63ac1025a0 2024-09-21T01:16:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63b1637640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f63980b6610 0x7f63980b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63b1637640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f63980b6610 0x7f63980b8b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63a80ceb70 tx=0x7f63a810c6e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 -- 172.21.15.37:0/3613778677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 msgr2=0x558c281dae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 0x558c281dae50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011440 tx=0x7f63a4011900 comp rx=0 tx=0).stop 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 -- 172.21.15.37:0/3613778677 shutdown_connections 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e0a2f0 0x558c281db4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 --2- 172.21.15.37:0/3613778677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e331b0 0x558c281dae50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.491+0000 7f63ba80c740 1 -- 172.21.15.37:0/3613778677 >> 172.21.15.37:0/3613778677 conn(0x558c27e27300 msgr2=0x558c281d68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.492+0000 7f63ba80c740 1 -- 172.21.15.37:0/3613778677 shutdown_connections 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.492+0000 7f63ba80c740 1 -- 172.21.15.37:0/3613778677 wait complete. 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.492+0000 7f63ba80c740 1 -- start start 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.492+0000 7f63ba80c740 1 Processor -- start 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558c28074ab0 con 0x558c27e0a2f0 2024-09-21T01:16:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558c280e2730 con 0x558c27e124d0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558c281dcb30 con 0x558c27e331b0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63ba80c740 10 client.0 _ll_register_callbacks cb 0x558c281366b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281e4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59394/0 (socket says 172.21.15.37:59394) 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 -- 172.21.15.37:0/567939352 learned_addr learned my addr 172.21.15.37:0/567939352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b0e36640 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 -- 172.21.15.37:0/567939352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 msgr2=0x558c281e57c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281e57c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 -- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 msgr2=0x558c281e4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281e4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.493+0000 7f63b1e38640 1 -- 172.21.15.37:0/567939352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c27e9e790 con 0x558c27e0a2f0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f63b1e38640 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281e4590 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009d70 tx=0x7f63a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bddd3ab7171467e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f6394ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f6394ff9640 1 -- 172.21.15.37:0/567939352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4026020 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f6394ff9640 1 -- 172.21.15.37:0/567939352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f63a4004200 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63a4004050 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f6394ff9640 1 -- 172.21.15.37:0/567939352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63a4004400 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f63ba80c740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c27f17620 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.494+0000 7f6394ff9640 1 -- 172.21.15.37:0/567939352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63a4004050 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f6394ff9640 1 -- 172.21.15.37:0/567939352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f63a402d4c0 con 0x558c27e0a2f0 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63ba80c740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63ba80c740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63ba80c740 20 client.15648 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63ba80c740 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27df1d80 0x558c281fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63ba80c740 4 client.15648 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c2814f640 con 0x558c27df1d80 2024-09-21T01:16:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.495+0000 7f63b0e36640 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27df1d80 0x558c281fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.496+0000 7f63b0e36640 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27df1d80 0x558c281fa1f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d7dca3724d79ceb server_cookie=ff740733373d478e in_seq=0 out_seq=0 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.496+0000 7f6394ff9640 10 client.15648 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f6394ff9640 1 -- 172.21.15.37:0/567939352 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c2814f640 con 0x558c27df1d80 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f6394ff9640 10 client.15648 handle_command_reply: tid=0 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 client.15648 shutdown 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 msgr2=0x558c281e4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281e4590 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009d70 tx=0x7f63a4009da0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 shutdown_connections 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27df1d80 0x558c281fa1f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281e4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 --2- 172.21.15.37:0/567939352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281e4590 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 >> 172.21.15.37:0/567939352 conn(0x558c27e27300 msgr2=0x558c281d4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f6394ff9640 0 client.15648 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 shutdown_connections 2024-09-21T01:16:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.497+0000 7f63ba80c740 1 -- 172.21.15.37:0/567939352 wait complete. 2024-09-21T01:16:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.498+0000 7f63ba80c740 20 client.15648 trim_cache size 0 max 16384 2024-09-21T01:16:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 Processor -- start 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 -- start start 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281d5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281d5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1a8e70 con 0x558c27e0a2f0 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1aa9b0 con 0x558c27e124d0 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63ba80c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1a9540 con 0x558c27e331b0 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59410/0 (socket says 172.21.15.37:59410) 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.515+0000 7f63b1e38640 1 -- 172.21.15.37:0/595221862 learned_addr learned my addr 172.21.15.37:0/595221862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b0e36640 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281d5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b1e38640 1 -- 172.21.15.37:0/595221862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 msgr2=0x558c281d6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b1e38640 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b1e38640 1 -- 172.21.15.37:0/595221862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 msgr2=0x558c281d5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b1e38640 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281d5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b1e38640 1 -- 172.21.15.37:0/595221862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c281e27a0 con 0x558c27e0a2f0 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f63b1e38640 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281d5610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011440 tx=0x7f63a40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3cb4e6da213da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f6396ffd640 1 -- 172.21.15.37:0/595221862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4026070 con 0x558c27e0a2f0 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f6396ffd640 1 -- 172.21.15.37:0/595221862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63a4003d90 con 0x558c27e0a2f0 2024-09-21T01:16:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.516+0000 7f6396ffd640 1 -- 172.21.15.37:0/595221862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4004800 con 0x558c27e0a2f0 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 -- 172.21.15.37:0/595221862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 msgr2=0x558c281d5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281d5610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011440 tx=0x7f63a40039c0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 -- 172.21.15.37:0/595221862 shutdown_connections 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281d6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e124d0 0x558c281d5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 --2- 172.21.15.37:0/595221862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e0a2f0 0x558c281d5610 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 -- 172.21.15.37:0/595221862 >> 172.21.15.37:0/595221862 conn(0x558c27e27300 msgr2=0x558c281d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 -- 172.21.15.37:0/595221862 shutdown_connections 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 -- 172.21.15.37:0/595221862 wait complete. 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 -- start start 2024-09-21T01:16:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.518+0000 7f63ba80c740 1 Processor -- start 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e0a2f0 0x558c281f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e124d0 0x558c281f4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1aa2e0 con 0x558c27e124d0 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1a9c10 con 0x558c27e0a2f0 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1a6e30 con 0x558c27e331b0 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63ba80c740 10 client.0 _ll_register_callbacks cb 0x7f63a810c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e0a2f0 0x558c281f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b0e36640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e124d0 0x558c281f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b1e38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e0a2f0 0x558c281f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36204/0 (socket says 172.21.15.37:36204) 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b1e38640 1 -- 172.21.15.37:0/2797799596 learned_addr learned my addr 172.21.15.37:0/2797799596 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b1e38640 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b0e36640 1 -- 172.21.15.37:0/2797799596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 msgr2=0x558c281f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b0e36640 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b0e36640 1 -- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e0a2f0 msgr2=0x558c281f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b0e36640 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e0a2f0 0x558c281f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.519+0000 7f63b0e36640 1 -- 172.21.15.37:0/2797799596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c281f54f0 con 0x558c27e124d0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f63b0e36640 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e124d0 0x558c281f4220 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f639c004810 tx=0x7f639c0157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1f1aa937a6444 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f6394ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f6394ff9640 1 -- 172.21.15.37:0/2797799596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c0059c0 con 0x558c27e124d0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f6394ff9640 1 -- 172.21.15.37:0/2797799596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f639c005b60 con 0x558c27e124d0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63a4003d90 con 0x558c27e124d0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f6394ff9640 1 -- 172.21.15.37:0/2797799596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f639c005d60 con 0x558c27e124d0 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f63ba80c740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c281f68b0 con 0x558c27e124d0 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.520+0000 7f6394ff9640 1 -- 172.21.15.37:0/2797799596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f639c006500 con 0x558c27e124d0 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f6394ff9640 1 -- 172.21.15.37:0/2797799596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f639c0257b0 con 0x558c27e124d0 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63ba80c740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63ba80c740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63ba80c740 20 client.15654 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63ba80c740 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27dc71c0 0x558c28266e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63ba80c740 4 client.15654 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f63a4003d90 con 0x558c27dc71c0 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.521+0000 7f63b1e38640 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27dc71c0 0x558c28266e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.522+0000 7f6394ff9640 10 client.15654 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.522+0000 7f63b1e38640 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27dc71c0 0x558c28266e20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b2b82e69e90694c server_cookie=8f9019403c97ba3 in_seq=0 out_seq=0 2024-09-21T01:16:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.528+0000 7f6394ff9640 1 -- 172.21.15.37:0/2797799596 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f63a4003d90 con 0x558c27dc71c0 2024-09-21T01:16:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.528+0000 7f6394ff9640 10 client.15654 handle_command_reply: tid=0 2024-09-21T01:16:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.528+0000 7f63ba80c740 1 client.15654 shutdown 2024-09-21T01:16:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e124d0 msgr2=0x558c281f4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e124d0 0x558c281f4220 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f639c004810 tx=0x7f639c0157f0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 shutdown_connections 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x558c27dc71c0 0x558c28266e20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f6394ff9640 0 client.15654 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c27e331b0 0x558c281f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558c27e124d0 0x558c281f4220 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 --2- 172.21.15.37:0/2797799596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558c27e0a2f0 0x558c281f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 >> 172.21.15.37:0/2797799596 conn(0x558c27e27300 msgr2=0x558c281defa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 shutdown_connections 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 1 -- 172.21.15.37:0/2797799596 wait complete. 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.529+0000 7f63ba80c740 20 client.15654 trim_cache size 0 max 16384 2024-09-21T01:16:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:16:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:16:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:16:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:16:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f63980b6610 msgr2=0x7f63980b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f63980b6610 0x7f63980b8b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63a80ceb70 tx=0x7f63a810c6e0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 msgr2=0x7f63ac197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac197e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f63a8003940 tx=0x7f63a8003730 comp rx=0 tx=0).stop 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 shutdown_connections 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f63980b6610 0x7f63980b8b20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63ac103fc0 0x7f63ac198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ac103620 0x7f63ac1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 --2- 172.21.15.37:0/3094168052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ac1025a0 0x7f63ac197e30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 >> 172.21.15.37:0/3094168052 conn(0x7f63ac0fdee0 msgr2=0x7f63ac106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 shutdown_connections 2024-09-21T01:16:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:43.530+0000 7f63b389b640 1 -- 172.21.15.37:0/3094168052 wait complete. 2024-09-21T01:16:44.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:16:44.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:44 smithi037 ceph-mon[31105]: pgmap v379: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:44.534 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:44 smithi137 ceph-mon[34607]: pgmap v379: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:44 smithi144 ceph-mon[34818]: pgmap v379: 97 pgs: 97 active+clean; 661 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:16:45.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 -- 172.21.15.37:0/1958860259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348108d20 msgr2=0x7f434810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 --2- 172.21.15.37:0/1958860259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348108d20 0x7f434810f550 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4340009ca0 tx=0x7f434002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 -- 172.21.15.37:0/1958860259 shutdown_connections 2024-09-21T01:16:45.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 --2- 172.21.15.37:0/1958860259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348108d20 0x7f434810f550 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 --2- 172.21.15.37:0/1958860259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43481083d0 0x7f43481087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 --2- 172.21.15.37:0/1958860259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4348102a90 0x7f4348102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 -- 172.21.15.37:0/1958860259 >> 172.21.15.37:0/1958860259 conn(0x7f4348079730 msgr2=0x7f4348079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 -- 172.21.15.37:0/1958860259 shutdown_connections 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.072+0000 7f434da2f640 1 -- 172.21.15.37:0/1958860259 wait complete. 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.073+0000 7f434da2f640 1 Processor -- start 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.073+0000 7f434da2f640 1 -- start start 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f434da2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 0x7f434819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f434da2f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43481083d0 0x7f434819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f434da2f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4348108d20 0x7f434819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f434da2f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43481129e0 con 0x7f4348102a90 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 0x7f434819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 0x7f434819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59432/0 (socket says 172.21.15.37:59432) 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f4346ffd640 1 -- 172.21.15.37:0/3591468250 learned_addr learned my addr 172.21.15.37:0/3591468250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:45.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4348112860 con 0x7f43481083d0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4348112b60 con 0x7f4348108d20 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f433e7fc640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43481083d0 0x7f434819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f43477fe640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4348108d20 0x7f434819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f433e7fc640 1 -- 172.21.15.37:0/3591468250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4348108d20 msgr2=0x7f434819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f433e7fc640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4348108d20 0x7f434819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f433e7fc640 1 -- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 msgr2=0x7f434819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f433e7fc640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 0x7f434819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f433e7fc640 1 -- 172.21.15.37:0/3591468250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43481a03b0 con 0x7f43481083d0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.074+0000 7f4346ffd640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 0x7f434819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.075+0000 7f433e7fc640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43481083d0 0x7f434819a9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f434806b680 tx=0x7f433000dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.075+0000 7f434ca2d640 1 -- 172.21.15.37:0/3591468250 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330017070 con 0x7f43481083d0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.075+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43481a06a0 con 0x7f43481083d0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.075+0000 7f434ca2d640 1 -- 172.21.15.37:0/3591468250 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43300099a0 con 0x7f43481083d0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.075+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43481a6e00 con 0x7f43481083d0 2024-09-21T01:16:45.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.075+0000 7f434ca2d640 1 -- 172.21.15.37:0/3591468250 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43300047a0 con 0x7f43481083d0 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.078+0000 7f4353fa3740 1 Processor -- start 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.078+0000 7f4353fa3740 1 -- start start 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.078+0000 7f434ca2d640 1 -- 172.21.15.37:0/3591468250 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4330004940 con 0x7f43481083d0 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.078+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedcb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedcbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fedcc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4353fa3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630fed41ea0 con 0x5630fe9fb1b0 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4353fa3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5630fed312d0 con 0x5630fea03390 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4353fa3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5630fed350e0 con 0x5630fea24070 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedcbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedcbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59436/0 (socket says 172.21.15.37:59436) 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 -- 172.21.15.37:0/320816049 learned_addr learned my addr 172.21.15.37:0/320816049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f43477fe640 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedcb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 -- 172.21.15.37:0/320816049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 msgr2=0x5630fedcb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedcb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 -- 172.21.15.37:0/320816049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 msgr2=0x5630fedcc0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fedcc0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 -- 172.21.15.37:0/320816049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fea8f650 con 0x5630fe9fb1b0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.079+0000 7f4346ffd640 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedcbba0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4338009f90 tx=0x7f4338011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd558d1641f0bf87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.080+0000 7f433dffb640 1 -- 172.21.15.37:0/320816049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433800f8f0 con 0x5630fe9fb1b0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.080+0000 7f433dffb640 1 -- 172.21.15.37:0/320816049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f433801a070 con 0x5630fe9fb1b0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.080+0000 7f433dffb640 1 -- 172.21.15.37:0/320816049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338016e60 con 0x5630fe9fb1b0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.080+0000 7f434ca2d640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f43340b6590 0x7f43340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.080+0000 7f43477fe640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f43340b6590 0x7f43340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f434ca2d640 1 -- 172.21.15.37:0/3591468250 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f43300e6de0 con 0x7f43481083d0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f43477fe640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f43340b6590 0x7f43340b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f434002f500 tx=0x7f434002f310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 -- 172.21.15.37:0/320816049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 msgr2=0x5630fedcbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedcbba0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4338009f90 tx=0x7f4338011ae0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 -- 172.21.15.37:0/320816049 shutdown_connections 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fedcc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedcbba0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 --2- 172.21.15.37:0/320816049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedcb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.081+0000 7f4353fa3740 1 -- 172.21.15.37:0/320816049 >> 172.21.15.37:0/320816049 conn(0x5630fea18460 msgr2=0x5630fedc9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.082+0000 7f4353fa3740 1 -- 172.21.15.37:0/320816049 shutdown_connections 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.082+0000 7f4353fa3740 1 -- 172.21.15.37:0/320816049 wait complete. 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.082+0000 7f4353fa3740 1 -- start start 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.082+0000 7f4353fa3740 1 Processor -- start 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedd6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea03390 0x5630fedd72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea24070 0x5630fede3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedd6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630feb92700 con 0x5630fe9fb1b0 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedd6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59452/0 (socket says 172.21.15.37:59452) 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4346ffd640 1 -- 172.21.15.37:0/2822603656 learned_addr learned my addr 172.21.15.37:0/2822603656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5630feccc160 con 0x5630fea24070 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f43477fe640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea24070 0x5630fede3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5630fedd9e40 con 0x5630fea03390 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea03390 0x5630fedd72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.083+0000 7f4353fa3740 10 client.0 _ll_register_callbacks cb 0x5630fece59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4346ffd640 1 -- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea03390 msgr2=0x5630fedd72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4346ffd640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea03390 0x5630fedd72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4346ffd640 1 -- 172.21.15.37:0/2822603656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea24070 msgr2=0x5630fede3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4346ffd640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea24070 0x5630fede3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4346ffd640 1 -- 172.21.15.37:0/2822603656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fecf9c90 con 0x5630fe9fb1b0 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f43477fe640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea24070 0x5630fede3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea03390 0x5630fedd72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4326ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4346ffd640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedd6d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4338020040 tx=0x7f4338016b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461b39aa3261f7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4326ffd640 1 -- 172.21.15.37:0/2822603656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338004220 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4326ffd640 1 -- 172.21.15.37:0/2822603656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f43380043c0 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f433801a070 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4326ffd640 1 -- 172.21.15.37:0/2822603656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4338005040 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4353fa3740 10 client.15666 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.084+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630fede5b90 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4326ffd640 1 -- 172.21.15.37:0/2822603656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f433801a070 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4326ffd640 1 -- 172.21.15.37:0/2822603656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f433800f6f0 con 0x5630fe9fb1b0 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4353fa3740 10 client.15666 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4353fa3740 10 client.15666 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4353fa3740 20 client.15666 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9e29f0 0x5630fede8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4353fa3740 4 client.15666 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630fed43df0 con 0x5630fe9e29f0 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.085+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9e29f0 0x5630fede8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.086+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9e29f0 0x5630fede8f50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f4c19ce3d35ec03 server_cookie=3679de991c235e67 in_seq=0 out_seq=0 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.086+0000 7f4326ffd640 10 client.15666 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4326ffd640 1 -- 172.21.15.37:0/2822603656 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630fed43df0 con 0x5630fe9e29f0 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4326ffd640 10 client.15666 handle_command_reply: tid=0 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 client.15666 shutdown 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 msgr2=0x5630fedd6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedd6d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4338020040 tx=0x7f4338016b60 comp rx=0 tx=0).stop 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 shutdown_connections 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9e29f0 0x5630fede8f50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea24070 0x5630fede3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea03390 0x5630fedd72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2822603656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedd6d80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 >> 172.21.15.37:0/2822603656 conn(0x5630fea18460 msgr2=0x5630fedce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:45.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4326ffd640 0 client.15666 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:16:45.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 shutdown_connections 2024-09-21T01:16:45.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 1 -- 172.21.15.37:0/2822603656 wait complete. 2024-09-21T01:16:45.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.087+0000 7f4353fa3740 20 client.15666 trim_cache size 0 max 16384 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 Processor -- start 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 -- start start 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fe9fb1b0 0x5630fedd8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 0x5630fedccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fede30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f433e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 0x5630fedccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4348072f90 con 0x5630fea03390 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f433e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 0x5630fedccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59468/0 (socket says 172.21.15.37:59468) 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f433e7fc640 1 -- 172.21.15.37:0/1784716919 learned_addr learned my addr 172.21.15.37:0/1784716919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4348074ad0 con 0x5630fe9fb1b0 2024-09-21T01:16:45.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.101+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4348073660 con 0x5630fea24070 2024-09-21T01:16:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f433e7fc640 1 -- 172.21.15.37:0/1784716919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 msgr2=0x5630fede30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f4346ffd640 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fe9fb1b0 0x5630fedd8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f43477fe640 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fede30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f433e7fc640 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fede30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f433e7fc640 1 -- 172.21.15.37:0/1784716919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fe9fb1b0 msgr2=0x5630fedd8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f433e7fc640 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fe9fb1b0 0x5630fedd8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f433e7fc640 1 -- 172.21.15.37:0/1784716919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fedd5280 con 0x5630fea03390 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f43477fe640 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fede30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.102+0000 7f433e7fc640 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 0x5630fedccda0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4330005fd0 tx=0x7f43300e6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14359c12c65d2ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.103+0000 7f433d7fa640 1 -- 172.21.15.37:0/1784716919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43300b1a50 con 0x5630fea03390 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.103+0000 7f433d7fa640 1 -- 172.21.15.37:0/1784716919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43300b6990 con 0x5630fea03390 2024-09-21T01:16:45.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.103+0000 7f433d7fa640 1 -- 172.21.15.37:0/1784716919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43300d44b0 con 0x5630fea03390 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 msgr2=0x5630fedccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 0x5630fedccda0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4330005fd0 tx=0x7f43300e6040 comp rx=0 tx=0).stop 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 shutdown_connections 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fede30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fea03390 0x5630fedccda0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 --2- 172.21.15.37:0/1784716919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fe9fb1b0 0x5630fedd8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 >> 172.21.15.37:0/1784716919 conn(0x5630fea18460 msgr2=0x5630fedcc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:45.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 shutdown_connections 2024-09-21T01:16:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 -- 172.21.15.37:0/1784716919 wait complete. 2024-09-21T01:16:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.104+0000 7f4353fa3740 1 -- start start 2024-09-21T01:16:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 Processor -- start 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedec600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fede9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4348074400 con 0x5630fe9fb1b0 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4348073d30 con 0x5630fea03390 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4348070f50 con 0x5630fea24070 2024-09-21T01:16:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4353fa3740 10 client.0 _ll_register_callbacks cb 0x7f4340009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.105+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedec600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59470/0 (socket says 172.21.15.37:59470) 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f4346ffd640 1 -- 172.21.15.37:0/2880003321 learned_addr learned my addr 172.21.15.37:0/2880003321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f43477fe640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fede9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f433e7fc640 1 -- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 msgr2=0x5630fedea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f433e7fc640 1 -- 172.21.15.37:0/2880003321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 msgr2=0x5630fedec600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedec600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f433e7fc640 1 -- 172.21.15.37:0/2880003321 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fedea650 con 0x5630fea03390 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.106+0000 7f4346ffd640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedec600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f433e7fc640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fede9ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5630fecb7cc0 tx=0x7f43300e4880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffac59669995652b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4326ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:16:45.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4326ffd640 1 -- 172.21.15.37:0/2880003321 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43300b1a50 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4326ffd640 1 -- 172.21.15.37:0/2880003321 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4330098050 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43300b6990 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4326ffd640 1 -- 172.21.15.37:0/2880003321 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4330098290 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4353fa3740 10 client.25316 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630fee5bc20 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.107+0000 7f4326ffd640 1 -- 172.21.15.37:0/2880003321 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43300b6990 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4326ffd640 1 -- 172.21.15.37:0/2880003321 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43300a88c0 con 0x5630fea03390 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4353fa3740 10 client.25316 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4353fa3740 10 client.25316 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4353fa3740 20 client.25316 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9b7da0 0x5630fee5e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4353fa3740 4 client.25316 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630fed3f8a0 con 0x5630fe9b7da0 2024-09-21T01:16:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4346ffd640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9b7da0 0x5630fee5e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4326ffd640 10 client.25316 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.108+0000 7f4346ffd640 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9b7da0 0x5630fee5e380 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edc33c11222fd5ef server_cookie=981cbb452c251a2a in_seq=0 out_seq=0 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4326ffd640 1 -- 172.21.15.37:0/2880003321 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630fed3f8a0 con 0x5630fe9b7da0 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4326ffd640 10 client.25316 handle_command_reply: tid=0 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 client.25316 shutdown 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 msgr2=0x5630fede9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fede9ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5630fecb7cc0 tx=0x7f43300e4880 comp rx=0 tx=0).stop 2024-09-21T01:16:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 shutdown_connections 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5630fe9b7da0 0x5630fee5e380 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630fea24070 0x5630fedea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5630fea03390 0x5630fede9ad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4326ffd640 0 client.25316 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 --2- 172.21.15.37:0/2880003321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630fe9fb1b0 0x5630fedec600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.109+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 >> 172.21.15.37:0/2880003321 conn(0x5630fea18460 msgr2=0x5630fedcce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.110+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 shutdown_connections 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.110+0000 7f4353fa3740 1 -- 172.21.15.37:0/2880003321 wait complete. 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.110+0000 7f4353fa3740 20 client.25316 trim_cache size 0 max 16384 2024-09-21T01:16:45.114 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f43340b6590 msgr2=0x7f43340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f43340b6590 0x7f43340b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f434002f500 tx=0x7f434002f310 comp rx=0 tx=0).stop 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43481083d0 msgr2=0x7f434819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43481083d0 0x7f434819a9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f434806b680 tx=0x7f433000dbb0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 shutdown_connections 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f43340b6590 0x7f43340b8aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4348108d20 0x7f434819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43481083d0 0x7f434819a9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 --2- 172.21.15.37:0/3591468250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4348102a90 0x7f434819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 >> 172.21.15.37:0/3591468250 conn(0x7f4348079730 msgr2=0x7f43481019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 shutdown_connections 2024-09-21T01:16:45.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:45.111+0000 7f434da2f640 1 -- 172.21.15.37:0/3591468250 wait complete. 2024-09-21T01:16:45.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:16:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:46.214 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:46 smithi037 ceph-mon[31105]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T01:16:46.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:46 smithi144 ceph-mon[34818]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T01:16:46.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:46 smithi137 ceph-mon[34607]: pgmap v380: 97 pgs: 97 active+clean; 670 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 -- 172.21.15.37:0/1899423182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8102740 msgr2=0x7fced8110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1899423182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8102740 0x7fced8110570 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fced0009ca0 tx=0x7fced002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 -- 172.21.15.37:0/1899423182 shutdown_connections 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1899423182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8102740 0x7fced8110570 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1899423182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8101df0 0x7fced8102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1899423182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fced8108700 0x7fced8108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 -- 172.21.15.37:0/1899423182 >> 172.21.15.37:0/1899423182 conn(0x7fced8077ca0 msgr2=0x7fced80780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 -- 172.21.15.37:0/1899423182 shutdown_connections 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.731+0000 7fcedd44a640 1 -- 172.21.15.37:0/1899423182 wait complete. 2024-09-21T01:16:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.732+0000 7fcedd44a640 1 Processor -- start 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 -- start start 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 0x7fced8103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8102740 0x7fced8103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fced8108700 0x7fced8103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fced8113ab0 con 0x7fced8101df0 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fced8113930 con 0x7fced8102740 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.733+0000 7fcedd44a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fced8113c30 con 0x7fced8108700 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced77fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fced8108700 0x7fced8103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 0x7fced8103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fcecffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8102740 0x7fced8103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 0x7fced8103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44016/0 (socket says 172.21.15.37:44016) 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 -- 172.21.15.37:0/1903085635 learned_addr learned my addr 172.21.15.37:0/1903085635 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 -- 172.21.15.37:0/1903085635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fced8108700 msgr2=0x7fced8103aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fced8108700 0x7fced8103aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 -- 172.21.15.37:0/1903085635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8102740 msgr2=0x7fced8103560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8102740 0x7fced8103560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.734+0000 7fced6ffd640 1 -- 172.21.15.37:0/1903085635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced81a86a0 con 0x7fced8101df0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.735+0000 7fced6ffd640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 0x7fced8103020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcec800e9f0 tx=0x7fcec800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.735+0000 7fced4ff9640 1 -- 172.21.15.37:0/1903085635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800cd80 con 0x7fced8101df0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.735+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced81a8990 con 0x7fced8101df0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.735+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81a8f20 con 0x7fced8101df0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.735+0000 7fced4ff9640 1 -- 172.21.15.37:0/1903085635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80108e0 con 0x7fced8101df0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.736+0000 7fced4ff9640 1 -- 172.21.15.37:0/1903085635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8018980 con 0x7fced8101df0 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.738+0000 7fcee39be740 1 Processor -- start 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 -- start start 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 0x55a38e1e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de16390 0x55a38e1e7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a38e154ea0 con 0x55a38de37070 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a38e1442d0 con 0x55a38de0e1b0 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.739+0000 7fcee39be740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a38e1480e0 con 0x55a38de16390 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 0x55a38e1e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 0x55a38e1e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44024/0 (socket says 172.21.15.37:44024) 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 -- 172.21.15.37:0/2953255181 learned_addr learned my addr 172.21.15.37:0/2953255181 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced4ff9640 1 -- 172.21.15.37:0/1903085635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcec8010430 con 0x7fced8101df0 2024-09-21T01:16:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fcecffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de16390 0x55a38e1e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced6ffd640 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 -- 172.21.15.37:0/2953255181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de16390 msgr2=0x55a38e1e7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de16390 0x55a38e1e7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 -- 172.21.15.37:0/2953255181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 msgr2=0x55a38e1e73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1e73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced77fe640 1 -- 172.21.15.37:0/2953255181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a38dea2650 con 0x55a38de37070 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fcecffff640 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de16390 0x55a38e1e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.740+0000 7fced6ffd640 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1e73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.741+0000 7fced77fe640 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 0x55a38e1e6eb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fced002f4c0 tx=0x7fced0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640ee9e88e034596 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.741+0000 7fced4ff9640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcec40b6460 0x7fcec40b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.741+0000 7fcecd7fa640 1 -- 172.21.15.37:0/2953255181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0031cf0 con 0x55a38de37070 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.741+0000 7fcecd7fa640 1 -- 172.21.15.37:0/2953255181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced0036030 con 0x55a38de37070 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.741+0000 7fcecd7fa640 1 -- 172.21.15.37:0/2953255181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00042a0 con 0x55a38de37070 2024-09-21T01:16:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.741+0000 7fced6ffd640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcec40b6460 0x7fcec40b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.742+0000 7fced4ff9640 1 -- 172.21.15.37:0/1903085635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fcec80e7560 con 0x7fced8101df0 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.742+0000 7fcee39be740 1 -- 172.21.15.37:0/2953255181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 msgr2=0x55a38e1e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.742+0000 7fcee39be740 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 0x55a38e1e6eb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fced002f4c0 tx=0x7fced0009800 comp rx=0 tx=0).stop 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.742+0000 7fced6ffd640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcec40b6460 0x7fcec40b8970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcec80ad460 tx=0x7fcec80ec040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 -- 172.21.15.37:0/2953255181 shutdown_connections 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de16390 0x55a38e1e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1e73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 --2- 172.21.15.37:0/2953255181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de37070 0x55a38e1e6eb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 -- 172.21.15.37:0/2953255181 >> 172.21.15.37:0/2953255181 conn(0x55a38de2b460 msgr2=0x55a38e1e4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 -- 172.21.15.37:0/2953255181 shutdown_connections 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 -- 172.21.15.37:0/2953255181 wait complete. 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.743+0000 7fcee39be740 1 -- start start 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 Processor -- start 2024-09-21T01:16:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fced77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fced77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44026/0 (socket says 172.21.15.37:44026) 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fced77fe640 1 -- 172.21.15.37:0/3165328662 learned_addr learned my addr 172.21.15.37:0/3165328662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1fe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a38dfa5700 con 0x55a38de0e1b0 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a38e0df160 con 0x55a38de16390 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a38e1f54b0 con 0x55a38de37070 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.744+0000 7fcee39be740 10 client.0 _ll_register_callbacks cb 0x55a38e0f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fced77fe640 1 -- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 msgr2=0x55a38e1fe830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fced77fe640 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1fe830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fced77fe640 1 -- 172.21.15.37:0/3165328662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 msgr2=0x55a38e1f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fced77fe640 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fced77fe640 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a38e10cc90 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fced77fe640 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f25a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fced002a900 tx=0x7fced0031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4437c7704359515 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fcebe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fcebe7fc640 1 -- 172.21.15.37:0/3165328662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced004a040 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fcebe7fc640 1 -- 172.21.15.37:0/3165328662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fced0031650 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.745+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced0036030 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.746+0000 7fcebe7fc640 1 -- 172.21.15.37:0/3165328662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fced0031850 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.746+0000 7fcee39be740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.746+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a38e201200 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.746+0000 7fcebe7fc640 1 -- 172.21.15.37:0/3165328662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced0055070 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcebe7fc640 1 -- 172.21.15.37:0/3165328662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fced004d030 con 0x55a38de0e1b0 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcee39be740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcee39be740 10 client.15684 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:16:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcee39be740 20 client.15684 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddf59f0 0x55a38e2048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcee39be740 4 client.15684 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fced0036030 con 0x55a38ddf59f0 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.747+0000 7fcecffff640 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddf59f0 0x55a38e2048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.748+0000 7fcecffff640 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddf59f0 0x55a38e2048d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d286f283e9351c6 server_cookie=dadceccbd10c47f5 in_seq=0 out_seq=0 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.748+0000 7fcebe7fc640 10 client.15684 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.748+0000 7fcebe7fc640 1 -- 172.21.15.37:0/3165328662 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fced0036030 con 0x55a38ddf59f0 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.748+0000 7fcebe7fc640 10 client.15684 handle_command_reply: tid=0 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.748+0000 7fcee39be740 1 client.15684 shutdown 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 msgr2=0x55a38e1f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f25a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fced002a900 tx=0x7fced0031da0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 shutdown_connections 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddf59f0 0x55a38e2048d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 --2- 172.21.15.37:0/3165328662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f25a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 >> 172.21.15.37:0/3165328662 conn(0x55a38de2b460 msgr2=0x55a38e1ea040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcebe7fc640 0 client.15684 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:16:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 shutdown_connections 2024-09-21T01:16:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 1 -- 172.21.15.37:0/3165328662 wait complete. 2024-09-21T01:16:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.749+0000 7fcee39be740 20 client.15684 trim_cache size 0 max 16384 2024-09-21T01:16:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 Processor -- start 2024-09-21T01:16:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 -- start start 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fceb800e4c0 con 0x55a38de0e1b0 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fceb8010000 con 0x55a38de16390 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fcee39be740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fceb800eb90 con 0x55a38de37070 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fced77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fced77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44028/0 (socket says 172.21.15.37:44028) 2024-09-21T01:16:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.777+0000 7fced77fe640 1 -- 172.21.15.37:0/4182504034 learned_addr learned my addr 172.21.15.37:0/4182504034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fcecffff640 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 -- 172.21.15.37:0/4182504034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 msgr2=0x55a38e1fe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 -- 172.21.15.37:0/4182504034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 msgr2=0x55a38e1f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 -- 172.21.15.37:0/4182504034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a38e1e91a0 con 0x55a38de37070 2024-09-21T01:16:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.778+0000 7fced77fe640 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f1530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fced0031a90 tx=0x7fced0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2d70d2a5de9a47c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.779+0000 7fceccff9640 1 -- 172.21.15.37:0/4182504034 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0030da0 con 0x55a38de37070 2024-09-21T01:16:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.779+0000 7fceccff9640 1 -- 172.21.15.37:0/4182504034 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced0055070 con 0x55a38de37070 2024-09-21T01:16:46.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.779+0000 7fceccff9640 1 -- 172.21.15.37:0/4182504034 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0065470 con 0x55a38de37070 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 -- 172.21.15.37:0/4182504034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 msgr2=0x55a38e1f1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f1530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fced0031a90 tx=0x7fced0005fd0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 -- 172.21.15.37:0/4182504034 shutdown_connections 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f1530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de16390 0x55a38e1fe730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 --2- 172.21.15.37:0/4182504034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de0e1b0 0x55a38e1f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 -- 172.21.15.37:0/4182504034 >> 172.21.15.37:0/4182504034 conn(0x55a38de2b460 msgr2=0x55a38e1f0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 -- 172.21.15.37:0/4182504034 shutdown_connections 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 -- 172.21.15.37:0/4182504034 wait complete. 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.780+0000 7fcee39be740 1 -- start start 2024-09-21T01:16:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 Processor -- start 2024-09-21T01:16:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1fb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 0x55a38e1f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcecffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 0x55a38e1f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcecffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 0x55a38e1f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44030/0 (socket says 172.21.15.37:44030) 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcecffff640 1 -- 172.21.15.37:0/220999816 learned_addr learned my addr 172.21.15.37:0/220999816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fced77fe640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fceb800f930 con 0x55a38de16390 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fceb800f260 con 0x55a38de0e1b0 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.781+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fceb800c480 con 0x55a38de37070 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fced77fe640 1 -- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 msgr2=0x55a38e1f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fced77fe640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fced77fe640 1 -- 172.21.15.37:0/220999816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 msgr2=0x55a38e1f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fced77fe640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 0x55a38e1f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fced77fe640 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a38e1f7220 con 0x55a38de0e1b0 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fcecffff640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 0x55a38e1f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fcee39be740 10 client.0 _ll_register_callbacks cb 0x7fcec80eae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fced0055070 con 0x55a38de0e1b0 2024-09-21T01:16:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fced77fe640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1fb010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fced002ade0 tx=0x7fced0030fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a25dc6e2ec008fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.782+0000 7fcebe7fc640 10 client.25331 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.783+0000 7fcebe7fc640 1 -- 172.21.15.37:0/220999816 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced002f660 con 0x55a38de0e1b0 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.783+0000 7fcebe7fc640 1 -- 172.21.15.37:0/220999816 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fced002f800 con 0x55a38de0e1b0 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.783+0000 7fcebe7fc640 1 -- 172.21.15.37:0/220999816 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fced002fa40 con 0x55a38de0e1b0 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.783+0000 7fcee39be740 10 client.25331 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.783+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a38e26ef80 con 0x55a38de0e1b0 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.783+0000 7fcebe7fc640 1 -- 172.21.15.37:0/220999816 <== mon.2 v2:172.21.15.137:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fced004d040 con 0x55a38de0e1b0 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcee39be740 10 client.25331 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcee39be740 10 client.25331 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcee39be740 20 client.25331 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddcada0 0x55a38e271730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcee39be740 4 client.25331 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a38e156df0 con 0x55a38ddcada0 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcecffff640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddcada0 0x55a38e271730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcebe7fc640 10 client.25331 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.784+0000 7fcecffff640 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddcada0 0x55a38e271730 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f26baf9b2e21700 server_cookie=de150943f5d5edf2 in_seq=0 out_seq=0 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcebe7fc640 1 -- 172.21.15.37:0/220999816 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a38e156df0 con 0x55a38ddcada0 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcebe7fc640 10 client.25331 handle_command_reply: tid=0 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 client.25331 shutdown 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 msgr2=0x55a38e1fb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1fb010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fced002ade0 tx=0x7fced0030fd0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 shutdown_connections 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a38ddcada0 0x55a38e271730 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcebe7fc640 0 client.25331 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:16:46.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a38de37070 0x55a38e1f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a38de16390 0x55a38e1f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 --2- 172.21.15.37:0/220999816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a38de0e1b0 0x55a38e1fb010 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 >> 172.21.15.37:0/220999816 conn(0x55a38de2b460 msgr2=0x55a38e1f41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 shutdown_connections 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 1 -- 172.21.15.37:0/220999816 wait complete. 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.785+0000 7fcee39be740 20 client.25331 trim_cache size 0 max 16384 2024-09-21T01:16:46.790 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcec40b6460 msgr2=0x7fcec40b8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcec40b6460 0x7fcec40b8970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcec80ad460 tx=0x7fcec80ec040 comp rx=0 tx=0).stop 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 msgr2=0x7fced8103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 0x7fced8103020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcec800e9f0 tx=0x7fcec800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 shutdown_connections 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fcec40b6460 0x7fcec40b8970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fced8108700 0x7fced8103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fced8102740 0x7fced8103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 --2- 172.21.15.37:0/1903085635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced8101df0 0x7fced8103020 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.786+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 >> 172.21.15.37:0/1903085635 conn(0x7fced8077ca0 msgr2=0x7fced80feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.787+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 shutdown_connections 2024-09-21T01:16:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:46.787+0000 7fcedd44a640 1 -- 172.21.15.37:0/1903085635 wait complete. 2024-09-21T01:16:47.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:16:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 -- 172.21.15.37:0/655043020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24104840 msgr2=0x7f9d24104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/655043020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24104840 0x7f9d24104c50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009900 tx=0x7f9d1802a410 comp rx=0 tx=0).stop 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 -- 172.21.15.37:0/655043020 shutdown_connections 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/655043020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2410ddf0 0x7f9d24110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/655043020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24105270 0x7f9d2410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/655043020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24104840 0x7f9d24104c50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 -- 172.21.15.37:0/655043020 >> 172.21.15.37:0/655043020 conn(0x7f9d24079730 msgr2=0x7f9d24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 -- 172.21.15.37:0/655043020 shutdown_connections 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.381+0000 7f9d2aa65640 1 -- 172.21.15.37:0/655043020 wait complete. 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.382+0000 7f9d2aa65640 1 Processor -- start 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.382+0000 7f9d2aa65640 1 -- start start 2024-09-21T01:16:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d2aa65640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24104840 0x7f9d2419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d2aa65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 0x7f9d2419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d2aa65640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2410ddf0 0x7f9d2419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d2aa65640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24113a90 con 0x7f9d24105270 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d2aa65640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24113910 con 0x7f9d24104840 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d2aa65640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24113c10 con 0x7f9d2410ddf0 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 0x7f9d2419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 0x7f9d2419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44044/0 (socket says 172.21.15.37:44044) 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 -- 172.21.15.37:0/1910123009 learned_addr learned my addr 172.21.15.37:0/1910123009 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d28801640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24104840 0x7f9d2419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d29002640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2410ddf0 0x7f9d2419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 -- 172.21.15.37:0/1910123009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2410ddf0 msgr2=0x7f9d2419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2410ddf0 0x7f9d2419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 -- 172.21.15.37:0/1910123009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24104840 msgr2=0x7f9d2419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24104840 0x7f9d2419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.383+0000 7f9d23fff640 1 -- 172.21.15.37:0/1910123009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d241a04b0 con 0x7f9d24105270 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.384+0000 7f9d23fff640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 0x7f9d2419aae0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000e9f0 tx=0x7f9d1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.384+0000 7f9d21ffb640 1 -- 172.21.15.37:0/1910123009 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000ccc0 con 0x7f9d24105270 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.384+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d241a07a0 con 0x7f9d24105270 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.384+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d241a6f00 con 0x7f9d24105270 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.384+0000 7f9d21ffb640 1 -- 172.21.15.37:0/1910123009 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d100108e0 con 0x7f9d24105270 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.386+0000 7f9d21ffb640 1 -- 172.21.15.37:0/1910123009 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100187a0 con 0x7f9d24105270 2024-09-21T01:16:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.387+0000 7f9d30fd9740 1 Processor -- start 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 -- start start 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a5b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a5b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a5bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a479d1ea0 con 0x559a476b4070 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559a479c12d0 con 0x559a4768b1b0 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d30fd9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a479c50e0 con 0x559a47693390 2024-09-21T01:16:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d28801640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a5b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d28801640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a5b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35248/0 (socket says 172.21.15.37:35248) 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.388+0000 7f9d28801640 1 -- 172.21.15.37:0/3665538584 learned_addr learned my addr 172.21.15.37:0/3665538584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d29002640 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a5b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d28801640 1 -- 172.21.15.37:0/3665538584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 msgr2=0x559a47a5bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d28801640 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a5bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d28801640 1 -- 172.21.15.37:0/3665538584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 msgr2=0x559a47a5b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d28801640 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a5b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d28801640 1 -- 172.21.15.37:0/3665538584 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a4771f650 con 0x559a4768b1b0 2024-09-21T01:16:48.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.389+0000 7f9d21ffb640 1 -- 172.21.15.37:0/1910123009 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9d10010430 con 0x7f9d24105270 2024-09-21T01:16:48.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.391+0000 7f9d21ffb640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d140b6510 0x7f9d140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.391+0000 7f9d21ffb640 1 -- 172.21.15.37:0/1910123009 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9d100e7410 con 0x7f9d24105270 2024-09-21T01:16:48.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.391+0000 7f9d29002640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d140b6510 0x7f9d140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.391+0000 7f9d28801640 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a5b800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d2406bc00 tx=0x7f9d18032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc42e33a25a0734e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.392+0000 7f9d29002640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d140b6510 0x7f9d140b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005fd0 tx=0x7f9d1c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.392+0000 7f9d0effd640 1 -- 172.21.15.37:0/3665538584 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18040070 con 0x559a4768b1b0 2024-09-21T01:16:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.392+0000 7f9d0effd640 1 -- 172.21.15.37:0/3665538584 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d18004030 con 0x559a4768b1b0 2024-09-21T01:16:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.392+0000 7f9d0effd640 1 -- 172.21.15.37:0/3665538584 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18035040 con 0x559a4768b1b0 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3665538584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 msgr2=0x559a47a5b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a5b800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d2406bc00 tx=0x7f9d18032b20 comp rx=0 tx=0).stop 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3665538584 shutdown_connections 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a5bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a5b800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3665538584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a5b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3665538584 >> 172.21.15.37:0/3665538584 conn(0x559a476a8460 msgr2=0x559a47a591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3665538584 shutdown_connections 2024-09-21T01:16:48.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.393+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3665538584 wait complete. 2024-09-21T01:16:48.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.394+0000 7f9d30fd9740 1 -- start start 2024-09-21T01:16:48.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.394+0000 7f9d30fd9740 1 Processor -- start 2024-09-21T01:16:48.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a6b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a77100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d29002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a77100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d29002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a77100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44064/0 (socket says 172.21.15.37:44064) 2024-09-21T01:16:48.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d28801640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d28801640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35256/0 (socket says 172.21.15.37:35256) 2024-09-21T01:16:48.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a6b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a6b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37798/0 (socket says 172.21.15.37:37798) 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d29002640 1 -- 172.21.15.37:0/3108624391 learned_addr learned my addr 172.21.15.37:0/3108624391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a47822700 con 0x559a476b4070 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559a4795c160 con 0x559a4768b1b0 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.395+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a47a6dd40 con 0x559a47693390 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d28801640 1 -- 172.21.15.37:0/3108624391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 msgr2=0x559a47a6b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d28801640 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a6b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d28801640 1 -- 172.21.15.37:0/3108624391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 msgr2=0x559a47a77100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d28801640 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a77100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d28801640 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a47989c90 con 0x559a4768b1b0 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d29002640 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a77100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.396+0000 7f9d30fd9740 10 client.0 _ll_register_callbacks cb 0x559a479759e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d28801640 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6ad60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006010 tx=0x7f9d18005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7db0d857d40a6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d18004030 con 0x559a4768b1b0 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d03fff640 10 client.25343 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:16:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d03fff640 1 -- 172.21.15.37:0/3108624391 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1804c020 con 0x559a4768b1b0 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d03fff640 1 -- 172.21.15.37:0/3108624391 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9d18005480 con 0x559a4768b1b0 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d03fff640 1 -- 172.21.15.37:0/3108624391 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d18040070 con 0x559a4768b1b0 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d30fd9740 10 client.25343 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.397+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559a47a795f0 con 0x559a4768b1b0 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d03fff640 1 -- 172.21.15.37:0/3108624391 <== mon.2 v2:172.21.15.137:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9d180314a0 con 0x559a4768b1b0 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d30fd9740 10 client.25343 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d30fd9740 10 client.25343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d30fd9740 20 client.25343 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476729f0 0x559a47a7c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d30fd9740 4 client.25343 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.398+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a479d3df0 con 0x559a476729f0 2024-09-21T01:16:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.399+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476729f0 0x559a47a7c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.399+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476729f0 0x559a47a7c970 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e5719db57a29e0 server_cookie=d2c839e8e386610d in_seq=0 out_seq=0 2024-09-21T01:16:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.399+0000 7f9d03fff640 10 client.25343 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d03fff640 1 -- 172.21.15.37:0/3108624391 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a479d3df0 con 0x559a476729f0 2024-09-21T01:16:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d03fff640 10 client.25343 handle_command_reply: tid=0 2024-09-21T01:16:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d30fd9740 1 client.25343 shutdown 2024-09-21T01:16:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 msgr2=0x559a47a6ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6ad60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006010 tx=0x7f9d18005f00 comp rx=0 tx=0).stop 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 shutdown_connections 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476729f0 0x559a47a7c970 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.400+0000 7f9d03fff640 0 client.25343 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476b4070 0x559a47a77100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a6b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3108624391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6ad60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 >> 172.21.15.37:0/3108624391 conn(0x559a476a8460 msgr2=0x559a47a5ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 shutdown_connections 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3108624391 wait complete. 2024-09-21T01:16:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.401+0000 7f9d30fd9740 20 client.25343 trim_cache size 0 max 16384 2024-09-21T01:16:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 Processor -- start 2024-09-21T01:16:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 -- start start 2024-09-21T01:16:48.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476729f0 0x559a47a6b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a77000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a58af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d28801640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476729f0 0x559a47a6b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800e420 con 0x559a476729f0 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800ff60 con 0x559a4768b1b0 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d30fd9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800eaf0 con 0x559a47693390 2024-09-21T01:16:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d28801640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476729f0 0x559a47a6b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44070/0 (socket says 172.21.15.37:44070) 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d28801640 1 -- 172.21.15.37:0/3895724338 learned_addr learned my addr 172.21.15.37:0/3895724338 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.428+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a77000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d29002640 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a58af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d23fff640 1 -- 172.21.15.37:0/3895724338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 msgr2=0x559a47a58af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a58af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d23fff640 1 -- 172.21.15.37:0/3895724338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476729f0 msgr2=0x559a47a6b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476729f0 0x559a47a6b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d23fff640 1 -- 172.21.15.37:0/3895724338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a47a5c100 con 0x559a4768b1b0 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a77000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d100e4f10 tx=0x7f9d100a94f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce1a7e71225fc390 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.429+0000 7f9d0e7fc640 1 -- 172.21.15.37:0/3895724338 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100b2080 con 0x559a4768b1b0 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.430+0000 7f9d0e7fc640 1 -- 172.21.15.37:0/3895724338 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d100b6fc0 con 0x559a4768b1b0 2024-09-21T01:16:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.430+0000 7f9d0e7fc640 1 -- 172.21.15.37:0/3895724338 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100a9290 con 0x559a4768b1b0 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3895724338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 msgr2=0x559a47a77000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a77000 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d100e4f10 tx=0x7f9d100a94f0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3895724338 shutdown_connections 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a47693390 0x559a47a58af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a77000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3895724338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a476729f0 0x559a47a6b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3895724338 >> 172.21.15.37:0/3895724338 conn(0x559a476a8460 msgr2=0x559a47a6ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3895724338 shutdown_connections 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.431+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3895724338 wait complete. 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.432+0000 7f9d30fd9740 1 -- start start 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.432+0000 7f9d30fd9740 1 Processor -- start 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.432+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 0x559a47a6efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.432+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d30fd9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 0x559a47a6fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d28801640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 0x559a47a6efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d29002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 0x559a47a6fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d28801640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 0x559a47a6efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37816/0 (socket says 172.21.15.37:37816) 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d29002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 0x559a47a6fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44080/0 (socket says 172.21.15.37:44080) 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d28801640 1 -- 172.21.15.37:0/3601995928 learned_addr learned my addr 172.21.15.37:0/3601995928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800f890 con 0x559a47693390 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800f1c0 con 0x559a4768b1b0 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.433+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800c3e0 con 0x559a476729f0 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d30fd9740 10 client.0 _ll_register_callbacks cb 0x7f9d18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d28801640 1 -- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 msgr2=0x559a47a6f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d28801640 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d28801640 1 -- 172.21.15.37:0/3601995928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 msgr2=0x559a47a6fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d28801640 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 0x559a47a6fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d28801640 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a47ae6370 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d29002640 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 0x559a47a6fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d28801640 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 0x559a47a6efa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d1802a930 tx=0x7f9d18031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e9bf65ba83f8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d03fff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d03fff640 1 -- 172.21.15.37:0/3601995928 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1804c040 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.434+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d100b6fc0 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d03fff640 1 -- 172.21.15.37:0/3601995928 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9d18005270 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d03fff640 1 -- 172.21.15.37:0/3601995928 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d1806c050 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d30fd9740 10 client.25291 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a47ae74f0 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d03fff640 1 -- 172.21.15.37:0/3601995928 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d18004030 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d03fff640 1 -- 172.21.15.37:0/3601995928 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9d180035f0 con 0x559a476729f0 2024-09-21T01:16:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d30fd9740 10 client.25291 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d30fd9740 10 client.25291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.435+0000 7f9d30fd9740 20 client.25291 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.436+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476b4070 0x559a47ae9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.436+0000 7f9d30fd9740 4 client.25291 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.436+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9d100b6fc0 con 0x559a476b4070 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.436+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476b4070 0x559a47ae9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d03fff640 10 client.25291 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d23fff640 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476b4070 0x559a47ae9cb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc3437839f836666 server_cookie=2d22d82760af6384 in_seq=0 out_seq=0 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d03fff640 1 -- 172.21.15.37:0/3601995928 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9d100b6fc0 con 0x559a476b4070 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d03fff640 10 client.25291 handle_command_reply: tid=0 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d30fd9740 1 client.25291 shutdown 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 msgr2=0x559a47a6efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 0x559a47a6efa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d1802a930 tx=0x7f9d18031400 comp rx=0 tx=0).stop 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 shutdown_connections 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559a476b4070 0x559a47ae9cb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.437+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a47693390 0x559a47a6fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d03fff640 0 client.25291 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559a4768b1b0 0x559a47a6f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d30fd9740 1 --2- 172.21.15.37:0/3601995928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a476729f0 0x559a47a6efa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 >> 172.21.15.37:0/3601995928 conn(0x559a476a8460 msgr2=0x559a47a58ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 shutdown_connections 2024-09-21T01:16:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d30fd9740 1 -- 172.21.15.37:0/3601995928 wait complete. 2024-09-21T01:16:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.438+0000 7f9d30fd9740 20 client.25291 trim_cache size 0 max 16384 2024-09-21T01:16:48.442 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d140b6510 msgr2=0x7f9d140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d140b6510 0x7f9d140b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005fd0 tx=0x7f9d1c009500 comp rx=0 tx=0).stop 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 msgr2=0x7f9d2419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 0x7f9d2419aae0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000e9f0 tx=0x7f9d1000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 shutdown_connections 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d140b6510 0x7f9d140b8a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2410ddf0 0x7f9d2419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d24105270 0x7f9d2419aae0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 --2- 172.21.15.37:0/1910123009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d24104840 0x7f9d2419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 >> 172.21.15.37:0/1910123009 conn(0x7f9d24079730 msgr2=0x7f9d241069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 shutdown_connections 2024-09-21T01:16:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:48.439+0000 7f9d2aa65640 1 -- 172.21.15.37:0/1910123009 wait complete. 2024-09-21T01:16:48.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:48 smithi037 ceph-mon[31105]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T01:16:48.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:48 smithi137 ceph-mon[34607]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T01:16:48.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:48 smithi144 ceph-mon[34818]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-21T01:16:50.172 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:16:50.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:16:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:50.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:50 smithi037 ceph-mon[31105]: pgmap v382: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T01:16:50.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:50 smithi137 ceph-mon[34607]: pgmap v382: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T01:16:50.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:50 smithi144 ceph-mon[34818]: pgmap v382: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-09-21T01:16:51.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.093+0000 7f4b21539640 1 -- 172.21.15.37:0/2760956502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c1083b0 msgr2=0x7f4b1c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.093+0000 7f4b21539640 1 --2- 172.21.15.37:0/2760956502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1087c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009900 tx=0x7f4b1002a410 comp rx=0 tx=0).stop 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 -- 172.21.15.37:0/2760956502 shutdown_connections 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 --2- 172.21.15.37:0/2760956502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c108d00 0x7f4b1c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 --2- 172.21.15.37:0/2760956502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1087c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 --2- 172.21.15.37:0/2760956502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c103140 0x7f4b1c103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 -- 172.21.15.37:0/2760956502 >> 172.21.15.37:0/2760956502 conn(0x7f4b1c077c60 msgr2=0x7f4b1c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 -- 172.21.15.37:0/2760956502 shutdown_connections 2024-09-21T01:16:51.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.094+0000 7f4b21539640 1 -- 172.21.15.37:0/2760956502 wait complete. 2024-09-21T01:16:51.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.096+0000 7f4b21539640 1 Processor -- start 2024-09-21T01:16:51.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.096+0000 7f4b21539640 1 -- start start 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b21539640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c103140 0x7f4b1c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b21539640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b21539640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c108d00 0x7f4b1c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b21539640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c112a50 con 0x7f4b1c103140 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b21539640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1128d0 con 0x7f4b1c1083b0 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b21539640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c112bd0 con 0x7f4b1c108d00 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b1a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c103140 0x7f4b1c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b1a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35270/0 (socket says 172.21.15.37:35270) 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/2513622630 learned_addr learned my addr 172.21.15.37:0/2513622630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.097+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c108d00 0x7f4b1c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/2513622630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c108d00 msgr2=0x7f4b1c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1a7fc640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c108d00 0x7f4b1c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c103140 msgr2=0x7f4b1c199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1a7fc640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c103140 0x7f4b1c199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/2513622630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c1a8840 con 0x7f4b1c1083b0 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1affd640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c103140 0x7f4b1c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b1a7fc640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1996d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b10005ab0 tx=0x7f4b10003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b03fff640 1 -- 172.21.15.37:0/2513622630 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1003f070 con 0x7f4b1c1083b0 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c19b3a0 con 0x7f4b1c1083b0 2024-09-21T01:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b03fff640 1 -- 172.21.15.37:0/2513622630 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b10031d60 con 0x7f4b1c1083b0 2024-09-21T01:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b03fff640 1 -- 172.21.15.37:0/2513622630 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10035030 con 0x7f4b1c1083b0 2024-09-21T01:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.098+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c19b8d0 con 0x7f4b1c1083b0 2024-09-21T01:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.102+0000 7f4b27aad740 1 Processor -- start 2024-09-21T01:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.102+0000 7f4b27aad740 1 -- start start 2024-09-21T01:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.102+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 0x559765af9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 0x559765af9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 0x559765af9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44108/0 (socket says 172.21.15.37:44108) 2024-09-21T01:16:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.102+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765af9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/625018908 learned_addr learned my addr 172.21.15.37:0/625018908 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b27aad740 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765af9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559765a6fe60 con 0x559765752350 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559765a5f290 con 0x559765729490 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559765a630a0 con 0x559765731670 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1affd640 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765af9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1affd640 1 -- 172.21.15.37:0/625018908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 msgr2=0x559765af9eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1affd640 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765af9eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1affd640 1 -- 172.21.15.37:0/625018908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 msgr2=0x559765af9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1affd640 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 0x559765af9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1affd640 1 -- 172.21.15.37:0/625018908 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597657bd930 con 0x559765729490 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.103+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 0x559765af9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.104+0000 7f4b1affd640 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765af9970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c19b2b0 tx=0x7f4b0c009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e413b69e078431 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.104+0000 7f4b017fa640 1 -- 172.21.15.37:0/625018908 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0076c0 con 0x559765729490 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.104+0000 7f4b017fa640 1 -- 172.21.15.37:0/625018908 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b0c022070 con 0x559765729490 2024-09-21T01:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.104+0000 7f4b017fa640 1 -- 172.21.15.37:0/625018908 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c01dcb0 con 0x559765729490 2024-09-21T01:16:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b03fff640 1 -- 172.21.15.37:0/2513622630 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4b10042070 con 0x7f4b1c1083b0 2024-09-21T01:16:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 msgr2=0x559765af9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b27aad740 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765af9970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c19b2b0 tx=0x7f4b0c009a90 comp rx=0 tx=0).stop 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 shutdown_connections 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b27aad740 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765af9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b27aad740 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765af9970 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.105+0000 7f4b27aad740 1 --2- 172.21.15.37:0/625018908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765752350 0x559765af9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.106+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 >> 172.21.15.37:0/625018908 conn(0x559765746740 msgr2=0x559765af7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.106+0000 7f4b03fff640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b040b6590 0x7f4b040b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.106+0000 7f4b03fff640 1 -- 172.21.15.37:0/2513622630 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b10107700 con 0x7f4b1c1083b0 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.106+0000 7f4b1affd640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b040b6590 0x7f4b040b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.106+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 shutdown_connections 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.106+0000 7f4b27aad740 1 -- 172.21.15.37:0/625018908 wait complete. 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.107+0000 7f4b27aad740 1 -- start start 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.107+0000 7f4b1affd640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b040b6590 0x7f4b040b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0093c0 tx=0x7f4b0c01d890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.107+0000 7f4b27aad740 1 Processor -- start 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b05030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b05570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765752350 0x559765b10f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5597658c0890 con 0x559765731670 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5597659f9d40 con 0x559765729490 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559765b07c10 con 0x559765752350 2024-09-21T01:16:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b05030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b05030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35290/0 (socket says 172.21.15.37:35290) 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b1affd640 1 -- 172.21.15.37:0/604934474 learned_addr learned my addr 172.21.15.37:0/604934474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765752350 0x559765b10f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b1a7fc640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b05570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.108+0000 7f4b27aad740 10 client.0 _ll_register_callbacks cb 0x559765a5dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 msgr2=0x559765b05030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b05030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/604934474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 msgr2=0x559765b05570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b05570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/604934474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559765b114f0 con 0x559765752350 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765752350 0x559765b10f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400abe0 tx=0x7f4b14011580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5246e674906d962b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4afeff5640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4afeff5640 1 -- 172.21.15.37:0/604934474 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14011ea0 con 0x559765752350 2024-09-21T01:16:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b0c022070 con 0x559765752350 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.109+0000 7f4afeff5640 1 -- 172.21.15.37:0/604934474 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b14016650 con 0x559765752350 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4afeff5640 1 -- 172.21.15.37:0/604934474 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b14025050 con 0x559765752350 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4b27aad740 10 client.25297 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559765b13e60 con 0x559765752350 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4afeff5640 1 -- 172.21.15.37:0/604934474 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b14016d00 con 0x559765752350 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4afeff5640 1 -- 172.21.15.37:0/604934474 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4b1401eac0 con 0x559765752350 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4b27aad740 10 client.25297 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.110+0000 7f4b27aad740 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.111+0000 7f4b27aad740 20 client.25297 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.111+0000 7f4b27aad740 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765710cd0 0x559765b173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.111+0000 7f4b27aad740 4 client.25297 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.111+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4b0c022070 con 0x559765710cd0 2024-09-21T01:16:51.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.111+0000 7f4b1affd640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765710cd0 0x559765b173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.112+0000 7f4b1affd640 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765710cd0 0x559765b173d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6518b32add0c212 server_cookie=82d2d73335139f7a in_seq=0 out_seq=0 2024-09-21T01:16:51.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.112+0000 7f4afeff5640 10 client.25297 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.112+0000 7f4afeff5640 1 -- 172.21.15.37:0/604934474 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4b0c022070 con 0x559765710cd0 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.112+0000 7f4afeff5640 10 client.25297 handle_command_reply: tid=0 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 client.25297 shutdown 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765752350 msgr2=0x559765b10f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765752350 0x559765b10f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400abe0 tx=0x7f4b14011580 comp rx=0 tx=0).stop 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 shutdown_connections 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765710cd0 0x559765b173d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765752350 0x559765b10f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4afeff5640 0 client.25297 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b05570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 --2- 172.21.15.37:0/604934474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b05030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.113+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 >> 172.21.15.37:0/604934474 conn(0x559765746740 msgr2=0x559765afc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.114+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 shutdown_connections 2024-09-21T01:16:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.114+0000 7f4b27aad740 1 -- 172.21.15.37:0/604934474 wait complete. 2024-09-21T01:16:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.114+0000 7f4b27aad740 20 client.25297 trim_cache size 0 max 16384 2024-09-21T01:16:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 Processor -- start 2024-09-21T01:16:51.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 -- start start 2024-09-21T01:16:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 0x559765afcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b10e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765afab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1ad2f0 con 0x559765710cd0 2024-09-21T01:16:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1aee30 con 0x559765729490 2024-09-21T01:16:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b27aad740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1ad9c0 con 0x559765731670 2024-09-21T01:16:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 0x559765afcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 0x559765afcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44118/0 (socket says 172.21.15.37:44118) 2024-09-21T01:16:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.132+0000 7f4b1affd640 1 -- 172.21.15.37:0/1336684689 learned_addr learned my addr 172.21.15.37:0/1336684689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765afab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1a7fc640 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b10e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1affd640 1 -- 172.21.15.37:0/1336684689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 msgr2=0x559765afab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765afab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1affd640 1 -- 172.21.15.37:0/1336684689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 msgr2=0x559765b10e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b10e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1affd640 1 -- 172.21.15.37:0/1336684689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559765a24020 con 0x559765710cd0 2024-09-21T01:16:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 0x559765afcba0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c006010 tx=0x7f4b0c026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce62ef1e4913050 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.133+0000 7f4b00ff9640 1 -- 172.21.15.37:0/1336684689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0054d0 con 0x559765710cd0 2024-09-21T01:16:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.134+0000 7f4b00ff9640 1 -- 172.21.15.37:0/1336684689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b0c02c070 con 0x559765710cd0 2024-09-21T01:16:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.134+0000 7f4b00ff9640 1 -- 172.21.15.37:0/1336684689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c003850 con 0x559765710cd0 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 -- 172.21.15.37:0/1336684689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 msgr2=0x559765afcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 0x559765afcba0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c006010 tx=0x7f4b0c026000 comp rx=0 tx=0).stop 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 -- 172.21.15.37:0/1336684689 shutdown_connections 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765731670 0x559765afab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765729490 0x559765b10e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1336684689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765710cd0 0x559765afcba0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 -- 172.21.15.37:0/1336684689 >> 172.21.15.37:0/1336684689 conn(0x559765746740 msgr2=0x559765afa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 -- 172.21.15.37:0/1336684689 shutdown_connections 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 -- 172.21.15.37:0/1336684689 wait complete. 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 -- start start 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.135+0000 7f4b27aad740 1 Processor -- start 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765710cd0 0x559765b0d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765729490 0x559765b08ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b09390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1ae760 con 0x559765731670 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1ae090 con 0x559765710cd0 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c1ab2b0 con 0x559765729490 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b1a7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765729490 0x559765b08ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b27aad740 10 client.0 _ll_register_callbacks cb 0x7f4b14009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.136+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b09390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765710cd0 0x559765b0d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765710cd0 0x559765b0d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35316/0 (socket says 172.21.15.37:35316) 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1affd640 1 -- 172.21.15.37:0/1655565914 learned_addr learned my addr 172.21.15.37:0/1655565914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1655565914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765729490 msgr2=0x559765b08ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765729490 0x559765b08ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765710cd0 msgr2=0x559765b0d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765710cd0 0x559765b0d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1655565914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559765b80d70 con 0x559765731670 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b09390 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4b140154a0 tx=0x7f4b14015750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2bdcd654b1f7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.137+0000 7f4afeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4afeff5640 1 -- 172.21.15.37:0/1655565914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402d020 con 0x559765731670 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b0c02c070 con 0x559765731670 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4afeff5640 1 -- 172.21.15.37:0/1655565914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b14015bc0 con 0x559765731670 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4afeff5640 1 -- 172.21.15.37:0/1655565914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b14011ea0 con 0x559765731670 2024-09-21T01:16:51.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 10 client.15726 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559765b81e80 con 0x559765731670 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4afeff5640 1 -- 172.21.15.37:0/1655565914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b0c02c070 con 0x559765731670 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4afeff5640 1 -- 172.21.15.37:0/1655565914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4b14016450 con 0x559765731670 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 10 client.15726 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 20 client.15726 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765752350 0x559765b84670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 4 client.15726 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.138+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559765a71db0 con 0x559765752350 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.139+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765752350 0x559765b84670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.139+0000 7f4afeff5640 10 client.15726 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.139+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765752350 0x559765b84670 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae4ee88cc402d90 server_cookie=782066b14dec4746 in_seq=0 out_seq=0 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4afeff5640 1 -- 172.21.15.37:0/1655565914 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559765a71db0 con 0x559765752350 2024-09-21T01:16:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4afeff5640 10 client.15726 handle_command_reply: tid=0 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 client.15726 shutdown 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 msgr2=0x559765b09390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b09390 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4b140154a0 tx=0x7f4b14015750 comp rx=0 tx=0).stop 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 shutdown_connections 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559765752350 0x559765b84670 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4afeff5640 0 client.15726 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559765731670 0x559765b09390 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559765729490 0x559765b08ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 --2- 172.21.15.37:0/1655565914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559765710cd0 0x559765b0d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.141+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 >> 172.21.15.37:0/1655565914 conn(0x559765746740 msgr2=0x559765afae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.142+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 shutdown_connections 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.142+0000 7f4b27aad740 1 -- 172.21.15.37:0/1655565914 wait complete. 2024-09-21T01:16:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.142+0000 7f4b27aad740 20 client.15726 trim_cache size 0 max 16384 2024-09-21T01:16:51.153 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:16:51.153 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:16:51.153 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "5071e53c-b22f-4e9a-949f-ea3087632abb", 2024-09-21T01:16:51.153 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:16:51.153 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b040b6590 msgr2=0x7f4b040b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b040b6590 0x7f4b040b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0093c0 tx=0x7f4b0c01d890 comp rx=0 tx=0).stop 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 msgr2=0x7f4b1c1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1996d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b10005ab0 tx=0x7f4b10003c80 comp rx=0 tx=0).stop 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 shutdown_connections 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b040b6590 0x7f4b040b8aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c108d00 0x7f4b1c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b1c1083b0 0x7f4b1c1996d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 --2- 172.21.15.37:0/2513622630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c103140 0x7f4b1c199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 >> 172.21.15.37:0/2513622630 conn(0x7f4b1c077c60 msgr2=0x7f4b1c106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.143+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 shutdown_connections 2024-09-21T01:16:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:51.144+0000 7f4b21539640 1 -- 172.21.15.37:0/2513622630 wait complete. 2024-09-21T01:16:51.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:16:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:16:52.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:52 smithi037 ceph-mon[31105]: pgmap v383: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T01:16:52.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:52 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:16:52.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:52 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:52.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:52 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:16:52.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:52 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:52 smithi137 ceph-mon[34607]: pgmap v383: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T01:16:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:52 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:16:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:52 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:52 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:16:52.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:52 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:52 smithi144 ceph-mon[34818]: pgmap v383: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T01:16:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:52 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:16:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:52 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:52 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:16:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:52 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:16:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 -- 172.21.15.37:0/3456202094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 msgr2=0x7f559010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3456202094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 0x7f559010f530 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5588009ca0 tx=0x7f558802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 -- 172.21.15.37:0/3456202094 shutdown_connections 2024-09-21T01:16:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3456202094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 0x7f559010f530 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3456202094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590105170 0x7f5590105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3456202094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590103160 0x7f5590103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 -- 172.21.15.37:0/3456202094 >> 172.21.15.37:0/3456202094 conn(0x7f5590077c60 msgr2=0x7f55900780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 -- 172.21.15.37:0/3456202094 shutdown_connections 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.765+0000 7f5595b9f640 1 -- 172.21.15.37:0/3456202094 wait complete. 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.766+0000 7f5595b9f640 1 Processor -- start 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.766+0000 7f5595b9f640 1 -- start start 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f5595b9f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590103160 0x7f5590110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f5595b9f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 0x7f5590110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f5595b9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 0x7f5590110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f5595b9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5590113b10 con 0x7f5590105ac0 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f5595b9f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5590113990 con 0x7f5590105170 2024-09-21T01:16:52.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f558effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 0x7f5590110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f558effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 0x7f5590110550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35332/0 (socket says 172.21.15.37:35332) 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f558ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 0x7f5590110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f558effd640 1 -- 172.21.15.37:0/3786391497 learned_addr learned my addr 172.21.15.37:0/3786391497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590103160 0x7f5590110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.767+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5590113c90 con 0x7f5590103160 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558effd640 1 -- 172.21.15.37:0/3786391497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590103160 msgr2=0x7f5590110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558effd640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590103160 0x7f5590110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558effd640 1 -- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 msgr2=0x7f5590110a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558effd640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 0x7f5590110a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558effd640 1 -- 172.21.15.37:0/3786391497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55901a8860 con 0x7f5590105170 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590103160 0x7f5590110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558effd640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 0x7f5590110550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f558400d740 tx=0x7f558400dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558cff9640 1 -- 172.21.15.37:0/3786391497 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584017070 con 0x7f5590105170 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558cff9640 1 -- 172.21.15.37:0/3786391497 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f558400de50 con 0x7f5590105170 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55901a8b50 con 0x7f5590105170 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.768+0000 7f558cff9640 1 -- 172.21.15.37:0/3786391497 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558400f620 con 0x7f5590105170 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.769+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55901a9090 con 0x7f5590105170 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.771+0000 7f558cff9640 1 -- 172.21.15.37:0/3786391497 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f558401a070 con 0x7f5590105170 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.772+0000 7f559c113740 1 Processor -- start 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.772+0000 7f559c113740 1 -- start start 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.772+0000 7f559c113740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0950270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.772+0000 7f559c113740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09507b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.772+0000 7f558cff9640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55780b6590 0x7f55780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f559c113740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb0588390 0x55ffb0950cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f559c113740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ffb08c6e50 con 0x55ffb0588390 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f559c113740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ffb08b6280 con 0x55ffb05801b0 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f559c113740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ffb08ba090 con 0x55ffb05a9070 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55780b6590 0x7f55780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb0588390 0x55ffb0950cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35346/0 (socket says 172.21.15.37:35346) 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558effd640 1 -- 172.21.15.37:0/2437393430 learned_addr learned my addr 172.21.15.37:0/2437393430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558cff9640 1 -- 172.21.15.37:0/3786391497 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f55840e6ba0 con 0x7f5590105170 2024-09-21T01:16:52.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.773+0000 7f558ffff640 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0950270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55780b6590 0x7f55780b8aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5590111a60 tx=0x7f558000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558effd640 1 -- 172.21.15.37:0/2437393430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 msgr2=0x55ffb0950270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558effd640 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0950270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558effd640 1 -- 172.21.15.37:0/2437393430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb0588390 msgr2=0x55ffb0950cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558effd640 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb0588390 0x55ffb0950cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558effd640 1 -- 172.21.15.37:0/2437393430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffb0614650 con 0x55ffb05801b0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558ffff640 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb0588390 0x55ffb0950cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f558effd640 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09507b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5584000be0 tx=0x7f55840a8d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13263f6c9b833028 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f5575ffb640 1 -- 172.21.15.37:0/2437393430 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584021070 con 0x55ffb05801b0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f5575ffb640 1 -- 172.21.15.37:0/2437393430 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55840ac8b0 con 0x55ffb05801b0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.774+0000 7f5575ffb640 1 -- 172.21.15.37:0/2437393430 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55840b2ce0 con 0x55ffb05801b0 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.775+0000 7f559c113740 1 -- 172.21.15.37:0/2437393430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 msgr2=0x55ffb09507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.775+0000 7f559c113740 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09507b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5584000be0 tx=0x7f55840a8d00 comp rx=0 tx=0).stop 2024-09-21T01:16:52.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 -- 172.21.15.37:0/2437393430 shutdown_connections 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb0588390 0x55ffb0950cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09507b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 --2- 172.21.15.37:0/2437393430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0950270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 -- 172.21.15.37:0/2437393430 >> 172.21.15.37:0/2437393430 conn(0x55ffb059d460 msgr2=0x55ffb094e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 -- 172.21.15.37:0/2437393430 shutdown_connections 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.776+0000 7f559c113740 1 -- 172.21.15.37:0/2437393430 wait complete. 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.777+0000 7f559c113740 1 -- start start 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.777+0000 7f559c113740 1 Processor -- start 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.777+0000 7f559c113740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb095b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f559c113740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb0588390 0x55ffb095be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f559c113740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0967d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f559c113740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ffb0717700 con 0x55ffb05801b0 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f559c113740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ffb0851110 con 0x55ffb0588390 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f559c113740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ffb095e9f0 con 0x55ffb05a9070 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f559c113740 10 client.0 _ll_register_callbacks cb 0x55ffb086a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb095b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb095b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44160/0 (socket says 172.21.15.37:44160) 2024-09-21T01:16:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558f7fe640 1 -- 172.21.15.37:0/3703101906 learned_addr learned my addr 172.21.15.37:0/3703101906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:52.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558effd640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb0588390 0x55ffb095be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558ffff640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0967d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558effd640 1 -- 172.21.15.37:0/3703101906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 msgr2=0x55ffb0967d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558effd640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0967d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558effd640 1 -- 172.21.15.37:0/3703101906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 msgr2=0x55ffb095b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558effd640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb095b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.778+0000 7f558effd640 1 -- 172.21.15.37:0/3703101906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffb087ec40 con 0x55ffb0588390 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f558effd640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb0588390 0x55ffb095be40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55840a9370 tx=0x7f55840b1830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a3c38684682574 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f556effd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f556effd640 1 -- 172.21.15.37:0/3703101906 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584021070 con 0x55ffb0588390 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f556effd640 1 -- 172.21.15.37:0/3703101906 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f55840a9010 con 0x55ffb0588390 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55840ac8b0 con 0x55ffb0588390 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f556effd640 1 -- 172.21.15.37:0/3703101906 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f55840b2f60 con 0x55ffb0588390 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f559c113740 10 client.25376 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:52.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.779+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffb096a700 con 0x55ffb0588390 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f556effd640 1 -- 172.21.15.37:0/3703101906 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55840ac8b0 con 0x55ffb0588390 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f556effd640 1 -- 172.21.15.37:0/3703101906 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f558405c0f0 con 0x55ffb0588390 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f559c113740 10 client.25376 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f559c113740 10 client.25376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f559c113740 20 client.25376 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f559c113740 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05679f0 0x55ffb096da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f559c113740 4 client.25376 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffb08c8da0 con 0x55ffb05679f0 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.780+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05679f0 0x55ffb096da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.781+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05679f0 0x55ffb096da60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78db7a24bef401e9 server_cookie=5de8ac22b559120b in_seq=0 out_seq=0 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.781+0000 7f556effd640 10 client.25376 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f556effd640 1 -- 172.21.15.37:0/3703101906 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffb08c8da0 con 0x55ffb05679f0 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f556effd640 10 client.25376 handle_command_reply: tid=0 2024-09-21T01:16:52.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 client.25376 shutdown 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb0588390 msgr2=0x55ffb095be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb0588390 0x55ffb095be40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55840a9370 tx=0x7f55840b1830 comp rx=0 tx=0).stop 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 shutdown_connections 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05679f0 0x55ffb096da60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb05a9070 0x55ffb0967d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f556effd640 0 client.25376 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb0588390 0x55ffb095be40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 --2- 172.21.15.37:0/3703101906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb095b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 >> 172.21.15.37:0/3703101906 conn(0x55ffb059d460 msgr2=0x55ffb0951c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.782+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 shutdown_connections 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.783+0000 7f559c113740 1 -- 172.21.15.37:0/3703101906 wait complete. 2024-09-21T01:16:52.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.783+0000 7f559c113740 20 client.25376 trim_cache size 0 max 16384 2024-09-21T01:16:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.818+0000 7f559c113740 1 Processor -- start 2024-09-21T01:16:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.818+0000 7f559c113740 1 -- start start 2024-09-21T01:16:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.818+0000 7f559c113740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05679f0 0x55ffb095d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.818+0000 7f559c113740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb0967c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.818+0000 7f558effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb0967c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb0967c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44168/0 (socket says 172.21.15.37:44168) 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558effd640 1 -- 172.21.15.37:0/3301446191 learned_addr learned my addr 172.21.15.37:0/3301446191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f559c113740 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb0951610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b16c0 con 0x55ffb05801b0 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b3200 con 0x55ffb05679f0 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05679f0 0x55ffb095d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b1d90 con 0x55ffb0588390 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558ffff640 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb0951610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558ffff640 1 -- 172.21.15.37:0/3301446191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05679f0 msgr2=0x55ffb095d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558ffff640 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05679f0 0x55ffb095d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558ffff640 1 -- 172.21.15.37:0/3301446191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 msgr2=0x55ffb0967c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558ffff640 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb0967c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.819+0000 7f558ffff640 1 -- 172.21.15.37:0/3301446191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffb09530d0 con 0x55ffb0588390 2024-09-21T01:16:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.820+0000 7f558effd640 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb0967c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.820+0000 7f558ffff640 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb0951610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5588005e30 tx=0x7f558802a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c5ad9afcfd4879 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.820+0000 7f55757fa640 1 -- 172.21.15.37:0/3301446191 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588031450 con 0x55ffb0588390 2024-09-21T01:16:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.820+0000 7f55757fa640 1 -- 172.21.15.37:0/3301446191 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5588048020 con 0x55ffb0588390 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.820+0000 7f55757fa640 1 -- 172.21.15.37:0/3301446191 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55880043b0 con 0x55ffb0588390 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 msgr2=0x55ffb0951610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb0951610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5588005e30 tx=0x7f558802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 shutdown_connections 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb0951610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05801b0 0x55ffb0967c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 --2- 172.21.15.37:0/3301446191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05679f0 0x55ffb095d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 >> 172.21.15.37:0/3301446191 conn(0x55ffb059d460 msgr2=0x55ffb0950f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 shutdown_connections 2024-09-21T01:16:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.822+0000 7f559c113740 1 -- 172.21.15.37:0/3301446191 wait complete. 2024-09-21T01:16:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.823+0000 7f559c113740 1 -- start start 2024-09-21T01:16:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.823+0000 7f559c113740 1 Processor -- start 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05679f0 0x55ffb09cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb09d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b2b30 con 0x55ffb05679f0 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b2460 con 0x55ffb05801b0 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55901af680 con 0x55ffb0588390 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f559c113740 10 client.0 _ll_register_callbacks cb 0x7f5588009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f558ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb09d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f558ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb09d71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37914/0 (socket says 172.21.15.37:37914) 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f558effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f558ffff640 1 -- 172.21.15.37:0/3373445457 learned_addr learned my addr 172.21.15.37:0/3373445457 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.824+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05679f0 0x55ffb09cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558ffff640 1 -- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 msgr2=0x55ffb09cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558ffff640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558ffff640 1 -- 172.21.15.37:0/3373445457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05679f0 msgr2=0x55ffb09cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558ffff640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05679f0 0x55ffb09cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558ffff640 1 -- 172.21.15.37:0/3373445457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffb09ccee0 con 0x55ffb0588390 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05679f0 0x55ffb09cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f558ffff640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb09d71f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55880098b0 tx=0x7f5588031700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb756a73484b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.825+0000 7f556effd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f556effd640 1 -- 172.21.15.37:0/3373445457 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588051070 con 0x55ffb0588390 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f556effd640 1 -- 172.21.15.37:0/3373445457 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5588004210 con 0x55ffb0588390 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5588048020 con 0x55ffb0588390 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f556effd640 1 -- 172.21.15.37:0/3373445457 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f558805d050 con 0x55ffb0588390 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f559c113740 10 client.25321 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffb09e0f30 con 0x55ffb0588390 2024-09-21T01:16:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.826+0000 7f556effd640 1 -- 172.21.15.37:0/3373445457 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5588048020 con 0x55ffb0588390 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f556effd640 1 -- 172.21.15.37:0/3373445457 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f558802fc90 con 0x55ffb0588390 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f559c113740 10 client.25321 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f559c113740 10 client.25321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f559c113740 20 client.25321 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f559c113740 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05a9070 0x55ffb09e3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f559c113740 4 client.25321 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ffb08c4850 con 0x55ffb05a9070 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.827+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05a9070 0x55ffb09e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f558f7fe640 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05a9070 0x55ffb09e3640 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5016560214793b53 server_cookie=a34b09ea19c65054 in_seq=0 out_seq=0 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f556effd640 10 client.25321 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f556effd640 1 -- 172.21.15.37:0/3373445457 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55ffb08c4850 con 0x55ffb05a9070 2024-09-21T01:16:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f556effd640 10 client.25321 handle_command_reply: tid=0 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f559c113740 1 client.25321 shutdown 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 msgr2=0x55ffb09d71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f559c113740 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb09d71f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55880098b0 tx=0x7f5588031700 comp rx=0 tx=0).stop 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 shutdown_connections 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f559c113740 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ffb05a9070 0x55ffb09e3640 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f556effd640 0 client.25321 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.828+0000 7f559c113740 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffb0588390 0x55ffb09d71f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.829+0000 7f559c113740 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ffb05801b0 0x55ffb09cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.829+0000 7f559c113740 1 --2- 172.21.15.37:0/3373445457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffb05679f0 0x55ffb09cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.829+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 >> 172.21.15.37:0/3373445457 conn(0x55ffb059d460 msgr2=0x55ffb095d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.829+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 shutdown_connections 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.829+0000 7f559c113740 1 -- 172.21.15.37:0/3373445457 wait complete. 2024-09-21T01:16:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.829+0000 7f559c113740 20 client.25321 trim_cache size 0 max 16384 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "5071e53c-b22f-4e9a-949f-ea3087632abb", 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:16:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:16:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55780b6590 msgr2=0x7f55780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55780b6590 0x7f55780b8aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5590111a60 tx=0x7f558000b410 comp rx=0 tx=0).stop 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 msgr2=0x7f5590110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 0x7f5590110550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f558400d740 tx=0x7f558400dc00 comp rx=0 tx=0).stop 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 shutdown_connections 2024-09-21T01:16:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55780b6590 0x7f55780b8aa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5590105ac0 0x7f5590110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5590105170 0x7f5590110550 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 --2- 172.21.15.37:0/3786391497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5590103160 0x7f5590110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 >> 172.21.15.37:0/3786391497 conn(0x7f5590077c60 msgr2=0x7f5590106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 shutdown_connections 2024-09-21T01:16:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:16:52.830+0000 7f5595b9f640 1 -- 172.21.15.37:0/3786391497 wait complete. 2024-09-21T01:16:53.683 INFO:tasks.cephfs.filesystem:scrub status for tag:5071e53c-b22f-4e9a-949f-ea3087632abb - {'path': '/', 'tag': '5071e53c-b22f-4e9a-949f-ea3087632abb', 'options': 'recursive,force'} 2024-09-21T01:16:54.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:54 smithi037 ceph-mon[31105]: pgmap v384: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T01:16:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:54 smithi137 ceph-mon[34607]: pgmap v384: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T01:16:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:54 smithi144 ceph-mon[34818]: pgmap v384: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-21T01:16:56.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:56 smithi037 ceph-mon[31105]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T01:16:56.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:56 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:16:56.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:56 smithi137 ceph-mon[34607]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T01:16:56.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:56 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:16:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:56 smithi144 ceph-mon[34818]: pgmap v385: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-09-21T01:16:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:56 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 -- 172.21.15.37:0/281457848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c103fc0 msgr2=0x7f777c10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 --2- 172.21.15.37:0/281457848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c103fc0 0x7f777c10a960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7774009c90 tx=0x7f777402a860 comp rx=0 tx=0).stop 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 -- 172.21.15.37:0/281457848 shutdown_connections 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 --2- 172.21.15.37:0/281457848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c103fc0 0x7f777c10a960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 --2- 172.21.15.37:0/281457848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103620 0x7f777c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 --2- 172.21.15.37:0/281457848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c1025a0 0x7f777c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.682+0000 7f7783500640 1 -- 172.21.15.37:0/281457848 >> 172.21.15.37:0/281457848 conn(0x7f777c0fdee0 msgr2=0x7f777c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.683+0000 7f7783500640 1 -- 172.21.15.37:0/281457848 shutdown_connections 2024-09-21T01:16:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.683+0000 7f7783500640 1 -- 172.21.15.37:0/281457848 wait complete. 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.683+0000 7f7783500640 1 Processor -- start 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.683+0000 7f7783500640 1 -- start start 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7783500640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c1025a0 0x7f777c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7783500640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 0x7f777c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7783500640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103fc0 0x7f777c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7780a9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 0x7f777c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7783500640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f777c10e240 con 0x7f777c103620 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7780a9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 0x7f777c1994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54024/0 (socket says 172.21.15.37:54024) 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7780a9b640 1 -- 172.21.15.37:0/3030421651 learned_addr learned my addr 172.21.15.37:0/3030421651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7783500640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f777c10e0c0 con 0x7f777c1025a0 2024-09-21T01:16:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f778129c640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c1025a0 0x7f777c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f777c10e3c0 con 0x7f777c103fc0 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.684+0000 7f7781a9d640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103fc0 0x7f777c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7780a9b640 1 -- 172.21.15.37:0/3030421651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103fc0 msgr2=0x7f777c19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7780a9b640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103fc0 0x7f777c19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7780a9b640 1 -- 172.21.15.37:0/3030421651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c1025a0 msgr2=0x7f777c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7780a9b640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c1025a0 0x7f777c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7780a9b640 1 -- 172.21.15.37:0/3030421651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c19a8a0 con 0x7f777c103620 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7781a9d640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103fc0 0x7f777c19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f7780a9b640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 0x7f777c1994d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f776c00e9f0 tx=0x7f776c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.685+0000 7f77727fc640 1 -- 172.21.15.37:0/3030421651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c00cd80 con 0x7f777c103620 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.686+0000 7f77727fc640 1 -- 172.21.15.37:0/3030421651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f776c0054d0 con 0x7f777c103620 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.686+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c19ab90 con 0x7f777c103620 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.686+0000 7f77727fc640 1 -- 172.21.15.37:0/3030421651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c010690 con 0x7f777c103620 2024-09-21T01:16:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.686+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c06adc0 con 0x7f777c103620 2024-09-21T01:16:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.690+0000 7f77727fc640 1 -- 172.21.15.37:0/3030421651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f776c010830 con 0x7f777c103620 2024-09-21T01:16:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.690+0000 7f778a470740 1 Processor -- start 2024-09-21T01:16:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.690+0000 7f778a470740 1 -- start start 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778a470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25ac0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778a470740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778a470740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25ac1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778a470740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f25a2e6f0 con 0x556f256eb2f0 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778a470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556f25a1db20 con 0x556f257141b0 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778a470740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f25a21930 con 0x556f256f34d0 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778129c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778129c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54026/0 (socket says 172.21.15.37:54026) 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f778129c640 1 -- 172.21.15.37:0/1068405237 learned_addr learned my addr 172.21.15.37:0/1068405237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f7781a9d640 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25ac0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f7780a9b640 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25ac1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f77727fc640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77680b6590 0x7f77680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.691+0000 7f7781a9d640 1 -- 172.21.15.37:0/1068405237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 msgr2=0x556f25ac1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25ac1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 -- 172.21.15.37:0/1068405237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 msgr2=0x556f25ac08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 -- 172.21.15.37:0/1068405237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f259e3530 con 0x556f257141b0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f77727fc640 1 -- 172.21.15.37:0/3030421651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f776c0e76d0 con 0x7f777c103620 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77680b6590 0x7f77680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f778129c640 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25ac0260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7774005e20 tx=0x7f7774009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a091ce8186d4a7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.692+0000 7f7781a9d640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77680b6590 0x7f77680b8aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7774031040 tx=0x7f7774045000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.693+0000 7f77677fe640 1 -- 172.21.15.37:0/1068405237 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774031b70 con 0x556f257141b0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.693+0000 7f77677fe640 1 -- 172.21.15.37:0/1068405237 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7774036070 con 0x556f257141b0 2024-09-21T01:16:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.693+0000 7f77677fe640 1 -- 172.21.15.37:0/1068405237 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774045c60 con 0x556f257141b0 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 -- 172.21.15.37:0/1068405237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 msgr2=0x556f25ac0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25ac0260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7774005e20 tx=0x7f7774009390 comp rx=0 tx=0).stop 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 -- 172.21.15.37:0/1068405237 shutdown_connections 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25ac1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 --2- 172.21.15.37:0/1068405237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25ac0260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 -- 172.21.15.37:0/1068405237 >> 172.21.15.37:0/1068405237 conn(0x556f25708300 msgr2=0x556f25ab78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 -- 172.21.15.37:0/1068405237 shutdown_connections 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.694+0000 7f778a470740 1 -- 172.21.15.37:0/1068405237 wait complete. 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.695+0000 7f778a470740 1 -- start start 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.695+0000 7f778a470740 1 Processor -- start 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.695+0000 7f778a470740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.695+0000 7f778a470740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25aca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.695+0000 7f778a470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25acac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778a470740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f25955ab0 con 0x556f256eb2f0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54042/0 (socket says 172.21.15.37:54042) 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 -- 172.21.15.37:0/3827229509 learned_addr learned my addr 172.21.15.37:0/3827229509 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556f259c3730 con 0x556f257141b0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f25ac1ee0 con 0x556f256f34d0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778a470740 10 client.0 _ll_register_callbacks cb 0x556f25a176b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f7780a9b640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25aca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f7781a9d640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25acac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 -- 172.21.15.37:0/3827229509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 msgr2=0x556f25aca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25aca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 -- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 msgr2=0x556f25acac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25acac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 -- 172.21.15.37:0/3827229509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f2577f790 con 0x556f256eb2f0 2024-09-21T01:16:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f7781a9d640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25acac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f778129c640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac9a30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f777801cc50 tx=0x7f7778012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542272d4f2b98d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.696+0000 7f7764ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f7764ff9640 1 -- 172.21.15.37:0/3827229509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778004250 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7774036070 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f7764ff9640 1 -- 172.21.15.37:0/3827229509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f77780043f0 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f7764ff9640 1 -- 172.21.15.37:0/3827229509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77780035f0 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 10 client.15756 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f257f8620 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f7764ff9640 1 -- 172.21.15.37:0/3827229509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7774036070 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f7764ff9640 1 -- 172.21.15.37:0/3827229509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7778023020 con 0x556f256eb2f0 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 10 client.15756 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 20 client.15756 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.697+0000 7f778a470740 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f256d2d80 0x556f25abe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.698+0000 7f778a470740 4 client.15756 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:16:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.698+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f25a30640 con 0x556f256d2d80 2024-09-21T01:16:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.698+0000 7f7780a9b640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f256d2d80 0x556f25abe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.698+0000 7f7764ff9640 10 client.15756 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.698+0000 7f7780a9b640 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f256d2d80 0x556f25abe830 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c263b31c357c71fa server_cookie=5c176f7a9cd5199 in_seq=0 out_seq=0 2024-09-21T01:16:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.699+0000 7f7764ff9640 1 -- 172.21.15.37:0/3827229509 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f25a30640 con 0x556f256d2d80 2024-09-21T01:16:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.699+0000 7f7764ff9640 10 client.15756 handle_command_reply: tid=0 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.699+0000 7f778a470740 1 client.15756 shutdown 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.699+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 msgr2=0x556f25ac9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.699+0000 7f778a470740 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac9a30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f777801cc50 tx=0x7f7778012820 comp rx=0 tx=0).stop 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 shutdown_connections 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f256d2d80 0x556f25abe830 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f257141b0 0x556f25acac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f7764ff9640 0 client.15756 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256f34d0 0x556f25aca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 --2- 172.21.15.37:0/3827229509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256eb2f0 0x556f25ac9a30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 >> 172.21.15.37:0/3827229509 conn(0x556f25708300 msgr2=0x556f25ab5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 shutdown_connections 2024-09-21T01:16:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 1 -- 172.21.15.37:0/3827229509 wait complete. 2024-09-21T01:16:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.700+0000 7f778a470740 20 client.15756 trim_cache size 0 max 16384 2024-09-21T01:16:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 Processor -- start 2024-09-21T01:16:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 -- start start 2024-09-21T01:16:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 0x556f25abe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25ab7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256f34d0 0x556f25ac8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1a8d30 con 0x556f256d2d80 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1aa870 con 0x556f256f34d0 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778a470740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1a9400 con 0x556f256eb2f0 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778129c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 0x556f25abe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778129c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 0x556f25abe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54052/0 (socket says 172.21.15.37:54052) 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f778129c640 1 -- 172.21.15.37:0/1992836995 learned_addr learned my addr 172.21.15.37:0/1992836995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.729+0000 7f7780a9b640 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25ab7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f778129c640 1 -- 172.21.15.37:0/1992836995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 msgr2=0x556f25ab7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f778129c640 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25ab7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f778129c640 1 -- 172.21.15.37:0/1992836995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256f34d0 msgr2=0x556f25ac8c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f778129c640 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256f34d0 0x556f25ac8c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f778129c640 1 -- 172.21.15.37:0/1992836995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f25acafd0 con 0x556f256d2d80 2024-09-21T01:16:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f778129c640 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 0x556f25abe740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7778025920 tx=0x7f7778025b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6987bc62f6a4d21c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f7766ffd640 1 -- 172.21.15.37:0/1992836995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778025640 con 0x556f256d2d80 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f7766ffd640 1 -- 172.21.15.37:0/1992836995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7778005580 con 0x556f256d2d80 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.730+0000 7f7766ffd640 1 -- 172.21.15.37:0/1992836995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778010690 con 0x556f256d2d80 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 -- 172.21.15.37:0/1992836995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 msgr2=0x556f25abe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 0x556f25abe740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7778025920 tx=0x7f7778025b10 comp rx=0 tx=0).stop 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 -- 172.21.15.37:0/1992836995 shutdown_connections 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256f34d0 0x556f25ac8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25ab7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 --2- 172.21.15.37:0/1992836995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256d2d80 0x556f25abe740 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 -- 172.21.15.37:0/1992836995 >> 172.21.15.37:0/1992836995 conn(0x556f25708300 msgr2=0x556f25ac11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 -- 172.21.15.37:0/1992836995 shutdown_connections 2024-09-21T01:16:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 -- 172.21.15.37:0/1992836995 wait complete. 2024-09-21T01:16:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.732+0000 7f778a470740 1 -- start start 2024-09-21T01:16:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.733+0000 7f778a470740 1 Processor -- start 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.733+0000 7f778a470740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256d2d80 0x556f25acbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.733+0000 7f778a470740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25acc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.733+0000 7f778a470740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 0x556f25accc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f778a470740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1aa1a0 con 0x556f256f34d0 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f778a470740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1a9ad0 con 0x556f256d2d80 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f778a470740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1a6cf0 con 0x556f256eb2f0 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7781a9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 0x556f25accc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25acc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7781a9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 0x556f25accc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54066/0 (socket says 172.21.15.37:54066) 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7781a9d640 1 -- 172.21.15.37:0/699085625 learned_addr learned my addr 172.21.15.37:0/699085625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25acc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51606/0 (socket says 172.21.15.37:51606) 2024-09-21T01:16:56.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f778129c640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256d2d80 0x556f25acbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f778a470740 10 client.0 _ll_register_callbacks cb 0x7f7778009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 -- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256d2d80 msgr2=0x556f25acbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256d2d80 0x556f25acbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 -- 172.21.15.37:0/699085625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 msgr2=0x556f25accc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 0x556f25accc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 -- 172.21.15.37:0/699085625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f25acd3e0 con 0x556f256eb2f0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7781a9d640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 0x556f25accc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7780a9b640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25acc2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f776c0b39d0 tx=0x7f776c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df06f083052d8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.734+0000 7f7764ff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f7764ff9640 1 -- 172.21.15.37:0/699085625 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c0e9d90 con 0x556f256eb2f0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f7764ff9640 1 -- 172.21.15.37:0/699085625 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f776c0aeb50 con 0x556f256eb2f0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7778005580 con 0x556f256eb2f0 2024-09-21T01:16:56.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f7764ff9640 1 -- 172.21.15.37:0/699085625 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f776c0ad330 con 0x556f256eb2f0 2024-09-21T01:16:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f778a470740 10 client.25339 fetch_fsmap learned FSMap version 28 2024-09-21T01:16:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f25ad0770 con 0x556f256eb2f0 2024-09-21T01:16:56.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.735+0000 7f7764ff9640 1 -- 172.21.15.37:0/699085625 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f776c005680 con 0x556f256eb2f0 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.736+0000 7f7764ff9640 1 -- 172.21.15.37:0/699085625 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f776c010b20 con 0x556f256eb2f0 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.736+0000 7f778a470740 10 client.25339 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.736+0000 7f778a470740 10 client.25339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f778a470740 20 client.25339 populate_metadata read hostname 'smithi037' 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f778a470740 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f257141b0 0x556f25ad1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f778a470740 4 client.25339 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7778005580 con 0x556f257141b0 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f778129c640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f257141b0 0x556f25ad1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f7764ff9640 10 client.25339 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.737+0000 7f778129c640 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f257141b0 0x556f25ad1150 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1bc05d6f75a2d2f server_cookie=60d2b570cfc2af94 in_seq=0 out_seq=0 2024-09-21T01:16:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.743+0000 7f7764ff9640 1 -- 172.21.15.37:0/699085625 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7778005580 con 0x556f257141b0 2024-09-21T01:16:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.743+0000 7f7764ff9640 10 client.25339 handle_command_reply: tid=0 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.743+0000 7f778a470740 1 client.25339 shutdown 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 msgr2=0x556f25acc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25acc2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f776c0b39d0 tx=0x7f776c014000 comp rx=0 tx=0).stop 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 shutdown_connections 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f257141b0 0x556f25ad1150 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f256f34d0 0x556f25accc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f7764ff9640 0 client.25339 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f256eb2f0 0x556f25acc2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 --2- 172.21.15.37:0/699085625 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f256d2d80 0x556f25acbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 >> 172.21.15.37:0/699085625 conn(0x556f25708300 msgr2=0x556f25ab7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 shutdown_connections 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 1 -- 172.21.15.37:0/699085625 wait complete. 2024-09-21T01:16:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.744+0000 7f778a470740 20 client.25339 trim_cache size 0 max 16384 2024-09-21T01:16:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:16:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:16:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:16:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77680b6590 msgr2=0x7f77680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77680b6590 0x7f77680b8aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7774031040 tx=0x7f7774045000 comp rx=0 tx=0).stop 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 msgr2=0x7f777c1994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 0x7f777c1994d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f776c00e9f0 tx=0x7f776c00edf0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 shutdown_connections 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f77680b6590 0x7f77680b8aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f777c103fc0 0x7f777c19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f777c103620 0x7f777c1994d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 --2- 172.21.15.37:0/3030421651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f777c1025a0 0x7f777c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 >> 172.21.15.37:0/3030421651 conn(0x7f777c0fdee0 msgr2=0x7f777c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 shutdown_connections 2024-09-21T01:16:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:16:56.745+0000 7f7783500640 1 -- 172.21.15.37:0/3030421651 wait complete. 2024-09-21T01:16:58.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:16:58 smithi037 ceph-mon[31105]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T01:16:58.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:16:58 smithi137 ceph-mon[34607]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T01:16:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:16:58 smithi144 ceph-mon[34818]: pgmap v386: 97 pgs: 97 active+clean; 671 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T01:17:00.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:00 smithi037 ceph-mon[31105]: pgmap v387: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T01:17:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:00 smithi137 ceph-mon[34607]: pgmap v387: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T01:17:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:00 smithi144 ceph-mon[34818]: pgmap v387: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 511 B/s wr, 13 op/s 2024-09-21T01:17:02.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:02 smithi037 ceph-mon[31105]: pgmap v388: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T01:17:02.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:02 smithi137 ceph-mon[34607]: pgmap v388: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T01:17:02.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:02 smithi144 ceph-mon[34818]: pgmap v388: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T01:17:04.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:04 smithi037 ceph-mon[31105]: pgmap v389: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T01:17:04.672 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:04 smithi137 ceph-mon[34607]: pgmap v389: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T01:17:04.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:04 smithi144 ceph-mon[34818]: pgmap v389: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T01:17:06.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:06 smithi037 ceph-mon[31105]: pgmap v390: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-21T01:17:06.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:06 smithi144 ceph-mon[34818]: pgmap v390: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-21T01:17:06.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:06 smithi137 ceph-mon[34607]: pgmap v390: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-21T01:17:08.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:08 smithi037 ceph-mon[31105]: pgmap v391: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:17:08.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:08 smithi137 ceph-mon[34607]: pgmap v391: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:17:08.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:08 smithi144 ceph-mon[34818]: pgmap v391: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T01:17:09.382 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 91% (11571/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T01:17:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 -- 172.21.15.37:0/1235585206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8109550 msgr2=0x7f52d810b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/1235585206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8109550 0x7f52d810b970 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009ca0 tx=0x7f52d002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 -- 172.21.15.37:0/1235585206 shutdown_connections 2024-09-21T01:17:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/1235585206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8109550 0x7f52d810b970 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/1235585206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52d8106bf0 0x7f52d8109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/1235585206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52d8101aa0 0x7f52d8101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.850+0000 7f52dd6f9640 1 -- 172.21.15.37:0/1235585206 >> 172.21.15.37:0/1235585206 conn(0x7f52d80fd680 msgr2=0x7f52d80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.851+0000 7f52dd6f9640 1 -- 172.21.15.37:0/1235585206 shutdown_connections 2024-09-21T01:17:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.851+0000 7f52dd6f9640 1 -- 172.21.15.37:0/1235585206 wait complete. 2024-09-21T01:17:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.851+0000 7f52dd6f9640 1 Processor -- start 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.851+0000 7f52dd6f9640 1 -- start start 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52dd6f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 0x7f52d8199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52dd6f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52d8106bf0 0x7f52d819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52dd6f9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52d8109550 0x7f52d819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52dd6f9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52d810f300 con 0x7f52d8101aa0 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52dd6f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52d810f180 con 0x7f52d8106bf0 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52dd6f9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52d810f480 con 0x7f52d8109550 2024-09-21T01:17:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 0x7f52d8199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 0x7f52d8199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37410/0 (socket says 172.21.15.37:37410) 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 -- 172.21.15.37:0/2936443293 learned_addr learned my addr 172.21.15.37:0/2936443293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52d8109550 0x7f52d819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d67fc640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52d8106bf0 0x7f52d819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 -- 172.21.15.37:0/2936443293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52d8109550 msgr2=0x7f52d819b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52d8109550 0x7f52d819b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 -- 172.21.15.37:0/2936443293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52d8106bf0 msgr2=0x7f52d819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52d8106bf0 0x7f52d819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 -- 172.21.15.37:0/2936443293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d819b940 con 0x7f52d8101aa0 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.852+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 0x7f52d8199f00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f52c800e9f0 tx=0x7f52c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.853+0000 7f52bffff640 1 -- 172.21.15.37:0/2936443293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c800cd80 con 0x7f52d8101aa0 2024-09-21T01:17:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.853+0000 7f52bffff640 1 -- 172.21.15.37:0/2936443293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52c80054d0 con 0x7f52d8101aa0 2024-09-21T01:17:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.853+0000 7f52bffff640 1 -- 172.21.15.37:0/2936443293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8010690 con 0x7f52d8101aa0 2024-09-21T01:17:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.853+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d819bc30 con 0x7f52d8101aa0 2024-09-21T01:17:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.853+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d81a2320 con 0x7f52d8101aa0 2024-09-21T01:17:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.855+0000 7f52e466b740 1 Processor -- start 2024-09-21T01:17:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.855+0000 7f52e466b740 1 -- start start 2024-09-21T01:17:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.855+0000 7f52bffff640 1 -- 172.21.15.37:0/2936443293 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f52c8004e90 con 0x7f52d8101aa0 2024-09-21T01:17:09.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52e466b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844d8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52e466b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7841032f0 0x55e7844d88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52e466b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78410b4d0 0x55e7844d9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52e466b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e7844466f0 con 0x55e78412c1b0 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52e466b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e784435b20 con 0x55e7841032f0 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52e466b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e784439930 con 0x55e78410b4d0 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844d8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37426/0 (socket says 172.21.15.37:37426) 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 -- 172.21.15.37:0/2210619963 learned_addr learned my addr 172.21.15.37:0/2210619963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7841032f0 0x55e7844d88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d67fc640 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78410b4d0 0x55e7844d9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 -- 172.21.15.37:0/2210619963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78410b4d0 msgr2=0x55e7844d9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78410b4d0 0x55e7844d9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 -- 172.21.15.37:0/2210619963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7841032f0 msgr2=0x55e7844d88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7841032f0 0x55e7844d88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 -- 172.21.15.37:0/2210619963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7843fb530 con 0x55e78412c1b0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7841032f0 0x55e7844d88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52bffff640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52c00b6510 0x7f52c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.856+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844d8260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f52d0035000 tx=0x7f52d002f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ebad09f1ad2c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.857+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52c00b6510 0x7f52c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.857+0000 7f52bd7fa640 1 -- 172.21.15.37:0/2210619963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0031650 con 0x55e78412c1b0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.857+0000 7f52bd7fa640 1 -- 172.21.15.37:0/2210619963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52d0036030 con 0x55e78412c1b0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.857+0000 7f52bd7fa640 1 -- 172.21.15.37:0/2210619963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0004800 con 0x55e78412c1b0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.857+0000 7f52bffff640 1 -- 172.21.15.37:0/2936443293 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f52c80e77a0 con 0x7f52d8101aa0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 -- 172.21.15.37:0/2210619963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 msgr2=0x55e7844d8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52d6ffd640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52c00b6510 0x7f52c00b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a9f00 tx=0x7f52c8004a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844d8260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f52d0035000 tx=0x7f52d002f4c0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 -- 172.21.15.37:0/2210619963 shutdown_connections 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78410b4d0 0x55e7844d9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e7841032f0 0x55e7844d88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- 172.21.15.37:0/2210619963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844d8260 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 -- 172.21.15.37:0/2210619963 >> 172.21.15.37:0/2210619963 conn(0x55e784120300 msgr2=0x55e7844cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 -- 172.21.15.37:0/2210619963 shutdown_connections 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 -- 172.21.15.37:0/2210619963 wait complete. 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 -- start start 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 Processor -- start 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844e1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 0x55e7844e1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.858+0000 7f52e466b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78412c1b0 0x55e7844e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52e466b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e78436dab0 con 0x55e78410b4d0 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52e466b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e7843db730 con 0x55e78412c1b0 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52e466b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e7844d9d60 con 0x55e7841032f0 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52e466b740 10 client.0 _ll_register_callbacks cb 0x55e78442f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:09.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 0x55e7844e1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 0x55e7844e1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37440/0 (socket says 172.21.15.37:37440) 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 -- 172.21.15.37:0/2274845760 learned_addr learned my addr 172.21.15.37:0/2274845760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78412c1b0 0x55e7844e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 -- 172.21.15.37:0/2274845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 msgr2=0x55e7844e1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844e1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 -- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78412c1b0 msgr2=0x55e7844e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78412c1b0 0x55e7844e2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 -- 172.21.15.37:0/2274845760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e784197790 con 0x55e78410b4d0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78412c1b0 0x55e7844e2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52d67fc640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 0x55e7844e1ef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00df50 tx=0x7f52cc011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a996601c78a918e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52baff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52baff5640 1 -- 172.21.15.37:0/2274845760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc004220 con 0x55e78410b4d0 2024-09-21T01:17:09.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52baff5640 1 -- 172.21.15.37:0/2274845760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f52cc0043c0 con 0x55e78410b4d0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.859+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52d0036030 con 0x55e78410b4d0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52baff5640 1 -- 172.21.15.37:0/2274845760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52cc0035f0 con 0x55e78410b4d0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 10 client.15774 fetch_fsmap learned FSMap version 28 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e784210620 con 0x55e78410b4d0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52baff5640 1 -- 172.21.15.37:0/2274845760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52d0036030 con 0x55e78410b4d0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52baff5640 1 -- 172.21.15.37:0/2274845760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52cc012910 con 0x55e78410b4d0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 10 client.15774 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 20 client.15774 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840ead80 0x55e7844ef000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 4 client.15774 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e784448640 con 0x55e7840ead80 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.860+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840ead80 0x55e7844ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.861+0000 7f52baff5640 10 client.15774 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:09.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.861+0000 7f52d77fe640 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840ead80 0x55e7844ef000 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d2b1d593e8f87c server_cookie=42e30a8e04090241 in_seq=0 out_seq=0 2024-09-21T01:17:09.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52baff5640 1 -- 172.21.15.37:0/2274845760 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e784448640 con 0x55e7840ead80 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52baff5640 10 client.15774 handle_command_reply: tid=0 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 client.15774 shutdown 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 msgr2=0x55e7844e1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 0x55e7844e1ef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00df50 tx=0x7f52cc011870 comp rx=0 tx=0).stop 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 shutdown_connections 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840ead80 0x55e7844ef000 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78412c1b0 0x55e7844e2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52baff5640 0 client.15774 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78410b4d0 0x55e7844e1ef0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 --2- 172.21.15.37:0/2274845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844e1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 >> 172.21.15.37:0/2274845760 conn(0x55e784120300 msgr2=0x55e7844d92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 shutdown_connections 2024-09-21T01:17:09.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 1 -- 172.21.15.37:0/2274845760 wait complete. 2024-09-21T01:17:09.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.862+0000 7f52e466b740 20 client.15774 trim_cache size 0 max 16384 2024-09-21T01:17:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 Processor -- start 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 -- start start 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844da360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52d81a8d60 con 0x55e78412c1b0 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52d81aa8a0 con 0x55e78410b4d0 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52e466b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52d81a9430 con 0x55e7841032f0 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844da360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37450/0 (socket says 172.21.15.37:37450) 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52d77fe640 1 -- 172.21.15.37:0/203421243 learned_addr learned my addr 172.21.15.37:0/203421243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52d67fc640 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.877+0000 7f52d77fe640 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52d77fe640 1 -- 172.21.15.37:0/203421243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 msgr2=0x55e7844dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52d77fe640 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844dcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52d77fe640 1 -- 172.21.15.37:0/203421243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 msgr2=0x55e7844ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52d77fe640 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52d77fe640 1 -- 172.21.15.37:0/203421243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7844d8cd0 con 0x55e78412c1b0 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52d77fe640 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844da360 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009a60 tx=0x7f52d002f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d362e5b0b69f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52bcff9640 1 -- 172.21.15.37:0/203421243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d00041e0 con 0x55e78412c1b0 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52bcff9640 1 -- 172.21.15.37:0/203421243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52d0036040 con 0x55e78412c1b0 2024-09-21T01:17:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.878+0000 7f52bcff9640 1 -- 172.21.15.37:0/203421243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d002f660 con 0x55e78412c1b0 2024-09-21T01:17:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 -- 172.21.15.37:0/203421243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 msgr2=0x55e7844da360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844da360 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009a60 tx=0x7f52d002f4c0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 -- 172.21.15.37:0/203421243 shutdown_connections 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e78412c1b0 0x55e7844da360 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 --2- 172.21.15.37:0/203421243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e7841032f0 0x55e7844dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 -- 172.21.15.37:0/203421243 >> 172.21.15.37:0/203421243 conn(0x55e784120300 msgr2=0x55e7844cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 -- 172.21.15.37:0/203421243 shutdown_connections 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 -- 172.21.15.37:0/203421243 wait complete. 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 -- start start 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.879+0000 7f52e466b740 1 Processor -- start 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 0x55e7844e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78412c1b0 0x55e7844e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52d81aa1d0 con 0x55e7841032f0 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52d81a9b00 con 0x55e78410b4d0 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52d81a6d20 con 0x55e78412c1b0 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52e466b740 10 client.0 _ll_register_callbacks cb 0x7f52cc00d4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 0x55e7844e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 0x55e7844e91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37462/0 (socket says 172.21.15.37:37462) 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 -- 172.21.15.37:0/745431320 learned_addr learned my addr 172.21.15.37:0/745431320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d67fc640 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 -- 172.21.15.37:0/745431320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78412c1b0 msgr2=0x55e7844e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78412c1b0 0x55e7844e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 -- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 msgr2=0x55e7844e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 -- 172.21.15.37:0/745431320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7844e8730 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52d77fe640 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 0x55e7844e91f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f52d002ade0 tx=0x7f52d00044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9353e83306159a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.880+0000 7f52baff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52baff5640 1 -- 172.21.15.37:0/745431320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0004780 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52baff5640 1 -- 172.21.15.37:0/745431320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f52d0003cf0 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52d0036040 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52baff5640 1 -- 172.21.15.37:0/745431320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52d0031450 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 10 client.15780 fetch_fsmap learned FSMap version 28 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7844e7580 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52baff5640 1 -- 172.21.15.37:0/745431320 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52d0036040 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52baff5640 1 -- 172.21.15.37:0/745431320 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52d0043070 con 0x55e7841032f0 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 10 client.15780 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 20 client.15780 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.881+0000 7f52e466b740 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840c01c0 0x55e78455bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.882+0000 7f52e466b740 4 client.15780 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:17:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.882+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7844440f0 con 0x55e7840c01c0 2024-09-21T01:17:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.882+0000 7f52d67fc640 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840c01c0 0x55e78455bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.882+0000 7f52baff5640 10 client.15780 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.882+0000 7f52d67fc640 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840c01c0 0x55e78455bbc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b0e015d1cfd78a server_cookie=3d06f6e6345c1407 in_seq=0 out_seq=0 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52baff5640 1 -- 172.21.15.37:0/745431320 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7844440f0 con 0x55e7840c01c0 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52baff5640 10 client.15780 handle_command_reply: tid=0 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 client.15780 shutdown 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 msgr2=0x55e7844e91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 0x55e7844e91f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f52d002ade0 tx=0x7f52d00044d0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 shutdown_connections 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e7840c01c0 0x55e78455bbc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e78412c1b0 0x55e7844e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52baff5640 0 client.15780 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e78410b4d0 0x55e7844e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 --2- 172.21.15.37:0/745431320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7841032f0 0x55e7844e91f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 >> 172.21.15.37:0/745431320 conn(0x55e784120300 msgr2=0x55e7844f37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 shutdown_connections 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.888+0000 7f52e466b740 1 -- 172.21.15.37:0/745431320 wait complete. 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52e466b740 20 client.15780 trim_cache size 0 max 16384 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:17:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:17:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52c00b6510 msgr2=0x7f52c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52c00b6510 0x7f52c00b8a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a9f00 tx=0x7f52c8004a90 comp rx=0 tx=0).stop 2024-09-21T01:17:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 msgr2=0x7f52d8199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 0x7f52d8199f00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f52c800e9f0 tx=0x7f52c800edf0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 shutdown_connections 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52c00b6510 0x7f52c00b8a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52d8109550 0x7f52d819b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52d8106bf0 0x7f52d819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 --2- 172.21.15.37:0/2936443293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d8101aa0 0x7f52d8199f00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.889+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 >> 172.21.15.37:0/2936443293 conn(0x7f52d80fd680 msgr2=0x7f52d81079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.890+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 shutdown_connections 2024-09-21T01:17:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:09.890+0000 7f52dd6f9640 1 -- 172.21.15.37:0/2936443293 wait complete. 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.085 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-21T01:17:10.086 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.086 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-21T01:17:10.086 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.086 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T01:17:10.086 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:10.086 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:17:10.090 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T01:17:10.157 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T01:17:10.159 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T01:17:10.159 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T01:17:10.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:10 smithi037 ceph-mon[31105]: pgmap v392: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:17:10.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:17:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:10 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:10 smithi144 ceph-mon[34818]: pgmap v392: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:10 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:10 smithi137 ceph-mon[34607]: pgmap v392: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:10 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:10.903 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T01:17:10.973 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T01:17:11.012 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T01:17:11.014 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T01:17:11.014 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T01:17:11.054 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T01:17:11.057 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:17:11.057 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T01:17:11.115 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-21T01:17:11.116 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-21T01:17:11.116 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-21T01:17:11.177 INFO:tasks.workunit.client.0.smithi037.stdout:getting iogen 2024-09-21T01:17:11.178 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'getting iogen' 2024-09-21T01:17:11.178 INFO:tasks.workunit.client.0.smithi037.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-21T01:17:11.202 INFO:tasks.workunit.client.0.smithi037.stderr:--2024-09-21 01:17:11-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-21T01:17:11.203 INFO:tasks.workunit.client.0.smithi037.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T01:17:11.221 INFO:tasks.workunit.client.0.smithi037.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T01:17:11.242 INFO:tasks.workunit.client.0.smithi037.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T01:17:11.242 INFO:tasks.workunit.client.0.smithi037.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-21T01:17:11.243 INFO:tasks.workunit.client.0.smithi037.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-21T01:17:11.246 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:11.246 INFO:tasks.workunit.client.0.smithi037.stderr: 0K ....... 100% 533M=0s 2024-09-21T01:17:11.246 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:11.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-21 01:17:11 (533 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-21T01:17:11.246 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-21T01:17:11.247 INFO:tasks.workunit.client.0.smithi037.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-21T01:17:11.259 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0 2024-09-21T01:17:11.261 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0/src 2024-09-21T01:17:11.261 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0/src/iogen.8 2024-09-21T01:17:11.262 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0/src/iogen.c 2024-09-21T01:17:11.263 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0/README 2024-09-21T01:17:11.264 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0/Makefile.bsd 2024-09-21T01:17:11.265 INFO:tasks.workunit.client.0.smithi037.stdout:iogen_3.1p0/Makefile 2024-09-21T01:17:11.266 INFO:tasks.workunit.client.0.smithi037.stderr:+ cd iogen_3.1p0 2024-09-21T01:17:11.267 INFO:tasks.workunit.client.0.smithi037.stdout:making iogen 2024-09-21T01:17:11.267 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'making iogen' 2024-09-21T01:17:11.267 INFO:tasks.workunit.client.0.smithi037.stderr:+ make 2024-09-21T01:17:11.277 INFO:tasks.workunit.client.0.smithi037.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-21T01:17:11.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:17:11.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:17:11.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:11.502 INFO:tasks.workunit.client.0.smithi037.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-21T01:17:11.612 INFO:tasks.workunit.client.0.smithi037.stdout:running iogen 2024-09-21T01:17:11.613 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'running iogen' 2024-09-21T01:17:11.613 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./iogen -n 5 -s 2g 2024-09-21T01:17:11.613 INFO:tasks.workunit.client.0.smithi037.stderr:child spawned 87316 2024-09-21T01:17:11.613 INFO:tasks.workunit.client.0.smithi037.stderr:child spawned 87317 2024-09-21T01:17:11.614 INFO:tasks.workunit.client.0.smithi037.stderr:child spawned 87318 2024-09-21T01:17:11.614 INFO:tasks.workunit.client.0.smithi037.stderr:child spawned 87319 2024-09-21T01:17:11.614 INFO:tasks.workunit.client.0.smithi037.stderr:child spawned 87320 2024-09-21T01:17:11.614 INFO:tasks.workunit.client.0.smithi037.stdout:sleep for 10 min 2024-09-21T01:17:11.614 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'sleep for 10 min' 2024-09-21T01:17:11.615 INFO:tasks.workunit.client.0.smithi037.stderr:+ sleep 600 2024-09-21T01:17:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:17:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:17:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:17:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:17:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:17:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:12 smithi137 ceph-mon[34607]: pgmap v393: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:17:12.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:12 smithi144 ceph-mon[34818]: pgmap v393: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:17:13.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:12 smithi037 ceph-mon[31105]: pgmap v393: 97 pgs: 97 active+clean; 672 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T01:17:14.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:14 smithi144 ceph-mon[34818]: pgmap v394: 97 pgs: 97 active+clean; 93 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 MiB/s wr, 11 op/s 2024-09-21T01:17:14.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:14 smithi137 ceph-mon[34607]: pgmap v394: 97 pgs: 97 active+clean; 93 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 MiB/s wr, 11 op/s 2024-09-21T01:17:15.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:14 smithi037 ceph-mon[31105]: pgmap v394: 97 pgs: 97 active+clean; 93 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 MiB/s wr, 11 op/s 2024-09-21T01:17:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:16 smithi137 ceph-mon[34607]: pgmap v395: 97 pgs: 97 active+clean; 819 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 68 MiB/s wr, 100 op/s 2024-09-21T01:17:16.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:16 smithi144 ceph-mon[34818]: pgmap v395: 97 pgs: 97 active+clean; 819 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 68 MiB/s wr, 100 op/s 2024-09-21T01:17:17.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:16 smithi037 ceph-mon[31105]: pgmap v395: 97 pgs: 97 active+clean; 819 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 68 MiB/s wr, 100 op/s 2024-09-21T01:17:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:18 smithi137 ceph-mon[34607]: pgmap v396: 97 pgs: 97 active+clean; 1.3 GiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 112 MiB/s wr, 109 op/s 2024-09-21T01:17:18.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:18 smithi144 ceph-mon[34818]: pgmap v396: 97 pgs: 97 active+clean; 1.3 GiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 112 MiB/s wr, 109 op/s 2024-09-21T01:17:19.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:18 smithi037 ceph-mon[31105]: pgmap v396: 97 pgs: 97 active+clean; 1.3 GiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 112 MiB/s wr, 109 op/s 2024-09-21T01:17:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:20 smithi137 ceph-mon[34607]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 377 MiB/s wr, 287 op/s 2024-09-21T01:17:20.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:20 smithi144 ceph-mon[34818]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 377 MiB/s wr, 287 op/s 2024-09-21T01:17:20.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:20 smithi037 ceph-mon[31105]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 377 MiB/s wr, 287 op/s 2024-09-21T01:17:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:22 smithi137 ceph-mon[34607]: pgmap v398: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 452 MiB/s wr, 379 op/s 2024-09-21T01:17:22.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:22 smithi144 ceph-mon[34818]: pgmap v398: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 452 MiB/s wr, 379 op/s 2024-09-21T01:17:23.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:22 smithi037 ceph-mon[31105]: pgmap v398: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 452 MiB/s wr, 379 op/s 2024-09-21T01:17:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.145+0000 7f5f5884c640 1 -- 172.21.15.37:0/1739894193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 msgr2=0x7f5f5410f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.145+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1739894193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 0x7f5f5410f140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009860 tx=0x7f5f4402a380 comp rx=0 tx=0).stop 2024-09-21T01:17:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.146+0000 7f5f5884c640 1 -- 172.21.15.37:0/1739894193 shutdown_connections 2024-09-21T01:17:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.146+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1739894193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410f830 0x7f5f5410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.146+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1739894193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 0x7f5f5410f140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.146+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1739894193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5410a3c0 0x7f5f5410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.146+0000 7f5f5884c640 1 -- 172.21.15.37:0/1739894193 >> 172.21.15.37:0/1739894193 conn(0x7f5f54070640 msgr2=0x7f5f54072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.147+0000 7f5f5884c640 1 -- 172.21.15.37:0/1739894193 shutdown_connections 2024-09-21T01:17:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.147+0000 7f5f5884c640 1 -- 172.21.15.37:0/1739894193 wait complete. 2024-09-21T01:17:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.149+0000 7f5f5884c640 1 Processor -- start 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 -- start start 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 0x7f5f541a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 0x7f5f541a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5410f830 0x7f5f541a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5411dff0 con 0x7f5f5410a3c0 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5411de70 con 0x7f5f5410cd20 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.155+0000 7f5f5884c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5411e170 con 0x7f5f5410f830 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 0x7f5f541a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 0x7f5f541a8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57182/0 (socket says 172.21.15.37:57182) 2024-09-21T01:17:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 -- 172.21.15.37:0/1569765678 learned_addr learned my addr 172.21.15.37:0/1569765678 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 -- 172.21.15.37:0/1569765678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5410f830 msgr2=0x7f5f541a9d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:17:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5410f830 0x7f5f541a9d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 -- 172.21.15.37:0/1569765678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 msgr2=0x7f5f541a91c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:17:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 0x7f5f541a91c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.156+0000 7f5f52d9d640 1 -- 172.21.15.37:0/1569765678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f541aa590 con 0x7f5f5410a3c0 2024-09-21T01:17:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.157+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 0x7f5f541a8b50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00eab0 tx=0x7f5f4c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.160+0000 7f5f3bfff640 1 -- 172.21.15.37:0/1569765678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00ce40 con 0x7f5f5410a3c0 2024-09-21T01:17:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.160+0000 7f5f3bfff640 1 -- 172.21.15.37:0/1569765678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c011920 con 0x7f5f5410a3c0 2024-09-21T01:17:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.160+0000 7f5f3bfff640 1 -- 172.21.15.37:0/1569765678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c010a30 con 0x7f5f5410a3c0 2024-09-21T01:17:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.162+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f541aa880 con 0x7f5f5410a3c0 2024-09-21T01:17:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.162+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f541b0f70 con 0x7f5f5410a3c0 2024-09-21T01:17:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.169+0000 7f5f3bfff640 1 -- 172.21.15.37:0/1569765678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5f4c010bd0 con 0x7f5f5410a3c0 2024-09-21T01:17:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.169+0000 7f5f5ffc5740 1 Processor -- start 2024-09-21T01:17:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.169+0000 7f5f5ffc5740 1 -- start start 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.169+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a72040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a73200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d0969e46f0 con 0x55d0966a12f0 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d0969d3b20 con 0x55d0966ca1b0 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d0969d7930 con 0x55d0966a94d0 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a72040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a72040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46986/0 (socket says 172.21.15.37:46986) 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f5359e640 1 -- 172.21.15.37:0/3053989535 learned_addr learned my addr 172.21.15.37:0/3053989535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.170+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.171+0000 7f5f5259c640 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a73200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.171+0000 7f5f5359e640 1 -- 172.21.15.37:0/3053989535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 msgr2=0x55d096a73200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.172+0000 7f5f5359e640 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a73200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.172+0000 7f5f5359e640 1 -- 172.21.15.37:0/3053989535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 msgr2=0x55d096a726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.172+0000 7f5f5359e640 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.172+0000 7f5f5359e640 1 -- 172.21.15.37:0/3053989535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d096999530 con 0x55d0966ca1b0 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.172+0000 7f5f5259c640 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.173+0000 7f5f5359e640 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a72040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009ac0 tx=0x7f5f48009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d7158d8a36ffda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.174+0000 7f5f397fa640 1 -- 172.21.15.37:0/3053989535 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800ec90 con 0x55d0966ca1b0 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.175+0000 7f5f397fa640 1 -- 172.21.15.37:0/3053989535 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4800ee30 con 0x55d0966ca1b0 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.175+0000 7f5f397fa640 1 -- 172.21.15.37:0/3053989535 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48032440 con 0x55d0966ca1b0 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.176+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/3053989535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 msgr2=0x55d096a72040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.176+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a72040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009ac0 tx=0x7f5f48009f80 comp rx=0 tx=0).stop 2024-09-21T01:17:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.178+0000 7f5f3bfff640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f3c0b6720 0x7f5f3c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.179+0000 7f5f5359e640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f3c0b6720 0x7f5f3c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.180+0000 7f5f3bfff640 1 -- 172.21.15.37:0/1569765678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5f4c0e7940 con 0x7f5f5410a3c0 2024-09-21T01:17:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.188+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/3053989535 shutdown_connections 2024-09-21T01:17:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.188+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.188+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.188+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/3053989535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a72040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.188+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/3053989535 >> 172.21.15.37:0/3053989535 conn(0x55d0966be300 msgr2=0x55d096a6dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.193+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/3053989535 shutdown_connections 2024-09-21T01:17:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.195+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/3053989535 wait complete. 2024-09-21T01:17:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.195+0000 7f5f5359e640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f3c0b6720 0x7f5f3c0b8c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009a90 tx=0x7f5f48009810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.196+0000 7f5f5ffc5740 1 -- start start 2024-09-21T01:17:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.196+0000 7f5f5ffc5740 1 Processor -- start 2024-09-21T01:17:23.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a12f0 0x55d096a7b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a94d0 0x55d096a7bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 0x55d096a7ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d09690bab0 con 0x55d0966ca1b0 2024-09-21T01:17:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d096979730 con 0x55d0966a94d0 2024-09-21T01:17:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d096a73d70 con 0x55d0966a12f0 2024-09-21T01:17:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5ffc5740 10 client.0 _ll_register_callbacks cb 0x55d0969cd6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 0x55d096a7ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 0x55d096a7ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57196/0 (socket says 172.21.15.37:57196) 2024-09-21T01:17:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.201+0000 7f5f5359e640 1 -- 172.21.15.37:0/2710717420 learned_addr learned my addr 172.21.15.37:0/2710717420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.202+0000 7f5f5259c640 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a94d0 0x55d096a7bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.202+0000 7f5f5359e640 1 -- 172.21.15.37:0/2710717420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a12f0 msgr2=0x55d096a7b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.202+0000 7f5f5359e640 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a12f0 0x55d096a7b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.202+0000 7f5f5359e640 1 -- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a94d0 msgr2=0x55d096a7bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.202+0000 7f5f5359e640 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a94d0 0x55d096a7bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.202+0000 7f5f5359e640 1 -- 172.21.15.37:0/2710717420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d096735790 con 0x55d0966ca1b0 2024-09-21T01:17:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.205+0000 7f5f5359e640 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 0x55d096a7ca70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800ed10 tx=0x7f5f48004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3403328dabcbbe0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.205+0000 7f5f36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.206+0000 7f5f36ff5640 1 -- 172.21.15.37:0/2710717420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4804c050 con 0x55d0966ca1b0 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.206+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f4800ee30 con 0x55d0966ca1b0 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.206+0000 7f5f36ff5640 1 -- 172.21.15.37:0/2710717420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5f48005600 con 0x55d0966ca1b0 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.207+0000 7f5f36ff5640 1 -- 172.21.15.37:0/2710717420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f4803f050 con 0x55d0966ca1b0 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.207+0000 7f5f5ffc5740 10 client.15792 fetch_fsmap learned FSMap version 28 2024-09-21T01:17:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.207+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0967ae620 con 0x55d0966ca1b0 2024-09-21T01:17:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f36ff5640 1 -- 172.21.15.37:0/2710717420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4800ee30 con 0x55d0966ca1b0 2024-09-21T01:17:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f36ff5640 1 -- 172.21.15.37:0/2710717420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f4805b450 con 0x55d0966ca1b0 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f5ffc5740 10 client.15792 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f5ffc5740 10 client.15792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f5ffc5740 20 client.15792 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d096688d80 0x55d096a89430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f5ffc5740 4 client.15792 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.208+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0969e6640 con 0x55d096688d80 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.210+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d096688d80 0x55d096a89430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.212+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d096688d80 0x55d096a89430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7a939ac6f715f11 server_cookie=e6641fc055342bf5 in_seq=0 out_seq=0 2024-09-21T01:17:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.213+0000 7f5f36ff5640 10 client.15792 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.216+0000 7f5f36ff5640 1 -- 172.21.15.37:0/2710717420 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0969e6640 con 0x55d096688d80 2024-09-21T01:17:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.216+0000 7f5f36ff5640 10 client.15792 handle_command_reply: tid=0 2024-09-21T01:17:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.216+0000 7f5f5ffc5740 1 client.15792 shutdown 2024-09-21T01:17:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.219+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 msgr2=0x55d096a7ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.219+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 0x55d096a7ca70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800ed10 tx=0x7f5f48004f90 comp rx=0 tx=0).stop 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 shutdown_connections 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d096688d80 0x55d096a89430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966ca1b0 0x55d096a7ca70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a94d0 0x55d096a7bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2710717420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a12f0 0x55d096a7b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 >> 172.21.15.37:0/2710717420 conn(0x55d0966be300 msgr2=0x55d096a6c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f36ff5640 0 client.15792 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 shutdown_connections 2024-09-21T01:17:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.221+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2710717420 wait complete. 2024-09-21T01:17:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.222+0000 7f5f5ffc5740 20 client.15792 trim_cache size 0 max 16384 2024-09-21T01:17:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.258+0000 7f5f5ffc5740 1 Processor -- start 2024-09-21T01:17:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.258+0000 7f5f5ffc5740 1 -- start start 2024-09-21T01:17:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.259+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a68870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.259+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.259+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a7aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.259+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5407e100 con 0x55d0966a12f0 2024-09-21T01:17:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.259+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5407fc40 con 0x55d0966ca1b0 2024-09-21T01:17:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.260+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5407e7d0 con 0x55d0966a94d0 2024-09-21T01:17:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.260+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a68870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.261+0000 7f5f5259c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.261+0000 7f5f5359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a7aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.260+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a68870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57204/0 (socket says 172.21.15.37:57204) 2024-09-21T01:17:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.262+0000 7f5f52d9d640 1 -- 172.21.15.37:0/2640442710 learned_addr learned my addr 172.21.15.37:0/2640442710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.262+0000 7f5f52d9d640 1 -- 172.21.15.37:0/2640442710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 msgr2=0x55d096a6d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.262+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a6d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.262+0000 7f5f52d9d640 1 -- 172.21.15.37:0/2640442710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 msgr2=0x55d096a7aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.262+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a7aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.262+0000 7f5f52d9d640 1 -- 172.21.15.37:0/2640442710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d096a799f0 con 0x55d0966a12f0 2024-09-21T01:17:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.263+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a68870 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ada20 tx=0x7f5f4c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab7cad2a5ecb22e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.271+0000 7f5f38ff9640 1 -- 172.21.15.37:0/2640442710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0a9200 con 0x55d0966a12f0 2024-09-21T01:17:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.271+0000 7f5f38ff9640 1 -- 172.21.15.37:0/2640442710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c0ad5a0 con 0x55d0966a12f0 2024-09-21T01:17:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.272+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2640442710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 msgr2=0x55d096a68870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.273+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a68870 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ada20 tx=0x7f5f4c0094a0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.288+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2640442710 shutdown_connections 2024-09-21T01:17:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.288+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966ca1b0 0x55d096a7aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.288+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966a94d0 0x55d096a6d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.288+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/2640442710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a12f0 0x55d096a68870 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.288+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2640442710 >> 172.21.15.37:0/2640442710 conn(0x55d0966be300 msgr2=0x55d096a7a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.295+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2640442710 shutdown_connections 2024-09-21T01:17:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.295+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/2640442710 wait complete. 2024-09-21T01:17:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.296+0000 7f5f5ffc5740 1 -- start start 2024-09-21T01:17:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.296+0000 7f5f5ffc5740 1 Processor -- start 2024-09-21T01:17:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.297+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 0x55d096a7fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.297+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a94d0 0x55d096a80220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f5ffc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966ca1b0 0x55d096a80d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5407f570 con 0x55d0966a94d0 2024-09-21T01:17:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5407eea0 con 0x55d0966a12f0 2024-09-21T01:17:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f5ffc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5407c0c0 con 0x55d0966ca1b0 2024-09-21T01:17:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 0x55d096a7fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f52d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 0x55d096a7fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47000/0 (socket says 172.21.15.37:47000) 2024-09-21T01:17:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.298+0000 7f5f52d9d640 1 -- 172.21.15.37:0/185256993 learned_addr learned my addr 172.21.15.37:0/185256993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.299+0000 7f5f5ffc5740 10 client.0 _ll_register_callbacks cb 0x7f5f4c0ed4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.299+0000 7f5f52d9d640 1 -- 172.21.15.37:0/185256993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966ca1b0 msgr2=0x55d096a80d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.299+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966ca1b0 0x55d096a80d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.299+0000 7f5f52d9d640 1 -- 172.21.15.37:0/185256993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a94d0 msgr2=0x55d096a80220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.299+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a94d0 0x55d096a80220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.299+0000 7f5f52d9d640 1 -- 172.21.15.37:0/185256993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d096a81480 con 0x55d0966a12f0 2024-09-21T01:17:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.301+0000 7f5f52d9d640 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 0x55d096a7fb60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0aad00 tx=0x7f5f4c0b2380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4533f914997ccb02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.305+0000 7f5f36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:17:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.305+0000 7f5f36ff5640 1 -- 172.21.15.37:0/185256993 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0a9200 con 0x55d0966a12f0 2024-09-21T01:17:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.305+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f4c0ad5a0 con 0x55d0966a12f0 2024-09-21T01:17:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.305+0000 7f5f36ff5640 1 -- 172.21.15.37:0/185256993 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5f4c0accf0 con 0x55d0966a12f0 2024-09-21T01:17:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.306+0000 7f5f36ff5640 1 -- 172.21.15.37:0/185256993 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5f4c0b2570 con 0x55d0966a12f0 2024-09-21T01:17:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.310+0000 7f5f5ffc5740 10 client.25424 fetch_fsmap learned FSMap version 28 2024-09-21T01:17:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.310+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d096a827a0 con 0x55d0966a12f0 2024-09-21T01:17:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.314+0000 7f5f36ff5640 1 -- 172.21.15.37:0/185256993 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c0ae190 con 0x55d0966a12f0 2024-09-21T01:17:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.314+0000 7f5f36ff5640 1 -- 172.21.15.37:0/185256993 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5f4c00f040 con 0x55d0966a12f0 2024-09-21T01:17:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.314+0000 7f5f5ffc5740 10 client.25424 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T01:17:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.314+0000 7f5f5ffc5740 10 client.25424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.314+0000 7f5f5ffc5740 20 client.25424 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.315+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d09665e1c0 0x55d096a82f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.315+0000 7f5f5ffc5740 4 client.25424 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:17:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.315+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5f4c0ad5a0 con 0x55d09665e1c0 2024-09-21T01:17:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.320+0000 7f5f5259c640 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d09665e1c0 0x55d096a82f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.326+0000 7f5f5259c640 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d09665e1c0 0x55d096a82f70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e094b8730719a1 server_cookie=447bd27f2883228e in_seq=0 out_seq=0 2024-09-21T01:17:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:23.327+0000 7f5f36ff5640 10 client.25424 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:23.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:17:24.498 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:17:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:24 smithi137 ceph-mon[34607]: pgmap v399: 97 pgs: 97 active+clean; 7.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 610 MiB/s wr, 515 op/s 2024-09-21T01:17:24.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:24 smithi144 ceph-mon[34818]: pgmap v399: 97 pgs: 97 active+clean; 7.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 610 MiB/s wr, 515 op/s 2024-09-21T01:17:24.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:24 smithi037 ceph-mon[31105]: pgmap v399: 97 pgs: 97 active+clean; 7.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 610 MiB/s wr, 515 op/s 2024-09-21T01:17:26.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.246+0000 7f5f36ff5640 1 -- 172.21.15.37:0/185256993 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5f4c0ad5a0 con 0x55d09665e1c0 2024-09-21T01:17:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.246+0000 7f5f36ff5640 10 client.25424 handle_command_reply: tid=0 2024-09-21T01:17:26.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.246+0000 7f5f5ffc5740 1 client.25424 shutdown 2024-09-21T01:17:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.252+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 msgr2=0x55d096a7fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.252+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 0x55d096a7fb60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0aad00 tx=0x7f5f4c0b2380 comp rx=0 tx=0).stop 2024-09-21T01:17:26.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 shutdown_connections 2024-09-21T01:17:26.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d09665e1c0 0x55d096a82f70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0966ca1b0 0x55d096a80d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d0966a94d0 0x55d096a80220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 --2- 172.21.15.37:0/185256993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0966a12f0 0x55d096a7fb60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 >> 172.21.15.37:0/185256993 conn(0x55d0966be300 msgr2=0x55d096a68870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f36ff5640 0 client.25424 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 shutdown_connections 2024-09-21T01:17:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.255+0000 7f5f5ffc5740 1 -- 172.21.15.37:0/185256993 wait complete. 2024-09-21T01:17:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.256+0000 7f5f5ffc5740 20 client.25424 trim_cache size 0 max 16384 2024-09-21T01:17:26.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:17:26.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:17:26.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:17:26.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:17:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.263+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f3c0b6720 msgr2=0x7f5f3c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.263+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f3c0b6720 0x7f5f3c0b8c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009a90 tx=0x7f5f48009810 comp rx=0 tx=0).stop 2024-09-21T01:17:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.263+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 msgr2=0x7f5f541a8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.263+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 0x7f5f541a8b50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00eab0 tx=0x7f5f4c00ef70 comp rx=0 tx=0).stop 2024-09-21T01:17:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 shutdown_connections 2024-09-21T01:17:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5f3c0b6720 0x7f5f3c0b8c30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5410f830 0x7f5f541a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5410cd20 0x7f5f541a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 --2- 172.21.15.37:0/1569765678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f5410a3c0 0x7f5f541a8b50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 >> 172.21.15.37:0/1569765678 conn(0x7f5f54070640 msgr2=0x7f5f5410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.267+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 shutdown_connections 2024-09-21T01:17:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:26.268+0000 7f5f5884c640 1 -- 172.21.15.37:0/1569765678 wait complete. 2024-09-21T01:17:26.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:26 smithi037 ceph-mon[31105]: pgmap v400: 97 pgs: 97 active+clean; 8.8 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 786 MiB/s wr, 947 op/s 2024-09-21T01:17:26.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:26 smithi037 ceph-mon[31105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:17:26.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:26 smithi137 ceph-mon[34607]: pgmap v400: 97 pgs: 97 active+clean; 8.8 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 786 MiB/s wr, 947 op/s 2024-09-21T01:17:26.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:26 smithi137 ceph-mon[34607]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:17:26.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:26 smithi144 ceph-mon[34818]: pgmap v400: 97 pgs: 97 active+clean; 8.8 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 786 MiB/s wr, 947 op/s 2024-09-21T01:17:26.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:26 smithi144 ceph-mon[34818]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:17:27.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.283+0000 7f248bfff640 1 -- 172.21.15.37:0/1556860083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 msgr2=0x7f248c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.283+0000 7f248bfff640 1 --2- 172.21.15.37:0/1556860083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c10d6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2480009900 tx=0x7f248002a440 comp rx=0 tx=0).stop 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.287+0000 7f248bfff640 1 -- 172.21.15.37:0/1556860083 shutdown_connections 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.287+0000 7f248bfff640 1 --2- 172.21.15.37:0/1556860083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f248c11cba0 0x7f248c11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.287+0000 7f248bfff640 1 --2- 172.21.15.37:0/1556860083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f248c10dbf0 0x7f248c10e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.287+0000 7f248bfff640 1 --2- 172.21.15.37:0/1556860083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c10d6b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.287+0000 7f248bfff640 1 -- 172.21.15.37:0/1556860083 >> 172.21.15.37:0/1556860083 conn(0x7f248c06e9f0 msgr2=0x7f248c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.288+0000 7f248bfff640 1 -- 172.21.15.37:0/1556860083 shutdown_connections 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.288+0000 7f248bfff640 1 -- 172.21.15.37:0/1556860083 wait complete. 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.289+0000 7f248bfff640 1 Processor -- start 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 -- start start 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f248c10dbf0 0x7f248c11b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f248c11cba0 0x7f248c114ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f248c122720 con 0x7f248c10dbf0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1225a0 con 0x7f248c111cd0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.290+0000 7f248bfff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1228a0 con 0x7f248c11cba0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.293+0000 7f248b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f248c11cba0 0x7f248c114ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.294+0000 7f248a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.294+0000 7f248a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c114660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:55996/0 (socket says 172.21.15.37:55996) 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.294+0000 7f248a7fc640 1 -- 172.21.15.37:0/2397859910 learned_addr learned my addr 172.21.15.37:0/2397859910 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.294+0000 7f248affd640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f248c10dbf0 0x7f248c11b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.295+0000 7f248a7fc640 1 -- 172.21.15.37:0/2397859910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f248c11cba0 msgr2=0x7f248c114ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.296+0000 7f248a7fc640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f248c11cba0 0x7f248c114ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.296+0000 7f248a7fc640 1 -- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f248c10dbf0 msgr2=0x7f248c11b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.296+0000 7f248a7fc640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f248c10dbf0 0x7f248c11b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.296+0000 7f248a7fc640 1 -- 172.21.15.37:0/2397859910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1153a0 con 0x7f248c111cd0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.298+0000 7f248a7fc640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c114660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f248400ebc0 tx=0x7f248400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.299+0000 7f2473fff640 1 -- 172.21.15.37:0/2397859910 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484010630 con 0x7f248c111cd0 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.299+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c11a060 con 0x7f248c111cd0 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.299+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c11a5a0 con 0x7f248c111cd0 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.305+0000 7f24978b0740 1 Processor -- start 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 -- start start 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a722810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a722d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a35a390 0x563a1a723290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563a1a698e50 con 0x563a1a35a390 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563a1a688280 con 0x563a1a37b070 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.306+0000 7f24978b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563a1a68c090 con 0x563a1a3521b0 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.307+0000 7f2473fff640 1 -- 172.21.15.37:0/2397859910 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2484010c80 con 0x7f248c111cd0 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.308+0000 7f2473fff640 1 -- 172.21.15.37:0/2397859910 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484017bf0 con 0x7f248c111cd0 2024-09-21T01:17:27.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.308+0000 7f248affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a722d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.308+0000 7f248affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a722d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:57240/0 (socket says 172.21.15.37:57240) 2024-09-21T01:17:27.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.308+0000 7f248affd640 1 -- 172.21.15.37:0/4176273309 learned_addr learned my addr 172.21.15.37:0/4176273309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:27.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.308+0000 7f248b7fe640 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a722810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.309+0000 7f248a7fc640 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a35a390 0x563a1a723290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.309+0000 7f248affd640 1 -- 172.21.15.37:0/4176273309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 msgr2=0x563a1a722810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.309+0000 7f248affd640 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a722810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.309+0000 7f248affd640 1 -- 172.21.15.37:0/4176273309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a35a390 msgr2=0x563a1a723290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.309+0000 7f248affd640 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a35a390 0x563a1a723290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.312+0000 7f248affd640 1 -- 172.21.15.37:0/4176273309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1a3e6650 con 0x563a1a3521b0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.316+0000 7f2473fff640 1 -- 172.21.15.37:0/2397859910 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2484021440 con 0x7f248c111cd0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.318+0000 7f248affd640 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a722d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2480009230 tx=0x7f2480009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3e76626ca3f2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.319+0000 7f2473fff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24740b6710 0x7f24740b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.319+0000 7f24717fa640 1 -- 172.21.15.37:0/4176273309 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480041070 con 0x563a1a3521b0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.319+0000 7f24717fa640 1 -- 172.21.15.37:0/4176273309 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2480046910 con 0x563a1a3521b0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.319+0000 7f2473fff640 1 -- 172.21.15.37:0/2397859910 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f24840e8be0 con 0x7f248c111cd0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.320+0000 7f248b7fe640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24740b6710 0x7f24740b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.320+0000 7f24978b0740 1 -- 172.21.15.37:0/4176273309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 msgr2=0x563a1a722d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.320+0000 7f24978b0740 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a722d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2480009230 tx=0x7f2480009620 comp rx=0 tx=0).stop 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f248b7fe640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24740b6710 0x7f24740b8c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f247c009cf0 tx=0x7f247c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 -- 172.21.15.37:0/4176273309 shutdown_connections 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a35a390 0x563a1a723290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a722d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 --2- 172.21.15.37:0/4176273309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a722810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 -- 172.21.15.37:0/4176273309 >> 172.21.15.37:0/4176273309 conn(0x563a1a36f460 msgr2=0x563a1a720700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 -- 172.21.15.37:0/4176273309 shutdown_connections 2024-09-21T01:17:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.322+0000 7f24978b0740 1 -- 172.21.15.37:0/4176273309 wait complete. 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.323+0000 7f24978b0740 1 -- start start 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.323+0000 7f24978b0740 1 Processor -- start 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a72de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a72e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a72e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563a1a4e9700 con 0x563a1a3521b0 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563a1a623110 con 0x563a1a37b070 2024-09-21T01:17:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563a1a730fe0 con 0x563a1a35a390 2024-09-21T01:17:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.324+0000 7f24978b0740 10 client.0 _ll_register_callbacks cb 0x563a1a63c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.326+0000 7f248affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a72de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.326+0000 7f248affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a72de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37886/0 (socket says 172.21.15.37:37886) 2024-09-21T01:17:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.326+0000 7f248affd640 1 -- 172.21.15.37:0/2478622821 learned_addr learned my addr 172.21.15.37:0/2478622821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.326+0000 7f248b7fe640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a72e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.326+0000 7f248a7fc640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a72e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.328+0000 7f248b7fe640 1 -- 172.21.15.37:0/2478622821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 msgr2=0x563a1a72e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.328+0000 7f248b7fe640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a72e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.328+0000 7f248b7fe640 1 -- 172.21.15.37:0/2478622821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 msgr2=0x563a1a72de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.328+0000 7f248b7fe640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a72de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.328+0000 7f248b7fe640 1 -- 172.21.15.37:0/2478622821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1a650c40 con 0x563a1a37b070 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.330+0000 7f248b7fe640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a72e890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f247c0045e0 tx=0x7f247c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7249a4d938a6b0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.330+0000 7f246eff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.331+0000 7f246eff5640 1 -- 172.21.15.37:0/2478622821 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c01e470 con 0x563a1a37b070 2024-09-21T01:17:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.331+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2480046910 con 0x563a1a37b070 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.332+0000 7f246eff5640 1 -- 172.21.15.37:0/2478622821 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f247c01e610 con 0x563a1a37b070 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.333+0000 7f246eff5640 1 -- 172.21.15.37:0/2478622821 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f247c01e810 con 0x563a1a37b070 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.333+0000 7f24978b0740 10 client.25436 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.333+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a1a73cda0 con 0x563a1a37b070 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f246eff5640 1 -- 172.21.15.37:0/2478622821 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2480046910 con 0x563a1a37b070 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f246eff5640 1 -- 172.21.15.37:0/2478622821 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f247c027070 con 0x563a1a37b070 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f24978b0740 10 client.25436 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f24978b0740 10 client.25436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f24978b0740 20 client.25436 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f24978b0740 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a3399f0 0x563a1a7406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f24978b0740 4 client.25436 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.335+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a1a69ada0 con 0x563a1a3399f0 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.336+0000 7f248affd640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a3399f0 0x563a1a7406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.337+0000 7f246eff5640 10 client.25436 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.341+0000 7f248affd640 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a3399f0 0x563a1a7406b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863ab739d8bdb859 server_cookie=4c5a3eb940302164 in_seq=0 out_seq=0 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.347+0000 7f246eff5640 1 -- 172.21.15.37:0/2478622821 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a1a69ada0 con 0x563a1a3399f0 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.347+0000 7f246eff5640 10 client.25436 handle_command_reply: tid=0 2024-09-21T01:17:27.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.347+0000 7f24978b0740 1 client.25436 shutdown 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 msgr2=0x563a1a72e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a72e890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f247c0045e0 tx=0x7f247c004730 comp rx=0 tx=0).stop 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 shutdown_connections 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a3399f0 0x563a1a7406b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a37b070 0x563a1a72e890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a72e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 --2- 172.21.15.37:0/2478622821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a72de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 >> 172.21.15.37:0/2478622821 conn(0x563a1a36f460 msgr2=0x563a1a7259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f246eff5640 0 client.25436 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 shutdown_connections 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.348+0000 7f24978b0740 1 -- 172.21.15.37:0/2478622821 wait complete. 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.349+0000 7f24978b0740 20 client.25436 trim_cache size 0 max 16384 2024-09-21T01:17:27.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.395+0000 7f24978b0740 1 Processor -- start 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.395+0000 7f24978b0740 1 -- start start 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.396+0000 7f24978b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a73a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.396+0000 7f24978b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a35a390 0x563a1a723f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.396+0000 7f24978b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 0x563a1a72b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.396+0000 7f24978b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f247800e600 con 0x563a1a37b070 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.396+0000 7f24978b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2478010170 con 0x563a1a35a390 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.396+0000 7f24978b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f247800ecd0 con 0x563a1a3521b0 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.397+0000 7f248b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 0x563a1a72b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.397+0000 7f248b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 0x563a1a72b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37896/0 (socket says 172.21.15.37:37896) 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.397+0000 7f248b7fe640 1 -- 172.21.15.37:0/4283910340 learned_addr learned my addr 172.21.15.37:0/4283910340 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.397+0000 7f248a7fc640 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a35a390 0x563a1a723f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.397+0000 7f248b7fe640 1 -- 172.21.15.37:0/4283910340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 msgr2=0x563a1a73a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.397+0000 7f248b7fe640 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a73a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.398+0000 7f248b7fe640 1 -- 172.21.15.37:0/4283910340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a35a390 msgr2=0x563a1a723f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.398+0000 7f248b7fe640 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a35a390 0x563a1a723f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.398+0000 7f248b7fe640 1 -- 172.21.15.37:0/4283910340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1a72cd70 con 0x563a1a37b070 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.398+0000 7f248b7fe640 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 0x563a1a72b000 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097f0 tx=0x7f247c005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61a5eb5c2199ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.399+0000 7f2470ff9640 1 -- 172.21.15.37:0/4283910340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c033550 con 0x563a1a37b070 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.399+0000 7f2470ff9640 1 -- 172.21.15.37:0/4283910340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f247c033ca0 con 0x563a1a37b070 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.400+0000 7f24978b0740 1 -- 172.21.15.37:0/4283910340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 msgr2=0x563a1a72b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.400+0000 7f24978b0740 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 0x563a1a72b000 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097f0 tx=0x7f247c005920 comp rx=0 tx=0).stop 2024-09-21T01:17:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 -- 172.21.15.37:0/4283910340 shutdown_connections 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:17:27.582 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:17:27.583 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:17:27.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a37b070 0x563a1a72b000 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a35a390 0x563a1a723f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 --2- 172.21.15.37:0/4283910340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a3521b0 0x563a1a73a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 -- 172.21.15.37:0/4283910340 >> 172.21.15.37:0/4283910340 conn(0x563a1a36f460 msgr2=0x563a1a723840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 -- 172.21.15.37:0/4283910340 shutdown_connections 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.401+0000 7f24978b0740 1 -- 172.21.15.37:0/4283910340 wait complete. 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.402+0000 7f24978b0740 1 -- start start 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.402+0000 7f24978b0740 1 Processor -- start 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a731ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a732020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a30eda0 0x563a1a7a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f247800fa70 con 0x563a1a3521b0 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f247800f3a0 con 0x563a1a30eda0 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f247800c5c0 con 0x563a1a35a390 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.403+0000 7f24978b0740 10 client.0 _ll_register_callbacks cb 0x7f247c009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.405+0000 7f248a7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a732020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.405+0000 7f248affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a731ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.405+0000 7f248affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a731ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37908/0 (socket says 172.21.15.37:37908) 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.405+0000 7f248affd640 1 -- 172.21.15.37:0/3099932105 learned_addr learned my addr 172.21.15.37:0/3099932105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.405+0000 7f248b7fe640 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a30eda0 0x563a1a7a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.406+0000 7f248affd640 1 -- 172.21.15.37:0/3099932105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 msgr2=0x563a1a732020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.406+0000 7f248affd640 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a732020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.406+0000 7f248affd640 1 -- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a30eda0 msgr2=0x563a1a7a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.406+0000 7f248affd640 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a30eda0 0x563a1a7a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.406+0000 7f248affd640 1 -- 172.21.15.37:0/3099932105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1a7a95e0 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.407+0000 7f248affd640 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a731ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2480009230 tx=0x7f248002a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81639625dca0e79a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.407+0000 7f246eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.408+0000 7f246eff5640 1 -- 172.21.15.37:0/3099932105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480041040 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.408+0000 7f246eff5640 1 -- 172.21.15.37:0/3099932105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2480031de0 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.408+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a1a696850 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.409+0000 7f246eff5640 1 -- 172.21.15.37:0/3099932105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2480004960 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.409+0000 7f24978b0740 10 client.15813 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.409+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a1a7aa890 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.410+0000 7f246eff5640 1 -- 172.21.15.37:0/3099932105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563a1a696850 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.410+0000 7f246eff5640 1 -- 172.21.15.37:0/3099932105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f2480051040 con 0x563a1a3521b0 2024-09-21T01:17:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.411+0000 7f24978b0740 10 client.15813 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.411+0000 7f24978b0740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.411+0000 7f24978b0740 20 client.15813 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.411+0000 7f24978b0740 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a7aabd0 0x563a1a7acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.411+0000 7f24978b0740 4 client.15813 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.411+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a1a693c80 con 0x563a1a7aabd0 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.413+0000 7f248a7fc640 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a7aabd0 0x563a1a7acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.421+0000 7f248a7fc640 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a7aabd0 0x563a1a7acff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff65e3d8f73ca05 server_cookie=9f2421477d7ba3f3 in_seq=0 out_seq=0 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.421+0000 7f246eff5640 10 client.15813 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.424+0000 7f246eff5640 1 -- 172.21.15.37:0/3099932105 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x563a1a693c80 con 0x563a1a7aabd0 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.424+0000 7f246eff5640 10 client.15813 handle_command_reply: tid=0 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.425+0000 7f24978b0740 1 client.15813 shutdown 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.431+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 msgr2=0x563a1a731ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.431+0000 7f24978b0740 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a731ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2480009230 tx=0x7f248002a440 comp rx=0 tx=0).stop 2024-09-21T01:17:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.434+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 shutdown_connections 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.434+0000 7f24978b0740 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563a1a7aabd0 0x563a1a7acff0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.434+0000 7f24978b0740 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563a1a30eda0 0x563a1a7a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.434+0000 7f24978b0740 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a1a35a390 0x563a1a732020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.434+0000 7f24978b0740 1 --2- 172.21.15.37:0/3099932105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563a1a3521b0 0x563a1a731ae0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.434+0000 7f246eff5640 0 client.15813 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.435+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 >> 172.21.15.37:0/3099932105 conn(0x563a1a36f460 msgr2=0x563a1a72f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.439+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 shutdown_connections 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.439+0000 7f24978b0740 1 -- 172.21.15.37:0/3099932105 wait complete. 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.439+0000 7f24978b0740 20 client.15813 trim_cache size 0 max 16384 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24740b6710 msgr2=0x7f24740b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24740b6710 0x7f24740b8c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f247c009cf0 tx=0x7f247c005f90 comp rx=0 tx=0).stop 2024-09-21T01:17:27.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 msgr2=0x7f248c114660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c114660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f248400ebc0 tx=0x7f248400c6a0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 shutdown_connections 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f24740b6710 0x7f24740b8c20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f248c11cba0 0x7f248c114ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f248c111cd0 0x7f248c114660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 --2- 172.21.15.37:0/2397859910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f248c10dbf0 0x7f248c11b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 >> 172.21.15.37:0/2397859910 conn(0x7f248c06e9f0 msgr2=0x7f248c10fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 shutdown_connections 2024-09-21T01:17:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:27.440+0000 7f248bfff640 1 -- 172.21.15.37:0/2397859910 wait complete. 2024-09-21T01:17:28.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:28 smithi137 ceph-mon[34607]: pgmap v401: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 782 MiB/s wr, 1.05k op/s 2024-09-21T01:17:28.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:28 smithi144 ceph-mon[34818]: pgmap v401: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 782 MiB/s wr, 1.05k op/s 2024-09-21T01:17:29.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:28 smithi037 ceph-mon[31105]: pgmap v401: 97 pgs: 97 active+clean; 9.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 782 MiB/s wr, 1.05k op/s 2024-09-21T01:17:30.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:30 smithi137 ceph-mon[34607]: pgmap v402: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 996 MiB/s wr, 1.96k op/s 2024-09-21T01:17:30.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:30 smithi144 ceph-mon[34818]: pgmap v402: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 996 MiB/s wr, 1.96k op/s 2024-09-21T01:17:31.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:30 smithi037 ceph-mon[31105]: pgmap v402: 97 pgs: 97 active+clean; 9.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 996 MiB/s wr, 1.96k op/s 2024-09-21T01:17:31.749 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:17:31.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:17:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:17:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:32 smithi037 ceph-mon[31105]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 811 MiB/s wr, 2.02k op/s 2024-09-21T01:17:33.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:32 smithi144 ceph-mon[34818]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 811 MiB/s wr, 2.02k op/s 2024-09-21T01:17:33.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:32 smithi137 ceph-mon[34607]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 811 MiB/s wr, 2.02k op/s 2024-09-21T01:17:33.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:33 smithi137 ceph-mon[34607]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 898 MiB/s wr, 2.18k op/s 2024-09-21T01:17:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:33 smithi037 ceph-mon[31105]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 898 MiB/s wr, 2.18k op/s 2024-09-21T01:17:34.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:33 smithi144 ceph-mon[34818]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 898 MiB/s wr, 2.18k op/s 2024-09-21T01:17:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 -- 172.21.15.37:0/2854749972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10f150 msgr2=0x7f09fc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 --2- 172.21.15.37:0/2854749972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10f150 0x7f09fc10f560 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f09ec008570 tx=0x7f09ec00ac00 comp rx=0 tx=0).stop 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 -- 172.21.15.37:0/2854749972 shutdown_connections 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 --2- 172.21.15.37:0/2854749972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc10ad10 0x7f09fc116fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 --2- 172.21.15.37:0/2854749972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc10a3c0 0x7f09fc10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 --2- 172.21.15.37:0/2854749972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10f150 0x7f09fc10f560 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 -- 172.21.15.37:0/2854749972 >> 172.21.15.37:0/2854749972 conn(0x7f09fc0712f0 msgr2=0x7f09fc073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 -- 172.21.15.37:0/2854749972 shutdown_connections 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.930+0000 7f0a01128640 1 -- 172.21.15.37:0/2854749972 wait complete. 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.932+0000 7f0a01128640 1 Processor -- start 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.932+0000 7f0a01128640 1 -- start start 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.933+0000 7f0a01128640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc10a3c0 0x7f09fc11a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.933+0000 7f0a01128640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 0x7f09fc11a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.933+0000 7f0a01128640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc11fc40 0x7f09fc120050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.933+0000 7f0a01128640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc118c20 con 0x7f09fc10ad10 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.933+0000 7f0a01128640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc118aa0 con 0x7f09fc10a3c0 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.933+0000 7f0a01128640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc118da0 con 0x7f09fc11fc40 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.935+0000 7f09fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 0x7f09fc11a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.935+0000 7f09fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 0x7f09fc11a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37924/0 (socket says 172.21.15.37:37924) 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.935+0000 7f09fa59c640 1 -- 172.21.15.37:0/3867290717 learned_addr learned my addr 172.21.15.37:0/3867290717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.935+0000 7f09fb59e640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc11fc40 0x7f09fc120050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.935+0000 7f09fad9d640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc10a3c0 0x7f09fc11a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.937+0000 7f09fa59c640 1 -- 172.21.15.37:0/3867290717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc11fc40 msgr2=0x7f09fc120050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.937+0000 7f09fa59c640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc11fc40 0x7f09fc120050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.937+0000 7f09fa59c640 1 -- 172.21.15.37:0/3867290717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc10a3c0 msgr2=0x7f09fc11a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.937+0000 7f09fa59c640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc10a3c0 0x7f09fc11a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.937+0000 7f09fa59c640 1 -- 172.21.15.37:0/3867290717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc120730 con 0x7f09fc10ad10 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.939+0000 7f09fa59c640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 0x7f09fc11a9b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f09f0007860 tx=0x7f09f0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.940+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0019030 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.941+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09fc120a20 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.941+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09fc07b930 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.941+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09f000f8c0 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.941+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00039b0 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.949+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f09f001c070 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.951+0000 7f09e3fff640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6690 0x7f09e40b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.952+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f09f00e7ed0 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.955+0000 7f09fad9d640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6690 0x7f09e40b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.956+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e80052c0 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.975+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09f0023070 con 0x7f09fc10ad10 2024-09-21T01:17:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:34.976+0000 7f09fad9d640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6690 0x7f09e40b8ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f09ec006010 tx=0x7f09ec000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:35.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.547+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09e80055b0 con 0x7f09fc10ad10 2024-09-21T01:17:35.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:17:35.552 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-09-21T01:17:25:623190+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:17:25.572870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:17:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.549+0000 7f09e3fff640 1 -- 172.21.15.37:0/3867290717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11977 (secure 0 0 0) 0x7f09f00ae760 con 0x7f09fc10ad10 2024-09-21T01:17:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-09-21T01:17:35.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.556+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6690 msgr2=0x7f09e40b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.556+0000 7f0a01128640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6690 0x7f09e40b8ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f09ec006010 tx=0x7f09ec000bc0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.556+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 msgr2=0x7f09fc11a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:35.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.556+0000 7f0a01128640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 0x7f09fc11a9b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f09f0007860 tx=0x7f09f0007d20 comp rx=0 tx=0).stop 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 shutdown_connections 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f09e40b6690 0x7f09e40b8ba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc11fc40 0x7f09fc120050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09fc10ad10 0x7f09fc11a9b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 --2- 172.21.15.37:0/3867290717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09fc10a3c0 0x7f09fc11a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 >> 172.21.15.37:0/3867290717 conn(0x7f09fc0712f0 msgr2=0x7f09fc10dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 shutdown_connections 2024-09-21T01:17:35.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:35.557+0000 7f0a01128640 1 -- 172.21.15.37:0/3867290717 wait complete. 2024-09-21T01:17:36.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:35 smithi037 ceph-mon[31105]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 924 MiB/s wr, 2.42k op/s 2024-09-21T01:17:36.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:35 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3867290717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:17:36.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:35 smithi144 ceph-mon[34818]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 924 MiB/s wr, 2.42k op/s 2024-09-21T01:17:36.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:35 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3867290717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:17:36.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:35 smithi137 ceph-mon[34607]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 924 MiB/s wr, 2.42k op/s 2024-09-21T01:17:36.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:35 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3867290717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:17:38.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:17:38.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:37 smithi037 ceph-mon[31105]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 796 MiB/s wr, 2.16k op/s 2024-09-21T01:17:38.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:37 smithi137 ceph-mon[34607]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 796 MiB/s wr, 2.16k op/s 2024-09-21T01:17:38.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:37 smithi144 ceph-mon[34818]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 796 MiB/s wr, 2.16k op/s 2024-09-21T01:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:17:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.540+0000 7f555a5ce640 1 -- 172.21.15.37:0/1157853794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55540780d0 msgr2=0x7f555407a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.540+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1157853794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55540780d0 0x7f555407a4f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f555000af00 tx=0x7f55500327b0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.543+0000 7f555a5ce640 1 -- 172.21.15.37:0/1157853794 shutdown_connections 2024-09-21T01:17:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.543+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1157853794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555407aa30 0x7f555407cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.543+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1157853794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55540780d0 0x7f555407a4f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.543+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1157853794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5554075310 0x7f5554075780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.543+0000 7f555a5ce640 1 -- 172.21.15.37:0/1157853794 >> 172.21.15.37:0/1157853794 conn(0x7f5554070640 msgr2=0x7f5554072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.544+0000 7f555a5ce640 1 -- 172.21.15.37:0/1157853794 shutdown_connections 2024-09-21T01:17:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.548+0000 7f555a5ce640 1 -- 172.21.15.37:0/1157853794 wait complete. 2024-09-21T01:17:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 Processor -- start 2024-09-21T01:17:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 -- start start 2024-09-21T01:17:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5554075310 0x7f55541b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 0x7f55541b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555407aa30 0x7f55541b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55540809e0 con 0x7f5554075310 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5554080860 con 0x7f555407aa30 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.549+0000 7f555a5ce640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5554080b60 con 0x7f55540780d0 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.550+0000 7f5558dcb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 0x7f55541b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.550+0000 7f5558dcb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 0x7f55541b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47574/0 (socket says 172.21.15.37:47574) 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.550+0000 7f5558dcb640 1 -- 172.21.15.37:0/1055782688 learned_addr learned my addr 172.21.15.37:0/1055782688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.550+0000 7f55595cc640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5554075310 0x7f55541b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.551+0000 7f5558dcb640 1 -- 172.21.15.37:0/1055782688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555407aa30 msgr2=0x7f55541b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.551+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555407aa30 0x7f55541b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.551+0000 7f5558dcb640 1 -- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5554075310 msgr2=0x7f55541b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.551+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5554075310 0x7f55541b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.551+0000 7f5558dcb640 1 -- 172.21.15.37:0/1055782688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55541b2dc0 con 0x7f55540780d0 2024-09-21T01:17:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.553+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 0x7f55541b19f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5550000c00 tx=0x7f5550004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.553+0000 7f554a7fc640 1 -- 172.21.15.37:0/1055782688 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555005f070 con 0x7f55540780d0 2024-09-21T01:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.553+0000 7f554a7fc640 1 -- 172.21.15.37:0/1055782688 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f555000a850 con 0x7f55540780d0 2024-09-21T01:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.553+0000 7f554a7fc640 1 -- 172.21.15.37:0/1055782688 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550039930 con 0x7f55540780d0 2024-09-21T01:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.554+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55541b3050 con 0x7f55540780d0 2024-09-21T01:17:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.554+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55541b97a0 con 0x7f55540780d0 2024-09-21T01:17:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.570+0000 7f5562880740 1 Processor -- start 2024-09-21T01:17:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.570+0000 7f5562880740 1 -- start start 2024-09-21T01:17:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.571+0000 7f5562880740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a94040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.571+0000 7f5562880740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 0x55ec35a946b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.571+0000 7f5562880740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35a95200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.571+0000 7f5562880740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec35a066f0 con 0x55ec356ec1b0 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.571+0000 7f5562880740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ec359f5b20 con 0x55ec356c32f0 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.571+0000 7f5562880740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec359f9930 con 0x55ec356cb4d0 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.572+0000 7f55595cc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 0x55ec35a946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.572+0000 7f55595cc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 0x55ec35a946b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41592/0 (socket says 172.21.15.37:41592) 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.572+0000 7f55595cc640 1 -- 172.21.15.37:0/216049037 learned_addr learned my addr 172.21.15.37:0/216049037 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.573+0000 7f5559dcd640 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a94040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.573+0000 7f55595cc640 1 -- 172.21.15.37:0/216049037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 msgr2=0x55ec35a95200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:17:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.573+0000 7f55595cc640 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35a95200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.573+0000 7f55595cc640 1 -- 172.21.15.37:0/216049037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 msgr2=0x55ec35a94040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.573+0000 7f55595cc640 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a94040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.573+0000 7f55595cc640 1 -- 172.21.15.37:0/216049037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec359bb530 con 0x55ec356c32f0 2024-09-21T01:17:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.576+0000 7f554a7fc640 1 -- 172.21.15.37:0/1055782688 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5550062070 con 0x7f55540780d0 2024-09-21T01:17:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.577+0000 7f554a7fc640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55400b6650 0x7f55400b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.578+0000 7f55595cc640 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 0x55ec35a946b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f554400b820 tx=0x7f554400bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8375cd6d4bfbab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.579+0000 7f554a7fc640 1 -- 172.21.15.37:0/1055782688 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5550128df0 con 0x7f55540780d0 2024-09-21T01:17:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.581+0000 7f553f7fe640 1 -- 172.21.15.37:0/216049037 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554400d950 con 0x55ec356c32f0 2024-09-21T01:17:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.581+0000 7f553f7fe640 1 -- 172.21.15.37:0/216049037 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5544019070 con 0x55ec356c32f0 2024-09-21T01:17:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 -- 172.21.15.37:0/216049037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 msgr2=0x55ec35a946b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 0x55ec35a946b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f554400b820 tx=0x7f554400bce0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 -- 172.21.15.37:0/216049037 shutdown_connections 2024-09-21T01:17:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35a95200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356c32f0 0x55ec35a946b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 --2- 172.21.15.37:0/216049037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a94040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.583+0000 7f5562880740 1 -- 172.21.15.37:0/216049037 >> 172.21.15.37:0/216049037 conn(0x55ec356e0300 msgr2=0x55ec35a8fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:39.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.588+0000 7f5559dcd640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55400b6650 0x7f55400b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.596+0000 7f5559dcd640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55400b6650 0x7f55400b8b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f554c005fd0 tx=0x7f554c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.598+0000 7f5562880740 1 -- 172.21.15.37:0/216049037 shutdown_connections 2024-09-21T01:17:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.605+0000 7f5562880740 1 -- 172.21.15.37:0/216049037 wait complete. 2024-09-21T01:17:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.606+0000 7f5562880740 1 -- start start 2024-09-21T01:17:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.606+0000 7f5562880740 1 Processor -- start 2024-09-21T01:17:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.608+0000 7f5562880740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356cb4d0 0x55ec35a9d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.609+0000 7f5562880740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356ec1b0 0x55ec35a9dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.609+0000 7f5562880740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 0x55ec35a9e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.609+0000 7f5562880740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec3592dab0 con 0x55ec356cb4d0 2024-09-21T01:17:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.609+0000 7f5562880740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ec3599b730 con 0x55ec356aad80 2024-09-21T01:17:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.609+0000 7f5562880740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec35a95d70 con 0x55ec356ec1b0 2024-09-21T01:17:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.609+0000 7f5562880740 10 client.0 _ll_register_callbacks cb 0x55ec359ef6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.610+0000 7f5559dcd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 0x55ec35a9e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.610+0000 7f5558dcb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356ec1b0 0x55ec35a9dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.614+0000 7f5559dcd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 0x55ec35a9e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41600/0 (socket says 172.21.15.37:41600) 2024-09-21T01:17:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.614+0000 7f5559dcd640 1 -- 172.21.15.37:0/980769396 learned_addr learned my addr 172.21.15.37:0/980769396 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.616+0000 7f55595cc640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356cb4d0 0x55ec35a9d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.620+0000 7f5559dcd640 1 -- 172.21.15.37:0/980769396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356ec1b0 msgr2=0x55ec35a9dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.620+0000 7f5559dcd640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356ec1b0 0x55ec35a9dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.620+0000 7f5559dcd640 1 -- 172.21.15.37:0/980769396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356cb4d0 msgr2=0x55ec35a9d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.620+0000 7f5559dcd640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356cb4d0 0x55ec35a9d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.620+0000 7f5559dcd640 1 -- 172.21.15.37:0/980769396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec35757790 con 0x55ec356aad80 2024-09-21T01:17:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.623+0000 7f5558dcb640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356ec1b0 0x55ec35a9dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:17:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.626+0000 7f5559dcd640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 0x55ec35a9e880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f554c018df0 tx=0x7f554c00d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6750165dd8d05f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.626+0000 7f553cff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:17:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.627+0000 7f553cff9640 1 -- 172.21.15.37:0/980769396 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c004d20 con 0x55ec356aad80 2024-09-21T01:17:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.627+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec35a08640 con 0x55ec356aad80 2024-09-21T01:17:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.628+0000 7f553cff9640 1 -- 172.21.15.37:0/980769396 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f554c005020 con 0x55ec356aad80 2024-09-21T01:17:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.628+0000 7f553cff9640 1 -- 172.21.15.37:0/980769396 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f554c018e20 con 0x55ec356aad80 2024-09-21T01:17:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.628+0000 7f5562880740 10 client.25454 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.628+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec357d0620 con 0x55ec356aad80 2024-09-21T01:17:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.629+0000 7f553cff9640 1 -- 172.21.15.37:0/980769396 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ec35a08640 con 0x55ec356aad80 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f553cff9640 1 -- 172.21.15.37:0/980769396 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f554c0236a0 con 0x55ec356aad80 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f5562880740 10 client.25454 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f5562880740 10 client.25454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f5562880740 20 client.25454 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f5562880740 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec356801c0 0x55ec35aab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f5562880740 4 client.25454 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.634+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec35a040f0 con 0x55ec356801c0 2024-09-21T01:17:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.639+0000 7f55595cc640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec356801c0 0x55ec35aab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.659+0000 7f55595cc640 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec356801c0 0x55ec35aab320 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbfd34b8892f0890 server_cookie=90db121579969ad8 in_seq=0 out_seq=0 2024-09-21T01:17:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.660+0000 7f553cff9640 10 client.25454 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.664+0000 7f553cff9640 1 -- 172.21.15.37:0/980769396 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec35a040f0 con 0x55ec356801c0 2024-09-21T01:17:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.664+0000 7f553cff9640 10 client.25454 handle_command_reply: tid=0 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.664+0000 7f5562880740 1 client.25454 shutdown 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.664+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 msgr2=0x55ec35a9e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.664+0000 7f5562880740 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 0x55ec35a9e880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f554c018df0 tx=0x7f554c00d040 comp rx=0 tx=0).stop 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 shutdown_connections 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f5562880740 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec356801c0 0x55ec35aab320 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f5562880740 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356aad80 0x55ec35a9e880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f5562880740 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356ec1b0 0x55ec35a9dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f5562880740 1 --2- 172.21.15.37:0/980769396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356cb4d0 0x55ec35a9d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 >> 172.21.15.37:0/980769396 conn(0x55ec356e0300 msgr2=0x55ec35a8e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.665+0000 7f553cff9640 0 client.25454 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.669+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 shutdown_connections 2024-09-21T01:17:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.671+0000 7f5562880740 1 -- 172.21.15.37:0/980769396 wait complete. 2024-09-21T01:17:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.672+0000 7f5562880740 20 client.25454 trim_cache size 0 max 16384 2024-09-21T01:17:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.725+0000 7f5562880740 1 Processor -- start 2024-09-21T01:17:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.725+0000 7f5562880740 1 -- start start 2024-09-21T01:17:39.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.726+0000 7f5562880740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 0x55ec35a8a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.726+0000 7f5562880740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356cb4d0 0x55ec35a99430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.726+0000 7f5562880740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a99970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f5562880740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55541c2420 con 0x55ec356ec1b0 2024-09-21T01:17:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f5562880740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55541c3f90 con 0x55ec356cb4d0 2024-09-21T01:17:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f55595cc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 0x55ec35a8a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f55595cc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 0x55ec35a8a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47602/0 (socket says 172.21.15.37:47602) 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f5562880740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55541c2af0 con 0x55ec356aad80 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f55595cc640 1 -- 172.21.15.37:0/278159911 learned_addr learned my addr 172.21.15.37:0/278159911 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.727+0000 7f5559dcd640 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a99970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.728+0000 7f55595cc640 1 -- 172.21.15.37:0/278159911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356cb4d0 msgr2=0x55ec35a99430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.728+0000 7f55595cc640 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356cb4d0 0x55ec35a99430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.728+0000 7f55595cc640 1 -- 172.21.15.37:0/278159911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 msgr2=0x55ec35a99970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.728+0000 7f55595cc640 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a99970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.728+0000 7f55595cc640 1 -- 172.21.15.37:0/278159911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec35a9e080 con 0x55ec356aad80 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.728+0000 7f55595cc640 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 0x55ec35a8a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5544006e10 tx=0x7f554400f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfd5e317270c2162 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.730+0000 7f553effd640 1 -- 172.21.15.37:0/278159911 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544029070 con 0x55ec356aad80 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.730+0000 7f553effd640 1 -- 172.21.15.37:0/278159911 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5544019040 con 0x55ec356aad80 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 -- 172.21.15.37:0/278159911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 msgr2=0x55ec35a8a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 0x55ec35a8a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5544006e10 tx=0x7f554400f040 comp rx=0 tx=0).stop 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 -- 172.21.15.37:0/278159911 shutdown_connections 2024-09-21T01:17:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356ec1b0 0x55ec35a99970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356cb4d0 0x55ec35a99430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 --2- 172.21.15.37:0/278159911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356aad80 0x55ec35a8a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 -- 172.21.15.37:0/278159911 >> 172.21.15.37:0/278159911 conn(0x55ec356e0300 msgr2=0x55ec35a9eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:39.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 -- 172.21.15.37:0/278159911 shutdown_connections 2024-09-21T01:17:39.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.731+0000 7f5562880740 1 -- 172.21.15.37:0/278159911 wait complete. 2024-09-21T01:17:39.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.732+0000 7f5562880740 1 -- start start 2024-09-21T01:17:39.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.732+0000 7f5562880740 1 Processor -- start 2024-09-21T01:17:39.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.733+0000 7f5562880740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356aad80 0x55ec35aa45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f5562880740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35aa4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f5562880740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356ec1b0 0x55ec35b13d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f55595cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356aad80 0x55ec35aa45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f55595cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356aad80 0x55ec35aa45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45538/0 (socket says 172.21.15.37:45538) 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f55595cc640 1 -- 172.21.15.37:0/1372810790 learned_addr learned my addr 172.21.15.37:0/1372810790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35aa4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55541c3890 con 0x55ec356aad80 2024-09-21T01:17:39.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.734+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55541c31c0 con 0x55ec356ec1b0 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.735+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55541c03e0 con 0x55ec356cb4d0 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.735+0000 7f5559dcd640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356ec1b0 0x55ec35b13d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.735+0000 7f5562880740 10 client.0 _ll_register_callbacks cb 0x7f554c00bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.736+0000 7f5558dcb640 1 -- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356ec1b0 msgr2=0x55ec35b13d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.736+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356ec1b0 0x55ec35b13d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.736+0000 7f5558dcb640 1 -- 172.21.15.37:0/1372810790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356aad80 msgr2=0x55ec35aa45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.736+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356aad80 0x55ec35aa45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.736+0000 7f5558dcb640 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec35b144e0 con 0x55ec356cb4d0 2024-09-21T01:17:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.737+0000 7f5558dcb640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35aa4c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5550018820 tx=0x7f55500183d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11bbccc8ba1460f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.737+0000 7f553cff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:17:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.737+0000 7f553cff9640 1 -- 172.21.15.37:0/1372810790 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550069030 con 0x55ec356cb4d0 2024-09-21T01:17:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.737+0000 7f553cff9640 1 -- 172.21.15.37:0/1372810790 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f55500ee1a0 con 0x55ec356cb4d0 2024-09-21T01:17:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.737+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec35a01520 con 0x55ec356cb4d0 2024-09-21T01:17:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.738+0000 7f553cff9640 1 -- 172.21.15.37:0/1372810790 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55500ee890 con 0x55ec356cb4d0 2024-09-21T01:17:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.738+0000 7f5562880740 10 client.25393 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.738+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec35b158d0 con 0x55ec356cb4d0 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f553cff9640 1 -- 172.21.15.37:0/1372810790 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f555000aa00 con 0x55ec356cb4d0 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f553cff9640 1 -- 172.21.15.37:0/1372810790 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f55500da020 con 0x55ec356cb4d0 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f5562880740 10 client.25393 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f5562880740 10 client.25393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f5562880740 20 client.25393 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f5562880740 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec35b16350 0x55ec35b18770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f5562880740 4 client.25393 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:17:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.739+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec35a01520 con 0x55ec35b16350 2024-09-21T01:17:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.740+0000 7f55595cc640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec35b16350 0x55ec35b18770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.749+0000 7f55595cc640 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec35b16350 0x55ec35b18770 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642d798c3a597578 server_cookie=372e4d92a5156165 in_seq=0 out_seq=0 2024-09-21T01:17:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:39.750+0000 7f553cff9640 10 client.25393 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.216+0000 7f1eddf6e640 1 -- 172.21.15.37:0/408705041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 msgr2=0x7f1ed810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.217+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/408705041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed810a5a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009900 tx=0x7f1ec802a400 comp rx=0 tx=0).stop 2024-09-21T01:17:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.218+0000 7f1eddf6e640 1 -- 172.21.15.37:0/408705041 shutdown_connections 2024-09-21T01:17:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.218+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/408705041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed8110420 0x7f1ed8116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.218+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/408705041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed810fad0 0x7f1ed810fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.218+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/408705041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed810a5a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.218+0000 7f1eddf6e640 1 -- 172.21.15.37:0/408705041 >> 172.21.15.37:0/408705041 conn(0x7f1ed80780f0 msgr2=0x7f1ed81081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.222+0000 7f1eddf6e640 1 -- 172.21.15.37:0/408705041 shutdown_connections 2024-09-21T01:17:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.222+0000 7f1eddf6e640 1 -- 172.21.15.37:0/408705041 wait complete. 2024-09-21T01:17:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.223+0000 7f1eddf6e640 1 Processor -- start 2024-09-21T01:17:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.223+0000 7f1eddf6e640 1 -- start start 2024-09-21T01:17:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.224+0000 7f1eddf6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.224+0000 7f1eddf6e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed810fad0 0x7f1ed806d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.224+0000 7f1eddf6e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed8110420 0x7f1ed8072910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.224+0000 7f1eddf6e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed811a120 con 0x7f1ed810a190 2024-09-21T01:17:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.224+0000 7f1eddf6e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8119fa0 con 0x7f1ed8110420 2024-09-21T01:17:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.224+0000 7f1eddf6e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed811a2a0 con 0x7f1ed810fad0 2024-09-21T01:17:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.226+0000 7f1ed6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed810fad0 0x7f1ed806d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.227+0000 7f1ed77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.227+0000 7f1ed77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed806d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45554/0 (socket says 172.21.15.37:45554) 2024-09-21T01:17:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.227+0000 7f1ed77fe640 1 -- 172.21.15.37:0/831272383 learned_addr learned my addr 172.21.15.37:0/831272383 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.228+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed8110420 0x7f1ed8072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:40 smithi037 ceph-mon[31105]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 990 MiB/s wr, 2.75k op/s 2024-09-21T01:17:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.232+0000 7f1ed77fe640 1 -- 172.21.15.37:0/831272383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed810fad0 msgr2=0x7f1ed806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.232+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed810fad0 0x7f1ed806d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.232+0000 7f1ed77fe640 1 -- 172.21.15.37:0/831272383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed8110420 msgr2=0x7f1ed8072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.232+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed8110420 0x7f1ed8072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.232+0000 7f1ed77fe640 1 -- 172.21.15.37:0/831272383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8073040 con 0x7f1ed810a190 2024-09-21T01:17:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.232+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed8110420 0x7f1ed8072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:17:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.234+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed806d0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8031440 tx=0x7f1ec8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.237+0000 7f1ed4ff9640 1 -- 172.21.15.37:0/831272383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec803f070 con 0x7f1ed810a190 2024-09-21T01:17:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.237+0000 7f1ed4ff9640 1 -- 172.21.15.37:0/831272383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ec8031d60 con 0x7f1ed810a190 2024-09-21T01:17:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.237+0000 7f1ed4ff9640 1 -- 172.21.15.37:0/831272383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8035030 con 0x7f1ed810a190 2024-09-21T01:17:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.237+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed8073270 con 0x7f1ed810a190 2024-09-21T01:17:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.237+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed8073700 con 0x7f1ed810a190 2024-09-21T01:17:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.243+0000 7f1ee44e2740 1 Processor -- start 2024-09-21T01:17:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 -- start start 2024-09-21T01:17:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d46070 0x55fe820ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820edc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 0x55fe820ee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe82063ea0 con 0x55fe81d46070 2024-09-21T01:17:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fe820532d0 con 0x55fe81d25390 2024-09-21T01:17:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.244+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe820570e0 con 0x55fe81d1d1b0 2024-09-21T01:17:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.247+0000 7f1ed6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 0x55fe820ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.249+0000 7f1ed6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 0x55fe820ee140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41648/0 (socket says 172.21.15.37:41648) 2024-09-21T01:17:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.249+0000 7f1ed6ffd640 1 -- 172.21.15.37:0/3051167329 learned_addr learned my addr 172.21.15.37:0/3051167329 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.249+0000 7f1ed4ff9640 1 -- 172.21.15.37:0/831272383 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1ec8042070 con 0x7f1ed810a190 2024-09-21T01:17:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.249+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.250+0000 7f1ed4ff9640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ec00b6720 0x7f1ec00b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.251+0000 7f1ed4ff9640 1 -- 172.21.15.37:0/831272383 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1ec8107d10 con 0x7f1ed810a190 2024-09-21T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.253+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ec00b6720 0x7f1ec00b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.257+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ec00b6720 0x7f1ec00b8c30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000aeb0 tx=0x7f1ed000a460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:40.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.258+0000 7f1ed6ffd640 1 -- 172.21.15.37:0/3051167329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 msgr2=0x55fe820edc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.258+0000 7f1ed6ffd640 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820edc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.258+0000 7f1ed6ffd640 1 -- 172.21.15.37:0/3051167329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d46070 msgr2=0x55fe820ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.258+0000 7f1ed6ffd640 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d46070 0x55fe820ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.258+0000 7f1ed6ffd640 1 -- 172.21.15.37:0/3051167329 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe81db1650 con 0x55fe81d25390 2024-09-21T01:17:40.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.266+0000 7f1ed6ffd640 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 0x55fe820ee140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00cb40 tx=0x7f1ecc00e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f240ebd5bf76787d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:40.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.267+0000 7f1ebdffb640 1 -- 172.21.15.37:0/3051167329 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc004020 con 0x55fe81d25390 2024-09-21T01:17:40.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.267+0000 7f1ebdffb640 1 -- 172.21.15.37:0/3051167329 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc0041c0 con 0x55fe81d25390 2024-09-21T01:17:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.267+0000 7f1ebdffb640 1 -- 172.21.15.37:0/3051167329 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc010790 con 0x55fe81d25390 2024-09-21T01:17:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.270+0000 7f1ee44e2740 1 -- 172.21.15.37:0/3051167329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 msgr2=0x55fe820ee140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.270+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 0x55fe820ee140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00cb40 tx=0x7f1ecc00e350 comp rx=0 tx=0).stop 2024-09-21T01:17:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.278+0000 7f1ee44e2740 1 -- 172.21.15.37:0/3051167329 shutdown_connections 2024-09-21T01:17:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.278+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d25390 0x55fe820ee140 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.278+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.278+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/3051167329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d46070 0x55fe820ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.278+0000 7f1ee44e2740 1 -- 172.21.15.37:0/3051167329 >> 172.21.15.37:0/3051167329 conn(0x55fe81d3a460 msgr2=0x55fe820eb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.282+0000 7f1ee44e2740 1 -- 172.21.15.37:0/3051167329 shutdown_connections 2024-09-21T01:17:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.283+0000 7f1ee44e2740 1 -- 172.21.15.37:0/3051167329 wait complete. 2024-09-21T01:17:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.284+0000 7f1ee44e2740 1 -- start start 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 Processor -- start 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d46070 0x55fe82105190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe81eb4700 con 0x55fe81d25390 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fe81fee160 con 0x55fe81d46070 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe820fbea0 con 0x55fe81d1d1b0 2024-09-21T01:17:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.285+0000 7f1ee44e2740 10 client.0 _ll_register_callbacks cb 0x55fe820079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.287+0000 7f1ed6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.287+0000 7f1ed6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45576/0 (socket says 172.21.15.37:45576) 2024-09-21T01:17:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.287+0000 7f1ed6ffd640 1 -- 172.21.15.37:0/833965411 learned_addr learned my addr 172.21.15.37:0/833965411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:40.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.290+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d46070 0x55fe82105190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.290+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.291+0000 7f1ed7fff640 1 -- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 msgr2=0x55fe820f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.291+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820f8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.291+0000 7f1ed7fff640 1 -- 172.21.15.37:0/833965411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 msgr2=0x55fe820f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.291+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.291+0000 7f1ed7fff640 1 -- 172.21.15.37:0/833965411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe8201bc90 con 0x55fe81d46070 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.293+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d46070 0x55fe82105190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0010c30 tx=0x7f1ed000a370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87144f7c708e0597 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.295+0000 7f1eb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.295+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/833965411 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed001c440 con 0x55fe81d46070 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.295+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/833965411 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1ed001c5e0 con 0x55fe81d46070 2024-09-21T01:17:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.295+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ecc0041c0 con 0x55fe81d46070 2024-09-21T01:17:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.298+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/833965411 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ed0004b40 con 0x55fe81d46070 2024-09-21T01:17:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.300+0000 7f1ee44e2740 10 client.25466 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.300+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe82107c40 con 0x55fe81d46070 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.306+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/833965411 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc0041c0 con 0x55fe81d46070 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.306+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/833965411 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1ed0005470 con 0x55fe81d46070 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.308+0000 7f1ee44e2740 10 client.25466 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.308+0000 7f1ee44e2740 10 client.25466 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.308+0000 7f1ee44e2740 20 client.25466 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.308+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d049f0 0x55fe8210b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.308+0000 7f1ee44e2740 4 client.25466 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:40.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.308+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe82065df0 con 0x55fe81d049f0 2024-09-21T01:17:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.313+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d049f0 0x55fe8210b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.321+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d049f0 0x55fe8210b1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dcd2b3daa6f4814e server_cookie=de4747b43a4f8c2b in_seq=0 out_seq=0 2024-09-21T01:17:40.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.322+0000 7f1eb6ffd640 10 client.25466 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:17:40.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.324+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/833965411 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe82065df0 con 0x55fe81d049f0 2024-09-21T01:17:40.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.324+0000 7f1eb6ffd640 10 client.25466 handle_command_reply: tid=0 2024-09-21T01:17:40.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 client.25466 shutdown 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d46070 msgr2=0x55fe82105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d46070 0x55fe82105190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0010c30 tx=0x7f1ed000a370 comp rx=0 tx=0).stop 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 shutdown_connections 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d049f0 0x55fe8210b1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d46070 0x55fe82105190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/833965411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d1d1b0 0x55fe820f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.328+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 >> 172.21.15.37:0/833965411 conn(0x55fe81d3a460 msgr2=0x55fe820f0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:40.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.329+0000 7f1eb6ffd640 0 client.25466 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:17:40.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.329+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 shutdown_connections 2024-09-21T01:17:40.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.330+0000 7f1ee44e2740 1 -- 172.21.15.37:0/833965411 wait complete. 2024-09-21T01:17:40.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.330+0000 7f1ee44e2740 20 client.25466 trim_cache size 0 max 16384 2024-09-21T01:17:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.378+0000 7f1ee44e2740 1 Processor -- start 2024-09-21T01:17:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.378+0000 7f1ee44e2740 1 -- start start 2024-09-21T01:17:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.379+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d3a460 0x55fe820eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.379+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 0x55fe82105090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.379+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.380+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81be290 con 0x55fe81d25390 2024-09-21T01:17:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.380+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81bfe00 con 0x55fe81d1d1b0 2024-09-21T01:17:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.380+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81be960 con 0x55fe81d3a460 2024-09-21T01:17:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.380+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.380+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45586/0 (socket says 172.21.15.37:45586) 2024-09-21T01:17:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.380+0000 7f1ed7fff640 1 -- 172.21.15.37:0/644549399 learned_addr learned my addr 172.21.15.37:0/644549399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.381+0000 7f1ed7fff640 1 -- 172.21.15.37:0/644549399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d3a460 msgr2=0x55fe820eee00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.381+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d3a460 0x55fe820eee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.381+0000 7f1ed7fff640 1 -- 172.21.15.37:0/644549399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 msgr2=0x55fe82105090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.381+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 0x55fe82105090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.381+0000 7f1ed7fff640 1 -- 172.21.15.37:0/644549399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe820fa070 con 0x55fe81d25390 2024-09-21T01:17:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.383+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f5fa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000a7e0 tx=0x7f1ed0011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e24c934e99aa5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.384+0000 7f1ebd7fa640 1 -- 172.21.15.37:0/644549399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed003a070 con 0x55fe81d25390 2024-09-21T01:17:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.385+0000 7f1ebd7fa640 1 -- 172.21.15.37:0/644549399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed0015070 con 0x55fe81d25390 2024-09-21T01:17:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.385+0000 7f1ebd7fa640 1 -- 172.21.15.37:0/644549399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0032040 con 0x55fe81d25390 2024-09-21T01:17:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.388+0000 7f1ee44e2740 1 -- 172.21.15.37:0/644549399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 msgr2=0x55fe820f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.388+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f5fa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000a7e0 tx=0x7f1ed0011b40 comp rx=0 tx=0).stop 2024-09-21T01:17:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.392+0000 7f1ee44e2740 1 -- 172.21.15.37:0/644549399 shutdown_connections 2024-09-21T01:17:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.392+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d25390 0x55fe820f5fa0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.392+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 0x55fe82105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.392+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/644549399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d3a460 0x55fe820eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.392+0000 7f1ee44e2740 1 -- 172.21.15.37:0/644549399 >> 172.21.15.37:0/644549399 conn(0x55fe820eb8b0 msgr2=0x55fe820ee6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.395+0000 7f1ee44e2740 1 -- 172.21.15.37:0/644549399 shutdown_connections 2024-09-21T01:17:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.402+0000 7f1ee44e2740 1 -- 172.21.15.37:0/644549399 wait complete. 2024-09-21T01:17:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.403+0000 7f1ee44e2740 1 -- start start 2024-09-21T01:17:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.403+0000 7f1ee44e2740 1 Processor -- start 2024-09-21T01:17:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 0x55fe820fdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d25390 0x55fe820fe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 0x55fe8216eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81bf700 con 0x55fe81d3a460 2024-09-21T01:17:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81bf030 con 0x55fe81d1d1b0 2024-09-21T01:17:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed81bc250 con 0x55fe81d25390 2024-09-21T01:17:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.405+0000 7f1ee44e2740 10 client.0 _ll_register_callbacks cb 0x7f1ed000aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.406+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 0x55fe8216eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.406+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 0x55fe8216eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45592/0 (socket says 172.21.15.37:45592) 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.406+0000 7f1ed7fff640 1 -- 172.21.15.37:0/963378475 learned_addr learned my addr 172.21.15.37:0/963378475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.406+0000 7f1ed6ffd640 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d25390 0x55fe820fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.407+0000 7f1ed7fff640 1 -- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d25390 msgr2=0x55fe820fe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.407+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d25390 0x55fe820fe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.407+0000 7f1ed7fff640 1 -- 172.21.15.37:0/963378475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 msgr2=0x55fe820fdbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.407+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 0x55fe820fdbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.407+0000 7f1ed7fff640 1 -- 172.21.15.37:0/963378475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe8216f310 con 0x55fe81d3a460 2024-09-21T01:17:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.407+0000 7f1ed7fff640 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 0x55fe8216eca0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0002230 tx=0x7f1ed0005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9c32a4e713d2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.408+0000 7f1eb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.408+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/963378475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0032070 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.408+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed0015070 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.408+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/963378475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1ed003e650 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.409+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/963378475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ed003a040 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.409+0000 7f1ee44e2740 10 client.15852 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.409+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe82176700 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/963378475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed0015070 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/963378475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1ed0035050 con 0x55fe81d3a460 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1ee44e2740 10 client.15852 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1ee44e2740 10 client.15852 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:17:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1ee44e2740 20 client.15852 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d46070 0x55fe82178e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1ee44e2740 4 client.15852 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:17:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.410+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe820618a0 con 0x55fe81d46070 2024-09-21T01:17:40.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:40 smithi137 ceph-mon[34607]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 990 MiB/s wr, 2.75k op/s 2024-09-21T01:17:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.417+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d46070 0x55fe82178e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:40.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:40 smithi144 ceph-mon[34818]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 990 MiB/s wr, 2.75k op/s 2024-09-21T01:17:40.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.426+0000 7f1eb6ffd640 10 client.15852 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:17:40.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.426+0000 7f1ed77fe640 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d46070 0x55fe82178e40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7b6fdf346d902989 server_cookie=4c2b5a18b3a3e94f in_seq=0 out_seq=0 2024-09-21T01:17:40.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.430+0000 7f1eb6ffd640 1 -- 172.21.15.37:0/963378475 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe820618a0 con 0x55fe81d46070 2024-09-21T01:17:40.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.430+0000 7f1eb6ffd640 10 client.15852 handle_command_reply: tid=0 2024-09-21T01:17:40.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.430+0000 7f1ee44e2740 1 client.15852 shutdown 2024-09-21T01:17:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.434+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 msgr2=0x55fe8216eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.434+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 0x55fe8216eca0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0002230 tx=0x7f1ed0005450 comp rx=0 tx=0).stop 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.435+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 shutdown_connections 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.435+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55fe81d46070 0x55fe82178e40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.435+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe81d3a460 0x55fe8216eca0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.435+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe81d25390 0x55fe820fe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.435+0000 7f1ee44e2740 1 --2- 172.21.15.37:0/963378475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fe81d1d1b0 0x55fe820fdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.436+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 >> 172.21.15.37:0/963378475 conn(0x55fe820eb8b0 msgr2=0x55fe820ee6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.437+0000 7f1eb6ffd640 0 client.15852 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:17:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.437+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 shutdown_connections 2024-09-21T01:17:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.440+0000 7f1ee44e2740 1 -- 172.21.15.37:0/963378475 wait complete. 2024-09-21T01:17:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.442+0000 7f1ee44e2740 20 client.15852 trim_cache size 0 max 16384 2024-09-21T01:17:40.445 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:17:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ec00b6720 msgr2=0x7f1ec00b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ec00b6720 0x7f1ec00b8c30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000aeb0 tx=0x7f1ed000a460 comp rx=0 tx=0).stop 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 msgr2=0x7f1ed806d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed806d0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8031440 tx=0x7f1ec8003d80 comp rx=0 tx=0).stop 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 shutdown_connections 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1ec00b6720 0x7f1ec00b8c30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ed8110420 0x7f1ed8072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ed810fad0 0x7f1ed806d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 --2- 172.21.15.37:0/831272383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ed810a190 0x7f1ed806d0d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 >> 172.21.15.37:0/831272383 conn(0x7f1ed80780f0 msgr2=0x7f1ed810dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 shutdown_connections 2024-09-21T01:17:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:40.445+0000 7f1eddf6e640 1 -- 172.21.15.37:0/831272383 wait complete. 2024-09-21T01:17:41.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.526+0000 7f553cff9640 1 -- 172.21.15.37:0/1372810790 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec35a01520 con 0x55ec35b16350 2024-09-21T01:17:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.526+0000 7f553cff9640 10 client.25393 handle_command_reply: tid=0 2024-09-21T01:17:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.526+0000 7f5562880740 1 client.25393 shutdown 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 msgr2=0x55ec35aa4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35aa4c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5550018820 tx=0x7f55500183d0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 shutdown_connections 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ec35b16350 0x55ec35b18770 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ec356ec1b0 0x55ec35b13d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec356cb4d0 0x55ec35aa4c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 --2- 172.21.15.37:0/1372810790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec356aad80 0x55ec35aa45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 >> 172.21.15.37:0/1372810790 conn(0x55ec356e0300 msgr2=0x55ec35a9c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.527+0000 7f553cff9640 0 client.25393 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.528+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 shutdown_connections 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.528+0000 7f5562880740 1 -- 172.21.15.37:0/1372810790 wait complete. 2024-09-21T01:17:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.528+0000 7f5562880740 20 client.25393 trim_cache size 0 max 16384 2024-09-21T01:17:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:17:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:17:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:17:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.529+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55400b6650 msgr2=0x7f55400b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.529+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55400b6650 0x7f55400b8b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f554c005fd0 tx=0x7f554c009260 comp rx=0 tx=0).stop 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.529+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 msgr2=0x7f55541b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.529+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 0x7f55541b19f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5550000c00 tx=0x7f5550004f70 comp rx=0 tx=0).stop 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.530+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 shutdown_connections 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.530+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f55400b6650 0x7f55400b8b60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.530+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f555407aa30 0x7f55541b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.530+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55540780d0 0x7f55541b19f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.530+0000 7f555a5ce640 1 --2- 172.21.15.37:0/1055782688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5554075310 0x7f55541b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.530+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 >> 172.21.15.37:0/1055782688 conn(0x7f5554070640 msgr2=0x7f5554078ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.531+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 shutdown_connections 2024-09-21T01:17:41.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:41.531+0000 7f555a5ce640 1 -- 172.21.15.37:0/1055782688 wait complete. 2024-09-21T01:17:42.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:42 smithi037 ceph-mon[31105]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 816 MiB/s wr, 2.01k op/s 2024-09-21T01:17:42.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:42 smithi137 ceph-mon[34607]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 816 MiB/s wr, 2.01k op/s 2024-09-21T01:17:42.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:42 smithi144 ceph-mon[34818]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 816 MiB/s wr, 2.01k op/s 2024-09-21T01:17:43.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:17:44.204 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:17:44.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:44 smithi037 ceph-mon[31105]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 902 MiB/s wr, 2.11k op/s 2024-09-21T01:17:44.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:44 smithi137 ceph-mon[34607]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 902 MiB/s wr, 2.11k op/s 2024-09-21T01:17:44.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:44 smithi144 ceph-mon[34818]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 902 MiB/s wr, 2.11k op/s 2024-09-21T01:17:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.532+0000 7f165a7af640 1 -- 172.21.15.37:0/631171524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654108b20 msgr2=0x7f165410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.532+0000 7f165a7af640 1 --2- 172.21.15.37:0/631171524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654108b20 0x7f165410f350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f164c009ca0 tx=0x7f164c02a8f0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.538+0000 7f165a7af640 1 -- 172.21.15.37:0/631171524 shutdown_connections 2024-09-21T01:17:45.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.538+0000 7f165a7af640 1 --2- 172.21.15.37:0/631171524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654108b20 0x7f165410f350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.538+0000 7f165a7af640 1 --2- 172.21.15.37:0/631171524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16541081d0 0x7f16541085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.538+0000 7f165a7af640 1 --2- 172.21.15.37:0/631171524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1654102f60 0x7f1654103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.538+0000 7f165a7af640 1 -- 172.21.15.37:0/631171524 >> 172.21.15.37:0/631171524 conn(0x7f1654077aa0 msgr2=0x7f1654077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.539+0000 7f165a7af640 1 -- 172.21.15.37:0/631171524 shutdown_connections 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.540+0000 7f165a7af640 1 -- 172.21.15.37:0/631171524 wait complete. 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 Processor -- start 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 -- start start 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654102f60 0x7f1654110c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16541081d0 0x7f16541111b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 0x7f1654116470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1654119f50 con 0x7f1654108b20 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1654119dd0 con 0x7f1654102f60 2024-09-21T01:17:45.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.541+0000 7f165a7af640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f165411a0d0 con 0x7f16541081d0 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.543+0000 7f1659fae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 0x7f1654116470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.543+0000 7f1659fae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 0x7f1654116470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45616/0 (socket says 172.21.15.37:45616) 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.543+0000 7f1659fae640 1 -- 172.21.15.37:0/421544438 learned_addr learned my addr 172.21.15.37:0/421544438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.545+0000 7f16597ad640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654102f60 0x7f1654110c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.545+0000 7f1658fac640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16541081d0 0x7f16541111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.547+0000 7f1659fae640 1 -- 172.21.15.37:0/421544438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16541081d0 msgr2=0x7f16541111b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.547+0000 7f1659fae640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16541081d0 0x7f16541111b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.547+0000 7f1659fae640 1 -- 172.21.15.37:0/421544438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654102f60 msgr2=0x7f1654110c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.547+0000 7f1659fae640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654102f60 0x7f1654110c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.547+0000 7f1659fae640 1 -- 172.21.15.37:0/421544438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1654116ab0 con 0x7f1654108b20 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.559+0000 7f1659fae640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 0x7f1654116470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f164c030820 tx=0x7f164c030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.564+0000 7f164a7fc640 1 -- 172.21.15.37:0/421544438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c030d00 con 0x7f1654108b20 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.564+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1654116d40 con 0x7f1654108b20 2024-09-21T01:17:45.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.564+0000 7f164a7fc640 1 -- 172.21.15.37:0/421544438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f164c02d070 con 0x7f1654108b20 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.564+0000 7f164a7fc640 1 -- 172.21.15.37:0/421544438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c03b660 con 0x7f1654108b20 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.564+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16541175e0 con 0x7f1654108b20 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.570+0000 7f1661f85740 1 Processor -- start 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.570+0000 7f1661f85740 1 -- start start 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.570+0000 7f1661f85740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51fa070 0x55b7f55a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.571+0000 7f1661f85740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 0x55b7f55a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.571+0000 7f1661f85740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.571+0000 7f1661f85740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b7f5517ea0 con 0x55b7f51d9390 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.572+0000 7f16597ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 0x55b7f55a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.572+0000 7f16597ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 0x55b7f55a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:55228/0 (socket says 172.21.15.37:55228) 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.572+0000 7f16597ad640 1 -- 172.21.15.37:0/2311524729 learned_addr learned my addr 172.21.15.37:0/2311524729 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.571+0000 7f1661f85740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b7f55072d0 con 0x55b7f51fa070 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.572+0000 7f1661f85740 1 -- 172.21.15.37:0/2311524729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b7f550b0e0 con 0x55b7f51d11b0 2024-09-21T01:17:45.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.576+0000 7f164a7fc640 1 -- 172.21.15.37:0/421544438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f164c045960 con 0x7f1654108b20 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.576+0000 7f1658fac640 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51fa070 0x55b7f55a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.576+0000 7f1658fac640 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.577+0000 7f16597ad640 1 -- 172.21.15.37:0/2311524729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51fa070 msgr2=0x55b7f55a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.577+0000 7f16597ad640 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51fa070 0x55b7f55a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.577+0000 7f16597ad640 1 -- 172.21.15.37:0/2311524729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 msgr2=0x55b7f55a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.577+0000 7f16597ad640 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.577+0000 7f16597ad640 1 -- 172.21.15.37:0/2311524729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f5265650 con 0x55b7f51d11b0 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.578+0000 7f16597ad640 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 0x55b7f55a19e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f165000b7f0 tx=0x7f165000bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f360bc42dd85e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.579+0000 7f164a7fc640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f16400b6720 0x7f16400b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.579+0000 7f163f7fe640 1 -- 172.21.15.37:0/2311524729 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165000d950 con 0x55b7f51d11b0 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.579+0000 7f164a7fc640 1 -- 172.21.15.37:0/421544438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f164c1082e0 con 0x7f1654108b20 2024-09-21T01:17:45.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.579+0000 7f163f7fe640 1 -- 172.21.15.37:0/2311524729 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1650018070 con 0x55b7f51d11b0 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 -- 172.21.15.37:0/2311524729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 msgr2=0x55b7f55a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 0x55b7f55a19e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f165000b7f0 tx=0x7f165000bcb0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1658fac640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f16400b6720 0x7f16400b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 -- 172.21.15.37:0/2311524729 shutdown_connections 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51d11b0 0x55b7f55a19e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 --2- 172.21.15.37:0/2311524729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51fa070 0x55b7f55a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 -- 172.21.15.37:0/2311524729 >> 172.21.15.37:0/2311524729 conn(0x55b7f51ee460 msgr2=0x55b7f559f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.581+0000 7f1661f85740 1 -- 172.21.15.37:0/2311524729 shutdown_connections 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.582+0000 7f1661f85740 1 -- 172.21.15.37:0/2311524729 wait complete. 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.582+0000 7f1661f85740 1 -- start start 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.582+0000 7f1661f85740 1 Processor -- start 2024-09-21T01:17:45.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.583+0000 7f1661f85740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51d9390 0x55b7f55af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.583+0000 7f1661f85740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 0x55b7f55ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.583+0000 7f1661f85740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.583+0000 7f1661f85740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b7f5368700 con 0x55b7f51fa070 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.583+0000 7f1661f85740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b7f54a2160 con 0x55b7f51d9390 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.583+0000 7f1661f85740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b7f55afcd0 con 0x55b7f51b89f0 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.584+0000 7f1661f85740 10 client.0 _ll_register_callbacks cb 0x55b7f54bb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.584+0000 7f1658fac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 0x55b7f55ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.584+0000 7f1658fac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 0x55b7f55ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58422/0 (socket says 172.21.15.37:58422) 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.584+0000 7f1658fac640 1 -- 172.21.15.37:0/2901284562 learned_addr learned my addr 172.21.15.37:0/2901284562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:45.852 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.585+0000 7f1658fac640 1 -- 172.21.15.37:0/2901284562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 msgr2=0x55b7f55ace70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.585+0000 7f1658fac640 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55ace70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.585+0000 7f1658fac640 1 -- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51d9390 msgr2=0x55b7f55af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.585+0000 7f1658fac640 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51d9390 0x55b7f55af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.585+0000 7f1658fac640 1 -- 172.21.15.37:0/2901284562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f54cfc90 con 0x55b7f51fa070 2024-09-21T01:17:45.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.588+0000 7f1658fac640 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 0x55b7f55ac760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1644010430 tx=0x7f16440108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4078d41777765c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.588+0000 7f163cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.592+0000 7f163cff9640 1 -- 172.21.15.37:0/2901284562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644025060 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.592+0000 7f163cff9640 1 -- 172.21.15.37:0/2901284562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f164401e9a0 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.592+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7f5519df0 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.599+0000 7f1658fac640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f16400b6720 0x7f16400b8c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1644022000 tx=0x7f164401f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.599+0000 7f163cff9640 1 -- 172.21.15.37:0/2901284562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f164400fe60 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.599+0000 7f1661f85740 10 client.15858 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.599+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7f55cc750 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f163cff9640 1 -- 172.21.15.37:0/2901284562 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b7f5519df0 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f163cff9640 1 -- 172.21.15.37:0/2901284562 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1644032020 con 0x55b7f51fa070 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f1661f85740 10 client.15858 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f1661f85740 10 client.15858 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f1661f85740 20 client.15858 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:45.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f1661f85740 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f518dda0 0x55b7f55cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f1661f85740 4 client.15858 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.608+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7f55158a0 con 0x55b7f518dda0 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.609+0000 7f16597ad640 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f518dda0 0x55b7f55cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.612+0000 7f163cff9640 10 client.15858 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.612+0000 7f16597ad640 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f518dda0 0x55b7f55cfda0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2fd8456c800b4b3d server_cookie=9e4abcac0028fba1 in_seq=0 out_seq=0 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.614+0000 7f163cff9640 1 -- 172.21.15.37:0/2901284562 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1650018040 con 0x55b7f518dda0 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.614+0000 7f163cff9640 10 client.15858 handle_command_reply: tid=0 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.614+0000 7f1661f85740 1 client.15858 shutdown 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 msgr2=0x55b7f55ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 0x55b7f55ac760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1644010430 tx=0x7f16440108f0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 shutdown_connections 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f518dda0 0x55b7f55cfda0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51fa070 0x55b7f55ac760 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 --2- 172.21.15.37:0/2901284562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f51d9390 0x55b7f55af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 >> 172.21.15.37:0/2901284562 conn(0x55b7f51ee460 msgr2=0x55b7f55a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f163cff9640 0 client.15858 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 shutdown_connections 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 1 -- 172.21.15.37:0/2901284562 wait complete. 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.615+0000 7f1661f85740 20 client.15858 trim_cache size 0 max 16384 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.644+0000 7f1661f85740 1 Processor -- start 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.645+0000 7f1661f85740 1 -- start start 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.646+0000 7f1661f85740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.646+0000 7f1661f85740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.646+0000 7f1661f85740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f55d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.647+0000 7f1661f85740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16540739c0 con 0x55b7f51d9390 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.647+0000 7f1661f85740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1654075530 con 0x55b7f55d5ae0 2024-09-21T01:17:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.647+0000 7f1661f85740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1654074090 con 0x55b7f51b89f0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.648+0000 7f1659fae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f55d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.648+0000 7f1659fae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f55d5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:34038/0 (socket says 172.21.15.37:34038) 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.648+0000 7f1659fae640 1 -- 172.21.15.37:0/2538802403 learned_addr learned my addr 172.21.15.37:0/2538802403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.649+0000 7f16597ad640 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.652+0000 7f1658fac640 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.653+0000 7f1659fae640 1 -- 172.21.15.37:0/2538802403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 msgr2=0x55b7f55a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.653+0000 7f1659fae640 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.654+0000 7f1659fae640 1 -- 172.21.15.37:0/2538802403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 msgr2=0x55b7f55d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.654+0000 7f1659fae640 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.654+0000 7f1659fae640 1 -- 172.21.15.37:0/2538802403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f55a7fd0 con 0x55b7f55d5ae0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.659+0000 7f1659fae640 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f55d5ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f164c0caa00 tx=0x7f164c02a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702f85c73f333bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.663+0000 7f163effd640 1 -- 172.21.15.37:0/2538802403 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c0098d0 con 0x55b7f55d5ae0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.663+0000 7f163effd640 1 -- 172.21.15.37:0/2538802403 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f164c036040 con 0x55b7f55d5ae0 2024-09-21T01:17:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.663+0000 7f163effd640 1 -- 172.21.15.37:0/2538802403 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c0c8e60 con 0x55b7f55d5ae0 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.667+0000 7f1661f85740 1 -- 172.21.15.37:0/2538802403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 msgr2=0x55b7f55d5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.667+0000 7f1661f85740 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f55d5ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f164c0caa00 tx=0x7f164c02a8f0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.669+0000 7f1661f85740 1 -- 172.21.15.37:0/2538802403 shutdown_connections 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.670+0000 7f1661f85740 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f55d5ef0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.670+0000 7f1661f85740 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.670+0000 7f1661f85740 1 --2- 172.21.15.37:0/2538802403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.670+0000 7f1661f85740 1 -- 172.21.15.37:0/2538802403 >> 172.21.15.37:0/2538802403 conn(0x55b7f51ee460 msgr2=0x55b7f55a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.677+0000 7f1661f85740 1 -- 172.21.15.37:0/2538802403 shutdown_connections 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.678+0000 7f1661f85740 1 -- 172.21.15.37:0/2538802403 wait complete. 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.678+0000 7f1661f85740 1 -- start start 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.679+0000 7f1661f85740 1 Processor -- start 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.688+0000 7f1661f85740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.688+0000 7f1661f85740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.688+0000 7f1661f85740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f56397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.688+0000 7f1661f85740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1654074e30 con 0x55b7f51d9390 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.688+0000 7f1661f85740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1654074760 con 0x55b7f55d5ae0 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.688+0000 7f1661f85740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1654071980 con 0x55b7f51b89f0 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.689+0000 7f1661f85740 10 client.0 _ll_register_callbacks cb 0x7f164400ec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.693+0000 7f16597ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.693+0000 7f16597ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:55254/0 (socket says 172.21.15.37:55254) 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.693+0000 7f16597ad640 1 -- 172.21.15.37:0/803716714 learned_addr learned my addr 172.21.15.37:0/803716714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.693+0000 7f1658fac640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.694+0000 7f1658fac640 1 -- 172.21.15.37:0/803716714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 msgr2=0x55b7f55b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.694+0000 7f1658fac640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.694+0000 7f1658fac640 1 -- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 msgr2=0x55b7f56397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.693+0000 7f1659fae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f56397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.697+0000 7f1658fac640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f56397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.697+0000 7f1658fac640 1 -- 172.21.15.37:0/803716714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f5639d90 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.697+0000 7f1659fae640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f56397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.703+0000 7f1658fac640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55b1cd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1644015000 tx=0x7f164401f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896d29169596bc83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.703+0000 7f163cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.707+0000 7f163cff9640 1 -- 172.21.15.37:0/803716714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164403a020 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.707+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f164c036040 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.707+0000 7f163cff9640 1 -- 172.21.15.37:0/803716714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1644005220 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.711+0000 7f163cff9640 1 -- 172.21.15.37:0/803716714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1644025040 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.711+0000 7f1661f85740 10 client.15867 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.711+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7f563b010 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.715+0000 7f163cff9640 1 -- 172.21.15.37:0/803716714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f164c036040 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f163cff9640 1 -- 172.21.15.37:0/803716714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1644032040 con 0x55b7f51d9390 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f1661f85740 10 client.15867 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:45.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f1661f85740 10 client.15867 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f1661f85740 20 client.15867 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f1661f85740 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f563b780 0x55b7f563dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f1661f85740 4 client.15867 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.716+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7f5512cd0 con 0x55b7f563b780 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.719+0000 7f16597ad640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f563b780 0x55b7f563dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.734+0000 7f16597ad640 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f563b780 0x55b7f563dba0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4ac9fb09f9da0234 server_cookie=dec1f561a4a58950 in_seq=0 out_seq=0 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.734+0000 7f163cff9640 10 client.15867 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.736+0000 7f163cff9640 1 -- 172.21.15.37:0/803716714 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7f5512cd0 con 0x55b7f563b780 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.736+0000 7f163cff9640 10 client.15867 handle_command_reply: tid=0 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.736+0000 7f1661f85740 1 client.15867 shutdown 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 msgr2=0x55b7f55b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55b1cd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1644015000 tx=0x7f164401f510 comp rx=0 tx=0).stop 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 shutdown_connections 2024-09-21T01:17:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55b7f563b780 0x55b7f563dba0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b7f55d5ae0 0x55b7f56397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7f51d9390 0x55b7f55b1cd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 --2- 172.21.15.37:0/803716714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b7f51b89f0 0x55b7f55b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 >> 172.21.15.37:0/803716714 conn(0x55b7f51ee460 msgr2=0x55b7f55aafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f163cff9640 0 client.15867 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 shutdown_connections 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 1 -- 172.21.15.37:0/803716714 wait complete. 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.739+0000 7f1661f85740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f16400b6720 msgr2=0x7f16400b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f16400b6720 0x7f16400b8c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1644022000 tx=0x7f164401f000 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 msgr2=0x7f1654116470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 0x7f1654116470 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f164c030820 tx=0x7f164c030850 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 shutdown_connections 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f16400b6720 0x7f16400b8c30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1654108b20 0x7f1654116470 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16541081d0 0x7f16541111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 --2- 172.21.15.37:0/421544438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1654102f60 0x7f1654110c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:45.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.741+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 >> 172.21.15.37:0/421544438 conn(0x7f1654077aa0 msgr2=0x7f1654106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:45.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.742+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 shutdown_connections 2024-09-21T01:17:45.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:45.742+0000 7f165a7af640 1 -- 172.21.15.37:0/421544438 wait complete. 2024-09-21T01:17:46.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:46 smithi037 ceph-mon[31105]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 934 MiB/s wr, 2.31k op/s 2024-09-21T01:17:46.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:46 smithi137 ceph-mon[34607]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 934 MiB/s wr, 2.31k op/s 2024-09-21T01:17:46.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:46 smithi144 ceph-mon[34818]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 934 MiB/s wr, 2.31k op/s 2024-09-21T01:17:48.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:48 smithi137 ceph-mon[34607]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 MiB/s wr, 2.12k op/s 2024-09-21T01:17:48.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:48 smithi144 ceph-mon[34818]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 MiB/s wr, 2.12k op/s 2024-09-21T01:17:48.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:48 smithi037 ceph-mon[31105]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 MiB/s wr, 2.12k op/s 2024-09-21T01:17:49.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:17:49.748 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:17:50.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:50 smithi037 ceph-mon[31105]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 999 MiB/s wr, 2.78k op/s 2024-09-21T01:17:50.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:50 smithi137 ceph-mon[34607]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 999 MiB/s wr, 2.78k op/s 2024-09-21T01:17:50.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:50 smithi144 ceph-mon[34818]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 999 MiB/s wr, 2.78k op/s 2024-09-21T01:17:52.043 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:17:52.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.772+0000 7fc0adae5640 1 -- 172.21.15.37:0/2984583465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 msgr2=0x7fc0a810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.772+0000 7fc0adae5640 1 --2- 172.21.15.37:0/2984583465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a810f550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009ca0 tx=0x7fc0a002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.772+0000 7fc0adae5640 1 -- 172.21.15.37:0/2984583465 shutdown_connections 2024-09-21T01:17:52.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.772+0000 7fc0adae5640 1 --2- 172.21.15.37:0/2984583465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a810f550 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.772+0000 7fc0adae5640 1 --2- 172.21.15.37:0/2984583465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0a81083d0 0x7fc0a81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.772+0000 7fc0adae5640 1 --2- 172.21.15.37:0/2984583465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a8102ae0 0x7fc0a8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.773+0000 7fc0adae5640 1 -- 172.21.15.37:0/2984583465 >> 172.21.15.37:0/2984583465 conn(0x7fc0a8079760 msgr2=0x7fc0a8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.773+0000 7fc0adae5640 1 -- 172.21.15.37:0/2984583465 shutdown_connections 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.773+0000 7fc0adae5640 1 -- 172.21.15.37:0/2984583465 wait complete. 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.775+0000 7fc0adae5640 1 Processor -- start 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.775+0000 7fc0adae5640 1 -- start start 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.775+0000 7fc0adae5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a8102ae0 0x7fc0a819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.776+0000 7fc0adae5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0a81083d0 0x7fc0a819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.776+0000 7fc0adae5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a81a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.776+0000 7fc0adae5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8115d40 con 0x7fc0a8108d20 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.776+0000 7fc0adae5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8115bc0 con 0x7fc0a81083d0 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.776+0000 7fc0adae5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8115ec0 con 0x7fc0a8102ae0 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a81a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a81a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58464/0 (socket says 172.21.15.37:58464) 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 -- 172.21.15.37:0/3024849205 learned_addr learned my addr 172.21.15.37:0/3024849205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a8102ae0 0x7fc0a819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 -- 172.21.15.37:0/3024849205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a8102ae0 msgr2=0x7fc0a819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a8102ae0 0x7fc0a819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 -- 172.21.15.37:0/3024849205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0a81083d0 msgr2=0x7fc0a819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0a81083d0 0x7fc0a819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.777+0000 7fc0a7fff640 1 -- 172.21.15.37:0/3024849205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a81a25e0 con 0x7fc0a8108d20 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.778+0000 7fc0a7fff640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a81a1eb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005e30 tx=0x7fc0a0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.778+0000 7fc0a4ff9640 1 -- 172.21.15.37:0/3024849205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0004040 con 0x7fc0a8108d20 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.778+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a81a2870 con 0x7fc0a8108d20 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.778+0000 7fc0a4ff9640 1 -- 172.21.15.37:0/3024849205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0a0004690 con 0x7fc0a8108d20 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.778+0000 7fc0a4ff9640 1 -- 172.21.15.37:0/3024849205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0030ce0 con 0x7fc0a8108d20 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.778+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81a9030 con 0x7fc0a8108d20 2024-09-21T01:17:52.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.783+0000 7fc0b4059740 1 Processor -- start 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0a4ff9640 1 -- 172.21.15.37:0/3024849205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc0a00041e0 con 0x7fc0a8108d20 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 -- start start 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x5622281fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x5622281fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 0x5622281fad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562228170ea0 con 0x562227e32390 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622281602d0 con 0x562227e2a1b0 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.784+0000 7fc0b4059740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5622281640e0 con 0x562227e53070 2024-09-21T01:17:52.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 0x5622281fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 0x5622281fad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58470/0 (socket says 172.21.15.37:58470) 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2702134805 learned_addr learned my addr 172.21.15.37:0/2702134805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x5622281fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a4ff9640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0900b6590 0x7fc0900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2702134805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 msgr2=0x5622281fa2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x5622281fa2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2702134805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 msgr2=0x5622281fa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x5622281fa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2702134805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562227ebe650 con 0x562227e32390 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a4ff9640 1 -- 172.21.15.37:0/3024849205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc0a0108580 con 0x7fc0a8108d20 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.785+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 0x5622281fad40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00ba80 tx=0x7fc09c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b72539f2ffc785 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:52.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.786+0000 7fc0a7fff640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0900b6590 0x7fc0900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.786+0000 7fc08dffb640 1 -- 172.21.15.37:0/2702134805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c016070 con 0x562227e32390 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.786+0000 7fc08dffb640 1 -- 172.21.15.37:0/2702134805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09c0054d0 con 0x562227e32390 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.786+0000 7fc08dffb640 1 -- 172.21.15.37:0/2702134805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c010460 con 0x562227e32390 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 -- 172.21.15.37:0/2702134805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 msgr2=0x5622281fad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0a7fff640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0900b6590 0x7fc0900b8aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00ce410 tx=0x7fc0a0030810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 0x5622281fad40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00ba80 tx=0x7fc09c00bf40 comp rx=0 tx=0).stop 2024-09-21T01:17:52.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 -- 172.21.15.37:0/2702134805 shutdown_connections 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e32390 0x5622281fad40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x5622281fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2702134805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x5622281fa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.787+0000 7fc0b4059740 1 -- 172.21.15.37:0/2702134805 >> 172.21.15.37:0/2702134805 conn(0x562227e47460 msgr2=0x5622281f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.788+0000 7fc0b4059740 1 -- 172.21.15.37:0/2702134805 shutdown_connections 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.788+0000 7fc0b4059740 1 -- 172.21.15.37:0/2702134805 wait complete. 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.788+0000 7fc0b4059740 1 -- start start 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 Processor -- start 2024-09-21T01:17:52.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x562228205a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x562228205f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 0x562228211dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562227fc1700 con 0x562227e119f0 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622280fb160 con 0x562227e2a1b0 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562228208aa0 con 0x562227e53070 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.789+0000 7fc0b4059740 10 client.0 _ll_register_callbacks cb 0x5622281149e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 0x562228211dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 0x562228211dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58480/0 (socket says 172.21.15.37:58480) 2024-09-21T01:17:52.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/1238709096 learned_addr learned my addr 172.21.15.37:0/1238709096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x562228205f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 msgr2=0x562228205f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x562228205f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/1238709096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 msgr2=0x562228205a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x562228205a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/1238709096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562228128c90 con 0x562227e119f0 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 0x562228211dc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc09c005890 tx=0x7fc09c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f3cbbbc5bbd787 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:52.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.790+0000 7fc086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc086ffd640 1 -- 172.21.15.37:0/1238709096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c016070 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc086ffd640 1 -- 172.21.15.37:0/1238709096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc09c004030 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c0054d0 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc086ffd640 1 -- 172.21.15.37:0/1238709096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc09c02b050 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc0b4059740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5622282148a0 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.791+0000 7fc086ffd640 1 -- 172.21.15.37:0/1238709096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09c0051b0 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc086ffd640 1 -- 172.21.15.37:0/1238709096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc09c003680 con 0x562227e119f0 2024-09-21T01:17:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc0b4059740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc0b4059740 10 client.15879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc0b4059740 20 client.15879 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc0b4059740 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227de6da0 0x562228217c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc0b4059740 4 client.15879 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.792+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc09c0054d0 con 0x562227de6da0 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.793+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227de6da0 0x562228217c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.794+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227de6da0 0x562228217c60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89485587b2b1f89 server_cookie=f24e9fcd46842496 in_seq=0 out_seq=0 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.794+0000 7fc086ffd640 10 client.15879 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:17:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.795+0000 7fc086ffd640 1 -- 172.21.15.37:0/1238709096 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc09c0054d0 con 0x562227de6da0 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.795+0000 7fc086ffd640 10 client.15879 handle_command_reply: tid=0 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.795+0000 7fc0b4059740 1 client.15879 shutdown 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 msgr2=0x562228211dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 0x562228211dc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc09c005890 tx=0x7fc09c0049d0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 shutdown_connections 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227de6da0 0x562228217c60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc086ffd640 0 client.15879 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227e119f0 0x562228211dc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e53070 0x562228205f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 --2- 172.21.15.37:0/1238709096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x562228205a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.796+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 >> 172.21.15.37:0/1238709096 conn(0x562227e47460 msgr2=0x5622281fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.797+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 shutdown_connections 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.797+0000 7fc0b4059740 1 -- 172.21.15.37:0/1238709096 wait complete. 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.798+0000 7fc0b4059740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.818+0000 7fc0b4059740 1 Processor -- start 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 -- start start 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x562228202c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e119f0 0x562228203160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x56222821ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b1620 con 0x562227de6da0 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b3190 con 0x562227e2a1b0 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0b4059740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b1cf0 con 0x562227e119f0 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x562228202c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x562228202c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58484/0 (socket says 172.21.15.37:58484) 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.819+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2791215695 learned_addr learned my addr 172.21.15.37:0/2791215695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2791215695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e119f0 msgr2=0x562228203160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e119f0 0x562228203160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2791215695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 msgr2=0x56222821ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x56222821ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2791215695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622282006b0 con 0x562227de6da0 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x562228202c20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc09c004c70 tx=0x7fc09c0058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2da19de8e54350 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2791215695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c016070 con 0x562227de6da0 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2791215695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09c00d770 con 0x562227de6da0 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.820+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2791215695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c004ca0 con 0x562227de6da0 2024-09-21T01:17:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.821+0000 7fc0b4059740 1 -- 172.21.15.37:0/2791215695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 msgr2=0x562228202c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.821+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x562228202c20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc09c004c70 tx=0x7fc09c0058c0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 -- 172.21.15.37:0/2791215695 shutdown_connections 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e2a1b0 0x56222821ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e119f0 0x562228203160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2791215695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x562228202c20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 -- 172.21.15.37:0/2791215695 >> 172.21.15.37:0/2791215695 conn(0x562227e47460 msgr2=0x5622282042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 -- 172.21.15.37:0/2791215695 shutdown_connections 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 -- 172.21.15.37:0/2791215695 wait complete. 2024-09-21T01:17:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.822+0000 7fc0b4059740 1 -- start start 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 Processor -- start 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x56222821b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e119f0 0x56222821b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e2a1b0 0x562228215e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b2a90 con 0x562227de6da0 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b23c0 con 0x562227e119f0 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81af5e0 con 0x562227e2a1b0 2024-09-21T01:17:52.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0b4059740 10 client.0 _ll_register_callbacks cb 0x7fc09c00b980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x56222821b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x56222821b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58494/0 (socket says 172.21.15.37:58494) 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.823+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2629915964 learned_addr learned my addr 172.21.15.37:0/2629915964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e119f0 0x56222821b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e2a1b0 msgr2=0x562228215e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e2a1b0 0x562228215e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2629915964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e119f0 msgr2=0x56222821b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:52.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e119f0 0x56222821b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a6ffd640 1 -- 172.21.15.37:0/2629915964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562228216570 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e119f0 0x56222821b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.824+0000 7fc0a6ffd640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x56222821b0c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0059f0 tx=0x7fc09c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee610eba92b1029 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc086ffd640 1 -- 172.21.15.37:0/2629915964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c03c060 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc086ffd640 1 -- 172.21.15.37:0/2629915964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc09c003fa0 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c00d770 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc086ffd640 1 -- 172.21.15.37:0/2629915964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc09c016070 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc0b4059740 10 client.15885 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.825+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56222828b780 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc086ffd640 1 -- 172.21.15.37:0/2629915964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09c00d770 con 0x562227de6da0 2024-09-21T01:17:52.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc086ffd640 1 -- 172.21.15.37:0/2629915964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc09c0104e0 con 0x562227de6da0 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc0b4059740 10 client.15885 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc0b4059740 10 client.15885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc0b4059740 20 client.15885 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227e53070 0x56222828de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc0b4059740 4 client.15885 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.826+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562228172df0 con 0x562227e53070 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.827+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227e53070 0x56222828de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.829+0000 7fc086ffd640 10 client.15885 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:17:52.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.829+0000 7fc0a77fe640 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227e53070 0x56222828de30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89788600696d637 server_cookie=4ef2e9551f9f4926 in_seq=0 out_seq=0 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.830+0000 7fc086ffd640 1 -- 172.21.15.37:0/2629915964 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562228172df0 con 0x562227e53070 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.830+0000 7fc086ffd640 10 client.15885 handle_command_reply: tid=0 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.830+0000 7fc0b4059740 1 client.15885 shutdown 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.830+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 msgr2=0x56222821b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.830+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x56222821b0c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0059f0 tx=0x7fc09c005f30 comp rx=0 tx=0).stop 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 shutdown_connections 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x562227e53070 0x56222828de30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562227e2a1b0 0x562228215e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562227e119f0 0x56222821b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc086ffd640 0 client.15885 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 --2- 172.21.15.37:0/2629915964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562227de6da0 0x56222821b0c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 >> 172.21.15.37:0/2629915964 conn(0x562227e47460 msgr2=0x5622281fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 shutdown_connections 2024-09-21T01:17:52.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.831+0000 7fc0b4059740 1 -- 172.21.15.37:0/2629915964 wait complete. 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.832+0000 7fc0b4059740 20 client.15885 trim_cache size 0 max 16384 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0900b6590 msgr2=0x7fc0900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0900b6590 0x7fc0900b8aa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00ce410 tx=0x7fc0a0030810 comp rx=0 tx=0).stop 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 msgr2=0x7fc0a81a1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a81a1eb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005e30 tx=0x7fc0a0003ba0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 shutdown_connections 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc0900b6590 0x7fc0900b8aa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0a8108d20 0x7fc0a81a1eb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0a81083d0 0x7fc0a819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 --2- 172.21.15.37:0/3024849205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0a8102ae0 0x7fc0a819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.833+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 >> 172.21.15.37:0/3024849205 conn(0x7fc0a8079760 msgr2=0x7fc0a8105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.834+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 shutdown_connections 2024-09-21T01:17:52.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:51.834+0000 7fc0adae5640 1 -- 172.21.15.37:0/3024849205 wait complete. 2024-09-21T01:17:52.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:52 smithi144 ceph-mon[34818]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 2.20k op/s 2024-09-21T01:17:52.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:52 smithi137 ceph-mon[34607]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 2.20k op/s 2024-09-21T01:17:52.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:52 smithi037 ceph-mon[31105]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 2.20k op/s 2024-09-21T01:17:54.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:54 smithi137 ceph-mon[34607]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 912 MiB/s wr, 2.27k op/s 2024-09-21T01:17:54.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:54 smithi144 ceph-mon[34818]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 912 MiB/s wr, 2.27k op/s 2024-09-21T01:17:54.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:54 smithi037 ceph-mon[31105]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 912 MiB/s wr, 2.27k op/s 2024-09-21T01:17:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.708+0000 7f6e2b78b640 1 -- 172.21.15.37:0/3552176075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24102dd0 msgr2=0x7f6e241031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.708+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/3552176075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24102dd0 0x7f6e241031e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009900 tx=0x7f6e1402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 -- 172.21.15.37:0/3552176075 shutdown_connections 2024-09-21T01:17:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/3552176075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e24103770 0x7f6e2410a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/3552176075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24102dd0 0x7f6e241031e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/3552176075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e24101d50 0x7f6e241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 -- 172.21.15.37:0/3552176075 >> 172.21.15.37:0/3552176075 conn(0x7f6e240fd690 msgr2=0x7f6e240ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 -- 172.21.15.37:0/3552176075 shutdown_connections 2024-09-21T01:17:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.709+0000 7f6e2b78b640 1 -- 172.21.15.37:0/3552176075 wait complete. 2024-09-21T01:17:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.710+0000 7f6e2b78b640 1 Processor -- start 2024-09-21T01:17:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.710+0000 7f6e2b78b640 1 -- start start 2024-09-21T01:17:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.711+0000 7f6e2b78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 0x7f6e2419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.711+0000 7f6e2b78b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e24102dd0 0x7f6e2419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.711+0000 7f6e2b78b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e24103770 0x7f6e2419d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.711+0000 7f6e2b78b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2410da40 con 0x7f6e24101d50 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.711+0000 7f6e2b78b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2410d8c0 con 0x7f6e24102dd0 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e2b78b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2410dbc0 con 0x7f6e24103770 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 0x7f6e2419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 0x7f6e2419bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58520/0 (socket says 172.21.15.37:58520) 2024-09-21T01:17:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 -- 172.21.15.37:0/713404744 learned_addr learned my addr 172.21.15.37:0/713404744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 -- 172.21.15.37:0/713404744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e24103770 msgr2=0x7f6e2419d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e24103770 0x7f6e2419d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 -- 172.21.15.37:0/713404744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e24102dd0 msgr2=0x7f6e2419c660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:17:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e24102dd0 0x7f6e2419c660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.712+0000 7f6e29527640 1 -- 172.21.15.37:0/713404744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2419d9a0 con 0x7f6e24101d50 2024-09-21T01:17:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.713+0000 7f6e29527640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 0x7f6e2419bff0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000b4a0 tx=0x7f6e2000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.725+0000 7f6e1a7fc640 1 -- 172.21.15.37:0/713404744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20014070 con 0x7f6e24101d50 2024-09-21T01:17:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.725+0000 7f6e1a7fc640 1 -- 172.21.15.37:0/713404744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e20010ac0 con 0x7f6e24101d50 2024-09-21T01:17:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.725+0000 7f6e1a7fc640 1 -- 172.21.15.37:0/713404744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20017c30 con 0x7f6e24101d50 2024-09-21T01:17:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.726+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2419dc90 con 0x7f6e24101d50 2024-09-21T01:17:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.726+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e241a42b0 con 0x7f6e24101d50 2024-09-21T01:17:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.732+0000 7f6e327d4740 1 Processor -- start 2024-09-21T01:17:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 -- start start 2024-09-21T01:17:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 0x556ef67d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64082f0 0x556ef67d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64104d0 0x556ef67da010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ef674b6f0 con 0x556ef64311b0 2024-09-21T01:17:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556ef673ab20 con 0x556ef64104d0 2024-09-21T01:17:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.733+0000 7f6e327d4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ef673e930 con 0x556ef64082f0 2024-09-21T01:17:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.735+0000 7f6e29d28640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 0x556ef67d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.735+0000 7f6e29d28640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 0x556ef67d8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58528/0 (socket says 172.21.15.37:58528) 2024-09-21T01:17:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.735+0000 7f6e29d28640 1 -- 172.21.15.37:0/616473105 learned_addr learned my addr 172.21.15.37:0/616473105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.736+0000 7f6e29d28640 1 -- 172.21.15.37:0/616473105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64082f0 msgr2=0x556ef67d94c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.736+0000 7f6e29d28640 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64082f0 0x556ef67d94c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.736+0000 7f6e29d28640 1 -- 172.21.15.37:0/616473105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64104d0 msgr2=0x556ef67da010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.736+0000 7f6e29d28640 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64104d0 0x556ef67da010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.736+0000 7f6e29d28640 1 -- 172.21.15.37:0/616473105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef6700530 con 0x556ef64311b0 2024-09-21T01:17:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.738+0000 7f6e29d28640 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 0x556ef67d8e50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007cf0 tx=0x7f6e1c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a395e1a2fd768b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.741+0000 7f6e0f7fe640 1 -- 172.21.15.37:0/616473105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c014070 con 0x556ef64311b0 2024-09-21T01:17:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.741+0000 7f6e0f7fe640 1 -- 172.21.15.37:0/616473105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e1c00fb00 con 0x556ef64311b0 2024-09-21T01:17:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.744+0000 7f6e327d4740 1 -- 172.21.15.37:0/616473105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 msgr2=0x556ef67d8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.744+0000 7f6e327d4740 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 0x556ef67d8e50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007cf0 tx=0x7f6e1c00c6a0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.756+0000 7f6e1a7fc640 1 -- 172.21.15.37:0/713404744 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6e20017070 con 0x7f6e24101d50 2024-09-21T01:17:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.758+0000 7f6e1a7fc640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6e100b6660 0x7f6e100b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.759+0000 7f6e1a7fc640 1 -- 172.21.15.37:0/713404744 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6e200e4480 con 0x7f6e24101d50 2024-09-21T01:17:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.762+0000 7f6e29d28640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6e100b6660 0x7f6e100b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.764+0000 7f6e29d28640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6e100b6660 0x7f6e100b8b70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007cf0 tx=0x7f6e1c0079a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.782+0000 7f6e327d4740 1 -- 172.21.15.37:0/616473105 shutdown_connections 2024-09-21T01:17:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.782+0000 7f6e327d4740 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64104d0 0x556ef67da010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.782+0000 7f6e327d4740 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64082f0 0x556ef67d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.782+0000 7f6e327d4740 1 --2- 172.21.15.37:0/616473105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64311b0 0x556ef67d8e50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.782+0000 7f6e327d4740 1 -- 172.21.15.37:0/616473105 >> 172.21.15.37:0/616473105 conn(0x556ef6425300 msgr2=0x556ef67d48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.785+0000 7f6e327d4740 1 -- 172.21.15.37:0/616473105 shutdown_connections 2024-09-21T01:17:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.786+0000 7f6e327d4740 1 -- 172.21.15.37:0/616473105 wait complete. 2024-09-21T01:17:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.790+0000 7f6e327d4740 1 -- start start 2024-09-21T01:17:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.791+0000 7f6e327d4740 1 Processor -- start 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.792+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.792+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.792+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.793+0000 7f6e327d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ef6672ab0 con 0x556ef64082f0 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.793+0000 7f6e327d4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556ef66e0730 con 0x556ef64311b0 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.793+0000 7f6e327d4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ef67dab80 con 0x556ef64104d0 2024-09-21T01:17:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.793+0000 7f6e327d4740 10 client.0 _ll_register_callbacks cb 0x556ef67346b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.795+0000 7f6e29527640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.795+0000 7f6e29527640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58532/0 (socket says 172.21.15.37:58532) 2024-09-21T01:17:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.795+0000 7f6e29527640 1 -- 172.21.15.37:0/2851105927 learned_addr learned my addr 172.21.15.37:0/2851105927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.797+0000 7f6e28d26640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.797+0000 7f6e29d28640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.799+0000 7f6e29527640 1 -- 172.21.15.37:0/2851105927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 msgr2=0x556ef67f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.799+0000 7f6e29527640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.799+0000 7f6e29527640 1 -- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 msgr2=0x556ef67f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.799+0000 7f6e29527640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.799+0000 7f6e29527640 1 -- 172.21.15.37:0/2851105927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef649c790 con 0x556ef64082f0 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.800+0000 7f6e29527640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f3700 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6e200a8fd0 tx=0x7f6e200a8170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2351a7e0febdc97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.800+0000 7f6e0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.801+0000 7f6e0cff9640 1 -- 172.21.15.37:0/2851105927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001e070 con 0x556ef64082f0 2024-09-21T01:17:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.801+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c00fb00 con 0x556ef64082f0 2024-09-21T01:17:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.801+0000 7f6e0cff9640 1 -- 172.21.15.37:0/2851105927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6e200b6190 con 0x556ef64082f0 2024-09-21T01:17:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.802+0000 7f6e0cff9640 1 -- 172.21.15.37:0/2851105927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6e200b14e0 con 0x556ef64082f0 2024-09-21T01:17:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.802+0000 7f6e327d4740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.802+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ef6515620 con 0x556ef64082f0 2024-09-21T01:17:54.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.802+0000 7f6e0cff9640 1 -- 172.21.15.37:0/2851105927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e1c00fb00 con 0x556ef64082f0 2024-09-21T01:17:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e0cff9640 1 -- 172.21.15.37:0/2851105927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6e200a8350 con 0x556ef64082f0 2024-09-21T01:17:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e327d4740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e327d4740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e327d4740 20 client.15897 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e327d4740 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef63efd80 0x556ef6801340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e327d4740 4 client.15897 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.803+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ef674d640 con 0x556ef63efd80 2024-09-21T01:17:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.805+0000 7f6e28d26640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef63efd80 0x556ef6801340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.809+0000 7f6e28d26640 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef63efd80 0x556ef6801340 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70be8f721a80547 server_cookie=40dd1b57e4e8f6ec in_seq=0 out_seq=0 2024-09-21T01:17:54.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.810+0000 7f6e0cff9640 10 client.15897 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.816+0000 7f6e0cff9640 1 -- 172.21.15.37:0/2851105927 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ef674d640 con 0x556ef63efd80 2024-09-21T01:17:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.816+0000 7f6e0cff9640 10 client.15897 handle_command_reply: tid=0 2024-09-21T01:17:54.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.816+0000 7f6e327d4740 1 client.15897 shutdown 2024-09-21T01:17:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.823+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 msgr2=0x556ef67f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.823+0000 7f6e327d4740 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f3700 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6e200a8fd0 tx=0x7f6e200a8170 comp rx=0 tx=0).stop 2024-09-21T01:17:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 shutdown_connections 2024-09-21T01:17:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e327d4740 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef63efd80 0x556ef6801340 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e327d4740 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e327d4740 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e327d4740 1 --2- 172.21.15.37:0/2851105927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f3700 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 >> 172.21.15.37:0/2851105927 conn(0x556ef6425300 msgr2=0x556ef67d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.824+0000 7f6e0cff9640 0 client.15897 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.825+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 shutdown_connections 2024-09-21T01:17:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.825+0000 7f6e327d4740 1 -- 172.21.15.37:0/2851105927 wait complete. 2024-09-21T01:17:54.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.825+0000 7f6e327d4740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T01:17:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.888+0000 7f6e327d4740 1 Processor -- start 2024-09-21T01:17:54.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.888+0000 7f6e327d4740 1 -- start start 2024-09-21T01:17:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.889+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67dd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef68012d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e327d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0800e4f0 con 0x556ef64082f0 2024-09-21T01:17:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e327d4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e08010060 con 0x556ef64311b0 2024-09-21T01:17:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e29527640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e327d4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0800ebc0 con 0x556ef64104d0 2024-09-21T01:17:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e29527640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58546/0 (socket says 172.21.15.37:58546) 2024-09-21T01:17:54.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.890+0000 7f6e29527640 1 -- 172.21.15.37:0/1659953352 learned_addr learned my addr 172.21.15.37:0/1659953352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.891+0000 7f6e29527640 1 -- 172.21.15.37:0/1659953352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 msgr2=0x556ef67dd920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.891+0000 7f6e29527640 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67dd920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.891+0000 7f6e29527640 1 -- 172.21.15.37:0/1659953352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 msgr2=0x556ef68012d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.891+0000 7f6e29527640 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef68012d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.891+0000 7f6e29527640 1 -- 172.21.15.37:0/1659953352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef67f4e90 con 0x556ef64082f0 2024-09-21T01:17:54.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.893+0000 7f6e29527640 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f5090 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6e200b16a0 tx=0x7f6e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9041d4876522b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:54.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.895+0000 7f6e0effd640 1 -- 172.21.15.37:0/1659953352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001e070 con 0x556ef64082f0 2024-09-21T01:17:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.895+0000 7f6e0effd640 1 -- 172.21.15.37:0/1659953352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e200b6420 con 0x556ef64082f0 2024-09-21T01:17:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.895+0000 7f6e0effd640 1 -- 172.21.15.37:0/1659953352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200a8550 con 0x556ef64082f0 2024-09-21T01:17:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.897+0000 7f6e327d4740 1 -- 172.21.15.37:0/1659953352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 msgr2=0x556ef67f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.897+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f5090 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6e200b16a0 tx=0x7f6e200046c0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.903+0000 7f6e327d4740 1 -- 172.21.15.37:0/1659953352 shutdown_connections 2024-09-21T01:17:54.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.903+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef68012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.903+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef64104d0 0x556ef67dd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.903+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1659953352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64082f0 0x556ef67f5090 secure :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6e200b16a0 tx=0x7f6e200046c0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.903+0000 7f6e327d4740 1 -- 172.21.15.37:0/1659953352 >> 172.21.15.37:0/1659953352 conn(0x556ef6425300 msgr2=0x556ef67d9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.915+0000 7f6e327d4740 1 -- 172.21.15.37:0/1659953352 shutdown_connections 2024-09-21T01:17:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.915+0000 7f6e327d4740 1 -- 172.21.15.37:0/1659953352 wait complete. 2024-09-21T01:17:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.915+0000 7f6e327d4740 1 -- start start 2024-09-21T01:17:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.916+0000 7f6e327d4740 1 Processor -- start 2024-09-21T01:17:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64104d0 0x556ef67f8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef63c51c0 0x556ef67f9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0800f960 con 0x556ef64104d0 2024-09-21T01:17:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0800f290 con 0x556ef64311b0 2024-09-21T01:17:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0800c4b0 con 0x556ef63c51c0 2024-09-21T01:17:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.917+0000 7f6e327d4740 10 client.0 _ll_register_callbacks cb 0x7f6e200ac420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.918+0000 7f6e28d26640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.918+0000 7f6e28d26640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:34158/0 (socket says 172.21.15.37:34158) 2024-09-21T01:17:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.918+0000 7f6e28d26640 1 -- 172.21.15.37:0/1259717233 learned_addr learned my addr 172.21.15.37:0/1259717233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.918+0000 7f6e29d28640 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef63c51c0 0x556ef67f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.919+0000 7f6e29d28640 1 -- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 msgr2=0x556ef67f86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.919+0000 7f6e29d28640 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.919+0000 7f6e29d28640 1 -- 172.21.15.37:0/1259717233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64104d0 msgr2=0x556ef67f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.919+0000 7f6e29d28640 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64104d0 0x556ef67f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.919+0000 7f6e29d28640 1 -- 172.21.15.37:0/1259717233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef67f99c0 con 0x556ef63c51c0 2024-09-21T01:17:54.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.922+0000 7f6e29d28640 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef63c51c0 0x556ef67f9260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004a80 tx=0x7f6e1c01b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1168b9459ff309 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.928+0000 7f6e0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:17:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.928+0000 7f6e0cff9640 1 -- 172.21.15.37:0/1259717233 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c014040 con 0x556ef63c51c0 2024-09-21T01:17:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.928+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e200b6420 con 0x556ef63c51c0 2024-09-21T01:17:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.928+0000 7f6e0cff9640 1 -- 172.21.15.37:0/1259717233 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6e1c004d20 con 0x556ef63c51c0 2024-09-21T01:17:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.930+0000 7f6e0cff9640 1 -- 172.21.15.37:0/1259717233 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6e1c019570 con 0x556ef63c51c0 2024-09-21T01:17:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.932+0000 7f6e327d4740 10 client.25426 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.932+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ef67face0 con 0x556ef63c51c0 2024-09-21T01:17:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e0cff9640 1 -- 172.21.15.37:0/1259717233 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e200b6420 con 0x556ef63c51c0 2024-09-21T01:17:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e0cff9640 1 -- 172.21.15.37:0/1259717233 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6e1c038050 con 0x556ef63c51c0 2024-09-21T01:17:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e327d4740 10 client.25426 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e327d4740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:17:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e327d4740 20 client.25426 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:54.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef67fb790 0x556ef6876560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:54.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e327d4740 4 client.25426 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:17:54.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.935+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ef67490f0 con 0x556ef67fb790 2024-09-21T01:17:54.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.936+0000 7f6e29527640 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef67fb790 0x556ef6876560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:54.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.937+0000 7f6e0cff9640 10 client.25426 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:54.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:54.939+0000 7f6e29527640 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef67fb790 0x556ef6876560 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a5b43c452110af server_cookie=97c9b9109a055782 in_seq=0 out_seq=0 2024-09-21T01:17:55.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:17:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:17:56.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:56 smithi137 ceph-mon[34607]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 938 MiB/s wr, 2.32k op/s 2024-09-21T01:17:56.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:56 smithi144 ceph-mon[34818]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 938 MiB/s wr, 2.32k op/s 2024-09-21T01:17:56.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:56 smithi037 ceph-mon[31105]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 938 MiB/s wr, 2.32k op/s 2024-09-21T01:17:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 -- 172.21.15.37:0/4073393608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc107b30 msgr2=0x7fcccc107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 --2- 172.21.15.37:0/4073393608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc107b30 0x7fcccc107f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc001a910 tx=0x7fccc003c640 comp rx=0 tx=0).stop 2024-09-21T01:17:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 -- 172.21.15.37:0/4073393608 shutdown_connections 2024-09-21T01:17:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 --2- 172.21.15.37:0/4073393608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc108480 0x7fcccc10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 --2- 172.21.15.37:0/4073393608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc107b30 0x7fcccc107f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 --2- 172.21.15.37:0/4073393608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcccc1021f0 0x7fcccc102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.186+0000 7fccd16b2640 1 -- 172.21.15.37:0/4073393608 >> 172.21.15.37:0/4073393608 conn(0x7fcccc077c60 msgr2=0x7fcccc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.188+0000 7fccd16b2640 1 -- 172.21.15.37:0/4073393608 shutdown_connections 2024-09-21T01:17:57.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.188+0000 7fccd16b2640 1 -- 172.21.15.37:0/4073393608 wait complete. 2024-09-21T01:17:57.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.189+0000 7fccd16b2640 1 Processor -- start 2024-09-21T01:17:57.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.190+0000 7fccd16b2640 1 -- start start 2024-09-21T01:17:57.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.190+0000 7fccd16b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc1021f0 0x7fcccc10a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fccd16b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcccc107b30 0x7fcccc10ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fccd16b2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108480 0x7fcccc116940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fccd16b2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc06edf0 con 0x7fcccc107b30 2024-09-21T01:17:57.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fcccaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc1021f0 0x7fcccc10a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fcccaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc1021f0 0x7fcccc10a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41798/0 (socket says 172.21.15.37:41798) 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fcccaffd640 1 -- 172.21.15.37:0/634537647 learned_addr learned my addr 172.21.15.37:0/634537647 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc06ec70 con 0x7fcccc1021f0 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.191+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108480 0x7fcccc116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.192+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc06ef70 con 0x7fcccc108480 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.193+0000 7fccca7fc640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcccc107b30 0x7fcccc10ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.194+0000 7fcccb7fe640 1 -- 172.21.15.37:0/634537647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc1021f0 msgr2=0x7fcccc10a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.194+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc1021f0 0x7fcccc10a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.194+0000 7fcccb7fe640 1 -- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcccc107b30 msgr2=0x7fcccc10ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.194+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcccc107b30 0x7fcccc10ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.194+0000 7fcccb7fe640 1 -- 172.21.15.37:0/634537647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc116f00 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.195+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108480 0x7fcccc116940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccc400e940 tx=0x7fccc400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.195+0000 7fccb3fff640 1 -- 172.21.15.37:0/634537647 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4004d20 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.196+0000 7fccb3fff640 1 -- 172.21.15.37:0/634537647 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc4005020 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.196+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc1171f0 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.197+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc117700 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.197+0000 7fccb3fff640 1 -- 172.21.15.37:0/634537647 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40116d0 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.202+0000 7fccd7c26740 1 Processor -- start 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.204+0000 7fccb3fff640 1 -- 172.21.15.37:0/634537647 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fccc4005460 con 0x7fcccc108480 2024-09-21T01:17:57.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.205+0000 7fccd7c26740 1 -- start start 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.206+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe835f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.206+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.206+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe8360120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.206+0000 7fccd7c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbe82d5ea0 con 0x55bbe7f97390 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.206+0000 7fccd7c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbe82c52d0 con 0x55bbe7fb8070 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.206+0000 7fccd7c26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bbe82c90e0 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.208+0000 7fccca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe8360120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.208+0000 7fccca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe8360120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38278/0 (socket says 172.21.15.37:38278) 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.208+0000 7fccca7fc640 1 -- 172.21.15.37:0/2913037142 learned_addr learned my addr 172.21.15.37:0/2913037142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.208+0000 7fccca7fc640 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe835f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccca7fc640 1 -- 172.21.15.37:0/2913037142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 msgr2=0x55bbe835fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccca7fc640 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccca7fc640 1 -- 172.21.15.37:0/2913037142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 msgr2=0x55bbe835f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccca7fc640 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe835f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccca7fc640 1 -- 172.21.15.37:0/2913037142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe8023650 con 0x55bbe7f97390 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccb3fff640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fccb40b65d0 0x7fccb40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccca7fc640 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe8360120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fccc0005ab0 tx=0x7fccc0005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5e61595d1c65fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.209+0000 7fccb3fff640 1 -- 172.21.15.37:0/634537647 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fccc40e7240 con 0x7fcccc108480 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.210+0000 7fcccaffd640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fccb40b65d0 0x7fccb40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.210+0000 7fccb17fa640 1 -- 172.21.15.37:0/2913037142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0047040 con 0x55bbe7f97390 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.210+0000 7fccb17fa640 1 -- 172.21.15.37:0/2913037142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc0004a60 con 0x55bbe7f97390 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.211+0000 7fccd7c26740 1 -- 172.21.15.37:0/2913037142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 msgr2=0x55bbe8360120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.211+0000 7fcccaffd640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fccb40b65d0 0x7fccb40b8ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00b770 tx=0x7fccbc00b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccb17fa640 1 -- 172.21.15.37:0/2913037142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0047040 con 0x55bbe7f97390 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe8360120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fccc0005ab0 tx=0x7fccc0005a40 comp rx=0 tx=0).stop 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 -- 172.21.15.37:0/2913037142 shutdown_connections 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe8360120 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 --2- 172.21.15.37:0/2913037142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe835f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 -- 172.21.15.37:0/2913037142 >> 172.21.15.37:0/2913037142 conn(0x55bbe7fac460 msgr2=0x55bbe835d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.212+0000 7fccd7c26740 1 -- 172.21.15.37:0/2913037142 shutdown_connections 2024-09-21T01:17:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.213+0000 7fccd7c26740 1 -- 172.21.15.37:0/2913037142 wait complete. 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.213+0000 7fccd7c26740 1 -- start start 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 Processor -- start 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f8f1b0 0x55bbe836ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f97390 0x55bbe836b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 0x55bbe836b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbe8126700 con 0x55bbe7fb8070 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bbe8260160 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bbe836de70 con 0x55bbe7f97390 2024-09-21T01:17:57.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.214+0000 7fccd7c26740 10 client.0 _ll_register_callbacks cb 0x55bbe82799e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:57.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.215+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 0x55bbe836b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.215+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 0x55bbe836b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38284/0 (socket says 172.21.15.37:38284) 2024-09-21T01:17:57.362 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:17:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.215+0000 7fcccb7fe640 1 -- 172.21.15.37:0/3783740123 learned_addr learned my addr 172.21.15.37:0/3783740123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.215+0000 7fccca7fc640 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f97390 0x55bbe836b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fcccb7fe640 1 -- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f97390 msgr2=0x55bbe836b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f97390 0x55bbe836b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fcccb7fe640 1 -- 172.21.15.37:0/3783740123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f8f1b0 msgr2=0x55bbe836ac60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f8f1b0 0x55bbe836ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fcccb7fe640 1 -- 172.21.15.37:0/3783740123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe828dc90 con 0x55bbe7fb8070 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 0x55bbe836b6e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fccc40aa6f0 tx=0x7fccc40acdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1712ae833afef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.216+0000 7fccaeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.217+0000 7fccaeff5640 1 -- 172.21.15.37:0/3783740123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc401f070 con 0x55bbe7fb8070 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.217+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccc0004a60 con 0x55bbe7fb8070 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.217+0000 7fccaeff5640 1 -- 172.21.15.37:0/3783740123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fccc40ac6e0 con 0x55bbe7fb8070 2024-09-21T01:17:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.217+0000 7fccaeff5640 1 -- 172.21.15.37:0/3783740123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fccc40b1eb0 con 0x55bbe7fb8070 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.217+0000 7fccd7c26740 10 client.15912 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.217+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bbe8379b20 con 0x55bbe7fb8070 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccaeff5640 1 -- 172.21.15.37:0/3783740123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc0004a60 con 0x55bbe7fb8070 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccaeff5640 1 -- 172.21.15.37:0/3783740123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fccc400f040 con 0x55bbe7fb8070 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccd7c26740 10 client.15912 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccd7c26740 10 client.15912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccd7c26740 20 client.15912 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccd7c26740 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f769f0 0x55bbe837d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccd7c26740 4 client.15912 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.218+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbe82d7df0 con 0x55bbe7f769f0 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.220+0000 7fcccaffd640 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f769f0 0x55bbe837d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.222+0000 7fcccaffd640 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f769f0 0x55bbe837d470 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a345906bcb268af server_cookie=39eecb987136a24e in_seq=0 out_seq=0 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.222+0000 7fccaeff5640 10 client.15912 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.225+0000 7fccaeff5640 1 -- 172.21.15.37:0/3783740123 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bbe82d7df0 con 0x55bbe7f769f0 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.225+0000 7fccaeff5640 10 client.15912 handle_command_reply: tid=0 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.225+0000 7fccd7c26740 1 client.15912 shutdown 2024-09-21T01:17:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.225+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 msgr2=0x55bbe836b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.225+0000 7fccd7c26740 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 0x55bbe836b6e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fccc40aa6f0 tx=0x7fccc40acdd0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 shutdown_connections 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccd7c26740 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f769f0 0x55bbe837d470 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccd7c26740 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7fb8070 0x55bbe836b6e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccd7c26740 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f97390 0x55bbe836b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccd7c26740 1 --2- 172.21.15.37:0/3783740123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f8f1b0 0x55bbe836ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 >> 172.21.15.37:0/3783740123 conn(0x55bbe7fac460 msgr2=0x55bbe8362880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.226+0000 7fccaeff5640 0 client.15912 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.227+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 shutdown_connections 2024-09-21T01:17:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.227+0000 7fccd7c26740 1 -- 172.21.15.37:0/3783740123 wait complete. 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.229+0000 7fccd7c26740 20 client.15912 trim_cache size 0 max 16384 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.258+0000 7fccd7c26740 1 Processor -- start 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.258+0000 7fccd7c26740 1 -- start start 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f97390 0x55bbe835d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7fb8070 0x55bbe8367e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccd7c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b5ab0 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccd7c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b7620 con 0x55bbe7f97390 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccd7c26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b6180 con 0x55bbe7fb8070 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38286/0 (socket says 172.21.15.37:38286) 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccaffd640 1 -- 172.21.15.37:0/350501859 learned_addr learned my addr 172.21.15.37:0/350501859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fccca7fc640 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f97390 0x55bbe835d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7fb8070 0x55bbe8367e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccaffd640 1 -- 172.21.15.37:0/350501859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7fb8070 msgr2=0x55bbe8367e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccaffd640 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7fb8070 0x55bbe8367e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.259+0000 7fcccaffd640 1 -- 172.21.15.37:0/350501859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f97390 msgr2=0x55bbe835d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.260+0000 7fcccaffd640 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f97390 0x55bbe835d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.260+0000 7fcccaffd640 1 -- 172.21.15.37:0/350501859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe836bf20 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.260+0000 7fcccaffd640 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835cbc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fccbc005fd0 tx=0x7fccbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5936edf4e5a689ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.260+0000 7fccb0ff9640 1 -- 172.21.15.37:0/350501859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc02b070 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.260+0000 7fccb0ff9640 1 -- 172.21.15.37:0/350501859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc005030 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.260+0000 7fccb0ff9640 1 -- 172.21.15.37:0/350501859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc004bc0 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 -- 172.21.15.37:0/350501859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 msgr2=0x55bbe835cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835cbc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fccbc005fd0 tx=0x7fccbc013000 comp rx=0 tx=0).stop 2024-09-21T01:17:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 -- 172.21.15.37:0/350501859 shutdown_connections 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7fb8070 0x55bbe8367e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7f97390 0x55bbe835d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 --2- 172.21.15.37:0/350501859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f8f1b0 0x55bbe835cbc0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 -- 172.21.15.37:0/350501859 >> 172.21.15.37:0/350501859 conn(0x55bbe7fac460 msgr2=0x55bbe8361090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 -- 172.21.15.37:0/350501859 shutdown_connections 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 -- 172.21.15.37:0/350501859 wait complete. 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.262+0000 7fccd7c26740 1 -- start start 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.263+0000 7fccd7c26740 1 Processor -- start 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.263+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe8373640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.263+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe836ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.263+0000 7fccd7c26740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe836f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fccd7c26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b6f20 con 0x55bbe7f97390 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fccd7c26740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b6850 con 0x55bbe7fb8070 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fccd7c26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b3a70 con 0x55bbe7f8f1b0 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fccd7c26740 10 client.0 _ll_register_callbacks cb 0x7fccc4005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe836f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe836f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41824/0 (socket says 172.21.15.37:41824) 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fcccb7fe640 1 -- 172.21.15.37:0/1167371877 learned_addr learned my addr 172.21.15.37:0/1167371877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fccca7fc640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe836ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.264+0000 7fcccaffd640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe8373640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.265+0000 7fcccb7fe640 1 -- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 msgr2=0x55bbe8373640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.265+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe8373640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.265+0000 7fcccb7fe640 1 -- 172.21.15.37:0/1167371877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 msgr2=0x55bbe836ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.265+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe836ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.265+0000 7fcccb7fe640 1 -- 172.21.15.37:0/1167371877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe836f660 con 0x55bbe7fb8070 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.265+0000 7fcccb7fe640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe836f120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccc40e74e0 tx=0x7fccc40ac590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6715ca3b72ca99af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:17:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccaeff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:17:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccaeff5640 1 -- 172.21.15.37:0/1167371877 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc40c7070 con 0x55bbe7fb8070 2024-09-21T01:17:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccaeff5640 1 -- 172.21.15.37:0/1167371877 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fccc40b6330 con 0x55bbe7fb8070 2024-09-21T01:17:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccbc005030 con 0x55bbe7fb8070 2024-09-21T01:17:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccaeff5640 1 -- 172.21.15.37:0/1167371877 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fccc401f040 con 0x55bbe7fb8070 2024-09-21T01:17:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccd7c26740 10 client.25502 fetch_fsmap learned FSMap version 29 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.266+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bbe83e7ac0 con 0x55bbe7fb8070 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccaeff5640 1 -- 172.21.15.37:0/1167371877 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc005030 con 0x55bbe7fb8070 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccaeff5640 1 -- 172.21.15.37:0/1167371877 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fccc40b6530 con 0x55bbe7fb8070 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccd7c26740 10 client.25502 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccd7c26740 10 client.25502 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccd7c26740 20 client.25502 populate_metadata read hostname 'smithi037' 2024-09-21T01:17:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccd7c26740 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f4bda0 0x55bbe83ea280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccd7c26740 4 client.25502 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.267+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbe82d38a0 con 0x55bbe7f4bda0 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.268+0000 7fcccaffd640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f4bda0 0x55bbe83ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.268+0000 7fcccaffd640 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f4bda0 0x55bbe83ea280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=466be1d78fc1dda0 server_cookie=3c0cfb13803c4f08 in_seq=0 out_seq=0 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.268+0000 7fccaeff5640 10 client.25502 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccaeff5640 1 -- 172.21.15.37:0/1167371877 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbe82d38a0 con 0x55bbe7f4bda0 2024-09-21T01:17:57.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccaeff5640 10 client.25502 handle_command_reply: tid=0 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 client.25502 shutdown 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 msgr2=0x55bbe836f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe836f120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccc40e74e0 tx=0x7fccc40ac590 comp rx=0 tx=0).stop 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 shutdown_connections 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55bbe7f4bda0 0x55bbe83ea280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bbe7fb8070 0x55bbe836f120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbe7f97390 0x55bbe836ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 --2- 172.21.15.37:0/1167371877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbe7f8f1b0 0x55bbe8373640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 >> 172.21.15.37:0/1167371877 conn(0x55bbe7fac460 msgr2=0x55bbe8376a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.269+0000 7fccaeff5640 0 client.25502 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.270+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 shutdown_connections 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.270+0000 7fccd7c26740 1 -- 172.21.15.37:0/1167371877 wait complete. 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.270+0000 7fccd7c26740 20 client.25502 trim_cache size 0 max 16384 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fccb40b65d0 msgr2=0x7fccb40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fccb40b65d0 0x7fccb40b8ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00b770 tx=0x7fccbc00b700 comp rx=0 tx=0).stop 2024-09-21T01:17:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108480 msgr2=0x7fcccc116940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108480 0x7fcccc116940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccc400e940 tx=0x7fccc400ee00 comp rx=0 tx=0).stop 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 shutdown_connections 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fccb40b65d0 0x7fccb40b8ae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108480 0x7fcccc116940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcccc107b30 0x7fcccc10ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 --2- 172.21.15.37:0/634537647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcccc1021f0 0x7fcccc10a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.271+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 >> 172.21.15.37:0/634537647 conn(0x7fcccc077c60 msgr2=0x7fcccc105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.272+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 shutdown_connections 2024-09-21T01:17:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:17:57.272+0000 7fccd16b2640 1 -- 172.21.15.37:0/634537647 wait complete. 2024-09-21T01:17:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e0cff9640 1 -- 172.21.15.37:0/1259717233 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ef67490f0 con 0x556ef67fb790 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e0cff9640 10 client.25426 handle_command_reply: tid=0 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 client.25426 shutdown 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef63c51c0 msgr2=0x556ef67f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef63c51c0 0x556ef67f9260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004a80 tx=0x7f6e1c01b050 comp rx=0 tx=0).stop 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 shutdown_connections 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ef67fb790 0x556ef6876560 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ef63c51c0 0x556ef67f9260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ef64311b0 0x556ef67f86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 --2- 172.21.15.37:0/1259717233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ef64104d0 0x556ef67f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 >> 172.21.15.37:0/1259717233 conn(0x556ef6425300 msgr2=0x556ef67cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.399+0000 7f6e0cff9640 0 client.25426 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.400+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 shutdown_connections 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.400+0000 7f6e327d4740 1 -- 172.21.15.37:0/1259717233 wait complete. 2024-09-21T01:17:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.400+0000 7f6e327d4740 20 client.25426 trim_cache size 0 max 16384 2024-09-21T01:17:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:17:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:17:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:17:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:17:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.405+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6e100b6660 msgr2=0x7f6e100b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.405+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6e100b6660 0x7f6e100b8b70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007cf0 tx=0x7f6e1c0079a0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.405+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 msgr2=0x7f6e2419bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.405+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 0x7f6e2419bff0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000b4a0 tx=0x7f6e2000b960 comp rx=0 tx=0).stop 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.406+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 shutdown_connections 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.406+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6e100b6660 0x7f6e100b8b70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.406+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e24103770 0x7f6e2419d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.406+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e24102dd0 0x7f6e2419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.406+0000 7f6e2b78b640 1 --2- 172.21.15.37:0/713404744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e24101d50 0x7f6e2419bff0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:17:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.406+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 >> 172.21.15.37:0/713404744 conn(0x7f6e240fd690 msgr2=0x7f6e240ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:17:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.408+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 shutdown_connections 2024-09-21T01:17:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:17:57.408+0000 7f6e2b78b640 1 -- 172.21.15.37:0/713404744 wait complete. 2024-09-21T01:17:58.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:17:58 smithi144 ceph-mon[34818]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 1.99k op/s 2024-09-21T01:17:58.433 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:17:58 smithi137 ceph-mon[34607]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 1.99k op/s 2024-09-21T01:17:58.455 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:17:58 smithi037 ceph-mon[31105]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 1.99k op/s 2024-09-21T01:18:00.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:00 smithi037 ceph-mon[31105]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 993 MiB/s wr, 2.42k op/s 2024-09-21T01:18:00.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:18:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:00 smithi137 ceph-mon[34607]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 993 MiB/s wr, 2.42k op/s 2024-09-21T01:18:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:00 smithi144 ceph-mon[34818]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 993 MiB/s wr, 2.42k op/s 2024-09-21T01:18:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:02 smithi037 ceph-mon[31105]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 818 MiB/s wr, 1.75k op/s 2024-09-21T01:18:02.471 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:02 smithi137 ceph-mon[34607]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 818 MiB/s wr, 1.75k op/s 2024-09-21T01:18:02.472 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:02 smithi144 ceph-mon[34818]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 818 MiB/s wr, 1.75k op/s 2024-09-21T01:18:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 -- 172.21.15.37:0/719806321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c111cd0 msgr2=0x7f311c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 --2- 172.21.15.37:0/719806321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c111cd0 0x7f311c10d6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3110009860 tx=0x7f311002a360 comp rx=0 tx=0).stop 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 -- 172.21.15.37:0/719806321 shutdown_connections 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 --2- 172.21.15.37:0/719806321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c11cba0 0x7f311c11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 --2- 172.21.15.37:0/719806321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c10dbf0 0x7f311c10e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 --2- 172.21.15.37:0/719806321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c111cd0 0x7f311c10d6b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.711+0000 7f3121418640 1 -- 172.21.15.37:0/719806321 >> 172.21.15.37:0/719806321 conn(0x7f311c06e9f0 msgr2=0x7f311c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.721+0000 7f3121418640 1 -- 172.21.15.37:0/719806321 shutdown_connections 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.723+0000 7f3121418640 1 -- 172.21.15.37:0/719806321 wait complete. 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.725+0000 7f3121418640 1 Processor -- start 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.726+0000 7f3121418640 1 -- start start 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.727+0000 7f3121418640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c10dbf0 0x7f311c11c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.727+0000 7f3121418640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c11cba0 0x7f311c118420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.727+0000 7f3121418640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c118960 0x7f311c118d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.727+0000 7f3121418640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311c114bf0 con 0x7f311c11cba0 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.727+0000 7f3121418640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f311c114a70 con 0x7f311c118960 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.727+0000 7f3121418640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f311c114d70 con 0x7f311c10dbf0 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.728+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c11cba0 0x7f311c118420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.728+0000 7f3120c17640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c118960 0x7f311c118d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.728+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c11cba0 0x7f311c118420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38318/0 (socket says 172.21.15.37:38318) 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.728+0000 7f311b7fe640 1 -- 172.21.15.37:0/3261495097 learned_addr learned my addr 172.21.15.37:0/3261495097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.729+0000 7f311bfff640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c10dbf0 0x7f311c11c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.729+0000 7f3120c17640 1 -- 172.21.15.37:0/3261495097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c10dbf0 msgr2=0x7f311c11c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.729+0000 7f3120c17640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c10dbf0 0x7f311c11c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.729+0000 7f3120c17640 1 -- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c11cba0 msgr2=0x7f311c118420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.729+0000 7f3120c17640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c11cba0 0x7f311c118420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.729+0000 7f3120c17640 1 -- 172.21.15.37:0/3261495097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1acc00 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.732+0000 7f3120c17640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c118960 0x7f311c118d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f310c01f950 tx=0x7f310c01fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.733+0000 7f31197fa640 1 -- 172.21.15.37:0/3261495097 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c01db90 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.733+0000 7f31197fa640 1 -- 172.21.15.37:0/3261495097 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310c01dd30 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.733+0000 7f31197fa640 1 -- 172.21.15.37:0/3261495097 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c004a00 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.735+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1ace90 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.735+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1ad290 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.746+0000 7f31197fa640 1 -- 172.21.15.37:0/3261495097 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f310c004ba0 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.748+0000 7f31197fa640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f31040b65c0 0x7f31040b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.749+0000 7f31197fa640 1 -- 172.21.15.37:0/3261495097 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f310c0f8fb0 con 0x7f311c118960 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.749+0000 7f3128bee740 1 Processor -- start 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.750+0000 7f311bfff640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f31040b65c0 0x7f31040b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.751+0000 7f311bfff640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f31040b65c0 0x7f31040b8ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3110009830 tx=0x7f3110009370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.754+0000 7f3128bee740 1 -- start start 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.755+0000 7f3128bee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.755+0000 7f3128bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.755+0000 7f3128bee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.755+0000 7f3128bee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563c74945ea0 con 0x563c74607390 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.755+0000 7f3128bee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563c749352d0 con 0x563c74628070 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.755+0000 7f3128bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563c749390e0 con 0x563c745ff1b0 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.758+0000 7f3120c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.758+0000 7f3120c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38324/0 (socket says 172.21.15.37:38324) 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.758+0000 7f3120c17640 1 -- 172.21.15.37:0/2200716760 learned_addr learned my addr 172.21.15.37:0/2200716760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.758+0000 7f311b7fe640 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.761+0000 7f311bfff640 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.764+0000 7f3120c17640 1 -- 172.21.15.37:0/2200716760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 msgr2=0x563c749cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.764+0000 7f3120c17640 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.764+0000 7f3120c17640 1 -- 172.21.15.37:0/2200716760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 msgr2=0x563c749cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.764+0000 7f3120c17640 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.764+0000 7f3120c17640 1 -- 172.21.15.37:0/2200716760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c74693650 con 0x563c74607390 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.773+0000 7f3120c17640 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749cfee0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f310c0bb7b0 tx=0x7f310c0052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a39786f9d42662 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.778+0000 7f31027fc640 1 -- 172.21.15.37:0/2200716760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c02d070 con 0x563c74607390 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.778+0000 7f31027fc640 1 -- 172.21.15.37:0/2200716760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310c0becf0 con 0x563c74607390 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.779+0000 7f3128bee740 1 -- 172.21.15.37:0/2200716760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 msgr2=0x563c749cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.779+0000 7f3128bee740 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749cfee0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f310c0bb7b0 tx=0x7f310c0052e0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.786+0000 7f3128bee740 1 -- 172.21.15.37:0/2200716760 shutdown_connections 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.786+0000 7f3128bee740 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749cfee0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.786+0000 7f3128bee740 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.786+0000 7f3128bee740 1 --2- 172.21.15.37:0/2200716760 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.786+0000 7f3128bee740 1 -- 172.21.15.37:0/2200716760 >> 172.21.15.37:0/2200716760 conn(0x563c7461c460 msgr2=0x563c749cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.789+0000 7f3128bee740 1 -- 172.21.15.37:0/2200716760 shutdown_connections 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.790+0000 7f3128bee740 1 -- 172.21.15.37:0/2200716760 wait complete. 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.791+0000 7f3128bee740 1 -- start start 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.792+0000 7f3128bee740 1 Processor -- start 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749daab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749daff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563c74796700 con 0x563c74607390 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563c748d0160 con 0x563c74628070 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563c749ddc30 con 0x563c745ff1b0 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.793+0000 7f3128bee740 10 client.0 _ll_register_callbacks cb 0x563c748e99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.796+0000 7f3120c17640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.796+0000 7f311bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749daab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.798+0000 7f311bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749daab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59968/0 (socket says 172.21.15.37:59968) 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.798+0000 7f311bfff640 1 -- 172.21.15.37:0/404051356 learned_addr learned my addr 172.21.15.37:0/404051356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.798+0000 7f311b7fe640 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749daff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.802+0000 7f311b7fe640 1 -- 172.21.15.37:0/404051356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 msgr2=0x563c749daab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.802+0000 7f311b7fe640 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749daab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.802+0000 7f311b7fe640 1 -- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 msgr2=0x563c749e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.802+0000 7f311b7fe640 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.802+0000 7f311b7fe640 1 -- 172.21.15.37:0/404051356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c748fdc90 con 0x563c74607390 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.806+0000 7f311b7fe640 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749daff0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f311c110ee0 tx=0x7f3114004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0dff6c71c42d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.807+0000 7f30fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.811+0000 7f30fb7fe640 1 -- 172.21.15.37:0/404051356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114012850 con 0x563c74607390 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.811+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310c0becf0 con 0x563c74607390 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.811+0000 7f30fb7fe640 1 -- 172.21.15.37:0/404051356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f31140129f0 con 0x563c74607390 2024-09-21T01:18:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.812+0000 7f30fb7fe640 1 -- 172.21.15.37:0/404051356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3114012bf0 con 0x563c74607390 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.813+0000 7f3128bee740 10 client.15930 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.813+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c749e9a10 con 0x563c74607390 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.813+0000 7f30fb7fe640 1 -- 172.21.15.37:0/404051356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310c0becf0 con 0x563c74607390 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.813+0000 7f30fb7fe640 1 -- 172.21.15.37:0/404051356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f311400f040 con 0x563c74607390 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.814+0000 7f3128bee740 10 client.15930 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.814+0000 7f3128bee740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.814+0000 7f3128bee740 20 client.15930 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.814+0000 7f3128bee740 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c745e69f0 0x563c749ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.814+0000 7f3128bee740 4 client.15930 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.814+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c74947df0 con 0x563c745e69f0 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.816+0000 7f311bfff640 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c745e69f0 0x563c749ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.818+0000 7f311bfff640 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c745e69f0 0x563c749ecf60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b08dd47d9ce3962 server_cookie=b2546c1d3fbd1d24 in_seq=0 out_seq=0 2024-09-21T01:18:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.818+0000 7f30fb7fe640 10 client.15930 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.825+0000 7f30fb7fe640 1 -- 172.21.15.37:0/404051356 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c74947df0 con 0x563c745e69f0 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.825+0000 7f30fb7fe640 10 client.15930 handle_command_reply: tid=0 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.826+0000 7f3128bee740 1 client.15930 shutdown 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 msgr2=0x563c749daff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749daff0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f311c110ee0 tx=0x7f3114004410 comp rx=0 tx=0).stop 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 shutdown_connections 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c745e69f0 0x563c749ecf60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74628070 0x563c749e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c74607390 0x563c749daff0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 --2- 172.21.15.37:0/404051356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c745ff1b0 0x563c749daab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 >> 172.21.15.37:0/404051356 conn(0x563c7461c460 msgr2=0x563c749d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.831+0000 7f30fb7fe640 0 client.15930 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.833+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 shutdown_connections 2024-09-21T01:18:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.835+0000 7f3128bee740 1 -- 172.21.15.37:0/404051356 wait complete. 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.835+0000 7f3128bee740 20 client.15930 trim_cache size 0 max 16384 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.872+0000 7f3128bee740 1 Processor -- start 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.874+0000 7f3128bee740 1 -- start start 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.875+0000 7f3128bee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 0x563c749d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.875+0000 7f3128bee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.876+0000 7f3128bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.876+0000 7f3128bee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b5c00 con 0x563c745ff1b0 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.876+0000 7f3128bee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b7770 con 0x563c74607390 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.876+0000 7f3128bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b62d0 con 0x563c74628070 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.878+0000 7f3120c17640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.878+0000 7f311bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 0x563c749d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.878+0000 7f311bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 0x563c749d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38346/0 (socket says 172.21.15.37:38346) 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.878+0000 7f311bfff640 1 -- 172.21.15.37:0/1502465983 learned_addr learned my addr 172.21.15.37:0/1502465983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.878+0000 7f311b7fe640 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.879+0000 7f311bfff640 1 -- 172.21.15.37:0/1502465983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 msgr2=0x563c749cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.879+0000 7f311bfff640 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.879+0000 7f311bfff640 1 -- 172.21.15.37:0/1502465983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 msgr2=0x563c749dc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.879+0000 7f311bfff640 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749dc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.879+0000 7f311bfff640 1 -- 172.21.15.37:0/1502465983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c749db3a0 con 0x563c745ff1b0 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.881+0000 7f311bfff640 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 0x563c749d0e50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f311002a950 tx=0x7f311003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c170b9c6b33d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.882+0000 7f3101ffb640 1 -- 172.21.15.37:0/1502465983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110057070 con 0x563c745ff1b0 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.883+0000 7f3101ffb640 1 -- 172.21.15.37:0/1502465983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3110042040 con 0x563c745ff1b0 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.884+0000 7f3128bee740 1 -- 172.21.15.37:0/1502465983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 msgr2=0x563c749d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.884+0000 7f3128bee740 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 0x563c749d0e50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f311002a950 tx=0x7f311003f000 comp rx=0 tx=0).stop 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.885+0000 7f3128bee740 1 -- 172.21.15.37:0/1502465983 shutdown_connections 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.885+0000 7f3128bee740 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.885+0000 7f3128bee740 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749dc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.885+0000 7f3128bee740 1 --2- 172.21.15.37:0/1502465983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745ff1b0 0x563c749d0e50 secure :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f311002a950 tx=0x7f311003f000 comp rx=0 tx=0).stop 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.885+0000 7f3128bee740 1 -- 172.21.15.37:0/1502465983 >> 172.21.15.37:0/1502465983 conn(0x563c7461c460 msgr2=0x563c749dbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.888+0000 7f3128bee740 1 -- 172.21.15.37:0/1502465983 shutdown_connections 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.889+0000 7f3128bee740 1 -- 172.21.15.37:0/1502465983 wait complete. 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.890+0000 7f3128bee740 1 -- start start 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.890+0000 7f3128bee740 1 Processor -- start 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.891+0000 7f3128bee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749e3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.893+0000 7f3128bee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749debd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.894+0000 7f3128bee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745bbda0 0x563c749df150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.894+0000 7f3128bee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b7070 con 0x563c745bbda0 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.894+0000 7f3128bee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b69a0 con 0x563c74607390 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.894+0000 7f3128bee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b3bc0 con 0x563c74628070 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.894+0000 7f3128bee740 10 client.0 _ll_register_callbacks cb 0x7f3114009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749debd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59980/0 (socket says 172.21.15.37:59980) 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 -- 172.21.15.37:0/1847123209 learned_addr learned my addr 172.21.15.37:0/1847123209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 -- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 msgr2=0x563c749e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 -- 172.21.15.37:0/1847123209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745bbda0 msgr2=0x563c749df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745bbda0 0x563c749df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.895+0000 7f311b7fe640 1 -- 172.21.15.37:0/1847123209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c749df8e0 con 0x563c74628070 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.897+0000 7f311b7fe640 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749debd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3114005fa0 tx=0x7f3114009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e318f8a1702b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.897+0000 7f30fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.897+0000 7f30fb7fe640 1 -- 172.21.15.37:0/1847123209 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311402a070 con 0x563c74628070 2024-09-21T01:18:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.898+0000 7f30fb7fe640 1 -- 172.21.15.37:0/1847123209 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3114012860 con 0x563c74628070 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.899+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3110042040 con 0x563c74628070 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.905+0000 7f30fb7fe640 1 -- 172.21.15.37:0/1847123209 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f311401b430 con 0x563c74628070 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.907+0000 7f3128bee740 10 client.25456 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.907+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c74a578a0 con 0x563c74628070 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.908+0000 7f30fb7fe640 1 -- 172.21.15.37:0/1847123209 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3110042040 con 0x563c74628070 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.909+0000 7f30fb7fe640 1 -- 172.21.15.37:0/1847123209 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f3114025820 con 0x563c74628070 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.910+0000 7f3128bee740 10 client.25456 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.910+0000 7f3128bee740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.910+0000 7f3128bee740 20 client.25456 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.910+0000 7f3128bee740 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c74a58030 0x563c74a5a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.910+0000 7f3128bee740 4 client.25456 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.910+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c749438a0 con 0x563c74a58030 2024-09-21T01:18:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.913+0000 7f311bfff640 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c74a58030 0x563c74a5a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.921+0000 7f311bfff640 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c74a58030 0x563c74a5a470 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c419fbdd7b68802b server_cookie=44e7e0ff932b15a2 in_seq=0 out_seq=0 2024-09-21T01:18:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.921+0000 7f30fb7fe640 10 client.25456 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.923+0000 7f30fb7fe640 1 -- 172.21.15.37:0/1847123209 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c749438a0 con 0x563c74a58030 2024-09-21T01:18:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.923+0000 7f30fb7fe640 10 client.25456 handle_command_reply: tid=0 2024-09-21T01:18:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.923+0000 7f3128bee740 1 client.25456 shutdown 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 msgr2=0x563c749debd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749debd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3114005fa0 tx=0x7f3114009d80 comp rx=0 tx=0).stop 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 shutdown_connections 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563c74a58030 0x563c74a5a470 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c745bbda0 0x563c749df150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c74628070 0x563c749debd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 --2- 172.21.15.37:0/1847123209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563c74607390 0x563c749e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 >> 172.21.15.37:0/1847123209 conn(0x563c7461c460 msgr2=0x563c749d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.925+0000 7f30fb7fe640 0 client.25456 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:02.935 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:18:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.927+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 shutdown_connections 2024-09-21T01:18:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.927+0000 7f3128bee740 1 -- 172.21.15.37:0/1847123209 wait complete. 2024-09-21T01:18:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.927+0000 7f3128bee740 20 client.25456 trim_cache size 0 max 16384 2024-09-21T01:18:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.929+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f31040b65c0 msgr2=0x7f31040b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.929+0000 7f3121418640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f31040b65c0 0x7f31040b8ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3110009830 tx=0x7f3110009370 comp rx=0 tx=0).stop 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.930+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c118960 msgr2=0x7f311c118d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.930+0000 7f3121418640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c118960 0x7f311c118d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f310c01f950 tx=0x7f310c01fe10 comp rx=0 tx=0).stop 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.931+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 shutdown_connections 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.932+0000 7f3121418640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f31040b65c0 0x7f31040b8ad0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.932+0000 7f3121418640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f311c118960 0x7f311c118d70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.932+0000 7f3121418640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c11cba0 0x7f311c118420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.932+0000 7f3121418640 1 --2- 172.21.15.37:0/3261495097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f311c10dbf0 0x7f311c11c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.932+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 >> 172.21.15.37:0/3261495097 conn(0x7f311c06e9f0 msgr2=0x7f311c10c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.933+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 shutdown_connections 2024-09-21T01:18:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:02.934+0000 7f3121418640 1 -- 172.21.15.37:0/3261495097 wait complete. 2024-09-21T01:18:04.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:04 smithi037 ceph-mon[31105]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 908 MiB/s wr, 1.93k op/s 2024-09-21T01:18:04.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:04 smithi137 ceph-mon[34607]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 908 MiB/s wr, 1.93k op/s 2024-09-21T01:18:04.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:04 smithi144 ceph-mon[34818]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 908 MiB/s wr, 1.93k op/s 2024-09-21T01:18:06.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:06 smithi037 ceph-mon[31105]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 930 MiB/s wr, 2.32k op/s 2024-09-21T01:18:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:06 smithi137 ceph-mon[34607]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 930 MiB/s wr, 2.32k op/s 2024-09-21T01:18:06.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:06 smithi144 ceph-mon[34818]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 930 MiB/s wr, 2.32k op/s 2024-09-21T01:18:07.083 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:18:07.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:18:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:18:08.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:08 smithi037 ceph-mon[31105]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 784 MiB/s wr, 2.05k op/s 2024-09-21T01:18:08.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:08 smithi137 ceph-mon[34607]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 784 MiB/s wr, 2.05k op/s 2024-09-21T01:18:08.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:08 smithi144 ceph-mon[34818]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 784 MiB/s wr, 2.05k op/s 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.593+0000 7f512f355640 1 -- 172.21.15.37:0/2987031658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128101e50 msgr2=0x7f5128102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.593+0000 7f512f355640 1 --2- 172.21.15.37:0/2987031658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128101e50 0x7f5128102260 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5118009900 tx=0x7f511802a440 comp rx=0 tx=0).stop 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.597+0000 7f512f355640 1 -- 172.21.15.37:0/2987031658 shutdown_connections 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.597+0000 7f512f355640 1 --2- 172.21.15.37:0/2987031658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51281069f0 0x7f5128110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.597+0000 7f512f355640 1 --2- 172.21.15.37:0/2987031658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51281060a0 0x7f51281064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.597+0000 7f512f355640 1 --2- 172.21.15.37:0/2987031658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5128101e50 0x7f5128102260 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.597+0000 7f512f355640 1 -- 172.21.15.37:0/2987031658 >> 172.21.15.37:0/2987031658 conn(0x7f5128077aa0 msgr2=0x7f5128077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.598+0000 7f512f355640 1 -- 172.21.15.37:0/2987031658 shutdown_connections 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.598+0000 7f512f355640 1 -- 172.21.15.37:0/2987031658 wait complete. 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.599+0000 7f512f355640 1 Processor -- start 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.599+0000 7f512f355640 1 -- start start 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512f355640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5128101e50 0x7f512810dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512f355640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51281060a0 0x7f512810e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512f355640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 0x7f51281ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512f355640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5128104920 con 0x7f51281069f0 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512f355640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f51281047a0 con 0x7f51281060a0 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512f355640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5128104aa0 con 0x7f5128101e50 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.600+0000 7f512db52640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51281060a0 0x7f512810e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.601+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 0x7f51281ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.601+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 0x7f51281ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49718/0 (socket says 172.21.15.37:49718) 2024-09-21T01:18:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.601+0000 7f512eb54640 1 -- 172.21.15.37:0/2277657769 learned_addr learned my addr 172.21.15.37:0/2277657769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.602+0000 7f512eb54640 1 -- 172.21.15.37:0/2277657769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5128101e50 msgr2=0x7f512810dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.602+0000 7f512eb54640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5128101e50 0x7f512810dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.602+0000 7f512eb54640 1 -- 172.21.15.37:0/2277657769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51281060a0 msgr2=0x7f512810e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.602+0000 7f512eb54640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51281060a0 0x7f512810e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.602+0000 7f512eb54640 1 -- 172.21.15.37:0/2277657769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51281acc90 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.602+0000 7f512eb54640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 0x7f51281ac750 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f512000b990 tx=0x7f512000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.603+0000 7f511f7fe640 1 -- 172.21.15.37:0/2277657769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120019070 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.603+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51281acec0 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.603+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51281ad320 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.603+0000 7f511f7fe640 1 -- 172.21.15.37:0/2277657769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f512000cba0 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.603+0000 7f511f7fe640 1 -- 172.21.15.37:0/2277657769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200075d0 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.608+0000 7f511f7fe640 1 -- 172.21.15.37:0/2277657769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f512001c070 con 0x7f51281069f0 2024-09-21T01:18:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.610+0000 7f511f7fe640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51140b6510 0x7f51140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.610+0000 7f511f7fe640 1 -- 172.21.15.37:0/2277657769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f51200e66f0 con 0x7f51281069f0 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.611+0000 7f5136b2b740 1 Processor -- start 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.611+0000 7f512e353640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51140b6510 0x7f51140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.611+0000 7f5136b2b740 1 -- start start 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065ed350 0x55f906994610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065c4490 0x55f906994b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f906995090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f5136b2b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f90690ae60 con 0x55f9065cc670 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f5136b2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f9068fa290 con 0x55f9065ed350 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f5136b2b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f9068fe0a0 con 0x55f9065c4490 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f512e353640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51140b6510 0x7f51140b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f511802a960 tx=0x7f5118000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f906995090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f906995090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49734/0 (socket says 172.21.15.37:49734) 2024-09-21T01:18:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f512eb54640 1 -- 172.21.15.37:0/702671474 learned_addr learned my addr 172.21.15.37:0/702671474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.612+0000 7f512e353640 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065ed350 0x55f906994610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.613+0000 7f512eb54640 1 -- 172.21.15.37:0/702671474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065c4490 msgr2=0x55f906994b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.613+0000 7f512eb54640 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065c4490 0x55f906994b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.613+0000 7f512eb54640 1 -- 172.21.15.37:0/702671474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065ed350 msgr2=0x55f906994610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.613+0000 7f512eb54640 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065ed350 0x55f906994610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.613+0000 7f512eb54640 1 -- 172.21.15.37:0/702671474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f906658930 con 0x55f9065cc670 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.613+0000 7f512eb54640 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f906995090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f51200ac540 tx=0x7f51200ac690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef27608447e426b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.614+0000 7f511cff9640 1 -- 172.21.15.37:0/702671474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200acf40 con 0x55f9065cc670 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.614+0000 7f511cff9640 1 -- 172.21.15.37:0/702671474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51200b1320 con 0x55f9065cc670 2024-09-21T01:18:09.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.614+0000 7f511cff9640 1 -- 172.21.15.37:0/702671474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200ab510 con 0x55f9065cc670 2024-09-21T01:18:09.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.615+0000 7f5136b2b740 1 -- 172.21.15.37:0/702671474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 msgr2=0x55f906995090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.615+0000 7f5136b2b740 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f906995090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f51200ac540 tx=0x7f51200ac690 comp rx=0 tx=0).stop 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 -- 172.21.15.37:0/702671474 shutdown_connections 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f906995090 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065c4490 0x55f906994b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 --2- 172.21.15.37:0/702671474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065ed350 0x55f906994610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 -- 172.21.15.37:0/702671474 >> 172.21.15.37:0/702671474 conn(0x55f9065e1740 msgr2=0x55f906992500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 -- 172.21.15.37:0/702671474 shutdown_connections 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.619+0000 7f5136b2b740 1 -- 172.21.15.37:0/702671474 wait complete. 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.620+0000 7f5136b2b740 1 -- start start 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.620+0000 7f5136b2b740 1 Processor -- start 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065ed350 0x55f9069ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f90675b890 con 0x55f9065cc670 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f906894d40 con 0x55f9065c4490 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f9069a2e30 con 0x55f9065ed350 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f5136b2b740 10 client.0 _ll_register_callbacks cb 0x55f9068f8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f512db52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.621+0000 7f512e353640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.622+0000 7f512e353640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43430/0 (socket says 172.21.15.37:43430) 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.622+0000 7f512e353640 1 -- 172.21.15.37:0/2142798418 learned_addr learned my addr 172.21.15.37:0/2142798418 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.622+0000 7f512e353640 1 -- 172.21.15.37:0/2142798418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065ed350 msgr2=0x55f9069ac1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.622+0000 7f512e353640 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065ed350 0x55f9069ac1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.623+0000 7f512e353640 1 -- 172.21.15.37:0/2142798418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 msgr2=0x55f9069a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.623+0000 7f512e353640 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.623+0000 7f512e353640 1 -- 172.21.15.37:0/2142798418 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9069ac6f0 con 0x55f9065c4490 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.624+0000 7f512e353640 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a0120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5118033000 tx=0x7f5118009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b761e5a81cc081 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:09.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.624+0000 7f5111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.624+0000 7f5111ffb640 1 -- 172.21.15.37:0/2142798418 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511804c070 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.625+0000 7f5111ffb640 1 -- 172.21.15.37:0/2142798418 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5118031900 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.625+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51200b1320 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.626+0000 7f5111ffb640 1 -- 172.21.15.37:0/2142798418 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5118040070 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.627+0000 7f5136b2b740 10 client.25520 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.627+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f9069af000 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.628+0000 7f5111ffb640 1 -- 172.21.15.37:0/2142798418 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5118048420 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.628+0000 7f5111ffb640 1 -- 172.21.15.37:0/2142798418 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f511803a3f0 con 0x55f9065c4490 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.628+0000 7f5136b2b740 10 client.25520 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.628+0000 7f5136b2b740 10 client.25520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.628+0000 7f5136b2b740 20 client.25520 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.629+0000 7f5136b2b740 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065abcd0 0x55f9069b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.629+0000 7f5136b2b740 4 client.25520 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:09.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.629+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f51200b1320 con 0x55f9065abcd0 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.630+0000 7f512db52640 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065abcd0 0x55f9069b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.633+0000 7f5111ffb640 10 client.25520 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.633+0000 7f512db52640 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065abcd0 0x55f9069b25a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3553330e7d2de7b0 server_cookie=8fde0592b309f2f6 in_seq=0 out_seq=0 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.636+0000 7f5111ffb640 1 -- 172.21.15.37:0/2142798418 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f51200b1320 con 0x55f9065abcd0 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.636+0000 7f5111ffb640 10 client.25520 handle_command_reply: tid=0 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.636+0000 7f5136b2b740 1 client.25520 shutdown 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.636+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 msgr2=0x55f9069a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a0120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5118033000 tx=0x7f5118009260 comp rx=0 tx=0).stop 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 shutdown_connections 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065abcd0 0x55f9069b25a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065ed350 0x55f9069ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5111ffb640 0 client.25520 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:09.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 --2- 172.21.15.37:0/2142798418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a0120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 >> 172.21.15.37:0/2142798418 conn(0x55f9065e1740 msgr2=0x55f9069977a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 shutdown_connections 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 1 -- 172.21.15.37:0/2142798418 wait complete. 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.637+0000 7f5136b2b740 20 client.25520 trim_cache size 0 max 16384 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.657+0000 7f5136b2b740 1 Processor -- start 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.657+0000 7f5136b2b740 1 -- start start 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f906992560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f90699d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f5136b2b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00e590 con 0x55f9065cc670 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f5136b2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f510c010100 con 0x55f9065c4490 2024-09-21T01:18:09.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f5136b2b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00ec60 con 0x55f9065abcd0 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f90699d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f90699d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49754/0 (socket says 172.21.15.37:49754) 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f512eb54640 1 -- 172.21.15.37:0/1643000064 learned_addr learned my addr 172.21.15.37:0/1643000064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.658+0000 7f512db52640 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f512eb54640 1 -- 172.21.15.37:0/1643000064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 msgr2=0x55f906992560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f512eb54640 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f906992560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f512eb54640 1 -- 172.21.15.37:0/1643000064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 msgr2=0x55f9069ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f512eb54640 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f512eb54640 1 -- 172.21.15.37:0/1643000064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9069a11e0 con 0x55f9065cc670 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f512eb54640 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f90699d110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5120016000 tx=0x7f51200a8fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ff6cbff87d74e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f5113fff640 1 -- 172.21.15.37:0/1643000064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200b1040 con 0x55f9065cc670 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f5113fff640 1 -- 172.21.15.37:0/1643000064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51200b1320 con 0x55f9065cc670 2024-09-21T01:18:09.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.659+0000 7f5113fff640 1 -- 172.21.15.37:0/1643000064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200ade60 con 0x55f9065cc670 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.660+0000 7f5136b2b740 1 -- 172.21.15.37:0/1643000064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 msgr2=0x55f90699d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.660+0000 7f5136b2b740 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f90699d110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5120016000 tx=0x7f51200a8fc0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 -- 172.21.15.37:0/1643000064 shutdown_connections 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f90699d110 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 --2- 172.21.15.37:0/1643000064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f906992560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 -- 172.21.15.37:0/1643000064 >> 172.21.15.37:0/1643000064 conn(0x55f9065e1740 msgr2=0x55f90699e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 -- 172.21.15.37:0/1643000064 shutdown_connections 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.661+0000 7f5136b2b740 1 -- 172.21.15.37:0/1643000064 wait complete. 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.662+0000 7f5136b2b740 1 -- start start 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.662+0000 7f5136b2b740 1 Processor -- start 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.663+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f9069a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.663+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.663+0000 7f5136b2b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.664+0000 7f5136b2b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00fa00 con 0x55f9065cc670 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.664+0000 7f5136b2b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00f330 con 0x55f9065c4490 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.664+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.664+0000 7f512eb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49768/0 (socket says 172.21.15.37:49768) 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.664+0000 7f512eb54640 1 -- 172.21.15.37:0/888031027 learned_addr learned my addr 172.21.15.37:0/888031027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.664+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00c550 con 0x55f9065abcd0 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512eb54640 1 -- 172.21.15.37:0/888031027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 msgr2=0x55f9069a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512e353640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f9069a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512eb54640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f9069a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512eb54640 1 -- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 msgr2=0x55f9069a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512eb54640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512eb54640 1 -- 172.21.15.37:0/888031027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9069a3840 con 0x55f9065cc670 2024-09-21T01:18:09.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512e353640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f9069a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f5136b2b740 10 client.0 _ll_register_callbacks cb 0x7f5118004380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51200b1320 con 0x55f9065cc670 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.665+0000 7f512eb54640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a30d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f51200a9ab0 tx=0x7f51200a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f70013ba702d3b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.666+0000 7f5111ffb640 10 client.15951 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.667+0000 7f5111ffb640 1 -- 172.21.15.37:0/888031027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200c7060 con 0x55f9065cc670 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.667+0000 7f5111ffb640 1 -- 172.21.15.37:0/888031027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f51200abaa0 con 0x55f9065cc670 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.667+0000 7f5111ffb640 1 -- 172.21.15.37:0/888031027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f51200b1040 con 0x55f9065cc670 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.667+0000 7f5136b2b740 10 client.15951 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.667+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f906a1d740 con 0x55f9065cc670 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5111ffb640 1 -- 172.21.15.37:0/888031027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f51200ce2f0 con 0x55f9065cc670 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5136b2b740 10 client.15951 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5136b2b740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5136b2b740 20 client.15951 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:09.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5136b2b740 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065ed350 0x55f906a1f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:09.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5136b2b740 4 client.15951 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:18:09.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.669+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f90690cdb0 con 0x55f9065ed350 2024-09-21T01:18:09.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.670+0000 7f512e353640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065ed350 0x55f906a1f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:09.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.671+0000 7f512e353640 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065ed350 0x55f906a1f950 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dedcf3f47cb81744 server_cookie=89e27a053fea2d6c in_seq=0 out_seq=0 2024-09-21T01:18:09.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.671+0000 7f5111ffb640 10 client.15951 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:09.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.980+0000 7f5111ffb640 1 -- 172.21.15.37:0/888031027 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f90690cdb0 con 0x55f9065ed350 2024-09-21T01:18:09.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.980+0000 7f5111ffb640 10 client.15951 handle_command_reply: tid=0 2024-09-21T01:18:09.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.980+0000 7f5136b2b740 1 client.15951 shutdown 2024-09-21T01:18:09.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.980+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 msgr2=0x55f9069a30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.980+0000 7f5136b2b740 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a30d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f51200a9ab0 tx=0x7f51200a8ce0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.981+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 shutdown_connections 2024-09-21T01:18:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.981+0000 7f5136b2b740 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f9065ed350 0x55f906a1f950 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.981+0000 7f5136b2b740 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9065cc670 0x55f9069a30d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.981+0000 7f5111ffb640 0 client.15951 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.981+0000 7f5136b2b740 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f9065c4490 0x55f9069a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.981+0000 7f5136b2b740 1 --2- 172.21.15.37:0/888031027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9065abcd0 0x55f9069a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.982+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 >> 172.21.15.37:0/888031027 conn(0x55f9065e1740 msgr2=0x55f9069a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.982+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 shutdown_connections 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.982+0000 7f5136b2b740 1 -- 172.21.15.37:0/888031027 wait complete. 2024-09-21T01:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.982+0000 7f5136b2b740 20 client.15951 trim_cache size 0 max 16384 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "1dd64a11-a2d7-4948-b0a6-aa898fa3066f", 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.983+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51140b6510 msgr2=0x7f51140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.983+0000 7f512f355640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51140b6510 0x7f51140b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f511802a960 tx=0x7f5118000bc0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.983+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 msgr2=0x7f51281ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.983+0000 7f512f355640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 0x7f51281ac750 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f512000b990 tx=0x7f512000be50 comp rx=0 tx=0).stop 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 shutdown_connections 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f51140b6510 0x7f51140b8a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51281069f0 0x7f51281ac750 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f51281060a0 0x7f512810e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 --2- 172.21.15.37:0/2277657769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5128101e50 0x7f512810dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 >> 172.21.15.37:0/2277657769 conn(0x7f5128077aa0 msgr2=0x7f51281073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.984+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 shutdown_connections 2024-09-21T01:18:09.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:09.986+0000 7f512f355640 1 -- 172.21.15.37:0/2277657769 wait complete. 2024-09-21T01:18:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 -- 172.21.15.37:0/4078979079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc950103620 msgr2=0x7fc950103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 --2- 172.21.15.37:0/4078979079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc950103620 0x7fc950103a30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc940009900 tx=0x7fc94002a410 comp rx=0 tx=0).stop 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 -- 172.21.15.37:0/4078979079 shutdown_connections 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 --2- 172.21.15.37:0/4078979079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 0x7fc95010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 --2- 172.21.15.37:0/4078979079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc950103620 0x7fc950103a30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 --2- 172.21.15.37:0/4078979079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9501025a0 0x7fc950102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 -- 172.21.15.37:0/4078979079 >> 172.21.15.37:0/4078979079 conn(0x7fc9500fdee0 msgr2=0x7fc950100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 -- 172.21.15.37:0/4078979079 shutdown_connections 2024-09-21T01:18:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.574+0000 7fc95844d640 1 -- 172.21.15.37:0/4078979079 wait complete. 2024-09-21T01:18:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 Processor -- start 2024-09-21T01:18:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 -- start start 2024-09-21T01:18:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9501025a0 0x7fc950199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc950103620 0x7fc95019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 0x7fc95019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010e220 con 0x7fc9501025a0 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010e0a0 con 0x7fc950103620 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc95844d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010e3a0 con 0x7fc950103fc0 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9501025a0 0x7fc950199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9501025a0 0x7fc950199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49780/0 (socket says 172.21.15.37:49780) 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc9561e9640 1 -- 172.21.15.37:0/4182823401 learned_addr learned my addr 172.21.15.37:0/4182823401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc950103620 0x7fc95019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.575+0000 7fc9569ea640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 0x7fc95019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9569ea640 1 -- 172.21.15.37:0/4182823401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc950103620 msgr2=0x7fc95019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9569ea640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc950103620 0x7fc95019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9569ea640 1 -- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9501025a0 msgr2=0x7fc950199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9569ea640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9501025a0 0x7fc950199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9569ea640 1 -- 172.21.15.37:0/4182823401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95019b960 con 0x7fc950103fc0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9569ea640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 0x7fc95019b140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc94800eb20 tx=0x7fc94800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9477fe640 1 -- 172.21.15.37:0/4182823401 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9480039c0 con 0x7fc950103fc0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95019bc50 con 0x7fc950103fc0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9477fe640 1 -- 172.21.15.37:0/4182823401 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc948003b60 con 0x7fc950103fc0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc9477fe640 1 -- 172.21.15.37:0/4182823401 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948010690 con 0x7fc950103fc0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.576+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9501a2340 con 0x7fc950103fc0 2024-09-21T01:18:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.579+0000 7fc9477fe640 1 -- 172.21.15.37:0/4182823401 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc948003fa0 con 0x7fc950103fc0 2024-09-21T01:18:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.579+0000 7fc95f3c1740 1 Processor -- start 2024-09-21T01:18:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 -- start start 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da094e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0954c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da096010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607da0076f0 con 0x5607d9ccc4d0 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5607d9ff6b20 con 0x5607d9cc42f0 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5607d9ffa930 con 0x5607d9ced1b0 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc9477fe640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc93c0b6510 0x7fc93c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da094e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:36620/0 (socket says 172.21.15.37:36620) 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43456/0 (socket says 172.21.15.37:43456) 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.580+0000 7fc9559e8640 1 -- 172.21.15.37:0/3831557943 learned_addr learned my addr 172.21.15.37:0/3831557943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9569ea640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc93c0b6510 0x7fc93c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9559e8640 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da096010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9477fe640 1 -- 172.21.15.37:0/4182823401 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc9480e7a10 con 0x7fc950103fc0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9561e9640 1 -- 172.21.15.37:0/3831557943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 msgr2=0x5607da094e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9561e9640 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da094e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9561e9640 1 -- 172.21.15.37:0/3831557943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 msgr2=0x5607da096010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9561e9640 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da096010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9561e9640 1 -- 172.21.15.37:0/3831557943 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d9fbc530 con 0x5607d9cc42f0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9561e9640 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0954c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009c80 tx=0x7fc94c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=502ba4e101fe24df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc9569ea640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc93c0b6510 0x7fc93c0b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc948009190 tx=0x7fc9480a2410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc944bfe640 1 -- 172.21.15.37:0/3831557943 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004250 con 0x5607d9cc42f0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc944bfe640 1 -- 172.21.15.37:0/3831557943 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc94c009e30 con 0x5607d9cc42f0 2024-09-21T01:18:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.581+0000 7fc944bfe640 1 -- 172.21.15.37:0/3831557943 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004ce0 con 0x5607d9cc42f0 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3831557943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 msgr2=0x5607da0954c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0954c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009c80 tx=0x7fc94c011810 comp rx=0 tx=0).stop 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3831557943 shutdown_connections 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da096010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0954c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3831557943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da094e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3831557943 >> 172.21.15.37:0/3831557943 conn(0x5607d9ce1300 msgr2=0x5607da0908e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.582+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3831557943 shutdown_connections 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3831557943 wait complete. 2024-09-21T01:18:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 -- start start 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 Processor -- start 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da09e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607d9f2eab0 con 0x5607d9ccc4d0 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5607d9f9c730 con 0x5607d9cc42f0 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5607da096b30 con 0x5607d9ced1b0 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc95f3c1740 10 client.0 _ll_register_callbacks cb 0x5607d9ff06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da09e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da09e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43472/0 (socket says 172.21.15.37:43472) 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc9559e8640 1 -- 172.21.15.37:0/3688937140 learned_addr learned my addr 172.21.15.37:0/3688937140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49804/0 (socket says 172.21.15.37:49804) 2024-09-21T01:18:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.583+0000 7fc9559e8640 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc9561e9640 1 -- 172.21.15.37:0/3688937140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 msgr2=0x5607da09f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc9561e9640 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc9561e9640 1 -- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 msgr2=0x5607da09e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc9561e9640 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da09e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc9561e9640 1 -- 172.21.15.37:0/3688937140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d9d58790 con 0x5607d9ccc4d0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc9561e9640 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da09ec20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009620 tx=0x7fc94c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf61f676937346f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc939ffb640 1 -- 172.21.15.37:0/3688937140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c029070 con 0x5607d9ccc4d0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc939ffb640 1 -- 172.21.15.37:0/3688937140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc94c023430 con 0x5607d9ccc4d0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc94c009e30 con 0x5607d9ccc4d0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc939ffb640 1 -- 172.21.15.37:0/3688937140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc94c035050 con 0x5607d9ccc4d0 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc95f3c1740 10 client.15963 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.584+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5607d9dd1620 con 0x5607d9ccc4d0 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc939ffb640 1 -- 172.21.15.37:0/3688937140 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc94c009e30 con 0x5607d9ccc4d0 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc939ffb640 1 -- 172.21.15.37:0/3688937140 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc94c019430 con 0x5607d9ccc4d0 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc95f3c1740 10 client.15963 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc95f3c1740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc95f3c1740 20 client.15963 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9cabd80 0x5607da0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc95f3c1740 4 client.15963 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607da009640 con 0x5607d9cabd80 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.585+0000 7fc9559e8640 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9cabd80 0x5607da0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.586+0000 7fc939ffb640 10 client.15963 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.586+0000 7fc9559e8640 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9cabd80 0x5607da0aba60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba7f5fbd16e630c server_cookie=d1546b00352b5535 in_seq=0 out_seq=0 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc939ffb640 1 -- 172.21.15.37:0/3688937140 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607da009640 con 0x5607d9cabd80 2024-09-21T01:18:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc939ffb640 10 client.15963 handle_command_reply: tid=0 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 client.15963 shutdown 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 msgr2=0x5607da09ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da09ec20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009620 tx=0x7fc94c0038a0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 shutdown_connections 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9cabd80 0x5607da0aba60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da09ec20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc939ffb640 0 client.15963 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/3688937140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da09e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 >> 172.21.15.37:0/3688937140 conn(0x5607d9ce1300 msgr2=0x5607da08eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 shutdown_connections 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.587+0000 7fc95f3c1740 1 -- 172.21.15.37:0/3688937140 wait complete. 2024-09-21T01:18:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.588+0000 7fc95f3c1740 20 client.15963 trim_cache size 0 max 16384 2024-09-21T01:18:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 Processor -- start 2024-09-21T01:18:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 -- start start 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da094df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da095330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501ab020 con 0x5607d9ccc4d0 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501acb90 con 0x5607d9cc42f0 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501ab6f0 con 0x5607d9ced1b0 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da095330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc9561e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da095330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49808/0 (socket says 172.21.15.37:49808) 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc9561e9640 1 -- 172.21.15.37:0/342868377 learned_addr learned my addr 172.21.15.37:0/342868377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.602+0000 7fc9559e8640 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da094df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9559e8640 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9561e9640 1 -- 172.21.15.37:0/342868377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 msgr2=0x5607da09e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9561e9640 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9561e9640 1 -- 172.21.15.37:0/342868377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 msgr2=0x5607da094df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9561e9640 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da094df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9561e9640 1 -- 172.21.15.37:0/342868377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607da09c720 con 0x5607d9ccc4d0 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc9561e9640 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da095330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc94c011d10 tx=0x7fc94c003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bb4474862a1234 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc93bfff640 1 -- 172.21.15.37:0/342868377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c029040 con 0x5607d9ccc4d0 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc93bfff640 1 -- 172.21.15.37:0/342868377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc94c005520 con 0x5607d9ccc4d0 2024-09-21T01:18:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.603+0000 7fc93bfff640 1 -- 172.21.15.37:0/342868377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0044c0 con 0x5607d9ccc4d0 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 -- 172.21.15.37:0/342868377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 msgr2=0x5607da095330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da095330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc94c011d10 tx=0x7fc94c003990 comp rx=0 tx=0).stop 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 -- 172.21.15.37:0/342868377 shutdown_connections 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ced1b0 0x5607da09e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ccc4d0 0x5607da095330 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/342868377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da094df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 -- 172.21.15.37:0/342868377 >> 172.21.15.37:0/342868377 conn(0x5607d9ce1300 msgr2=0x5607da090220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 -- 172.21.15.37:0/342868377 shutdown_connections 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 -- 172.21.15.37:0/342868377 wait complete. 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 -- start start 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.604+0000 7fc95f3c1740 1 Processor -- start 2024-09-21T01:18:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ccc4d0 0x5607da0a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ced1b0 0x5607da0a2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501ac490 con 0x5607d9ced1b0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501abdc0 con 0x5607d9cc42f0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9501a8fe0 con 0x5607d9ccc4d0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc95f3c1740 10 client.0 _ll_register_callbacks cb 0x7fc940009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43486/0 (socket says 172.21.15.37:43486) 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 -- 172.21.15.37:0/2066657690 learned_addr learned my addr 172.21.15.37:0/2066657690 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ced1b0 0x5607da0a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9561e9640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ccc4d0 0x5607da0a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 -- 172.21.15.37:0/2066657690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ccc4d0 msgr2=0x5607da0a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ccc4d0 0x5607da0a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 -- 172.21.15.37:0/2066657690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ced1b0 msgr2=0x5607da0a2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ced1b0 0x5607da0a2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 -- 172.21.15.37:0/2066657690 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607da0a2e80 con 0x5607d9cc42f0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9561e9640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ccc4d0 0x5607da0a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc9559e8640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0a14f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc940006010 tx=0x7fc94003f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d3735201260ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.605+0000 7fc939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc939ffb640 1 -- 172.21.15.37:0/2066657690 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940035040 con 0x5607d9cc42f0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc939ffb640 1 -- 172.21.15.37:0/2066657690 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc9400315a0 con 0x5607d9cc42f0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc94c005520 con 0x5607d9cc42f0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc939ffb640 1 -- 172.21.15.37:0/2066657690 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9400317a0 con 0x5607d9cc42f0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 10 client.25538 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5607da0a6220 con 0x5607d9cc42f0 2024-09-21T01:18:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc939ffb640 1 -- 172.21.15.37:0/2066657690 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc94c005520 con 0x5607d9cc42f0 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc939ffb640 1 -- 172.21.15.37:0/2066657690 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc94003d950 con 0x5607d9cc42f0 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 10 client.25538 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 10 client.25538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 20 client.25538 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9c811c0 0x5607da1186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 4 client.25538 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.606+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5607da0050f0 con 0x5607d9c811c0 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.607+0000 7fc9561e9640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9c811c0 0x5607da1186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.607+0000 7fc9561e9640 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9c811c0 0x5607da1186a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=536c650e150cbc37 server_cookie=6734c4dc55ff2db3 in_seq=0 out_seq=0 2024-09-21T01:18:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.607+0000 7fc939ffb640 10 client.25538 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:10.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:10 smithi137 ceph-mon[34607]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 996 MiB/s wr, 2.42k op/s 2024-09-21T01:18:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:10 smithi144 ceph-mon[34818]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 996 MiB/s wr, 2.42k op/s 2024-09-21T01:18:10.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:10 smithi037 ceph-mon[31105]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 996 MiB/s wr, 2.42k op/s 2024-09-21T01:18:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.961+0000 7fc939ffb640 1 -- 172.21.15.37:0/2066657690 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5607da0050f0 con 0x5607d9c811c0 2024-09-21T01:18:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.961+0000 7fc939ffb640 10 client.25538 handle_command_reply: tid=0 2024-09-21T01:18:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.961+0000 7fc95f3c1740 1 client.25538 shutdown 2024-09-21T01:18:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.965+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 msgr2=0x5607da0a14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.965+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0a14f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc940006010 tx=0x7fc94003f040 comp rx=0 tx=0).stop 2024-09-21T01:18:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 shutdown_connections 2024-09-21T01:18:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5607d9c811c0 0x5607da1186a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607d9ced1b0 0x5607da0a2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5607d9ccc4d0 0x5607da0a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc95f3c1740 1 --2- 172.21.15.37:0/2066657690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607d9cc42f0 0x5607da0a14f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 >> 172.21.15.37:0/2066657690 conn(0x5607d9ce1300 msgr2=0x5607da08f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.967+0000 7fc939ffb640 0 client.25538 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.968+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 shutdown_connections 2024-09-21T01:18:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.968+0000 7fc95f3c1740 1 -- 172.21.15.37:0/2066657690 wait complete. 2024-09-21T01:18:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.968+0000 7fc95f3c1740 20 client.25538 trim_cache size 0 max 16384 2024-09-21T01:18:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:18:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:18:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:18:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.978+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc93c0b6510 msgr2=0x7fc93c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.978+0000 7fc95844d640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc93c0b6510 0x7fc93c0b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc948009190 tx=0x7fc9480a2410 comp rx=0 tx=0).stop 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.978+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 msgr2=0x7fc95019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.978+0000 7fc95844d640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 0x7fc95019b140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc94800eb20 tx=0x7fc94800c2d0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.981+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 shutdown_connections 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.981+0000 7fc95844d640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc93c0b6510 0x7fc93c0b8a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.981+0000 7fc95844d640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc950103fc0 0x7fc95019b140 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.981+0000 7fc95844d640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc950103620 0x7fc95019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.981+0000 7fc95844d640 1 --2- 172.21.15.37:0/4182823401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9501025a0 0x7fc950199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.981+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 >> 172.21.15.37:0/4182823401 conn(0x7fc9500fdee0 msgr2=0x7fc9500ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.982+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 shutdown_connections 2024-09-21T01:18:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:10.982+0000 7fc95844d640 1 -- 172.21.15.37:0/4182823401 wait complete. 2024-09-21T01:18:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:11 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:18:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:11 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:11 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:18:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:11 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:18:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:11 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:11 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:18:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:11 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:18:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:11 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:11 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:18:11.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:11 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:11 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:11 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:11 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:11 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:11 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:11 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:11 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:11.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:11 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:18:12.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:12 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:12.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:12 smithi137 ceph-mon[34607]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 822 MiB/s wr, 1.92k op/s 2024-09-21T01:18:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:12 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:12.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:12 smithi144 ceph-mon[34818]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 822 MiB/s wr, 1.92k op/s 2024-09-21T01:18:12.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:12 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:18:12.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:12 smithi037 ceph-mon[31105]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 822 MiB/s wr, 1.92k op/s 2024-09-21T01:18:12.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:18:13.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:18:13.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:18:13.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:18:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:18:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:18:13.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:18:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:18:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:18:13.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:18:13.875 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:18:14.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:14 smithi037 ceph-mon[31105]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 904 MiB/s wr, 2.32k op/s 2024-09-21T01:18:14.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:14 smithi144 ceph-mon[34818]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 904 MiB/s wr, 2.32k op/s 2024-09-21T01:18:14.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:14 smithi137 ceph-mon[34607]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 904 MiB/s wr, 2.32k op/s 2024-09-21T01:18:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.325+0000 7feddc652640 1 -- 172.21.15.37:0/1126754989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 msgr2=0x7fedd410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.325+0000 7feddc652640 1 --2- 172.21.15.37:0/1126754989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd410f540 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009ca0 tx=0x7fedcc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 -- 172.21.15.37:0/1126754989 shutdown_connections 2024-09-21T01:18:15.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 --2- 172.21.15.37:0/1126754989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd410f540 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 --2- 172.21.15.37:0/1126754989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 0x7fedd41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 --2- 172.21.15.37:0/1126754989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd4102a80 0x7fedd4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 -- 172.21.15.37:0/1126754989 >> 172.21.15.37:0/1126754989 conn(0x7fedd4079740 msgr2=0x7fedd4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 -- 172.21.15.37:0/1126754989 shutdown_connections 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.326+0000 7feddc652640 1 -- 172.21.15.37:0/1126754989 wait complete. 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.327+0000 7feddc652640 1 Processor -- start 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.328+0000 7feddc652640 1 -- start start 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.328+0000 7feddc652640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd4102a80 0x7fedd4199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.328+0000 7feddc652640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 0x7fedd4199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.328+0000 7feddc652640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.329+0000 7feddc652640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4112ab0 con 0x7fedd4108d10 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.329+0000 7feddc652640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4112930 con 0x7fedd41083c0 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.329+0000 7feddc652640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4112c30 con 0x7fedd4102a80 2024-09-21T01:18:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.329+0000 7feddabef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.329+0000 7feddabef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49838/0 (socket says 172.21.15.37:49838) 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.329+0000 7feddabef640 1 -- 172.21.15.37:0/352458518 learned_addr learned my addr 172.21.15.37:0/352458518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7feddabef640 1 -- 172.21.15.37:0/352458518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd4102a80 msgr2=0x7fedd4199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7feddabef640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd4102a80 0x7fedd4199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7feddabef640 1 -- 172.21.15.37:0/352458518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 msgr2=0x7fedd4199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7fedd9bed640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 0x7fedd4199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7feddabef640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 0x7fedd4199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7feddabef640 1 -- 172.21.15.37:0/352458518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd419f490 con 0x7fedd4108d10 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.330+0000 7fedd9bed640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 0x7fedd4199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.331+0000 7feddabef640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd419ed60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fedcc031a20 tx=0x7fedcc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.331+0000 7fedcb7fe640 1 -- 172.21.15.37:0/352458518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc04a070 con 0x7fedd4108d10 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.331+0000 7fedcb7fe640 1 -- 172.21.15.37:0/352458518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedcc003cc0 con 0x7fedd4108d10 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.331+0000 7fedcb7fe640 1 -- 172.21.15.37:0/352458518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc02fad0 con 0x7fedd4108d10 2024-09-21T01:18:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.331+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd419f720 con 0x7fedd4108d10 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.332+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd406b820 con 0x7fedd4108d10 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.338+0000 7fedcb7fe640 1 -- 172.21.15.37:0/352458518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fedcc04d070 con 0x7fedd4108d10 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.340+0000 7fedcb7fe640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fedc00b6660 0x7fedc00b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.341+0000 7fedcb7fe640 1 -- 172.21.15.37:0/352458518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fedcc109bc0 con 0x7fedd4108d10 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.341+0000 7fedda3ee640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fedc00b6660 0x7fedc00b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 Processor -- start 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 -- start start 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afcb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afcbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afcc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b38af41e50 con 0x55b38ac24070 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.342+0000 7fede2bc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b38af31280 con 0x55b38ac03390 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.343+0000 7fede2bc6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b38af35090 con 0x55b38abfb1b0 2024-09-21T01:18:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.344+0000 7fedda3ee640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fedc00b6660 0x7fedc00b8b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009710 tx=0x7fedd0006c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.344+0000 7fedda3ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afcb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.344+0000 7feddabef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afcc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.344+0000 7feddabef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afcc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43504/0 (socket says 172.21.15.37:43504) 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.344+0000 7feddabef640 1 -- 172.21.15.37:0/1093572314 learned_addr learned my addr 172.21.15.37:0/1093572314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.345+0000 7fedd9bed640 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afcbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.346+0000 7fedda3ee640 1 -- 172.21.15.37:0/1093572314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 msgr2=0x55b38afcbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.346+0000 7fedda3ee640 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afcbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.346+0000 7fedda3ee640 1 -- 172.21.15.37:0/1093572314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 msgr2=0x55b38afcc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.346+0000 7fedda3ee640 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afcc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.346+0000 7fedda3ee640 1 -- 172.21.15.37:0/1093572314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38ac8f650 con 0x55b38ac24070 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.346+0000 7feddabef640 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afcc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:18:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.347+0000 7fedda3ee640 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afcb650 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009fa0 tx=0x7fedd000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26413bf37089996d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.347+0000 7fedc8ff9640 1 -- 172.21.15.37:0/1093572314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0023070 con 0x55b38ac24070 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.347+0000 7fedc8ff9640 1 -- 172.21.15.37:0/1093572314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd0015df0 con 0x55b38ac24070 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.348+0000 7fedc8ff9640 1 -- 172.21.15.37:0/1093572314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0013ba0 con 0x55b38ac24070 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.349+0000 7fede2bc6740 1 -- 172.21.15.37:0/1093572314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 msgr2=0x55b38afcb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.349+0000 7fede2bc6740 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afcb650 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009fa0 tx=0x7fedd000e000 comp rx=0 tx=0).stop 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 -- 172.21.15.37:0/1093572314 shutdown_connections 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afcc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afcbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 --2- 172.21.15.37:0/1093572314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afcb650 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 -- 172.21.15.37:0/1093572314 >> 172.21.15.37:0/1093572314 conn(0x55b38ac18460 msgr2=0x55b38afc9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 -- 172.21.15.37:0/1093572314 shutdown_connections 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 -- 172.21.15.37:0/1093572314 wait complete. 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.350+0000 7fede2bc6740 1 -- start start 2024-09-21T01:18:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.351+0000 7fede2bc6740 1 Processor -- start 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afd74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afd7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afe1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b38ad92700 con 0x55b38ac24070 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b38aecc110 con 0x55b38ac03390 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b38afd5dd0 con 0x55b38abfb1b0 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7fede2bc6740 10 client.0 _ll_register_callbacks cb 0x55b38aee5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7feddabef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afe1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7feddabef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afe1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49854/0 (socket says 172.21.15.37:49854) 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.352+0000 7feddabef640 1 -- 172.21.15.37:0/707506126 learned_addr learned my addr 172.21.15.37:0/707506126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.353+0000 7feddabef640 1 -- 172.21.15.37:0/707506126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 msgr2=0x55b38afd74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.353+0000 7feddabef640 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afd74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.353+0000 7feddabef640 1 -- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 msgr2=0x55b38afd7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.353+0000 7feddabef640 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afd7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.353+0000 7feddabef640 1 -- 172.21.15.37:0/707506126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38aef9c40 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.353+0000 7feddabef640 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afe1c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0cfaa0 tx=0x7fedcc0cf8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c369685e6ce39e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.354+0000 7fedbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.354+0000 7fedbdffb640 1 -- 172.21.15.37:0/707506126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0d3020 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.354+0000 7fedbdffb640 1 -- 172.21.15.37:0/707506126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fedcc0b5bc0 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.355+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedd0015df0 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.355+0000 7fedbdffb640 1 -- 172.21.15.37:0/707506126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedcc0d9730 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.355+0000 7fede2bc6740 10 client.15981 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.355+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b38afdd870 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.356+0000 7fedbdffb640 1 -- 172.21.15.37:0/707506126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd0015df0 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fedbdffb640 1 -- 172.21.15.37:0/707506126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fedcc0f7160 con 0x55b38ac24070 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fede2bc6740 10 client.15981 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fede2bc6740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fede2bc6740 20 client.15981 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fede2bc6740 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38abe29f0 0x55b38aff9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fede2bc6740 4 client.15981 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.357+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b38af43da0 con 0x55b38abe29f0 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.361+0000 7fedda3ee640 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38abe29f0 0x55b38aff9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.372+0000 7fedda3ee640 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38abe29f0 0x55b38aff9f00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf2a3d4d7f97c5e4 server_cookie=a9098b0c3eec100c in_seq=0 out_seq=0 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.372+0000 7fedbdffb640 10 client.15981 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.379+0000 7fedbdffb640 1 -- 172.21.15.37:0/707506126 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b38af43da0 con 0x55b38abe29f0 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.379+0000 7fedbdffb640 10 client.15981 handle_command_reply: tid=0 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.379+0000 7fede2bc6740 1 client.15981 shutdown 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 msgr2=0x55b38afe1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afe1c30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0cfaa0 tx=0x7fedcc0cf8b0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 shutdown_connections 2024-09-21T01:18:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38abe29f0 0x55b38aff9f00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38ac24070 0x55b38afe1c30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38afd7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 --2- 172.21.15.37:0/707506126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38abfb1b0 0x55b38afd74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 >> 172.21.15.37:0/707506126 conn(0x55b38ac18460 msgr2=0x55b38afc7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fedbdffb640 0 client.15981 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.380+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 shutdown_connections 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.383+0000 7fede2bc6740 1 -- 172.21.15.37:0/707506126 wait complete. 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.383+0000 7fede2bc6740 20 client.15981 trim_cache size 0 max 16384 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.424+0000 7fede2bc6740 1 Processor -- start 2024-09-21T01:18:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.424+0000 7fede2bc6740 1 -- start start 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.425+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 0x55b38afd0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.425+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac03390 0x55b38afd1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fedda3ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 0x55b38afd0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fedda3ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 0x55b38afd0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49862/0 (socket says 172.21.15.37:49862) 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fedda3ee640 1 -- 172.21.15.37:0/2438836276 learned_addr learned my addr 172.21.15.37:0/2438836276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fede2bc6740 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac24070 0x55b38afd1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fedd41ad3a0 con 0x55b38abfb1b0 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedd41aef10 con 0x55b38ac24070 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fedd41ada70 con 0x55b38ac03390 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7fedd9bed640 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac03390 0x55b38afd1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.426+0000 7feddabef640 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac24070 0x55b38afd1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.427+0000 7fedda3ee640 1 -- 172.21.15.37:0/2438836276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac03390 msgr2=0x55b38afd1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.427+0000 7fedda3ee640 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac03390 0x55b38afd1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.427+0000 7fedda3ee640 1 -- 172.21.15.37:0/2438836276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac24070 msgr2=0x55b38afd1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.427+0000 7fedda3ee640 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac24070 0x55b38afd1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.427+0000 7fedda3ee640 1 -- 172.21.15.37:0/2438836276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38afd5170 con 0x55b38abfb1b0 2024-09-21T01:18:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.434+0000 7fedda3ee640 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 0x55b38afd0700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55b38afddb30 tx=0x7fedd00152b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68051484ab20eca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:15.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.439+0000 7fedbffff640 1 -- 172.21.15.37:0/2438836276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd0023040 con 0x55b38abfb1b0 2024-09-21T01:18:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.439+0000 7fedbffff640 1 -- 172.21.15.37:0/2438836276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd0015df0 con 0x55b38abfb1b0 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 msgr2=0x55b38afd0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 0x55b38afd0700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55b38afddb30 tx=0x7fedd00152b0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 shutdown_connections 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac24070 0x55b38afd1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac03390 0x55b38afd1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 --2- 172.21.15.37:0/2438836276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abfb1b0 0x55b38afd0700 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.441+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 >> 172.21.15.37:0/2438836276 conn(0x55b38ac18460 msgr2=0x55b38aff9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.445+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 shutdown_connections 2024-09-21T01:18:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.445+0000 7fede2bc6740 1 -- 172.21.15.37:0/2438836276 wait complete. 2024-09-21T01:18:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.445+0000 7fede2bc6740 1 -- start start 2024-09-21T01:18:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 Processor -- start 2024-09-21T01:18:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38b00bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac24070 0x55b38b009160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 0x55b38b0096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fedd41ae810 con 0x55b38abb7da0 2024-09-21T01:18:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedd41ae140 con 0x55b38ac03390 2024-09-21T01:18:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fedd41ab360 con 0x55b38ac24070 2024-09-21T01:18:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.446+0000 7fede2bc6740 10 client.0 _ll_register_callbacks cb 0x7fedcc0cf7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.450+0000 7feddabef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 0x55b38b0096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.450+0000 7feddabef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 0x55b38b0096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49866/0 (socket says 172.21.15.37:49866) 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.450+0000 7feddabef640 1 -- 172.21.15.37:0/3332597759 learned_addr learned my addr 172.21.15.37:0/3332597759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.451+0000 7feddabef640 1 -- 172.21.15.37:0/3332597759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac24070 msgr2=0x55b38b009160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.451+0000 7feddabef640 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac24070 0x55b38b009160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.451+0000 7feddabef640 1 -- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 msgr2=0x55b38b00bc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:18:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.451+0000 7feddabef640 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38b00bc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.451+0000 7feddabef640 1 -- 172.21.15.37:0/3332597759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38b009c90 con 0x55b38abb7da0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.460+0000 7feddabef640 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 0x55b38b0096a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0d98f0 tx=0x7fedcc0b73a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e59611f028950be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.460+0000 7fedbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.460+0000 7fedbdffb640 1 -- 172.21.15.37:0/3332597759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0d3030 con 0x55b38abb7da0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.460+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b38af3f850 con 0x55b38abb7da0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.460+0000 7fedbdffb640 1 -- 172.21.15.37:0/3332597759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fedcc0b5dc0 con 0x55b38abb7da0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.461+0000 7fedbdffb640 1 -- 172.21.15.37:0/3332597759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedcc0cbc40 con 0x55b38abb7da0 2024-09-21T01:18:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.461+0000 7fede2bc6740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.461+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b38b0756f0 con 0x55b38abb7da0 2024-09-21T01:18:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.462+0000 7fedbdffb640 1 -- 172.21.15.37:0/3332597759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b38af3f850 con 0x55b38abb7da0 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fedbdffb640 1 -- 172.21.15.37:0/3332597759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fedcc0cf000 con 0x55b38abb7da0 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fede2bc6740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fede2bc6740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fede2bc6740 20 client.15987 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fede2bc6740 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38b075cb0 0x55b38b0780d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fede2bc6740 4 client.15987 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:18:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.464+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b38af3cc80 con 0x55b38b075cb0 2024-09-21T01:18:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.471+0000 7fedda3ee640 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38b075cb0 0x55b38b0780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:15.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.478+0000 7fedda3ee640 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38b075cb0 0x55b38b0780d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b48722ab55d08e71 server_cookie=9aaf58c0711c935b in_seq=0 out_seq=0 2024-09-21T01:18:15.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.480+0000 7fedbdffb640 10 client.15987 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:15.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.480+0000 7fedbdffb640 1 -- 172.21.15.37:0/3332597759 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55b38af3cc80 con 0x55b38b075cb0 2024-09-21T01:18:15.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.480+0000 7fedbdffb640 10 client.15987 handle_command_reply: tid=0 2024-09-21T01:18:15.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.480+0000 7fede2bc6740 1 client.15987 shutdown 2024-09-21T01:18:15.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.482+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 msgr2=0x55b38b0096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.482+0000 7fede2bc6740 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 0x55b38b0096a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0d98f0 tx=0x7fedcc0b73a0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 shutdown_connections 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fede2bc6740 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55b38b075cb0 0x55b38b0780d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fede2bc6740 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b38abb7da0 0x55b38b0096a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fede2bc6740 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b38ac24070 0x55b38b009160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fede2bc6740 1 --2- 172.21.15.37:0/3332597759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b38ac03390 0x55b38b00bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 >> 172.21.15.37:0/3332597759 conn(0x55b38ac18460 msgr2=0x55b38aff9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:15.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.483+0000 7fedbdffb640 0 client.15987 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.490+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 shutdown_connections 2024-09-21T01:18:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.490+0000 7fede2bc6740 1 -- 172.21.15.37:0/3332597759 wait complete. 2024-09-21T01:18:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.490+0000 7fede2bc6740 20 client.15987 trim_cache size 0 max 16384 2024-09-21T01:18:15.493 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "1dd64a11-a2d7-4948-b0a6-aa898fa3066f", 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:18:15.494 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:18:15.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:18:15.496 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.493+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fedc00b6660 msgr2=0x7fedc00b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.493+0000 7feddc652640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fedc00b6660 0x7fedc00b8b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009710 tx=0x7fedd0006c90 comp rx=0 tx=0).stop 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.493+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 msgr2=0x7fedd419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.493+0000 7feddc652640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd419ed60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fedcc031a20 tx=0x7fedcc031a50 comp rx=0 tx=0).stop 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.494+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 shutdown_connections 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.494+0000 7feddc652640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fedc00b6660 0x7fedc00b8b70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.494+0000 7feddc652640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd4108d10 0x7fedd419ed60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.494+0000 7feddc652640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedd41083c0 0x7fedd4199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.494+0000 7feddc652640 1 --2- 172.21.15.37:0/352458518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd4102a80 0x7fedd4199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.494+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 >> 172.21.15.37:0/352458518 conn(0x7fedd4079740 msgr2=0x7fedd4105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.498+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 shutdown_connections 2024-09-21T01:18:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:15.499+0000 7feddc652640 1 -- 172.21.15.37:0/352458518 wait complete. 2024-09-21T01:18:16.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:16 smithi137 ceph-mon[34607]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 918 MiB/s wr, 2.57k op/s 2024-09-21T01:18:16.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:16 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:18:16.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:16 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:18:16.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:16 smithi144 ceph-mon[34818]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 918 MiB/s wr, 2.57k op/s 2024-09-21T01:18:16.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:16 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:18:16.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:16 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:18:16.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:16 smithi037 ceph-mon[31105]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 918 MiB/s wr, 2.57k op/s 2024-09-21T01:18:16.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:16 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:18:16.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:16 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:18:17.795 INFO:tasks.cephfs.filesystem:scrub status for tag:1dd64a11-a2d7-4948-b0a6-aa898fa3066f - {'path': '/', 'tag': '1dd64a11-a2d7-4948-b0a6-aa898fa3066f', 'options': 'recursive,force'} 2024-09-21T01:18:18.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:18 smithi137 ceph-mon[34607]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 769 MiB/s wr, 2.03k op/s 2024-09-21T01:18:18.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:18 smithi144 ceph-mon[34818]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 769 MiB/s wr, 2.03k op/s 2024-09-21T01:18:18.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:18 smithi037 ceph-mon[31105]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 769 MiB/s wr, 2.03k op/s 2024-09-21T01:18:20.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:20 smithi137 ceph-mon[34607]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 984 MiB/s wr, 2.31k op/s 2024-09-21T01:18:20.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:20 smithi144 ceph-mon[34818]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 984 MiB/s wr, 2.31k op/s 2024-09-21T01:18:20.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:20 smithi037 ceph-mon[31105]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 984 MiB/s wr, 2.31k op/s 2024-09-21T01:18:22.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:22 smithi137 ceph-mon[34607]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 1.99k op/s 2024-09-21T01:18:22.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:22 smithi144 ceph-mon[34818]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 1.99k op/s 2024-09-21T01:18:22.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:22 smithi037 ceph-mon[31105]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 1.99k op/s 2024-09-21T01:18:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.259+0000 7f04f2ffd640 1 -- 172.21.15.37:0/3166514869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4035020 con 0x7f04f41025a0 2024-09-21T01:18:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 -- 172.21.15.37:0/3166514869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f41025a0 msgr2=0x7f04f4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:24.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 --2- 172.21.15.37:0/3166514869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f41025a0 0x7f04f4102a10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009900 tx=0x7f04e402a440 comp rx=0 tx=0).stop 2024-09-21T01:18:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 -- 172.21.15.37:0/3166514869 shutdown_connections 2024-09-21T01:18:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 --2- 172.21.15.37:0/3166514869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f4103fc0 0x7f04f406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 --2- 172.21.15.37:0/3166514869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4103620 0x7f04f4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 --2- 172.21.15.37:0/3166514869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f41025a0 0x7f04f4102a10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.260+0000 7f04fa598640 1 -- 172.21.15.37:0/3166514869 >> 172.21.15.37:0/3166514869 conn(0x7f04f40fdee0 msgr2=0x7f04f4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:24.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.261+0000 7f04fa598640 1 -- 172.21.15.37:0/3166514869 shutdown_connections 2024-09-21T01:18:24.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.261+0000 7f04fa598640 1 -- 172.21.15.37:0/3166514869 wait complete. 2024-09-21T01:18:24.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.263+0000 7f04fa598640 1 Processor -- start 2024-09-21T01:18:24.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.263+0000 7f04fa598640 1 -- start start 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.264+0000 7f04fa598640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f41025a0 0x7f04f419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04fa598640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 0x7f04f419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04fa598640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f419d500 0x7f04f419d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 0x7f04f419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 0x7f04f419c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48608/0 (socket says 172.21.15.37:48608) 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04f37fe640 1 -- 172.21.15.37:0/3873388648 learned_addr learned my addr 172.21.15.37:0/3873388648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4111650 con 0x7f04f4103fc0 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41114d0 con 0x7f04f41025a0 2024-09-21T01:18:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.265+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41117d0 con 0x7f04f419d500 2024-09-21T01:18:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.266+0000 7f04f3fff640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f41025a0 0x7f04f419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.266+0000 7f04f8b35640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f419d500 0x7f04f419d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.266+0000 7f04f37fe640 1 -- 172.21.15.37:0/3873388648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f419d500 msgr2=0x7f04f419d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:24.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.266+0000 7f04f37fe640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f419d500 0x7f04f419d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.267+0000 7f04f37fe640 1 -- 172.21.15.37:0/3873388648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f41025a0 msgr2=0x7f04f419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.267+0000 7f04f37fe640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f41025a0 0x7f04f419c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.267+0000 7f04f37fe640 1 -- 172.21.15.37:0/3873388648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f419e1b0 con 0x7f04f4103fc0 2024-09-21T01:18:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.267+0000 7f04f37fe640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 0x7f04f419c9d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f04e8006fd0 tx=0x7f04e800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.268+0000 7f04f17fa640 1 -- 172.21.15.37:0/3873388648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8015020 con 0x7f04f4103fc0 2024-09-21T01:18:24.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.268+0000 7f04f17fa640 1 -- 172.21.15.37:0/3873388648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04e8011ce0 con 0x7f04f4103fc0 2024-09-21T01:18:24.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.268+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f41a45a0 con 0x7f04f4103fc0 2024-09-21T01:18:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.270+0000 7f04f17fa640 1 -- 172.21.15.37:0/3873388648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8010e00 con 0x7f04f4103fc0 2024-09-21T01:18:24.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.270+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f41a4b10 con 0x7f04f4103fc0 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 Processor -- start 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 -- start start 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645328271b0 0x564532bd7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bd7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 0x564532bd8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564532b416f0 con 0x5645328064d0 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564532b30b20 con 0x5645328271b0 2024-09-21T01:18:24.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.273+0000 7f05015e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564532b34930 con 0x5645327fe2f0 2024-09-21T01:18:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.274+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 0x564532bd8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.274+0000 7f04f17fa640 1 -- 172.21.15.37:0/3873388648 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f04e8018020 con 0x7f04f4103fc0 2024-09-21T01:18:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.274+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 0x564532bd8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48618/0 (socket says 172.21.15.37:48618) 2024-09-21T01:18:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.274+0000 7f04f37fe640 1 -- 172.21.15.37:0/443941691 learned_addr learned my addr 172.21.15.37:0/443941691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:24.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.275+0000 7f04f17fa640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04dc0b64e0 0x7f04dc0b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.276+0000 7f04f8b35640 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645328271b0 0x564532bd7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.276+0000 7f04f3fff640 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bd7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.276+0000 7f04f8b35640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04dc0b64e0 0x7f04dc0b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f37fe640 1 -- 172.21.15.37:0/443941691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 msgr2=0x564532bd7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f37fe640 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bd7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f37fe640 1 -- 172.21.15.37:0/443941691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645328271b0 msgr2=0x564532bd7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f37fe640 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645328271b0 0x564532bd7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f37fe640 1 -- 172.21.15.37:0/443941691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564532af6530 con 0x5645328064d0 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f3fff640 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bd7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f17fa640 1 -- 172.21.15.37:0/3873388648 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f04e80e6800 con 0x7f04f4103fc0 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.277+0000 7f04f8b35640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04dc0b64e0 0x7f04dc0b89f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0070b0 tx=0x7f04ec0099d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:24.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.278+0000 7f04f37fe640 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 0x564532bd8820 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f04e8010710 tx=0x7f04e8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f0032536fe3150 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.278+0000 7f04da7fc640 1 -- 172.21.15.37:0/443941691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80ac720 con 0x5645328064d0 2024-09-21T01:18:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.278+0000 7f04da7fc640 1 -- 172.21.15.37:0/443941691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04e80ac460 con 0x5645328064d0 2024-09-21T01:18:24.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.278+0000 7f04da7fc640 1 -- 172.21.15.37:0/443941691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8012000 con 0x5645328064d0 2024-09-21T01:18:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 -- 172.21.15.37:0/443941691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 msgr2=0x564532bd8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 0x564532bd8820 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f04e8010710 tx=0x7f04e8020000 comp rx=0 tx=0).stop 2024-09-21T01:18:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 -- 172.21.15.37:0/443941691 shutdown_connections 2024-09-21T01:18:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328064d0 0x564532bd8820 secure :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f04e8010710 tx=0x7f04e8020000 comp rx=0 tx=0).stop 2024-09-21T01:18:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bd7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 --2- 172.21.15.37:0/443941691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645328271b0 0x564532bd7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.280+0000 7f05015e2740 1 -- 172.21.15.37:0/443941691 >> 172.21.15.37:0/443941691 conn(0x56453281b300 msgr2=0x564532bca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.281+0000 7f05015e2740 1 -- 172.21.15.37:0/443941691 shutdown_connections 2024-09-21T01:18:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.281+0000 7f05015e2740 1 -- 172.21.15.37:0/443941691 wait complete. 2024-09-21T01:18:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.282+0000 7f05015e2740 1 -- start start 2024-09-21T01:18:24.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.282+0000 7f05015e2740 1 Processor -- start 2024-09-21T01:18:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.283+0000 7f05015e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.284+0000 7f05015e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328271b0 0x564532be1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.284+0000 7f05015e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.284+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328271b0 0x564532be1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.284+0000 7f05015e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564532a68ab0 con 0x5645328271b0 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.284+0000 7f04f3fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.285+0000 7f05015e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564532ad6730 con 0x5645327e5d80 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.285+0000 7f04f3fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51082/0 (socket says 172.21.15.37:51082) 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.285+0000 7f04f3fff640 1 -- 172.21.15.37:0/3572156484 learned_addr learned my addr 172.21.15.37:0/3572156484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.284+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328271b0 0x564532be1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48630/0 (socket says 172.21.15.37:48630) 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.285+0000 7f04f8b35640 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.285+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564532bd92e0 con 0x5645327fe2f0 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.285+0000 7f05015e2740 10 client.0 _ll_register_callbacks cb 0x564532b2a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04f3fff640 1 -- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 msgr2=0x564532be2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04f3fff640 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04f3fff640 1 -- 172.21.15.37:0/3572156484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328271b0 msgr2=0x564532be1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04f3fff640 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328271b0 0x564532be1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04f3fff640 1 -- 172.21.15.37:0/3572156484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564532892790 con 0x5645327fe2f0 2024-09-21T01:18:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04f3fff640 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be0eb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009900 tx=0x7f04e4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f78529e4b3c0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.286+0000 7f04d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:18:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.287+0000 7f04d37fe640 1 -- 172.21.15.37:0/3572156484 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4035020 con 0x5645327fe2f0 2024-09-21T01:18:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.287+0000 7f04d37fe640 1 -- 172.21.15.37:0/3572156484 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f04e40047a0 con 0x5645327fe2f0 2024-09-21T01:18:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.288+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e80ac460 con 0x5645327fe2f0 2024-09-21T01:18:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.289+0000 7f04d37fe640 1 -- 172.21.15.37:0/3572156484 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04e4005df0 con 0x5645327fe2f0 2024-09-21T01:18:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.289+0000 7f05015e2740 10 client.25489 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.289+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56453290b620 con 0x5645327fe2f0 2024-09-21T01:18:24.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.290+0000 7f04d37fe640 1 -- 172.21.15.37:0/3572156484 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04e4004bb0 con 0x5645327fe2f0 2024-09-21T01:18:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.291+0000 7f04d37fe640 1 -- 172.21.15.37:0/3572156484 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f04e403a040 con 0x5645327fe2f0 2024-09-21T01:18:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.292+0000 7f05015e2740 10 client.25489 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.292+0000 7f05015e2740 10 client.25489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.292+0000 7f05015e2740 20 client.25489 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:24.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.292+0000 7f05015e2740 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645327bb1c0 0x564532bee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.292+0000 7f05015e2740 4 client.25489 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.292+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f04e80ac460 con 0x5645327bb1c0 2024-09-21T01:18:24.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.293+0000 7f04f37fe640 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645327bb1c0 0x564532bee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.295+0000 7f04d37fe640 10 client.25489 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.295+0000 7f04f37fe640 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645327bb1c0 0x564532bee620 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d482bdb8561287 server_cookie=97436845b7da5cf0 in_seq=0 out_seq=0 2024-09-21T01:18:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.300+0000 7f04d37fe640 1 -- 172.21.15.37:0/3572156484 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f04e80ac460 con 0x5645327bb1c0 2024-09-21T01:18:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.300+0000 7f04d37fe640 10 client.25489 handle_command_reply: tid=0 2024-09-21T01:18:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.300+0000 7f05015e2740 1 client.25489 shutdown 2024-09-21T01:18:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.301+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 msgr2=0x564532be0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be0eb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009900 tx=0x7f04e4004270 comp rx=0 tx=0).stop 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 shutdown_connections 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645327bb1c0 0x564532bee620 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645328271b0 0x564532be1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 --2- 172.21.15.37:0/3572156484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be0eb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f04d37fe640 0 client.25489 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.302+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 >> 172.21.15.37:0/3572156484 conn(0x56453281b300 msgr2=0x564532bc8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.303+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 shutdown_connections 2024-09-21T01:18:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.303+0000 7f05015e2740 1 -- 172.21.15.37:0/3572156484 wait complete. 2024-09-21T01:18:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.303+0000 7f05015e2740 20 client.25489 trim_cache size 0 max 16384 2024-09-21T01:18:24.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.353+0000 7f05015e2740 1 Processor -- start 2024-09-21T01:18:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.354+0000 7f05015e2740 1 -- start start 2024-09-21T01:18:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.355+0000 7f05015e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532bc55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.356+0000 7f05015e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532bc96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.356+0000 7f05015e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bc9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.356+0000 7f05015e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41a91c0 con 0x5645327bb1c0 2024-09-21T01:18:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.356+0000 7f05015e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41aad30 con 0x5645327e5d80 2024-09-21T01:18:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.356+0000 7f05015e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41a9890 con 0x5645327fe2f0 2024-09-21T01:18:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.358+0000 7f04f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532bc55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.358+0000 7f04f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532bc55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48644/0 (socket says 172.21.15.37:48644) 2024-09-21T01:18:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.358+0000 7f04f3fff640 1 -- 172.21.15.37:0/1004686991 learned_addr learned my addr 172.21.15.37:0/1004686991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:24.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.359+0000 7f04f8b35640 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bc9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.359+0000 7f04f37fe640 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532bc96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.364+0000 7f04f8b35640 1 -- 172.21.15.37:0/1004686991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 msgr2=0x564532bc96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.364+0000 7f04f8b35640 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532bc96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.364+0000 7f04f8b35640 1 -- 172.21.15.37:0/1004686991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 msgr2=0x564532bc55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.364+0000 7f04f8b35640 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532bc55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.364+0000 7f04f8b35640 1 -- 172.21.15.37:0/1004686991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564532be1250 con 0x5645327fe2f0 2024-09-21T01:18:24.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.370+0000 7f04f8b35640 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bc9c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009fd0 tx=0x7f04ec00f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96ef95483aa7a6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.371+0000 7f04d9ffb640 1 -- 172.21.15.37:0/1004686991 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec013040 con 0x5645327fe2f0 2024-09-21T01:18:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.371+0000 7f04d9ffb640 1 -- 172.21.15.37:0/1004686991 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04ec01d040 con 0x5645327fe2f0 2024-09-21T01:18:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.371+0000 7f04d9ffb640 1 -- 172.21.15.37:0/1004686991 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec023e60 con 0x5645327fe2f0 2024-09-21T01:18:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.377+0000 7f05015e2740 1 -- 172.21.15.37:0/1004686991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 msgr2=0x564532bc9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.377+0000 7f05015e2740 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bc9c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009fd0 tx=0x7f04ec00f000 comp rx=0 tx=0).stop 2024-09-21T01:18:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.377+0000 7f05015e2740 1 -- 172.21.15.37:0/1004686991 shutdown_connections 2024-09-21T01:18:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.377+0000 7f05015e2740 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532bc9c30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.377+0000 7f05015e2740 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532bc96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.377+0000 7f05015e2740 1 --2- 172.21.15.37:0/1004686991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532bc55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.378+0000 7f05015e2740 1 -- 172.21.15.37:0/1004686991 >> 172.21.15.37:0/1004686991 conn(0x56453281b300 msgr2=0x564532bca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:24.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.385+0000 7f05015e2740 1 -- 172.21.15.37:0/1004686991 shutdown_connections 2024-09-21T01:18:24.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.385+0000 7f05015e2740 1 -- 172.21.15.37:0/1004686991 wait complete. 2024-09-21T01:18:24.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.387+0000 7f05015e2740 1 -- start start 2024-09-21T01:18:24.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.388+0000 7f05015e2740 1 Processor -- start 2024-09-21T01:18:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.389+0000 7f05015e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532be5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.389+0000 7f05015e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.389+0000 7f04f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532be5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f05015e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f05015e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41aa630 con 0x5645327bb1c0 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f05015e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41a9f60 con 0x5645327e5d80 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f05015e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41a7180 con 0x5645327fe2f0 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f04f37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:34486/0 (socket says 172.21.15.37:34486) 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.390+0000 7f04f37fe640 1 -- 172.21.15.37:0/2112394265 learned_addr learned my addr 172.21.15.37:0/2112394265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:24.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.391+0000 7f05015e2740 10 client.0 _ll_register_callbacks cb 0x7f04e402ab40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:24.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.391+0000 7f04f8b35640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.392+0000 7f04f37fe640 1 -- 172.21.15.37:0/2112394265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 msgr2=0x564532be6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.392+0000 7f04f37fe640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.392+0000 7f04f37fe640 1 -- 172.21.15.37:0/2112394265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 msgr2=0x564532be5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.392+0000 7f04f37fe640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532be5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:24.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.392+0000 7f04f37fe640 1 -- 172.21.15.37:0/2112394265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564532be7540 con 0x5645327e5d80 2024-09-21T01:18:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.393+0000 7f04f37fe640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be62e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04e80ac650 tx=0x7f04e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faee30b0ebc879b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.397+0000 7f04f3fff640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532be5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.400+0000 7f04d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.401+0000 7f04d37fe640 1 -- 172.21.15.37:0/2112394265 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80ac0c0 con 0x5645327e5d80 2024-09-21T01:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.401+0000 7f04d37fe640 1 -- 172.21.15.37:0/2112394265 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f04e80a8bc0 con 0x5645327e5d80 2024-09-21T01:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.401+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04ec01d040 con 0x5645327e5d80 2024-09-21T01:18:24.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.403+0000 7f04d37fe640 1 -- 172.21.15.37:0/2112394265 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04e80ac2a0 con 0x5645327e5d80 2024-09-21T01:18:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.403+0000 7f05015e2740 10 client.25556 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.403+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564532be88a0 con 0x5645327e5d80 2024-09-21T01:18:24.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.404+0000 7f04d37fe640 1 -- 172.21.15.37:0/2112394265 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04ec01d040 con 0x5645327e5d80 2024-09-21T01:18:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.407+0000 7f04d37fe640 1 -- 172.21.15.37:0/2112394265 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f04e8010380 con 0x5645327e5d80 2024-09-21T01:18:24.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.407+0000 7f05015e2740 10 client.25556 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:24.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.407+0000 7f05015e2740 10 client.25556 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:24.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.407+0000 7f05015e2740 20 client.25556 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:24.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.407+0000 7f05015e2740 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645328271b0 0x564532c5b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:24.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.408+0000 7f05015e2740 4 client.25556 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:18:24.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.408+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564532b43640 con 0x5645328271b0 2024-09-21T01:18:24.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.409+0000 7f04f3fff640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645328271b0 0x564532c5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.419+0000 7f04f3fff640 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645328271b0 0x564532c5b420 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70cf28a69debaac server_cookie=110ae52700698568 in_seq=0 out_seq=0 2024-09-21T01:18:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:24.419+0000 7f04d37fe640 10 client.25556 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:24.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:24 smithi137 ceph-mon[34607]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 892 MiB/s wr, 2.37k op/s 2024-09-21T01:18:24.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:24 smithi144 ceph-mon[34818]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 892 MiB/s wr, 2.37k op/s 2024-09-21T01:18:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:24 smithi037 ceph-mon[31105]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 892 MiB/s wr, 2.37k op/s 2024-09-21T01:18:26.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:26 smithi137 ceph-mon[34607]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 923 MiB/s wr, 2.32k op/s 2024-09-21T01:18:26.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:26 smithi144 ceph-mon[34818]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 923 MiB/s wr, 2.32k op/s 2024-09-21T01:18:26.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:26 smithi037 ceph-mon[31105]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 923 MiB/s wr, 2.32k op/s 2024-09-21T01:18:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.209+0000 7f04d37fe640 1 -- 172.21.15.37:0/2112394265 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564532b43640 con 0x5645328271b0 2024-09-21T01:18:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.209+0000 7f04d37fe640 10 client.25556 handle_command_reply: tid=0 2024-09-21T01:18:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.209+0000 7f05015e2740 1 client.25556 shutdown 2024-09-21T01:18:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 msgr2=0x564532be62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be62e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04e80ac650 tx=0x7f04e80046c0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 shutdown_connections 2024-09-21T01:18:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5645328271b0 0x564532c5b420 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645327fe2f0 0x564532be6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5645327e5d80 0x564532be62e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 --2- 172.21.15.37:0/2112394265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5645327bb1c0 0x564532be5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 >> 172.21.15.37:0/2112394265 conn(0x56453281b300 msgr2=0x564532bca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.219+0000 7f04d37fe640 0 client.25556 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.220+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 shutdown_connections 2024-09-21T01:18:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.221+0000 7f05015e2740 1 -- 172.21.15.37:0/2112394265 wait complete. 2024-09-21T01:18:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.221+0000 7f05015e2740 20 client.25556 trim_cache size 0 max 16384 2024-09-21T01:18:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:18:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:18:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:18:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:18:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.225+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04dc0b64e0 msgr2=0x7f04dc0b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.225+0000 7f04fa598640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04dc0b64e0 0x7f04dc0b89f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0070b0 tx=0x7f04ec0099d0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.225+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 msgr2=0x7f04f419c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.225+0000 7f04fa598640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 0x7f04f419c9d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f04e8006fd0 tx=0x7f04e800b890 comp rx=0 tx=0).stop 2024-09-21T01:18:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.228+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 shutdown_connections 2024-09-21T01:18:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.228+0000 7f04fa598640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f04dc0b64e0 0x7f04dc0b89f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.228+0000 7f04fa598640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f419d500 0x7f04f419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.229+0000 7f04fa598640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04f4103fc0 0x7f04f419c9d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.229+0000 7f04fa598640 1 --2- 172.21.15.37:0/3873388648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04f41025a0 0x7f04f419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.229+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 >> 172.21.15.37:0/3873388648 conn(0x7f04f40fdee0 msgr2=0x7f04f4108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.232+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 shutdown_connections 2024-09-21T01:18:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:27.232+0000 7f04fa598640 1 -- 172.21.15.37:0/3873388648 wait complete. 2024-09-21T01:18:28.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:28 smithi137 ceph-mon[34607]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 755 MiB/s wr, 1.71k op/s 2024-09-21T01:18:28.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:28 smithi144 ceph-mon[34818]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 755 MiB/s wr, 1.71k op/s 2024-09-21T01:18:28.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:28 smithi037 ceph-mon[31105]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 755 MiB/s wr, 1.71k op/s 2024-09-21T01:18:30.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:30 smithi137 ceph-mon[34607]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1003 MiB/s wr, 2.17k op/s 2024-09-21T01:18:30.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:30 smithi144 ceph-mon[34818]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1003 MiB/s wr, 2.17k op/s 2024-09-21T01:18:30.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:30 smithi037 ceph-mon[31105]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1003 MiB/s wr, 2.17k op/s 2024-09-21T01:18:32.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:32 smithi137 ceph-mon[34607]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 816 MiB/s wr, 1.93k op/s 2024-09-21T01:18:33.423 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:32 smithi037 ceph-mon[31105]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 816 MiB/s wr, 1.93k op/s 2024-09-21T01:18:33.423 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:32 smithi144 ceph-mon[34818]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 816 MiB/s wr, 1.93k op/s 2024-09-21T01:18:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:34 smithi137 ceph-mon[34607]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 913 MiB/s wr, 2.28k op/s 2024-09-21T01:18:34.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:34 smithi144 ceph-mon[34818]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 913 MiB/s wr, 2.28k op/s 2024-09-21T01:18:34.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:34 smithi037 ceph-mon[31105]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 913 MiB/s wr, 2.28k op/s 2024-09-21T01:18:36.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:36 smithi037 ceph-mon[31105]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 930 MiB/s wr, 2.29k op/s 2024-09-21T01:18:36.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:36 smithi137 ceph-mon[34607]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 930 MiB/s wr, 2.29k op/s 2024-09-21T01:18:36.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:36 smithi144 ceph-mon[34818]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 930 MiB/s wr, 2.29k op/s 2024-09-21T01:18:38.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:38 smithi037 ceph-mon[31105]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 750 MiB/s wr, 1.83k op/s 2024-09-21T01:18:38.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:38 smithi137 ceph-mon[34607]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 750 MiB/s wr, 1.83k op/s 2024-09-21T01:18:38.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:38 smithi144 ceph-mon[34818]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 750 MiB/s wr, 1.83k op/s 2024-09-21T01:18:40.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:40 smithi037 ceph-mon[31105]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.0 GiB/s wr, 2.61k op/s 2024-09-21T01:18:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.540+0000 7f866a8f6640 1 -- 172.21.15.37:0/1452994395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f866410ab70 msgr2=0x7f866410af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.540+0000 7f866a8f6640 1 --2- 172.21.15.37:0/1452994395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f866410ab70 0x7f866410af80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f865c009ca0 tx=0x7f865c02a8f0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 -- 172.21.15.37:0/1452994395 shutdown_connections 2024-09-21T01:18:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 --2- 172.21.15.37:0/1452994395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f866410b510 0x7f8664111eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 --2- 172.21.15.37:0/1452994395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f866410ab70 0x7f866410af80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 --2- 172.21.15.37:0/1452994395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8664109af0 0x7f8664109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 -- 172.21.15.37:0/1452994395 >> 172.21.15.37:0/1452994395 conn(0x7f8664078e30 msgr2=0x7f866407b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 -- 172.21.15.37:0/1452994395 shutdown_connections 2024-09-21T01:18:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.541+0000 7f866a8f6640 1 -- 172.21.15.37:0/1452994395 wait complete. 2024-09-21T01:18:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 Processor -- start 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 -- start start 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 0x7f8664072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866410ab70 0x7f86640728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f866410b510 0x7f8664073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f86641157e0 con 0x7f8664109af0 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8664115660 con 0x7f866410ab70 2024-09-21T01:18:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.543+0000 7f866a8f6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8664115960 con 0x7f866410b510 2024-09-21T01:18:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.544+0000 7f86698f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 0x7f8664072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.544+0000 7f86698f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 0x7f8664072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53268/0 (socket says 172.21.15.37:53268) 2024-09-21T01:18:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.544+0000 7f86698f4640 1 -- 172.21.15.37:0/3586069712 learned_addr learned my addr 172.21.15.37:0/3586069712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.545+0000 7f866a0f5640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f866410b510 0x7f8664073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.545+0000 7f86690f3640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866410ab70 0x7f86640728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.546+0000 7f86698f4640 1 -- 172.21.15.37:0/3586069712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f866410b510 msgr2=0x7f8664073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.546+0000 7f86698f4640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f866410b510 0x7f8664073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.546+0000 7f86698f4640 1 -- 172.21.15.37:0/3586069712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866410ab70 msgr2=0x7f86640728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.546+0000 7f86698f4640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866410ab70 0x7f86640728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.546+0000 7f86698f4640 1 -- 172.21.15.37:0/3586069712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664073ca0 con 0x7f8664109af0 2024-09-21T01:18:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.547+0000 7f86698f4640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 0x7f8664072260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f865400b4a0 tx=0x7f865400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.547+0000 7f865affd640 1 -- 172.21.15.37:0/3586069712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654014070 con 0x7f8664109af0 2024-09-21T01:18:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.548+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8664073f90 con 0x7f8664109af0 2024-09-21T01:18:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.548+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8664074650 con 0x7f8664109af0 2024-09-21T01:18:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.551+0000 7f865affd640 1 -- 172.21.15.37:0/3586069712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8654010ac0 con 0x7f8664109af0 2024-09-21T01:18:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.552+0000 7f865affd640 1 -- 172.21.15.37:0/3586069712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654017c30 con 0x7f8664109af0 2024-09-21T01:18:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.552+0000 7f8672ac0740 1 Processor -- start 2024-09-21T01:18:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.553+0000 7f8672ac0740 1 -- start start 2024-09-21T01:18:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.556+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 0x55ee916bd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.556+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.556+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916be200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.556+0000 7f8672ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee9162f6f0 con 0x55ee913151b0 2024-09-21T01:18:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.556+0000 7f8672ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee9161eb20 con 0x55ee912ec2f0 2024-09-21T01:18:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.556+0000 7f8672ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee91622930 con 0x55ee912f44d0 2024-09-21T01:18:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.557+0000 7f866a0f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 0x55ee916bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.557+0000 7f866a0f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 0x55ee916bd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53284/0 (socket says 172.21.15.37:53284) 2024-09-21T01:18:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.557+0000 7f866a0f5640 1 -- 172.21.15.37:0/1285357651 learned_addr learned my addr 172.21.15.37:0/1285357651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.559+0000 7f866a0f5640 1 -- 172.21.15.37:0/1285357651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 msgr2=0x55ee916be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.559+0000 7f866a0f5640 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.559+0000 7f866a0f5640 1 -- 172.21.15.37:0/1285357651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 msgr2=0x55ee916bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.559+0000 7f866a0f5640 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.559+0000 7f866a0f5640 1 -- 172.21.15.37:0/1285357651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee915e4530 con 0x55ee913151b0 2024-09-21T01:18:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.559+0000 7f866a0f5640 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 0x55ee916bd040 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f866000b700 tx=0x7f866000bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c013b4211ae24a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.561+0000 7f865affd640 1 -- 172.21.15.37:0/3586069712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8654017070 con 0x7f8664109af0 2024-09-21T01:18:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.562+0000 7f865affd640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f86500b6710 0x7f86500b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.563+0000 7f86698f4640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f86500b6710 0x7f86500b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.563+0000 7f865affd640 1 -- 172.21.15.37:0/3586069712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f86540e88b0 con 0x7f8664109af0 2024-09-21T01:18:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.564+0000 7f86698f4640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f86500b6710 0x7f86500b8c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86540abc70 tx=0x7f8654078520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.567+0000 7f864ffff640 1 -- 172.21.15.37:0/1285357651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8660003dd0 con 0x55ee913151b0 2024-09-21T01:18:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.567+0000 7f864ffff640 1 -- 172.21.15.37:0/1285357651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8660015070 con 0x55ee913151b0 2024-09-21T01:18:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.574+0000 7f8672ac0740 1 -- 172.21.15.37:0/1285357651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 msgr2=0x55ee916bd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.574+0000 7f8672ac0740 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 0x55ee916bd040 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f866000b700 tx=0x7f866000bbc0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.580+0000 7f8672ac0740 1 -- 172.21.15.37:0/1285357651 shutdown_connections 2024-09-21T01:18:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.580+0000 7f8672ac0740 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.580+0000 7f8672ac0740 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916bd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.580+0000 7f8672ac0740 1 --2- 172.21.15.37:0/1285357651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee913151b0 0x55ee916bd040 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.580+0000 7f8672ac0740 1 -- 172.21.15.37:0/1285357651 >> 172.21.15.37:0/1285357651 conn(0x55ee91309300 msgr2=0x55ee916b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.589+0000 7f8672ac0740 1 -- 172.21.15.37:0/1285357651 shutdown_connections 2024-09-21T01:18:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.593+0000 7f8672ac0740 1 -- 172.21.15.37:0/1285357651 wait complete. 2024-09-21T01:18:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.595+0000 7f8672ac0740 1 -- start start 2024-09-21T01:18:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.595+0000 7f8672ac0740 1 Processor -- start 2024-09-21T01:18:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 0x55ee916c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee913151b0 0x55ee916c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee91556ab0 con 0x55ee912ec2f0 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ee915c4730 con 0x55ee913151b0 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee916bed70 con 0x55ee912f44d0 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.598+0000 7f8672ac0740 10 client.0 _ll_register_callbacks cb 0x55ee916186b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.599+0000 7f86690f3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.599+0000 7f86690f3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56384/0 (socket says 172.21.15.37:56384) 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.599+0000 7f86690f3640 1 -- 172.21.15.37:0/2461078459 learned_addr learned my addr 172.21.15.37:0/2461078459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.600+0000 7f86690f3640 1 -- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee913151b0 msgr2=0x55ee916c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.600+0000 7f86690f3640 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee913151b0 0x55ee916c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.600+0000 7f86690f3640 1 -- 172.21.15.37:0/2461078459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 msgr2=0x55ee916c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.600+0000 7f86690f3640 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 0x55ee916c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.600+0000 7f86690f3640 1 -- 172.21.15.37:0/2461078459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee91380790 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.601+0000 7f86690f3640 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916c6fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f865c0316b0 tx=0x7f865c0316e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf46bb391c6bafc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.601+0000 7f864d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.602+0000 7f864d7fa640 1 -- 172.21.15.37:0/2461078459 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c030800 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.602+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8660015070 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.602+0000 7f864d7fa640 1 -- 172.21.15.37:0/2461078459 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f865c0309a0 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.603+0000 7f864d7fa640 1 -- 172.21.15.37:0/2461078459 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f865c004b40 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.603+0000 7f8672ac0740 10 client.25504 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.603+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee913f9620 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f864d7fa640 1 -- 172.21.15.37:0/2461078459 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8660015070 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f864d7fa640 1 -- 172.21.15.37:0/2461078459 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f865c04c020 con 0x55ee912f44d0 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f8672ac0740 10 client.25504 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f8672ac0740 10 client.25504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f8672ac0740 20 client.25504 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f8672ac0740 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912d3d80 0x55ee916d4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f8672ac0740 4 client.25504 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.604+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee91631640 con 0x55ee912d3d80 2024-09-21T01:18:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.610+0000 7f866a0f5640 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912d3d80 0x55ee916d4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.612+0000 7f866a0f5640 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912d3d80 0x55ee916d4540 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a609a2d9ed215885 server_cookie=304fe8eedb4c56f1 in_seq=0 out_seq=0 2024-09-21T01:18:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.612+0000 7f864d7fa640 10 client.25504 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.619+0000 7f864d7fa640 1 -- 172.21.15.37:0/2461078459 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee91631640 con 0x55ee912d3d80 2024-09-21T01:18:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.619+0000 7f864d7fa640 10 client.25504 handle_command_reply: tid=0 2024-09-21T01:18:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.619+0000 7f8672ac0740 1 client.25504 shutdown 2024-09-21T01:18:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.621+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 msgr2=0x55ee916c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.621+0000 7f8672ac0740 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916c6fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f865c0316b0 tx=0x7f865c0316e0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 shutdown_connections 2024-09-21T01:18:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912d3d80 0x55ee916d4540 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee913151b0 0x55ee916c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee912f44d0 0x55ee916c6fb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 --2- 172.21.15.37:0/2461078459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 0x55ee916c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 >> 172.21.15.37:0/2461078459 conn(0x55ee91309300 msgr2=0x55ee916b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f864d7fa640 0 client.25504 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 shutdown_connections 2024-09-21T01:18:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.623+0000 7f8672ac0740 1 -- 172.21.15.37:0/2461078459 wait complete. 2024-09-21T01:18:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.625+0000 7f8672ac0740 20 client.25504 trim_cache size 0 max 16384 2024-09-21T01:18:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.673+0000 7f8672ac0740 1 Processor -- start 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 -- start start 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 0x55ee916c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 0x55ee916c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f864800e630 con 0x55ee912ec2f0 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86480101a0 con 0x55ee912f44d0 2024-09-21T01:18:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.675+0000 7f8672ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f864800ed00 con 0x55ee913151b0 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.676+0000 7f86690f3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 0x55ee916c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.676+0000 7f86690f3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 0x55ee916c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60254/0 (socket says 172.21.15.37:60254) 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.676+0000 7f86690f3640 1 -- 172.21.15.37:0/3062996600 learned_addr learned my addr 172.21.15.37:0/3062996600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.677+0000 7f866a0f5640 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.677+0000 7f86690f3640 1 -- 172.21.15.37:0/3062996600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 msgr2=0x55ee916b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.677+0000 7f86690f3640 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.677+0000 7f86690f3640 1 -- 172.21.15.37:0/3062996600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 msgr2=0x55ee916c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.677+0000 7f86690f3640 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 0x55ee916c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.677+0000 7f86690f3640 1 -- 172.21.15.37:0/3062996600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee916c72b0 con 0x55ee912f44d0 2024-09-21T01:18:40.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.678+0000 7f86690f3640 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 0x55ee916c6050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f865c04ea40 tx=0x7f865c04ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da24ffdffdb2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:40.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.680+0000 7f864f7fe640 1 -- 172.21.15.37:0/3062996600 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c004ee0 con 0x55ee912f44d0 2024-09-21T01:18:40.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.680+0000 7f864f7fe640 1 -- 172.21.15.37:0/3062996600 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f865c036040 con 0x55ee912f44d0 2024-09-21T01:18:40.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.680+0000 7f864f7fe640 1 -- 172.21.15.37:0/3062996600 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c005350 con 0x55ee912f44d0 2024-09-21T01:18:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.693+0000 7f8672ac0740 1 -- 172.21.15.37:0/3062996600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 msgr2=0x55ee916c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:40.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.693+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 0x55ee916c6050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f865c04ea40 tx=0x7f865c04ee30 comp rx=0 tx=0).stop 2024-09-21T01:18:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.695+0000 7f8672ac0740 1 -- 172.21.15.37:0/3062996600 shutdown_connections 2024-09-21T01:18:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.696+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.696+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912f44d0 0x55ee916c6050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.696+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3062996600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912ec2f0 0x55ee916c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.696+0000 7f8672ac0740 1 -- 172.21.15.37:0/3062996600 >> 172.21.15.37:0/3062996600 conn(0x55ee91309300 msgr2=0x55ee916b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.697+0000 7f8672ac0740 1 -- 172.21.15.37:0/3062996600 shutdown_connections 2024-09-21T01:18:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.697+0000 7f8672ac0740 1 -- 172.21.15.37:0/3062996600 wait complete. 2024-09-21T01:18:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.698+0000 7f8672ac0740 1 -- start start 2024-09-21T01:18:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.699+0000 7f8672ac0740 1 Processor -- start 2024-09-21T01:18:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.700+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.701+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912f44d0 0x55ee916cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.701+0000 7f8672ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.701+0000 7f8672ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f864800faa0 con 0x55ee912f44d0 2024-09-21T01:18:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.702+0000 7f8672ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f864800f3d0 con 0x55ee912ec2f0 2024-09-21T01:18:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.702+0000 7f8672ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f864800c5f0 con 0x55ee913151b0 2024-09-21T01:18:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.702+0000 7f866a0f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.702+0000 7f866a0f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60264/0 (socket says 172.21.15.37:60264) 2024-09-21T01:18:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.702+0000 7f8672ac0740 10 client.0 _ll_register_callbacks cb 0x7f865c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.702+0000 7f866a0f5640 1 -- 172.21.15.37:0/3346800329 learned_addr learned my addr 172.21.15.37:0/3346800329 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.703+0000 7f86690f3640 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912f44d0 0x55ee916cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.704+0000 7f86690f3640 1 -- 172.21.15.37:0/3346800329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 msgr2=0x55ee916ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.704+0000 7f86690f3640 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.704+0000 7f86690f3640 1 -- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 msgr2=0x55ee916cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.704+0000 7f86690f3640 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.704+0000 7f86690f3640 1 -- 172.21.15.37:0/3346800329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee916cd4b0 con 0x55ee912f44d0 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.704+0000 7f86690f3640 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912f44d0 0x55ee916cc1e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f865c04ebb0 tx=0x7f865c04e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd51cd2c55a687df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.705+0000 7f864d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.706+0000 7f864d7fa640 1 -- 172.21.15.37:0/3346800329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c057600 con 0x55ee912f44d0 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.706+0000 7f864d7fa640 1 -- 172.21.15.37:0/3346800329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f865c0577a0 con 0x55ee912f44d0 2024-09-21T01:18:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.706+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f865c036040 con 0x55ee912f44d0 2024-09-21T01:18:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.707+0000 7f864d7fa640 1 -- 172.21.15.37:0/3346800329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f865c0579a0 con 0x55ee912f44d0 2024-09-21T01:18:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.707+0000 7f8672ac0740 10 client.16014 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.707+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee916ce7a0 con 0x55ee912f44d0 2024-09-21T01:18:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.710+0000 7f864d7fa640 1 -- 172.21.15.37:0/3346800329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f865c036040 con 0x55ee912f44d0 2024-09-21T01:18:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.714+0000 7f864d7fa640 1 -- 172.21.15.37:0/3346800329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f865c04c040 con 0x55ee912f44d0 2024-09-21T01:18:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.714+0000 7f8672ac0740 10 client.16014 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.714+0000 7f8672ac0740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.714+0000 7f8672ac0740 20 client.16014 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.715+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912a91c0 0x55ee917410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.715+0000 7f8672ac0740 4 client.16014 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:18:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.715+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee9162d0f0 con 0x55ee912a91c0 2024-09-21T01:18:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.718+0000 7f866a0f5640 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912a91c0 0x55ee917410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.727+0000 7f866a0f5640 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912a91c0 0x55ee917410e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c749490e1f4c09 server_cookie=4c4ef59df6842e8b in_seq=0 out_seq=0 2024-09-21T01:18:40.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:40.727+0000 7f864d7fa640 10 client.16014 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:40.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:40 smithi137 ceph-mon[34607]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.0 GiB/s wr, 2.61k op/s 2024-09-21T01:18:40.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:40 smithi144 ceph-mon[34818]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.0 GiB/s wr, 2.61k op/s 2024-09-21T01:18:42.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:42 smithi037 ceph-mon[31105]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 MiB/s wr, 2.25k op/s 2024-09-21T01:18:42.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:42 smithi137 ceph-mon[34607]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 MiB/s wr, 2.25k op/s 2024-09-21T01:18:42.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:42 smithi144 ceph-mon[34818]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 MiB/s wr, 2.25k op/s 2024-09-21T01:18:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.046+0000 7f864d7fa640 1 -- 172.21.15.37:0/3346800329 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee9162d0f0 con 0x55ee912a91c0 2024-09-21T01:18:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.046+0000 7f864d7fa640 10 client.16014 handle_command_reply: tid=0 2024-09-21T01:18:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.046+0000 7f8672ac0740 1 client.16014 shutdown 2024-09-21T01:18:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.046+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912f44d0 msgr2=0x55ee916cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.046+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912f44d0 0x55ee916cc1e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f865c04ebb0 tx=0x7f865c04e690 comp rx=0 tx=0).stop 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 shutdown_connections 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ee912a91c0 0x55ee917410e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee913151b0 0x55ee916ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee912f44d0 0x55ee916cc1e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f8672ac0740 1 --2- 172.21.15.37:0/3346800329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ee912ec2f0 0x55ee916cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 >> 172.21.15.37:0/3346800329 conn(0x55ee91309300 msgr2=0x55ee916b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.047+0000 7f864d7fa640 0 client.16014 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.048+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 shutdown_connections 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.048+0000 7f8672ac0740 1 -- 172.21.15.37:0/3346800329 wait complete. 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.049+0000 7f8672ac0740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:18:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:18:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f86500b6710 msgr2=0x7f86500b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f86500b6710 0x7f86500b8c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86540abc70 tx=0x7f8654078520 comp rx=0 tx=0).stop 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 msgr2=0x7f8664072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 0x7f8664072260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f865400b4a0 tx=0x7f865400b960 comp rx=0 tx=0).stop 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 shutdown_connections 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f86500b6710 0x7f86500b8c20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f866410b510 0x7f8664073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f866410ab70 0x7f86640728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 --2- 172.21.15.37:0/3586069712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8664109af0 0x7f8664072260 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.050+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 >> 172.21.15.37:0/3586069712 conn(0x7f8664078e30 msgr2=0x7f866410de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.052+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 shutdown_connections 2024-09-21T01:18:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:43.052+0000 7f866a8f6640 1 -- 172.21.15.37:0/3586069712 wait complete. 2024-09-21T01:18:44.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:44 smithi037 ceph-mon[31105]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 915 MiB/s wr, 2.32k op/s 2024-09-21T01:18:44.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:44 smithi137 ceph-mon[34607]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 915 MiB/s wr, 2.32k op/s 2024-09-21T01:18:44.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:44 smithi144 ceph-mon[34818]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 915 MiB/s wr, 2.32k op/s 2024-09-21T01:18:46.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:46 smithi037 ceph-mon[31105]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 945 MiB/s wr, 2.18k op/s 2024-09-21T01:18:46.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:46 smithi137 ceph-mon[34607]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 945 MiB/s wr, 2.18k op/s 2024-09-21T01:18:46.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:46 smithi144 ceph-mon[34818]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 945 MiB/s wr, 2.18k op/s 2024-09-21T01:18:47.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:18:48.481 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:18:48.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:48 smithi037 ceph-mon[31105]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 767 MiB/s wr, 1.70k op/s 2024-09-21T01:18:48.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:48 smithi137 ceph-mon[34607]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 767 MiB/s wr, 1.70k op/s 2024-09-21T01:18:48.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:48 smithi144 ceph-mon[34818]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 767 MiB/s wr, 1.70k op/s 2024-09-21T01:18:50.357 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:18:50.357 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:18:50.357 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:18:50.358 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:18:50.358 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:18:50.358 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:18:50.358 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:50.358 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:18:50.359 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:18:50.359 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:18:50.359 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:18:50.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:18:50.359 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:18:50.359 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:18:50.360 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:18:50.361 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:18:50.361 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:18:50.361 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:18:50.361 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:18:50.361 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:18:50.361 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:18:50.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:18:50.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:18:50.362 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:18:50.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.046+0000 7ffb91b40640 1 -- 172.21.15.37:0/806678355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c10a9e0 msgr2=0x7ffb8c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.046+0000 7ffb91b40640 1 --2- 172.21.15.37:0/806678355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c10a9e0 0x7ffb8c10adf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009900 tx=0x7ffb7402a440 comp rx=0 tx=0).stop 2024-09-21T01:18:50.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.049+0000 7ffb91b40640 1 -- 172.21.15.37:0/806678355 shutdown_connections 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.049+0000 7ffb91b40640 1 --2- 172.21.15.37:0/806678355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb8c11cc30 0x7ffb8c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.049+0000 7ffb91b40640 1 --2- 172.21.15.37:0/806678355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c10a9e0 0x7ffb8c10adf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.049+0000 7ffb91b40640 1 --2- 172.21.15.37:0/806678355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c111f40 0x7ffb8c10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.049+0000 7ffb91b40640 1 -- 172.21.15.37:0/806678355 >> 172.21.15.37:0/806678355 conn(0x7ffb8c070ec0 msgr2=0x7ffb8c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.053+0000 7ffb91b40640 1 -- 172.21.15.37:0/806678355 shutdown_connections 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.056+0000 7ffb91b40640 1 -- 172.21.15.37:0/806678355 wait complete. 2024-09-21T01:18:50.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.059+0000 7ffb91b40640 1 Processor -- start 2024-09-21T01:18:50.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.060+0000 7ffb91b40640 1 -- start start 2024-09-21T01:18:50.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.061+0000 7ffb91b40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb8c10a9e0 0x7ffb8c11a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.061+0000 7ffb91b40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c111f40 0x7ffb8c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.061+0000 7ffb91b40640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c11cc30 0x7ffb8c113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.062+0000 7ffb91b40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1228b0 con 0x7ffb8c111f40 2024-09-21T01:18:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.062+0000 7ffb91b40640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c122730 con 0x7ffb8c10a9e0 2024-09-21T01:18:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.062+0000 7ffb91b40640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c122a30 con 0x7ffb8c11cc30 2024-09-21T01:18:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.065+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c11cc30 0x7ffb8c113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.065+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c11cc30 0x7ffb8c113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:46514/0 (socket says 172.21.15.37:46514) 2024-09-21T01:18:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.065+0000 7ffb8bfff640 1 -- 172.21.15.37:0/3922000400 learned_addr learned my addr 172.21.15.37:0/3922000400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.065+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb8c10a9e0 0x7ffb8c11a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.065+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c111f40 0x7ffb8c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.067+0000 7ffb82ffd640 1 -- 172.21.15.37:0/3922000400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c11cc30 msgr2=0x7ffb8c113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.067+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c11cc30 0x7ffb8c113c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.067+0000 7ffb82ffd640 1 -- 172.21.15.37:0/3922000400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb8c10a9e0 msgr2=0x7ffb8c11a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.067+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb8c10a9e0 0x7ffb8c11a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.067+0000 7ffb82ffd640 1 -- 172.21.15.37:0/3922000400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c1144b0 con 0x7ffb8c111f40 2024-09-21T01:18:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.069+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c111f40 0x7ffb8c1136f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009230 tx=0x7ffb74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.070+0000 7ffb897fa640 1 -- 172.21.15.37:0/3922000400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74040070 con 0x7ffb8c111f40 2024-09-21T01:18:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.070+0000 7ffb897fa640 1 -- 172.21.15.37:0/3922000400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb74031b40 con 0x7ffb8c111f40 2024-09-21T01:18:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.070+0000 7ffb897fa640 1 -- 172.21.15.37:0/3922000400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74035020 con 0x7ffb8c111f40 2024-09-21T01:18:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.070+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c1190f0 con 0x7ffb8c111f40 2024-09-21T01:18:50.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.070+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c119550 con 0x7ffb8c111f40 2024-09-21T01:18:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.090+0000 7ffb980b4740 1 Processor -- start 2024-09-21T01:18:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.090+0000 7ffb980b4740 1 -- start start 2024-09-21T01:18:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.091+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.092+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.092+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.092+0000 7ffb980b4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ed3503ae50 con 0x55ed34d1d070 2024-09-21T01:18:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.092+0000 7ffb980b4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed3502a280 con 0x55ed34cf41b0 2024-09-21T01:18:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.092+0000 7ffb980b4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ed3502e090 con 0x55ed34cfc390 2024-09-21T01:18:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.094+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.097+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41334/0 (socket says 172.21.15.37:41334) 2024-09-21T01:18:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.097+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/3839712916 learned_addr learned my addr 172.21.15.37:0/3839712916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:50.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.097+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.102+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.102+0000 7ffb897fa640 1 -- 172.21.15.37:0/3922000400 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ffb74043070 con 0x7ffb8c111f40 2024-09-21T01:18:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.105+0000 7ffb897fa640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ffb780b66e0 0x7ffb780b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.106+0000 7ffb897fa640 1 -- 172.21.15.37:0/3922000400 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ffb74107c70 con 0x7ffb8c111f40 2024-09-21T01:18:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.107+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/3839712916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 msgr2=0x55ed350c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.107+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.107+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/3839712916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 msgr2=0x55ed350c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.107+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.107+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/3839712916 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed34d88650 con 0x55ed34cf41b0 2024-09-21T01:18:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.111+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:18:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.111+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:18:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.113+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350c4b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00cbf0 tx=0x7ffb7c00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8db3c0f7f3726f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.113+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ffb780b66e0 0x7ffb780b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.117+0000 7ffb81ffb640 1 -- 172.21.15.37:0/3839712916 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c010630 con 0x55ed34cf41b0 2024-09-21T01:18:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.117+0000 7ffb81ffb640 1 -- 172.21.15.37:0/3839712916 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb7c010c80 con 0x55ed34cf41b0 2024-09-21T01:18:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.118+0000 7ffb81ffb640 1 -- 172.21.15.37:0/3839712916 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00fba0 con 0x55ed34cf41b0 2024-09-21T01:18:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.118+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ffb780b66e0 0x7ffb780b8bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb84011580 tx=0x7ffb84004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.121+0000 7ffb980b4740 1 -- 172.21.15.37:0/3839712916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 msgr2=0x55ed350c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.121+0000 7ffb980b4740 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350c4b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00cbf0 tx=0x7ffb7c00e720 comp rx=0 tx=0).stop 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 -- 172.21.15.37:0/3839712916 shutdown_connections 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350c4b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 --2- 172.21.15.37:0/3839712916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 -- 172.21.15.37:0/3839712916 >> 172.21.15.37:0/3839712916 conn(0x55ed34d11460 msgr2=0x55ed350c2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 -- 172.21.15.37:0/3839712916 shutdown_connections 2024-09-21T01:18:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.125+0000 7ffb980b4740 1 -- 172.21.15.37:0/3839712916 wait complete. 2024-09-21T01:18:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.126+0000 7ffb980b4740 1 -- start start 2024-09-21T01:18:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.127+0000 7ffb980b4740 1 Processor -- start 2024-09-21T01:18:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.127+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350dc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb980b4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ed34e8b700 con 0x55ed34d1d070 2024-09-21T01:18:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb980b4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed34fc5110 con 0x55ed34cf41b0 2024-09-21T01:18:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb980b4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ed350d2e30 con 0x55ed34cfc390 2024-09-21T01:18:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb980b4740 10 client.0 _ll_register_callbacks cb 0x55ed34fde990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350dc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58000/0 (socket says 172.21.15.37:58000) 2024-09-21T01:18:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.128+0000 7ffb8bfff640 1 -- 172.21.15.37:0/2020621912 learned_addr learned my addr 172.21.15.37:0/2020621912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.129+0000 7ffb8bfff640 1 -- 172.21.15.37:0/2020621912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 msgr2=0x55ed350d0260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:18:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.129+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350d0260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.129+0000 7ffb8bfff640 1 -- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 msgr2=0x55ed350cfd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:18:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.129+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350cfd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.129+0000 7ffb8bfff640 1 -- 172.21.15.37:0/2020621912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed34ff2c40 con 0x55ed34d1d070 2024-09-21T01:18:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.133+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350dc170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ffb84012f70 tx=0x7ffb84004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c99862d740bc94b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.133+0000 7ffb6affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.136+0000 7ffb6affd640 1 -- 172.21.15.37:0/2020621912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8401d650 con 0x55ed34d1d070 2024-09-21T01:18:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.136+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb7c010c80 con 0x55ed34d1d070 2024-09-21T01:18:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.136+0000 7ffb6affd640 1 -- 172.21.15.37:0/2020621912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ffb8401d7f0 con 0x55ed34d1d070 2024-09-21T01:18:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.138+0000 7ffb6affd640 1 -- 172.21.15.37:0/2020621912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb8401d9f0 con 0x55ed34d1d070 2024-09-21T01:18:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.138+0000 7ffb980b4740 10 client.16026 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.138+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed350debe0 con 0x55ed34d1d070 2024-09-21T01:18:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb6affd640 1 -- 172.21.15.37:0/2020621912 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb7c010c80 con 0x55ed34d1d070 2024-09-21T01:18:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb6affd640 1 -- 172.21.15.37:0/2020621912 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ffb8401ec40 con 0x55ed34d1d070 2024-09-21T01:18:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb980b4740 10 client.16026 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb980b4740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb980b4740 20 client.16026 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb980b4740 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cdb9f0 0x55ed350e2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb980b4740 4 client.16026 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.141+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed3503cda0 con 0x55ed34cdb9f0 2024-09-21T01:18:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.147+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cdb9f0 0x55ed350e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.153+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cdb9f0 0x55ed350e2640 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c7c200f206a548 server_cookie=4afe6cc45f3551d3 in_seq=0 out_seq=0 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.153+0000 7ffb6affd640 10 client.16026 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.157+0000 7ffb6affd640 1 -- 172.21.15.37:0/2020621912 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed3503cda0 con 0x55ed34cdb9f0 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.157+0000 7ffb6affd640 10 client.16026 handle_command_reply: tid=0 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.157+0000 7ffb980b4740 1 client.16026 shutdown 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 msgr2=0x55ed350dc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350dc170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ffb84012f70 tx=0x7ffb84004ab0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 shutdown_connections 2024-09-21T01:18:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cdb9f0 0x55ed350e2640 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34d1d070 0x55ed350dc170 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cfc390 0x55ed350d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 --2- 172.21.15.37:0/2020621912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cf41b0 0x55ed350cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 >> 172.21.15.37:0/2020621912 conn(0x55ed34d11460 msgr2=0x55ed350c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.158+0000 7ffb6affd640 0 client.16026 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.160+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 shutdown_connections 2024-09-21T01:18:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.160+0000 7ffb980b4740 1 -- 172.21.15.37:0/2020621912 wait complete. 2024-09-21T01:18:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.161+0000 7ffb980b4740 20 client.16026 trim_cache size 0 max 16384 2024-09-21T01:18:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.198+0000 7ffb980b4740 1 Processor -- start 2024-09-21T01:18:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.198+0000 7ffb980b4740 1 -- start start 2024-09-21T01:18:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.198+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 0x55ed350c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.198+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cfc390 0x55ed350c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34d1d070 0x55ed350c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb980b4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1c6af0 con 0x55ed34cf41b0 2024-09-21T01:18:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb980b4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1c8660 con 0x55ed34cfc390 2024-09-21T01:18:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb980b4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1c71c0 con 0x55ed34d1d070 2024-09-21T01:18:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 0x55ed350c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 0x55ed350c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58002/0 (socket says 172.21.15.37:58002) 2024-09-21T01:18:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/1533586536 learned_addr learned my addr 172.21.15.37:0/1533586536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cfc390 0x55ed350c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/1533586536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34d1d070 msgr2=0x55ed350c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34d1d070 0x55ed350c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/1533586536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cfc390 msgr2=0x55ed350c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cfc390 0x55ed350c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.199+0000 7ffb8b7fe640 1 -- 172.21.15.37:0/1533586536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed350dea10 con 0x55ed34cf41b0 2024-09-21T01:18:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.200+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 0x55ed350c5d90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00f750 tx=0x7ffb7c00f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890549bdd045a15e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.200+0000 7ffb817fa640 1 -- 172.21.15.37:0/1533586536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00c730 con 0x55ed34cf41b0 2024-09-21T01:18:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.200+0000 7ffb817fa640 1 -- 172.21.15.37:0/1533586536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb7c0054f0 con 0x55ed34cf41b0 2024-09-21T01:18:50.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.200+0000 7ffb817fa640 1 -- 172.21.15.37:0/1533586536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00fe20 con 0x55ed34cf41b0 2024-09-21T01:18:50.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.201+0000 7ffb980b4740 1 -- 172.21.15.37:0/1533586536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 msgr2=0x55ed350c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.201+0000 7ffb980b4740 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 0x55ed350c5d90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00f750 tx=0x7ffb7c00f780 comp rx=0 tx=0).stop 2024-09-21T01:18:50.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 -- 172.21.15.37:0/1533586536 shutdown_connections 2024-09-21T01:18:50.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34d1d070 0x55ed350c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34cfc390 0x55ed350c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 --2- 172.21.15.37:0/1533586536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cf41b0 0x55ed350c5d90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 -- 172.21.15.37:0/1533586536 >> 172.21.15.37:0/1533586536 conn(0x55ed34d11460 msgr2=0x55ed350c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 -- 172.21.15.37:0/1533586536 shutdown_connections 2024-09-21T01:18:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.202+0000 7ffb980b4740 1 -- 172.21.15.37:0/1533586536 wait complete. 2024-09-21T01:18:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.203+0000 7ffb980b4740 1 -- start start 2024-09-21T01:18:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.203+0000 7ffb980b4740 1 Processor -- start 2024-09-21T01:18:50.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cf41b0 0x55ed350d8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 0x55ed350d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34d1d070 0x55ed350d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1c7f60 con 0x55ed34cfc390 2024-09-21T01:18:50.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1c7890 con 0x55ed34d1d070 2024-09-21T01:18:50.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1c4ab0 con 0x55ed34cf41b0 2024-09-21T01:18:50.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb82ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 0x55ed350d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb82ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 0x55ed350d3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58016/0 (socket says 172.21.15.37:58016) 2024-09-21T01:18:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb82ffd640 1 -- 172.21.15.37:0/246129532 learned_addr learned my addr 172.21.15.37:0/246129532 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb980b4740 10 client.0 _ll_register_callbacks cb 0x7ffb84012bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.204+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cf41b0 0x55ed350d8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb8bfff640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34d1d070 0x55ed350d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb82ffd640 1 -- 172.21.15.37:0/246129532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cf41b0 msgr2=0x55ed350d8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cf41b0 0x55ed350d8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb82ffd640 1 -- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34d1d070 msgr2=0x55ed350d4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34d1d070 0x55ed350d4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb82ffd640 1 -- 172.21.15.37:0/246129532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed350d4c00 con 0x55ed34cfc390 2024-09-21T01:18:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.205+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cf41b0 0x55ed350d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:18:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.206+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 0x55ed350d3e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffb740cb030 tx=0x7ffb740ca4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428b3db07cd5439 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:50.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.206+0000 7ffb6affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:50.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.206+0000 7ffb6affd640 1 -- 172.21.15.37:0/246129532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb740cd710 con 0x55ed34cfc390 2024-09-21T01:18:50.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.206+0000 7ffb6affd640 1 -- 172.21.15.37:0/246129532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ffb740cd020 con 0x55ed34cfc390 2024-09-21T01:18:50.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.206+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb7c0054f0 con 0x55ed34cfc390 2024-09-21T01:18:50.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.207+0000 7ffb6affd640 1 -- 172.21.15.37:0/246129532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb740cd530 con 0x55ed34cfc390 2024-09-21T01:18:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.207+0000 7ffb980b4740 10 client.16032 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.207+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed3514d040 con 0x55ed34cfc390 2024-09-21T01:18:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.208+0000 7ffb6affd640 1 -- 172.21.15.37:0/246129532 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb740047a0 con 0x55ed34cfc390 2024-09-21T01:18:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.208+0000 7ffb6affd640 1 -- 172.21.15.37:0/246129532 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ffb7410e070 con 0x55ed34cfc390 2024-09-21T01:18:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.209+0000 7ffb980b4740 10 client.16032 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.209+0000 7ffb980b4740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.209+0000 7ffb980b4740 20 client.16032 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.209+0000 7ffb980b4740 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cb0da0 0x55ed3514f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.209+0000 7ffb980b4740 4 client.16032 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:18:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.209+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ffb7c0054f0 con 0x55ed34cb0da0 2024-09-21T01:18:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.211+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cb0da0 0x55ed3514f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.214+0000 7ffb8b7fe640 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cb0da0 0x55ed3514f860 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80b233d6647096 server_cookie=ad4f80d747ec021c in_seq=0 out_seq=0 2024-09-21T01:18:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.214+0000 7ffb6affd640 10 client.16032 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.217+0000 7ffb6affd640 1 -- 172.21.15.37:0/246129532 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x7ffb7c0054f0 con 0x55ed34cb0da0 2024-09-21T01:18:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.217+0000 7ffb6affd640 10 client.16032 handle_command_reply: tid=0 2024-09-21T01:18:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.217+0000 7ffb980b4740 1 client.16032 shutdown 2024-09-21T01:18:50.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.218+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 msgr2=0x55ed350d3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.218+0000 7ffb980b4740 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 0x55ed350d3e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffb740cb030 tx=0x7ffb740ca4e0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 shutdown_connections 2024-09-21T01:18:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb980b4740 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ed34cb0da0 0x55ed3514f860 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb980b4740 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed34d1d070 0x55ed350d4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb6affd640 0 client.16032 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb980b4740 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ed34cfc390 0x55ed350d3e20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb980b4740 1 --2- 172.21.15.37:0/246129532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed34cf41b0 0x55ed350d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.219+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 >> 172.21.15.37:0/246129532 conn(0x55ed34d11460 msgr2=0x55ed350c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.220+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 shutdown_connections 2024-09-21T01:18:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.220+0000 7ffb980b4740 1 -- 172.21.15.37:0/246129532 wait complete. 2024-09-21T01:18:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.220+0000 7ffb980b4740 20 client.16032 trim_cache size 0 max 16384 2024-09-21T01:18:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.240+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ffb780b66e0 msgr2=0x7ffb780b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.240+0000 7ffb91b40640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ffb780b66e0 0x7ffb780b8bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb84011580 tx=0x7ffb84004a40 comp rx=0 tx=0).stop 2024-09-21T01:18:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.240+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c111f40 msgr2=0x7ffb8c1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.240+0000 7ffb91b40640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c111f40 0x7ffb8c1136f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009230 tx=0x7ffb74004270 comp rx=0 tx=0).stop 2024-09-21T01:18:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.245+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 shutdown_connections 2024-09-21T01:18:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.245+0000 7ffb91b40640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ffb780b66e0 0x7ffb780b8bf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.245+0000 7ffb91b40640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c11cc30 0x7ffb8c113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.245+0000 7ffb91b40640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8c111f40 0x7ffb8c1136f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.245+0000 7ffb91b40640 1 --2- 172.21.15.37:0/3922000400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb8c10a9e0 0x7ffb8c11a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.245+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 >> 172.21.15.37:0/3922000400 conn(0x7ffb8c070ec0 msgr2=0x7ffb8c11e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.249+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 shutdown_connections 2024-09-21T01:18:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:50.249+0000 7ffb91b40640 1 -- 172.21.15.37:0/3922000400 wait complete. 2024-09-21T01:18:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:50 smithi037 ceph-mon[31105]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 2.46k op/s 2024-09-21T01:18:50.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:50 smithi137 ceph-mon[34607]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 2.46k op/s 2024-09-21T01:18:50.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:50 smithi144 ceph-mon[34818]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 2.46k op/s 2024-09-21T01:18:52.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:52 smithi037 ceph-mon[31105]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 827 MiB/s wr, 1.83k op/s 2024-09-21T01:18:52.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:52 smithi137 ceph-mon[34607]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 827 MiB/s wr, 1.83k op/s 2024-09-21T01:18:52.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:52 smithi144 ceph-mon[34818]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 827 MiB/s wr, 1.83k op/s 2024-09-21T01:18:53.423 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:18:53.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:18:54.120 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:18:54.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:54 smithi037 ceph-mon[31105]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 871 MiB/s wr, 1.85k op/s 2024-09-21T01:18:54.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:54 smithi137 ceph-mon[34607]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 871 MiB/s wr, 1.85k op/s 2024-09-21T01:18:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:54 smithi144 ceph-mon[34818]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 871 MiB/s wr, 1.85k op/s 2024-09-21T01:18:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 -- 172.21.15.37:0/2419732033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f666810fcf0 msgr2=0x7f6668110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:55.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 --2- 172.21.15.37:0/2419732033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f666810fcf0 0x7f6668110100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6658008570 tx=0x7f665800ac00 comp rx=0 tx=0).stop 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 -- 172.21.15.37:0/2419732033 shutdown_connections 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 --2- 172.21.15.37:0/2419732033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6668110640 0x7f6668116e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 --2- 172.21.15.37:0/2419732033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f666810fcf0 0x7f6668110100 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6658008570 tx=0x7f665800ac00 comp rx=0 tx=0).stop 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 --2- 172.21.15.37:0/2419732033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f666810a650 0x7f666810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.645+0000 7f666759e640 1 -- 172.21.15.37:0/2419732033 >> 172.21.15.37:0/2419732033 conn(0x7f666806ee50 msgr2=0x7f666806f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.646+0000 7f666759e640 1 -- 172.21.15.37:0/2419732033 shutdown_connections 2024-09-21T01:18:55.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.646+0000 7f666759e640 1 -- 172.21.15.37:0/2419732033 wait complete. 2024-09-21T01:18:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.648+0000 7f666759e640 1 Processor -- start 2024-09-21T01:18:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.648+0000 7f666759e640 1 -- start start 2024-09-21T01:18:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.648+0000 7f666759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f666810a650 0x7f66681a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:55.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.649+0000 7f666759e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6668110640 0x7f66681a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:55.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.649+0000 7f666759e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 0x7f66681a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:55.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.649+0000 7f666759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6668119f20 con 0x7f666810a650 2024-09-21T01:18:55.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.649+0000 7f666759e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6668119da0 con 0x7f6668110640 2024-09-21T01:18:55.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.649+0000 7f666759e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f666811a0a0 con 0x7f66681a62d0 2024-09-21T01:18:55.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.653+0000 7f665ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6668110640 0x7f66681a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:55.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.653+0000 7f6666d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 0x7f66681a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:55.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.653+0000 7f6666d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 0x7f66681a6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:46980/0 (socket says 172.21.15.37:46980) 2024-09-21T01:18:55.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.653+0000 7f6666d9d640 1 -- 172.21.15.37:0/4100399125 learned_addr learned my addr 172.21.15.37:0/4100399125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:55.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.653+0000 7f666659c640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f666810a650 0x7f66681a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.654+0000 7f6666d9d640 1 -- 172.21.15.37:0/4100399125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6668110640 msgr2=0x7f66681a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.654+0000 7f6666d9d640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6668110640 0x7f66681a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.654+0000 7f6666d9d640 1 -- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f666810a650 msgr2=0x7f66681a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.654+0000 7f6666d9d640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f666810a650 0x7f66681a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.654+0000 7f6666d9d640 1 -- 172.21.15.37:0/4100399125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66681a6f20 con 0x7f66681a62d0 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.655+0000 7f6666d9d640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 0x7f66681a6700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f666000abd0 tx=0x7f6660007590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:55.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.656+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660007ca0 con 0x7f66681a62d0 2024-09-21T01:18:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.656+0000 7f666759e640 1 -- 172.21.15.37:0/4100399125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66681be460 con 0x7f66681a62d0 2024-09-21T01:18:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.656+0000 7f666759e640 1 -- 172.21.15.37:0/4100399125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66681be800 con 0x7f66681a62d0 2024-09-21T01:18:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.658+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6660007e40 con 0x7f66681a62d0 2024-09-21T01:18:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.658+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660014410 con 0x7f66681a62d0 2024-09-21T01:18:55.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.661+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f66600148a0 con 0x7f66681a62d0 2024-09-21T01:18:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.664+0000 7f665f7fe640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f66480b6640 0x7f66480b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.664+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f66600e7bf0 con 0x7f66681a62d0 2024-09-21T01:18:55.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.665+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666810b630 con 0x7f66681a62d0 2024-09-21T01:18:55.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.668+0000 7f666659c640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f66480b6640 0x7f66480b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.678+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66600ae440 con 0x7f66681a62d0 2024-09-21T01:18:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:55.678+0000 7f666659c640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f66480b6640 0x7f66480b8b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f665000d5c0 tx=0x7f665000f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.175+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66681a1bc0 con 0x7f66681a62d0 2024-09-21T01:18:56.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.179+0000 7f665f7fe640 1 -- 172.21.15.37:0/4100399125 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11977 (secure 0 0 0) 0x7f66600b2820 con 0x7f66681a62d0 2024-09-21T01:18:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:18:56.181 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-09-21T01:17:25:623190+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:17:25.572870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:18:56.181 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-09-21T01:18:56.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.191+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f66480b6640 msgr2=0x7f66480b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.191+0000 7f665d7fa640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f66480b6640 0x7f66480b8b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f665000d5c0 tx=0x7f665000f040 comp rx=0 tx=0).stop 2024-09-21T01:18:56.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.191+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 msgr2=0x7f66681a6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.191+0000 7f665d7fa640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 0x7f66681a6700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f666000abd0 tx=0x7f6660007590 comp rx=0 tx=0).stop 2024-09-21T01:18:56.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.193+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 shutdown_connections 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.193+0000 7f665d7fa640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f66480b6640 0x7f66480b8b50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.193+0000 7f665d7fa640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66681a62d0 0x7f66681a6700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.193+0000 7f665d7fa640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6668110640 0x7f66681a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.193+0000 7f665d7fa640 1 --2- 172.21.15.37:0/4100399125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f666810a650 0x7f66681a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.193+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 >> 172.21.15.37:0/4100399125 conn(0x7f666806ee50 msgr2=0x7f666810df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.194+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 shutdown_connections 2024-09-21T01:18:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:18:56.194+0000 7f665d7fa640 1 -- 172.21.15.37:0/4100399125 wait complete. 2024-09-21T01:18:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.367+0000 7f885a022640 1 -- 172.21.15.37:0/3634047254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410a3c0 msgr2=0x7f885410c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.367+0000 7f885a022640 1 --2- 172.21.15.37:0/3634047254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410a3c0 0x7f885410c7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8850009900 tx=0x7f885002a440 comp rx=0 tx=0).stop 2024-09-21T01:18:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.371+0000 7f885a022640 1 -- 172.21.15.37:0/3634047254 shutdown_connections 2024-09-21T01:18:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.371+0000 7f885a022640 1 --2- 172.21.15.37:0/3634047254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f885410f830 0x7f885410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.371+0000 7f885a022640 1 --2- 172.21.15.37:0/3634047254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410cd20 0x7f885410f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.371+0000 7f885a022640 1 --2- 172.21.15.37:0/3634047254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410a3c0 0x7f885410c7e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.371+0000 7f885a022640 1 -- 172.21.15.37:0/3634047254 >> 172.21.15.37:0/3634047254 conn(0x7f8854070640 msgr2=0x7f8854072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.376+0000 7f885a022640 1 -- 172.21.15.37:0/3634047254 shutdown_connections 2024-09-21T01:18:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.379+0000 7f885a022640 1 -- 172.21.15.37:0/3634047254 wait complete. 2024-09-21T01:18:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.380+0000 7f885a022640 1 Processor -- start 2024-09-21T01:18:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 -- start start 2024-09-21T01:18:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f885410a3c0 0x7f8854116ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410cd20 0x7f8854117660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 0x7f8854118210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f885411dff0 con 0x7f885410f830 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f885411de70 con 0x7f885410cd20 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.381+0000 7f885a022640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f885411e170 con 0x7f885410a3c0 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.383+0000 7f8859821640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 0x7f8854118210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.383+0000 7f8859821640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 0x7f8854118210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48238/0 (socket says 172.21.15.37:48238) 2024-09-21T01:18:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.383+0000 7f8859821640 1 -- 172.21.15.37:0/597902430 learned_addr learned my addr 172.21.15.37:0/597902430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.384+0000 7f8859821640 1 -- 172.21.15.37:0/597902430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f885410a3c0 msgr2=0x7f8854116ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.384+0000 7f8859821640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f885410a3c0 0x7f8854116ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.384+0000 7f8859821640 1 -- 172.21.15.37:0/597902430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410cd20 msgr2=0x7f8854117660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:18:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.384+0000 7f8859821640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410cd20 0x7f8854117660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.384+0000 7f8859821640 1 -- 172.21.15.37:0/597902430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8854118a30 con 0x7f885410f830 2024-09-21T01:18:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.385+0000 7f8859821640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 0x7f8854118210 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f884c00eb10 tx=0x7f884c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.386+0000 7f884a7fc640 1 -- 172.21.15.37:0/597902430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c004b20 con 0x7f885410f830 2024-09-21T01:18:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.386+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8854118d20 con 0x7f885410f830 2024-09-21T01:18:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.386+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88541193e0 con 0x7f885410f830 2024-09-21T01:18:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.387+0000 7f884a7fc640 1 -- 172.21.15.37:0/597902430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f884c004cc0 con 0x7f885410f830 2024-09-21T01:18:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.388+0000 7f884a7fc640 1 -- 172.21.15.37:0/597902430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c010670 con 0x7f885410f830 2024-09-21T01:18:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.393+0000 7f88621ee740 1 Processor -- start 2024-09-21T01:18:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.394+0000 7f88621ee740 1 -- start start 2024-09-21T01:18:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.395+0000 7f88621ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62a5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.395+0000 7f88621ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.395+0000 7f88621ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.395+0000 7f88621ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599f62176f0 con 0x5599f5edc4d0 2024-09-21T01:18:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.395+0000 7f88621ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5599f6206b20 con 0x5599f5ed42f0 2024-09-21T01:18:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.395+0000 7f88621ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5599f620a930 con 0x5599f5efd1b0 2024-09-21T01:18:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.397+0000 7f885881f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.397+0000 7f885881f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.397+0000 7f885881f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48252/0 (socket says 172.21.15.37:48252) 2024-09-21T01:18:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.397+0000 7f885881f640 1 -- 172.21.15.37:0/745849059 learned_addr learned my addr 172.21.15.37:0/745849059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.400+0000 7f8859020640 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.401+0000 7f885881f640 1 -- 172.21.15.37:0/745849059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 msgr2=0x5599f62a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.401+0000 7f885881f640 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.401+0000 7f885881f640 1 -- 172.21.15.37:0/745849059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 msgr2=0x5599f62a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.401+0000 7f885881f640 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.401+0000 7f885881f640 1 -- 172.21.15.37:0/745849059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f61cc530 con 0x5599f5edc4d0 2024-09-21T01:18:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.401+0000 7f884a7fc640 1 -- 172.21.15.37:0/597902430 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f884c005020 con 0x7f885410f830 2024-09-21T01:18:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.402+0000 7f885881f640 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62a6200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f884400afc0 tx=0x7f88440068d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0d3342fb40ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.403+0000 7f884a7fc640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88400b6720 0x7f88400b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.403+0000 7f884a7fc640 1 -- 172.21.15.37:0/597902430 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f884c0e78e0 con 0x7f885410f830 2024-09-21T01:18:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.403+0000 7f883f7fe640 1 -- 172.21.15.37:0/745849059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844011040 con 0x5599f5edc4d0 2024-09-21T01:18:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.404+0000 7f883f7fe640 1 -- 172.21.15.37:0/745849059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8844014e10 con 0x5599f5edc4d0 2024-09-21T01:18:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.405+0000 7f883f7fe640 1 -- 172.21.15.37:0/745849059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844018430 con 0x5599f5edc4d0 2024-09-21T01:18:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.405+0000 7f8859020640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88400b6720 0x7f88400b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.406+0000 7f88621ee740 1 -- 172.21.15.37:0/745849059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 msgr2=0x5599f62a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.406+0000 7f88621ee740 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62a6200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f884400afc0 tx=0x7f88440068d0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.407+0000 7f88621ee740 1 -- 172.21.15.37:0/745849059 shutdown_connections 2024-09-21T01:18:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.407+0000 7f88621ee740 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62a6200 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.407+0000 7f88621ee740 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.407+0000 7f88621ee740 1 --2- 172.21.15.37:0/745849059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.407+0000 7f88621ee740 1 -- 172.21.15.37:0/745849059 >> 172.21.15.37:0/745849059 conn(0x5599f5ef1300 msgr2=0x5599f62a0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.407+0000 7f88621ee740 1 -- 172.21.15.37:0/745849059 shutdown_connections 2024-09-21T01:18:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.408+0000 7f8859020640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88400b6720 0x7f88400b8c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8850031490 tx=0x7f8850000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.408+0000 7f88621ee740 1 -- 172.21.15.37:0/745849059 wait complete. 2024-09-21T01:18:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.409+0000 7f88621ee740 1 -- start start 2024-09-21T01:18:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.409+0000 7f88621ee740 1 Processor -- start 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599f613eab0 con 0x5599f5edc4d0 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5599f61ac730 con 0x5599f5ed42f0 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5599f62a6d60 con 0x5599f5efd1b0 2024-09-21T01:18:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.410+0000 7f88621ee740 10 client.0 _ll_register_callbacks cb 0x5599f62006b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.411+0000 7f8859020640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.411+0000 7f885881f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.411+0000 7f885881f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48254/0 (socket says 172.21.15.37:48254) 2024-09-21T01:18:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.411+0000 7f885881f640 1 -- 172.21.15.37:0/4200655907 learned_addr learned my addr 172.21.15.37:0/4200655907 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.411+0000 7f8859821640 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.412+0000 7f885881f640 1 -- 172.21.15.37:0/4200655907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 msgr2=0x5599f62af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.412+0000 7f885881f640 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.412+0000 7f885881f640 1 -- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 msgr2=0x5599f62ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.412+0000 7f885881f640 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.412+0000 7f885881f640 1 -- 172.21.15.37:0/4200655907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f5f68790 con 0x5599f5edc4d0 2024-09-21T01:18:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.413+0000 7f885881f640 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62aee60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8844008be0 tx=0x7f88440049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ce4e3741accdbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.413+0000 7f883cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.414+0000 7f883cff9640 1 -- 172.21.15.37:0/4200655907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88440062c0 con 0x5599f5edc4d0 2024-09-21T01:18:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.414+0000 7f883cff9640 1 -- 172.21.15.37:0/4200655907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8844006460 con 0x5599f5edc4d0 2024-09-21T01:18:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.414+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8844014e10 con 0x5599f5edc4d0 2024-09-21T01:18:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.415+0000 7f883cff9640 1 -- 172.21.15.37:0/4200655907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8844006660 con 0x5599f5edc4d0 2024-09-21T01:18:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.415+0000 7f88621ee740 10 client.16047 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.415+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599f5fe1620 con 0x5599f5edc4d0 2024-09-21T01:18:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.415+0000 7f883cff9640 1 -- 172.21.15.37:0/4200655907 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8844014e10 con 0x5599f5edc4d0 2024-09-21T01:18:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f883cff9640 1 -- 172.21.15.37:0/4200655907 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8844021070 con 0x5599f5edc4d0 2024-09-21T01:18:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f88621ee740 10 client.16047 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f88621ee740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f88621ee740 20 client.16047 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f88621ee740 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f5ebbd80 0x5599f62bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f88621ee740 4 client.16047 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:18:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.416+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599f6219640 con 0x5599f5ebbd80 2024-09-21T01:18:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.419+0000 7f8859020640 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f5ebbd80 0x5599f62bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.423+0000 7f8859020640 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f5ebbd80 0x5599f62bbd20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b924a9bb48f4a5 server_cookie=d278aff498f0628e in_seq=0 out_seq=0 2024-09-21T01:18:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.424+0000 7f883cff9640 10 client.16047 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.428+0000 7f883cff9640 1 -- 172.21.15.37:0/4200655907 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599f6219640 con 0x5599f5ebbd80 2024-09-21T01:18:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.428+0000 7f883cff9640 10 client.16047 handle_command_reply: tid=0 2024-09-21T01:18:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.429+0000 7f88621ee740 1 client.16047 shutdown 2024-09-21T01:18:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.431+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 msgr2=0x5599f62aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.431+0000 7f88621ee740 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62aee60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8844008be0 tx=0x7f88440049e0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.434+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 shutdown_connections 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.434+0000 7f88621ee740 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f5ebbd80 0x5599f62bbd20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.434+0000 7f88621ee740 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.434+0000 7f88621ee740 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5edc4d0 0x5599f62aee60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.434+0000 7f88621ee740 1 --2- 172.21.15.37:0/4200655907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5ed42f0 0x5599f62ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.434+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 >> 172.21.15.37:0/4200655907 conn(0x5599f5ef1300 msgr2=0x5599f629f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:56.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.435+0000 7f883cff9640 0 client.16047 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.435+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 shutdown_connections 2024-09-21T01:18:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.435+0000 7f88621ee740 1 -- 172.21.15.37:0/4200655907 wait complete. 2024-09-21T01:18:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.437+0000 7f88621ee740 20 client.16047 trim_cache size 0 max 16384 2024-09-21T01:18:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.474+0000 7f88621ee740 1 Processor -- start 2024-09-21T01:18:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.474+0000 7f88621ee740 1 -- start start 2024-09-21T01:18:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.475+0000 7f88621ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5ed42f0 0x5599f62aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.475+0000 7f88621ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 0x5599f62ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.475+0000 7f88621ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.475+0000 7f88621ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f883800e480 con 0x5599f5ed42f0 2024-09-21T01:18:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.475+0000 7f88621ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f883800fff0 con 0x5599f5edc4d0 2024-09-21T01:18:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.475+0000 7f88621ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f883800eb50 con 0x5599f5efd1b0 2024-09-21T01:18:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.476+0000 7f8859821640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.476+0000 7f8859821640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47036/0 (socket says 172.21.15.37:47036) 2024-09-21T01:18:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.476+0000 7f8859821640 1 -- 172.21.15.37:0/36041754 learned_addr learned my addr 172.21.15.37:0/36041754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.477+0000 7f8859821640 1 -- 172.21.15.37:0/36041754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 msgr2=0x5599f62ad9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:18:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.477+0000 7f8859821640 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 0x5599f62ad9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.477+0000 7f8859821640 1 -- 172.21.15.37:0/36041754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5ed42f0 msgr2=0x5599f62aeeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:18:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.477+0000 7f8859821640 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5ed42f0 0x5599f62aeeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.477+0000 7f8859821640 1 -- 172.21.15.37:0/36041754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599f62a5fa0 con 0x5599f5efd1b0 2024-09-21T01:18:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.478+0000 7f8859821640 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62adf00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f884c0049d0 tx=0x7f884c00cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99de2421a6b64134 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.478+0000 7f883effd640 1 -- 172.21.15.37:0/36041754 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ae130 con 0x5599f5efd1b0 2024-09-21T01:18:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.478+0000 7f883effd640 1 -- 172.21.15.37:0/36041754 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f884c0b2510 con 0x5599f5efd1b0 2024-09-21T01:18:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 -- 172.21.15.37:0/36041754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 msgr2=0x5599f62adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62adf00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f884c0049d0 tx=0x7f884c00cee0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 -- 172.21.15.37:0/36041754 shutdown_connections 2024-09-21T01:18:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5efd1b0 0x5599f62adf00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 0x5599f62ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 --2- 172.21.15.37:0/36041754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5ed42f0 0x5599f62aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.480+0000 7f88621ee740 1 -- 172.21.15.37:0/36041754 >> 172.21.15.37:0/36041754 conn(0x5599f5ef1300 msgr2=0x5599f62ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.488+0000 7f88621ee740 1 -- 172.21.15.37:0/36041754 shutdown_connections 2024-09-21T01:18:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.489+0000 7f88621ee740 1 -- 172.21.15.37:0/36041754 wait complete. 2024-09-21T01:18:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.490+0000 7f88621ee740 1 -- start start 2024-09-21T01:18:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.490+0000 7f88621ee740 1 Processor -- start 2024-09-21T01:18:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5ed42f0 0x5599f62b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 0x5599f62b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 0x5599f62b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f883800f8f0 con 0x5599f5e911c0 2024-09-21T01:18:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f883800f220 con 0x5599f5edc4d0 2024-09-21T01:18:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f883800c440 con 0x5599f5ed42f0 2024-09-21T01:18:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.491+0000 7f88621ee740 10 client.0 _ll_register_callbacks cb 0x7f884c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:18:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.492+0000 7f8859821640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 0x5599f62b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.492+0000 7f8859821640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 0x5599f62b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48258/0 (socket says 172.21.15.37:48258) 2024-09-21T01:18:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.492+0000 7f8859821640 1 -- 172.21.15.37:0/1213692521 learned_addr learned my addr 172.21.15.37:0/1213692521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:18:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.493+0000 7f8859821640 1 -- 172.21.15.37:0/1213692521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5ed42f0 msgr2=0x5599f62b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.493+0000 7f8859821640 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5ed42f0 0x5599f62b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.493+0000 7f8859821640 1 -- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 msgr2=0x5599f62b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:18:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.493+0000 7f8859821640 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 0x5599f62b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.493+0000 7f8859821640 1 -- 172.21.15.37:0/1213692521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599f62b47e0 con 0x5599f5e911c0 2024-09-21T01:18:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.494+0000 7f8859821640 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 0x5599f62b4080 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f884c0aaca0 tx=0x7f884c0a93f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e601977d4fc30a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:18:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.494+0000 7f883cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:18:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.494+0000 7f883cff9640 1 -- 172.21.15.37:0/1213692521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0b7450 con 0x5599f5e911c0 2024-09-21T01:18:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.495+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599f62150f0 con 0x5599f5e911c0 2024-09-21T01:18:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.495+0000 7f883cff9640 1 -- 172.21.15.37:0/1213692521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f884c0acea0 con 0x5599f5e911c0 2024-09-21T01:18:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.548+0000 7f883cff9640 1 -- 172.21.15.37:0/1213692521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f884c0c3be0 con 0x5599f5e911c0 2024-09-21T01:18:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.551+0000 7f88621ee740 10 client.16050 fetch_fsmap learned FSMap version 29 2024-09-21T01:18:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.551+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599f62b5be0 con 0x5599f5e911c0 2024-09-21T01:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.557+0000 7f883cff9640 1 -- 172.21.15.37:0/1213692521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5599f62150f0 con 0x5599f5e911c0 2024-09-21T01:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.557+0000 7f883cff9640 1 -- 172.21.15.37:0/1213692521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f884c005310 con 0x5599f5e911c0 2024-09-21T01:18:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.558+0000 7f88621ee740 10 client.16050 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:18:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.558+0000 7f88621ee740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:18:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.558+0000 7f88621ee740 20 client.16050 populate_metadata read hostname 'smithi037' 2024-09-21T01:18:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.558+0000 7f88621ee740 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f62b6540 0x5599f63286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:18:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.558+0000 7f88621ee740 4 client.16050 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:18:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.558+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5599f6212520 con 0x5599f62b6540 2024-09-21T01:18:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.567+0000 7f8859020640 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f62b6540 0x5599f63286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:18:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.581+0000 7f8859020640 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f62b6540 0x5599f63286f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec8c14610eef4bd0 server_cookie=38ebd53aa24991be in_seq=0 out_seq=0 2024-09-21T01:18:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:56.582+0000 7f883cff9640 10 client.16050 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:56.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:56 smithi037 ceph-mon[31105]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 948 MiB/s wr, 2.11k op/s 2024-09-21T01:18:56.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:56 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/4100399125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:18:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:56 smithi137 ceph-mon[34607]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 948 MiB/s wr, 2.11k op/s 2024-09-21T01:18:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:56 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/4100399125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:18:56.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:56 smithi144 ceph-mon[34818]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 948 MiB/s wr, 2.11k op/s 2024-09-21T01:18:56.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:56 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/4100399125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:18:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.251+0000 7f883cff9640 1 -- 172.21.15.37:0/1213692521 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5599f6212520 con 0x5599f62b6540 2024-09-21T01:18:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.251+0000 7f883cff9640 10 client.16050 handle_command_reply: tid=0 2024-09-21T01:18:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.251+0000 7f88621ee740 1 client.16050 shutdown 2024-09-21T01:18:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.252+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 msgr2=0x5599f62b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.252+0000 7f88621ee740 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 0x5599f62b4080 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f884c0aaca0 tx=0x7f884c0a93f0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 shutdown_connections 2024-09-21T01:18:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f88621ee740 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5599f62b6540 0x5599f63286f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f88621ee740 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599f5e911c0 0x5599f62b4080 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f88621ee740 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5599f5edc4d0 0x5599f62b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f88621ee740 1 --2- 172.21.15.37:0/1213692521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5599f5ed42f0 0x5599f62b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 >> 172.21.15.37:0/1213692521 conn(0x5599f5ef1300 msgr2=0x5599f62ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.253+0000 7f883cff9640 0 client.16050 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:18:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.254+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 shutdown_connections 2024-09-21T01:18:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.254+0000 7f88621ee740 1 -- 172.21.15.37:0/1213692521 wait complete. 2024-09-21T01:18:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.254+0000 7f88621ee740 20 client.16050 trim_cache size 0 max 16384 2024-09-21T01:18:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:18:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:18:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:18:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:18:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.262+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88400b6720 msgr2=0x7f88400b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.262+0000 7f885a022640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88400b6720 0x7f88400b8c30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8850031490 tx=0x7f8850000bc0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.262+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 msgr2=0x7f8854118210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:18:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.262+0000 7f885a022640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 0x7f8854118210 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f884c00eb10 tx=0x7f884c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.269+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 shutdown_connections 2024-09-21T01:18:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.269+0000 7f885a022640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f88400b6720 0x7f88400b8c30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.269+0000 7f885a022640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f885410f830 0x7f8854118210 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.269+0000 7f885a022640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f885410cd20 0x7f8854117660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.269+0000 7f885a022640 1 --2- 172.21.15.37:0/597902430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f885410a3c0 0x7f8854116ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:18:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.269+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 >> 172.21.15.37:0/597902430 conn(0x7f8854070640 msgr2=0x7f885410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:18:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.270+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 shutdown_connections 2024-09-21T01:18:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:18:58.270+0000 7f885a022640 1 -- 172.21.15.37:0/597902430 wait complete. 2024-09-21T01:18:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:18:58 smithi137 ceph-mon[34607]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 761 MiB/s wr, 1.75k op/s 2024-09-21T01:18:58.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:18:58 smithi144 ceph-mon[34818]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 761 MiB/s wr, 1.75k op/s 2024-09-21T01:18:59.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:18:58 smithi037 ceph-mon[31105]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 761 MiB/s wr, 1.75k op/s 2024-09-21T01:18:59.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:18:59.909 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:00.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:00 smithi037 ceph-mon[31105]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 2.21k op/s 2024-09-21T01:19:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:00 smithi137 ceph-mon[34607]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 2.21k op/s 2024-09-21T01:19:00.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:00 smithi144 ceph-mon[34818]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 2.21k op/s 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.372+0000 7f338abee640 1 -- 172.21.15.37:0/2621236052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 msgr2=0x7f338411f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.372+0000 7f338abee640 1 --2- 172.21.15.37:0/2621236052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 0x7f338411f140 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3374009860 tx=0x7f337402a360 comp rx=0 tx=0).stop 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.373+0000 7f338abee640 1 -- 172.21.15.37:0/2621236052 shutdown_connections 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.373+0000 7f338abee640 1 --2- 172.21.15.37:0/2621236052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 0x7f338411f140 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.373+0000 7f338abee640 1 --2- 172.21.15.37:0/2621236052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.373+0000 7f338abee640 1 --2- 172.21.15.37:0/2621236052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 0x7f338410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.373+0000 7f338abee640 1 -- 172.21.15.37:0/2621236052 >> 172.21.15.37:0/2621236052 conn(0x7f3384070ec0 msgr2=0x7f33840712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.374+0000 7f338abee640 1 -- 172.21.15.37:0/2621236052 shutdown_connections 2024-09-21T01:19:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.375+0000 7f338abee640 1 -- 172.21.15.37:0/2621236052 wait complete. 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.378+0000 7f338abee640 1 Processor -- start 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.378+0000 7f338abee640 1 -- start start 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.379+0000 7f338abee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338411bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.379+0000 7f338abee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 0x7f338411c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.379+0000 7f338abee640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 0x7f3384116340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.379+0000 7f338abee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3384112830 con 0x7f338410a9e0 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.379+0000 7f338abee640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33841126b0 con 0x7f3384111f40 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.379+0000 7f338abee640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33841129b0 con 0x7f338411cc30 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.380+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338411bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.380+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338411bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48282/0 (socket says 172.21.15.37:48282) 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.380+0000 7f338898a640 1 -- 172.21.15.37:0/711804118 learned_addr learned my addr 172.21.15.37:0/711804118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f3383fff640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 0x7f338411c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f338898a640 1 -- 172.21.15.37:0/711804118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 msgr2=0x7f3384116340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f338898a640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 0x7f3384116340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f338898a640 1 -- 172.21.15.37:0/711804118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 msgr2=0x7f338411c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f338898a640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 0x7f338411c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f338898a640 1 -- 172.21.15.37:0/711804118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3384116bb0 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.381+0000 7f3383fff640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 0x7f338411c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.382+0000 7f338898a640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338411bf90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f337c00efb0 tx=0x7f337c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.383+0000 7f3381ffb640 1 -- 172.21.15.37:0/711804118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c01b070 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.384+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3384116e40 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.385+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3384128650 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.385+0000 7f3381ffb640 1 -- 172.21.15.37:0/711804118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337c00ba20 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.385+0000 7f3381ffb640 1 -- 172.21.15.37:0/711804118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c016ac0 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.405+0000 7f3381ffb640 1 -- 172.21.15.37:0/711804118 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f337c01e070 con 0x7f338410a9e0 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.406+0000 7f3391162740 1 Processor -- start 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.406+0000 7f3391162740 1 -- start start 2024-09-21T01:19:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.406+0000 7f3391162740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.406+0000 7f3391162740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e37be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.407+0000 7f3391162740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e38120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.407+0000 7f3391162740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570f4dadea0 con 0x5570f4a671b0 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.407+0000 7f3391162740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5570f4d9d2d0 con 0x5570f4a90070 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.407+0000 7f3391162740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5570f4da10e0 con 0x5570f4a6f390 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.408+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e37be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.408+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e37be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48284/0 (socket says 172.21.15.37:48284) 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.408+0000 7f338898a640 1 -- 172.21.15.37:0/4168824263 learned_addr learned my addr 172.21.15.37:0/4168824263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.408+0000 7f338918b640 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.409+0000 7f3383fff640 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e38120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.409+0000 7f338898a640 1 -- 172.21.15.37:0/4168824263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 msgr2=0x5570f4e38120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.409+0000 7f338898a640 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e38120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.410+0000 7f338898a640 1 -- 172.21.15.37:0/4168824263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 msgr2=0x5570f4e376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.410+0000 7f338898a640 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.410+0000 7f338898a640 1 -- 172.21.15.37:0/4168824263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f4afb650 con 0x5570f4a671b0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.410+0000 7f3383fff640 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e38120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.410+0000 7f3381ffb640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f336c0b6710 0x7f336c0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.411+0000 7f338898a640 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e37be0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f337c00b7d0 tx=0x7f337c016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd4748a37201b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.411+0000 7f3381ffb640 1 -- 172.21.15.37:0/711804118 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f337c0e8120 con 0x7f338410a9e0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.412+0000 7f336affd640 1 -- 172.21.15.37:0/4168824263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c0aa8c0 con 0x5570f4a671b0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.412+0000 7f338918b640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f336c0b6710 0x7f336c0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.412+0000 7f336affd640 1 -- 172.21.15.37:0/4168824263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337c0add80 con 0x5570f4a671b0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.412+0000 7f336affd640 1 -- 172.21.15.37:0/4168824263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c0ad9e0 con 0x5570f4a671b0 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.413+0000 7f3391162740 1 -- 172.21.15.37:0/4168824263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 msgr2=0x5570f4e37be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.413+0000 7f3391162740 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e37be0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f337c00b7d0 tx=0x7f337c016700 comp rx=0 tx=0).stop 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 -- 172.21.15.37:0/4168824263 shutdown_connections 2024-09-21T01:19:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e38120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e37be0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 --2- 172.21.15.37:0/4168824263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 -- 172.21.15.37:0/4168824263 >> 172.21.15.37:0/4168824263 conn(0x5570f4a84460 msgr2=0x5570f4e35590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 -- 172.21.15.37:0/4168824263 shutdown_connections 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.414+0000 7f3391162740 1 -- 172.21.15.37:0/4168824263 wait complete. 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.415+0000 7f338918b640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f336c0b6710 0x7f336c0b8c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33740303f0 tx=0x7f3374005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.415+0000 7f3391162740 1 -- start start 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.415+0000 7f3391162740 1 Processor -- start 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e42d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e43240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e43780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570f4bfe700 con 0x5570f4a671b0 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5570f4d38160 con 0x5570f4a90070 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5570f4e45d00 con 0x5570f4a6f390 2024-09-21T01:19:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f3391162740 10 client.0 _ll_register_callbacks cb 0x5570f4d519e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:01.559 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:19:01.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.416+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e42d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e42d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48290/0 (socket says 172.21.15.37:48290) 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 -- 172.21.15.37:0/325925683 learned_addr learned my addr 172.21.15.37:0/325925683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f3383fff640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e43240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338918b640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e43780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 -- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 msgr2=0x5570f4e43240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e43240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 -- 172.21.15.37:0/325925683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 msgr2=0x5570f4e43780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e43780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.417+0000 7f338898a640 1 -- 172.21.15.37:0/325925683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f4d65c90 con 0x5570f4a671b0 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.418+0000 7f338898a640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e42d00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f337c0ae200 tx=0x7f337c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3943918220fe9543 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.418+0000 7f3363fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.418+0000 7f3363fff640 1 -- 172.21.15.37:0/325925683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c0adbc0 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.418+0000 7f3363fff640 1 -- 172.21.15.37:0/325925683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f337c0ad6d0 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.419+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f337c0add80 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.419+0000 7f3363fff640 1 -- 172.21.15.37:0/325925683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f337c0ae040 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.419+0000 7f3391162740 10 client.16062 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.420+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570f4e51950 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3363fff640 1 -- 172.21.15.37:0/325925683 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337c0add80 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3363fff640 1 -- 172.21.15.37:0/325925683 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f337c00b040 con 0x5570f4a671b0 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3391162740 10 client.16062 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3391162740 10 client.16062 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3391162740 20 client.16062 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3391162740 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a4e9f0 0x5570f4e54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3391162740 4 client.16062 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.421+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570f4dafdf0 con 0x5570f4a4e9f0 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.422+0000 7f3383fff640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a4e9f0 0x5570f4e54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.423+0000 7f3363fff640 10 client.16062 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.423+0000 7f3383fff640 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a4e9f0 0x5570f4e54cb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=20634c8a2cdf6269 server_cookie=3c87ee0b0e1d3ed in_seq=0 out_seq=0 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.425+0000 7f3363fff640 1 -- 172.21.15.37:0/325925683 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570f4dafdf0 con 0x5570f4a4e9f0 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.425+0000 7f3363fff640 10 client.16062 handle_command_reply: tid=0 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 client.16062 shutdown 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 msgr2=0x5570f4e42d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e42d00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f337c0ae200 tx=0x7f337c004a40 comp rx=0 tx=0).stop 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 shutdown_connections 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a4e9f0 0x5570f4e54cb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3363fff640 0 client.16062 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:19:01.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a90070 0x5570f4e43780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a6f390 0x5570f4e43240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 --2- 172.21.15.37:0/325925683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a671b0 0x5570f4e42d00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.426+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 >> 172.21.15.37:0/325925683 conn(0x5570f4a84460 msgr2=0x5570f4e3a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.427+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 shutdown_connections 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.427+0000 7f3391162740 1 -- 172.21.15.37:0/325925683 wait complete. 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.427+0000 7f3391162740 20 client.16062 trim_cache size 0 max 16384 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.453+0000 7f3391162740 1 Processor -- start 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.453+0000 7f3391162740 1 -- start start 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.453+0000 7f3391162740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e44be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f3391162740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 0x5570f4e38de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f3391162740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e34bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f3391162740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f337000e470 con 0x5570f4a4e9f0 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f3391162740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f337000ffe0 con 0x5570f4a6f390 2024-09-21T01:19:01.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f3391162740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f337000eb40 con 0x5570f4a671b0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e44be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e44be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48300/0 (socket says 172.21.15.37:48300) 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f338898a640 1 -- 172.21.15.37:0/1963666286 learned_addr learned my addr 172.21.15.37:0/1963666286 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.454+0000 7f338918b640 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e34bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.455+0000 7f338898a640 1 -- 172.21.15.37:0/1963666286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 msgr2=0x5570f4e38de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.455+0000 7f338898a640 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 0x5570f4e38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.455+0000 7f338898a640 1 -- 172.21.15.37:0/1963666286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 msgr2=0x5570f4e34bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.455+0000 7f338898a640 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e34bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.455+0000 7f338898a640 1 -- 172.21.15.37:0/1963666286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570f4e43da0 con 0x5570f4a4e9f0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.456+0000 7f338898a640 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e44be0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f337c00cfd0 tx=0x7f337c016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e52829b7cafb434 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.457+0000 7f336a7fc640 1 -- 172.21.15.37:0/1963666286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c0aa110 con 0x5570f4a4e9f0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.457+0000 7f336a7fc640 1 -- 172.21.15.37:0/1963666286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337c0add80 con 0x5570f4a4e9f0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.457+0000 7f336a7fc640 1 -- 172.21.15.37:0/1963666286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c00be10 con 0x5570f4a4e9f0 2024-09-21T01:19:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 -- 172.21.15.37:0/1963666286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 msgr2=0x5570f4e44be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e44be0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f337c00cfd0 tx=0x7f337c016700 comp rx=0 tx=0).stop 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 -- 172.21.15.37:0/1963666286 shutdown_connections 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e34bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 0x5570f4e38de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 --2- 172.21.15.37:0/1963666286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e44be0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 -- 172.21.15.37:0/1963666286 >> 172.21.15.37:0/1963666286 conn(0x5570f4a84460 msgr2=0x5570f4e386d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 -- 172.21.15.37:0/1963666286 shutdown_connections 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.459+0000 7f3391162740 1 -- 172.21.15.37:0/1963666286 wait complete. 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.460+0000 7f3391162740 1 -- start start 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.460+0000 7f3391162740 1 Processor -- start 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e58550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 0x5570f4e55a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e55fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f337000f8e0 con 0x5570f4a4e9f0 2024-09-21T01:19:01.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f337000f210 con 0x5570f4a6f390 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f337000c430 con 0x5570f4a671b0 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.461+0000 7f3391162740 10 client.0 _ll_register_callbacks cb 0x7f337c0b7b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.462+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e58550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.462+0000 7f338898a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e58550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48314/0 (socket says 172.21.15.37:48314) 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.462+0000 7f338898a640 1 -- 172.21.15.37:0/821357589 learned_addr learned my addr 172.21.15.37:0/821357589 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.463+0000 7f338898a640 1 -- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 msgr2=0x5570f4e55a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.463+0000 7f338898a640 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 0x5570f4e55a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.463+0000 7f338898a640 1 -- 172.21.15.37:0/821357589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 msgr2=0x5570f4e55fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.463+0000 7f338898a640 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e55fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.463+0000 7f338898a640 1 -- 172.21.15.37:0/821357589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570f4e56770 con 0x5570f4a4e9f0 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.464+0000 7f338898a640 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e58550 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f337c0ab4e0 tx=0x7f337c004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fa8e1f39299d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.464+0000 7f3363fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:01.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.466+0000 7f3363fff640 1 -- 172.21.15.37:0/821357589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c0aa110 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.466+0000 7f3363fff640 1 -- 172.21.15.37:0/821357589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f337c0acf90 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.466+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f337c0add80 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.467+0000 7f3363fff640 1 -- 172.21.15.37:0/821357589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f337c0ad9e0 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.467+0000 7f3391162740 10 client.16068 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.467+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5570f4e56770 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3363fff640 1 -- 172.21.15.37:0/821357589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337c0add80 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3363fff640 1 -- 172.21.15.37:0/821357589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f337c0b3ee0 con 0x5570f4a4e9f0 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3391162740 10 client.16068 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3391162740 10 client.16068 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3391162740 20 client.16068 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3391162740 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a90070 0x5570f4ec16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3391162740 4 client.16068 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.468+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570f4dab8a0 con 0x5570f4a90070 2024-09-21T01:19:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.470+0000 7f3383fff640 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a90070 0x5570f4ec16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.474+0000 7f3363fff640 10 client.16068 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.474+0000 7f3383fff640 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a90070 0x5570f4ec16a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=db6f38e85848de48 server_cookie=bfe5859d6bbb0a0e in_seq=0 out_seq=0 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.475+0000 7f3363fff640 1 -- 172.21.15.37:0/821357589 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570f4dab8a0 con 0x5570f4a90070 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.475+0000 7f3363fff640 10 client.16068 handle_command_reply: tid=0 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.475+0000 7f3391162740 1 client.16068 shutdown 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.475+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 msgr2=0x5570f4e58550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.475+0000 7f3391162740 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e58550 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f337c0ab4e0 tx=0x7f337c004d80 comp rx=0 tx=0).stop 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 shutdown_connections 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3391162740 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5570f4a90070 0x5570f4ec16a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3391162740 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5570f4a6f390 0x5570f4e55fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3391162740 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570f4a671b0 0x5570f4e55a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3391162740 1 --2- 172.21.15.37:0/821357589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570f4a4e9f0 0x5570f4e58550 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 >> 172.21.15.37:0/821357589 conn(0x5570f4a84460 msgr2=0x5570f4e449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.477+0000 7f3363fff640 0 client.16068 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:19:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.479+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 shutdown_connections 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.480+0000 7f3391162740 1 -- 172.21.15.37:0/821357589 wait complete. 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.480+0000 7f3391162740 20 client.16068 trim_cache size 0 max 16384 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.488+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f336c0b6710 msgr2=0x7f336c0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.488+0000 7f338abee640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f336c0b6710 0x7f336c0b8c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33740303f0 tx=0x7f3374005c90 comp rx=0 tx=0).stop 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.488+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 msgr2=0x7f338411bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.488+0000 7f338abee640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338411bf90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f337c00efb0 tx=0x7f337c00c800 comp rx=0 tx=0).stop 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.490+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 shutdown_connections 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.490+0000 7f338abee640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f336c0b6710 0x7f336c0b8c20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.490+0000 7f338abee640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f338411cc30 0x7f3384116340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.490+0000 7f338abee640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3384111f40 0x7f338411c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.490+0000 7f338abee640 1 --2- 172.21.15.37:0/711804118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338410a9e0 0x7f338411bf90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.490+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 >> 172.21.15.37:0/711804118 conn(0x7f3384070ec0 msgr2=0x7f3384073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.506+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 shutdown_connections 2024-09-21T01:19:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:01.507+0000 7f338abee640 1 -- 172.21.15.37:0/711804118 wait complete. 2024-09-21T01:19:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:02 smithi137 ceph-mon[34607]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 814 MiB/s wr, 1.55k op/s 2024-09-21T01:19:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:02 smithi144 ceph-mon[34818]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 814 MiB/s wr, 1.55k op/s 2024-09-21T01:19:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:02 smithi037 ceph-mon[31105]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 814 MiB/s wr, 1.55k op/s 2024-09-21T01:19:04.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:19:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:04 smithi137 ceph-mon[34607]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 859 MiB/s wr, 1.65k op/s 2024-09-21T01:19:04.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:04 smithi144 ceph-mon[34818]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 859 MiB/s wr, 1.65k op/s 2024-09-21T01:19:05.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:04 smithi037 ceph-mon[31105]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 859 MiB/s wr, 1.65k op/s 2024-09-21T01:19:05.245 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:06 smithi137 ceph-mon[34607]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 995 MiB/s wr, 1.95k op/s 2024-09-21T01:19:06.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:06 smithi144 ceph-mon[34818]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 995 MiB/s wr, 1.95k op/s 2024-09-21T01:19:07.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:06 smithi037 ceph-mon[31105]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 995 MiB/s wr, 1.95k op/s 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.347+0000 7f8e283fc640 1 -- 172.21.15.37:0/1592713827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010a3c0 msgr2=0x7f8e2010a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.347+0000 7f8e283fc640 1 --2- 172.21.15.37:0/1592713827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010a3c0 0x7f8e2010a7d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000aa10 tx=0x7f8e1002b750 comp rx=0 tx=0).stop 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.352+0000 7f8e283fc640 1 -- 172.21.15.37:0/1592713827 shutdown_connections 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.352+0000 7f8e283fc640 1 --2- 172.21.15.37:0/1592713827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e2010ad10 0x7f8e20116fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.352+0000 7f8e283fc640 1 --2- 172.21.15.37:0/1592713827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010a3c0 0x7f8e2010a7d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.352+0000 7f8e283fc640 1 --2- 172.21.15.37:0/1592713827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010f150 0x7f8e2010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.352+0000 7f8e283fc640 1 -- 172.21.15.37:0/1592713827 >> 172.21.15.37:0/1592713827 conn(0x7f8e200712f0 msgr2=0x7f8e20073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.357+0000 7f8e283fc640 1 -- 172.21.15.37:0/1592713827 shutdown_connections 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.357+0000 7f8e283fc640 1 -- 172.21.15.37:0/1592713827 wait complete. 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 Processor -- start 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 -- start start 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e2010a3c0 0x7f8e201a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010ad10 0x7f8e201a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 0x7f8e201a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2011a100 con 0x7f8e2010ad10 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20119f80 con 0x7f8e2010a3c0 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.359+0000 7f8e283fc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2011a280 con 0x7f8e2010f150 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.360+0000 7f8e26999640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 0x7f8e201a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.361+0000 7f8e26999640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 0x7f8e201a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37238/0 (socket says 172.21.15.37:37238) 2024-09-21T01:19:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.361+0000 7f8e26999640 1 -- 172.21.15.37:0/2465318631 learned_addr learned my addr 172.21.15.37:0/2465318631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.363+0000 7f8e26198640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e2010a3c0 0x7f8e201a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.363+0000 7f8e26999640 1 -- 172.21.15.37:0/2465318631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e2010a3c0 msgr2=0x7f8e201a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.363+0000 7f8e26999640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e2010a3c0 0x7f8e201a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.363+0000 7f8e26999640 1 -- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010ad10 msgr2=0x7f8e201a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.363+0000 7f8e25997640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010ad10 0x7f8e201a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.364+0000 7f8e26999640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010ad10 0x7f8e201a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.364+0000 7f8e26999640 1 -- 172.21.15.37:0/2465318631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e201a17a0 con 0x7f8e2010f150 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.364+0000 7f8e25997640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010ad10 0x7f8e201a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.369+0000 7f8e26999640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 0x7f8e201a0f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e970 tx=0x7f8e1c00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.372+0000 7f8e177fe640 1 -- 172.21.15.37:0/2465318631 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00ccc0 con 0x7f8e2010f150 2024-09-21T01:19:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.373+0000 7f8e177fe640 1 -- 172.21.15.37:0/2465318631 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1c00ce60 con 0x7f8e2010f150 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.373+0000 7f8e177fe640 1 -- 172.21.15.37:0/2465318631 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c010430 con 0x7f8e2010f150 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.373+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e201a6450 con 0x7f8e2010f150 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.373+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e201a6990 con 0x7f8e2010f150 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.378+0000 7f8e2e970740 1 Processor -- start 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.379+0000 7f8e2e970740 1 -- start start 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.379+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cbd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.379+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cbdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e25997640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cbd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e26198640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cbdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e26198640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cbdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50090/0 (socket says 172.21.15.37:50090) 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e26198640 1 -- 172.21.15.37:0/4290882809 learned_addr learned my addr 172.21.15.37:0/4290882809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728f5390 0x555772cbe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555772c33ea0 con 0x5557728ed1b0 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555772c232d0 con 0x555772916070 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.381+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555772c270e0 con 0x5557728f5390 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.382+0000 7f8e26198640 1 -- 172.21.15.37:0/4290882809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728f5390 msgr2=0x555772cbe120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.382+0000 7f8e26198640 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728f5390 0x555772cbe120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.382+0000 7f8e26198640 1 -- 172.21.15.37:0/4290882809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 msgr2=0x555772cbd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.382+0000 7f8e26198640 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cbd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.382+0000 7f8e26198640 1 -- 172.21.15.37:0/4290882809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555772981650 con 0x5557728ed1b0 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.383+0000 7f8e25997640 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cbd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.383+0000 7f8e26198640 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cbdbe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009fa0 tx=0x7f8e1800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d746c12571fc73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.384+0000 7f8e14d9a640 1 -- 172.21.15.37:0/4290882809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1801a070 con 0x5557728ed1b0 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.384+0000 7f8e14d9a640 1 -- 172.21.15.37:0/4290882809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e180158c0 con 0x5557728ed1b0 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.384+0000 7f8e14d9a640 1 -- 172.21.15.37:0/4290882809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800a9e0 con 0x5557728ed1b0 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.386+0000 7f8e177fe640 1 -- 172.21.15.37:0/2465318631 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8e1c004ff0 con 0x7f8e2010f150 2024-09-21T01:19:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.388+0000 7f8e177fe640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8e0c0b6650 0x7f8e0c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.389+0000 7f8e177fe640 1 -- 172.21.15.37:0/2465318631 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8e1c0e7880 con 0x7f8e2010f150 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.391+0000 7f8e25997640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8e0c0b6650 0x7f8e0c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.393+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 msgr2=0x555772cbdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.393+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cbdbe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009fa0 tx=0x7f8e1800c8b0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.396+0000 7f8e25997640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8e0c0b6650 0x7f8e0c0b8b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8e10034040 tx=0x7f8e10005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.399+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 shutdown_connections 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.399+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728f5390 0x555772cbe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.399+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cbdbe0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.399+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4290882809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cbd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.399+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 >> 172.21.15.37:0/4290882809 conn(0x55577290a460 msgr2=0x555772cbb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.400+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 shutdown_connections 2024-09-21T01:19:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.404+0000 7f8e2e970740 1 -- 172.21.15.37:0/4290882809 wait complete. 2024-09-21T01:19:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 -- start start 2024-09-21T01:19:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 Processor -- start 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 0x555772cc8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728f5390 0x555772cc9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cd5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555772a84700 con 0x5557728f5390 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555772bbe160 con 0x555772916070 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.405+0000 7f8e2e970740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555772ccbe80 con 0x5557728ed1b0 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.406+0000 7f8e2e970740 10 client.0 _ll_register_callbacks cb 0x555772bd79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.406+0000 7f8e26198640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 0x555772cc8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.406+0000 7f8e26198640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 0x555772cc8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37252/0 (socket says 172.21.15.37:37252) 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.406+0000 7f8e26198640 1 -- 172.21.15.37:0/2317627946 learned_addr learned my addr 172.21.15.37:0/2317627946 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.406+0000 7f8e26999640 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cd5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.407+0000 7f8e26198640 1 -- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 msgr2=0x555772cd5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.407+0000 7f8e26198640 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cd5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.407+0000 7f8e26198640 1 -- 172.21.15.37:0/2317627946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728f5390 msgr2=0x555772cc9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:07.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.407+0000 7f8e26198640 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728f5390 0x555772cc9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.407+0000 7f8e26198640 1 -- 172.21.15.37:0/2317627946 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555772bebc90 con 0x5557728ed1b0 2024-09-21T01:19:07.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.407+0000 7f8e26198640 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 0x555772cc8dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e18015fa0 tx=0x7f8e18004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f764952a7b6badaf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.410+0000 7f8e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:19:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.410+0000 7f8e09ffb640 1 -- 172.21.15.37:0/2317627946 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18025060 con 0x5557728ed1b0 2024-09-21T01:19:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.410+0000 7f8e09ffb640 1 -- 172.21.15.37:0/2317627946 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8e1800a5e0 con 0x5557728ed1b0 2024-09-21T01:19:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.410+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e180158c0 con 0x5557728ed1b0 2024-09-21T01:19:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.411+0000 7f8e09ffb640 1 -- 172.21.15.37:0/2317627946 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e1801a040 con 0x5557728ed1b0 2024-09-21T01:19:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.412+0000 7f8e2e970740 10 client.25549 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.412+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555772cf9b10 con 0x5557728ed1b0 2024-09-21T01:19:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.413+0000 7f8e09ffb640 1 -- 172.21.15.37:0/2317627946 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1800ac90 con 0x5557728ed1b0 2024-09-21T01:19:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e09ffb640 1 -- 172.21.15.37:0/2317627946 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8e1802a070 con 0x5557728ed1b0 2024-09-21T01:19:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e2e970740 10 client.25549 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e2e970740 10 client.25549 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:19:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e2e970740 20 client.25549 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:07.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e2e970740 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728d49f0 0x555772cfce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e2e970740 4 client.25549 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:07.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.414+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8e180158c0 con 0x5557728d49f0 2024-09-21T01:19:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.424+0000 7f8e25997640 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728d49f0 0x555772cfce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.449+0000 7f8e09ffb640 10 client.25549 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:19:07.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.449+0000 7f8e25997640 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728d49f0 0x555772cfce70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7e0071f02670ca83 server_cookie=583c5675e1b0c137 in_seq=0 out_seq=0 2024-09-21T01:19:07.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.455+0000 7f8e09ffb640 1 -- 172.21.15.37:0/2317627946 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8e180158c0 con 0x5557728d49f0 2024-09-21T01:19:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.455+0000 7f8e09ffb640 10 client.25549 handle_command_reply: tid=0 2024-09-21T01:19:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.455+0000 7f8e2e970740 1 client.25549 shutdown 2024-09-21T01:19:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.455+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 msgr2=0x555772cc8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.455+0000 7f8e2e970740 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 0x555772cc8dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e18015fa0 tx=0x7f8e18004b50 comp rx=0 tx=0).stop 2024-09-21T01:19:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 shutdown_connections 2024-09-21T01:19:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728d49f0 0x555772cfce70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555772916070 0x555772cd5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728f5390 0x555772cc9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 --2- 172.21.15.37:0/2317627946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557728ed1b0 0x555772cc8dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 >> 172.21.15.37:0/2317627946 conn(0x55577290a460 msgr2=0x555772cc0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e09ffb640 0 client.25549 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.459+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 shutdown_connections 2024-09-21T01:19:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.461+0000 7f8e2e970740 1 -- 172.21.15.37:0/2317627946 wait complete. 2024-09-21T01:19:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.461+0000 7f8e2e970740 20 client.25549 trim_cache size 0 max 16384 2024-09-21T01:19:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.499+0000 7f8e2e970740 1 Processor -- start 2024-09-21T01:19:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.499+0000 7f8e2e970740 1 -- start start 2024-09-21T01:19:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.500+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cc9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.500+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cd50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.500+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cc5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.500+0000 7f8e2e970740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201afcb0 con 0x5557728ed1b0 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.500+0000 7f8e2e970740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201b1820 con 0x5557728f5390 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.500+0000 7f8e2e970740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201b0380 con 0x555772916070 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.501+0000 7f8e26198640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cc9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.501+0000 7f8e26198640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cc9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50106/0 (socket says 172.21.15.37:50106) 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.501+0000 7f8e26198640 1 -- 172.21.15.37:0/1141308621 learned_addr learned my addr 172.21.15.37:0/1141308621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.501+0000 7f8e26999640 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cc5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.502+0000 7f8e26999640 1 -- 172.21.15.37:0/1141308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 msgr2=0x555772cd50e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.502+0000 7f8e26999640 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cd50e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.502+0000 7f8e26999640 1 -- 172.21.15.37:0/1141308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 msgr2=0x555772cc9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.502+0000 7f8e26999640 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cc9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.502+0000 7f8e26999640 1 -- 172.21.15.37:0/1141308621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557728d4c20 con 0x555772916070 2024-09-21T01:19:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.503+0000 7f8e26198640 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cc9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:19:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.503+0000 7f8e26999640 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cc5fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e940 tx=0x7f8e1c0ad140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7a9a0dce45d670f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.504+0000 7f8e0bfff640 1 -- 172.21.15.37:0/1141308621 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0046c0 con 0x555772916070 2024-09-21T01:19:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.504+0000 7f8e0bfff640 1 -- 172.21.15.37:0/1141308621 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1c0ad4e0 con 0x555772916070 2024-09-21T01:19:07.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 -- 172.21.15.37:0/1141308621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 msgr2=0x555772cc5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cc5fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e940 tx=0x7f8e1c0ad140 comp rx=0 tx=0).stop 2024-09-21T01:19:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 -- 172.21.15.37:0/1141308621 shutdown_connections 2024-09-21T01:19:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cc5fb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cd50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 --2- 172.21.15.37:0/1141308621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772cc9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.506+0000 7f8e2e970740 1 -- 172.21.15.37:0/1141308621 >> 172.21.15.37:0/1141308621 conn(0x55577290a460 msgr2=0x555772cc8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.509+0000 7f8e2e970740 1 -- 172.21.15.37:0/1141308621 shutdown_connections 2024-09-21T01:19:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.509+0000 7f8e2e970740 1 -- 172.21.15.37:0/1141308621 wait complete. 2024-09-21T01:19:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.510+0000 7f8e2e970740 1 -- start start 2024-09-21T01:19:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.510+0000 7f8e2e970740 1 Processor -- start 2024-09-21T01:19:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772d003a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cfd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cfde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201b1120 con 0x5557728ed1b0 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201b0a50 con 0x5557728f5390 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e201a1c90 con 0x555772916070 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e2e970740 10 client.0 _ll_register_callbacks cb 0x7f8e18018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e25997640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cfd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e25997640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cfd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35928/0 (socket says 172.21.15.37:35928) 2024-09-21T01:19:07.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.511+0000 7f8e25997640 1 -- 172.21.15.37:0/4258493412 learned_addr learned my addr 172.21.15.37:0/4258493412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.512+0000 7f8e26198640 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772d003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.513+0000 7f8e25997640 1 -- 172.21.15.37:0/4258493412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 msgr2=0x555772cfde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.513+0000 7f8e25997640 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cfde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.513+0000 7f8e25997640 1 -- 172.21.15.37:0/4258493412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 msgr2=0x555772d003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.513+0000 7f8e25997640 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772d003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.513+0000 7f8e25997640 1 -- 172.21.15.37:0/4258493412 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555772cfe340 con 0x5557728f5390 2024-09-21T01:19:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.514+0000 7f8e25997640 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cfd8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006c6e0 tx=0x7f8e1002b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5b5d4aa726c9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.514+0000 7f8e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.514+0000 7f8e09ffb640 1 -- 172.21.15.37:0/4258493412 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10055070 con 0x5557728f5390 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.515+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e1c0ad4e0 con 0x5557728f5390 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.515+0000 7f8e09ffb640 1 -- 172.21.15.37:0/4258493412 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8e10030920 con 0x5557728f5390 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.515+0000 7f8e09ffb640 1 -- 172.21.15.37:0/4258493412 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e10061050 con 0x5557728f5390 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.515+0000 7f8e2e970740 10 client.25610 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.515+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555772d672d0 con 0x5557728f5390 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.516+0000 7f8e09ffb640 1 -- 172.21.15.37:0/4258493412 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1c0ad4e0 con 0x5557728f5390 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.516+0000 7f8e09ffb640 1 -- 172.21.15.37:0/4258493412 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8e1000b040 con 0x5557728f5390 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.516+0000 7f8e2e970740 10 client.25610 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.516+0000 7f8e2e970740 10 client.25610 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.516+0000 7f8e2e970740 20 client.25610 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.516+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728a9da0 0x555772d69a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.517+0000 7f8e2e970740 4 client.25610 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:19:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.517+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555772c35df0 con 0x5557728a9da0 2024-09-21T01:19:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.517+0000 7f8e26198640 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728a9da0 0x555772d69a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.519+0000 7f8e09ffb640 10 client.25610 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.521+0000 7f8e26198640 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728a9da0 0x555772d69a20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a2eaadaeaeb9343e server_cookie=67b1c9f973c0c13b in_seq=0 out_seq=0 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.522+0000 7f8e09ffb640 1 -- 172.21.15.37:0/4258493412 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555772c35df0 con 0x5557728a9da0 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.522+0000 7f8e09ffb640 10 client.25610 handle_command_reply: tid=0 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.522+0000 7f8e2e970740 1 client.25610 shutdown 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 msgr2=0x555772cfd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cfd8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006c6e0 tx=0x7f8e1002b750 comp rx=0 tx=0).stop 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 shutdown_connections 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5557728a9da0 0x555772d69a20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555772916070 0x555772cfde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5557728f5390 0x555772cfd8c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 --2- 172.21.15.37:0/4258493412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5557728ed1b0 0x555772d003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 >> 172.21.15.37:0/4258493412 conn(0x55577290a460 msgr2=0x555772cc7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e09ffb640 0 client.25610 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:19:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 shutdown_connections 2024-09-21T01:19:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.523+0000 7f8e2e970740 1 -- 172.21.15.37:0/4258493412 wait complete. 2024-09-21T01:19:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.524+0000 7f8e2e970740 20 client.25610 trim_cache size 0 max 16384 2024-09-21T01:19:07.527 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:19:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8e0c0b6650 msgr2=0x7f8e0c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8e0c0b6650 0x7f8e0c0b8b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8e10034040 tx=0x7f8e10005fd0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 msgr2=0x7f8e201a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 0x7f8e201a0f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00e970 tx=0x7f8e1c00ed70 comp rx=0 tx=0).stop 2024-09-21T01:19:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 shutdown_connections 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8e0c0b6650 0x7f8e0c0b8b60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e2010f150 0x7f8e201a0f80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e2010ad10 0x7f8e201a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 --2- 172.21.15.37:0/2465318631 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e2010a3c0 0x7f8e201a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 >> 172.21.15.37:0/2465318631 conn(0x7f8e200712f0 msgr2=0x7f8e2010c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 shutdown_connections 2024-09-21T01:19:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:07.526+0000 7f8e283fc640 1 -- 172.21.15.37:0/2465318631 wait complete. 2024-09-21T01:19:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:08 smithi137 ceph-mon[34607]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 767 MiB/s wr, 1.49k op/s 2024-09-21T01:19:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:08 smithi144 ceph-mon[34818]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 767 MiB/s wr, 1.49k op/s 2024-09-21T01:19:09.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:08 smithi037 ceph-mon[31105]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 767 MiB/s wr, 1.49k op/s 2024-09-21T01:19:09.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:19:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:10 smithi137 ceph-mon[34607]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.0 GiB/s wr, 2.40k op/s 2024-09-21T01:19:10.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:10 smithi144 ceph-mon[34818]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.0 GiB/s wr, 2.40k op/s 2024-09-21T01:19:10.933 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:10 smithi037 ceph-mon[31105]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.0 GiB/s wr, 2.40k op/s 2024-09-21T01:19:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.649+0000 7f8571c7b640 1 -- 172.21.15.37:0/66558985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 msgr2=0x7f856c10fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.649+0000 7f8571c7b640 1 --2- 172.21.15.37:0/66558985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c10fd10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8564009ca0 tx=0x7f856402a8f0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 -- 172.21.15.37:0/66558985 shutdown_connections 2024-09-21T01:19:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 --2- 172.21.15.37:0/66558985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c10fd10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 --2- 172.21.15.37:0/66558985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f856c10cd20 0x7f856c10f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 --2- 172.21.15.37:0/66558985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f856c10a3c0 0x7f856c10c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 -- 172.21.15.37:0/66558985 >> 172.21.15.37:0/66558985 conn(0x7f856c070640 msgr2=0x7f856c072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 -- 172.21.15.37:0/66558985 shutdown_connections 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.650+0000 7f8571c7b640 1 -- 172.21.15.37:0/66558985 wait complete. 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.651+0000 7f8571c7b640 1 Processor -- start 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.651+0000 7f8571c7b640 1 -- start start 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f8571c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f856c10a3c0 0x7f856c1a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f8571c7b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f856c10cd20 0x7f856c1a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f8571c7b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c1a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f8571c7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f856c11dfb0 con 0x7f856c10a3c0 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f8571c7b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f856c11de30 con 0x7f856c10cd20 2024-09-21T01:19:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f8571c7b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f856c11e130 con 0x7f856c10f830 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f857147a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c1a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f857147a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c1a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37294/0 (socket says 172.21.15.37:37294) 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.652+0000 7f857147a640 1 -- 172.21.15.37:0/3757766020 learned_addr learned my addr 172.21.15.37:0/3757766020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.653+0000 7f857147a640 1 -- 172.21.15.37:0/3757766020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f856c10cd20 msgr2=0x7f856c1a9180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.653+0000 7f857147a640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f856c10cd20 0x7f856c1a9180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.653+0000 7f857147a640 1 -- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f856c10a3c0 msgr2=0x7f856c1a8b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.653+0000 7f857147a640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f856c10a3c0 0x7f856c1a8b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.653+0000 7f857147a640 1 -- 172.21.15.37:0/3757766020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c1aa550 con 0x7f856c10f830 2024-09-21T01:19:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.653+0000 7f857147a640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c1a9d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8564030820 tx=0x7f8564030850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.656+0000 7f8569ffb640 1 -- 172.21.15.37:0/3757766020 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564030bf0 con 0x7f856c10f830 2024-09-21T01:19:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.656+0000 7f8569ffb640 1 -- 172.21.15.37:0/3757766020 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f856402d070 con 0x7f856c10f830 2024-09-21T01:19:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.656+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c1aa7e0 con 0x7f856c10f830 2024-09-21T01:19:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.656+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c111cd0 con 0x7f856c10f830 2024-09-21T01:19:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.657+0000 7f8569ffb640 1 -- 172.21.15.37:0/3757766020 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856403a680 con 0x7f856c10f830 2024-09-21T01:19:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.665+0000 7f8579e42740 1 Processor -- start 2024-09-21T01:19:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.669+0000 7f8579e42740 1 -- start start 2024-09-21T01:19:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.670+0000 7f8569ffb640 1 -- 172.21.15.37:0/3757766020 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f856403a820 con 0x7f856c10f830 2024-09-21T01:19:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.671+0000 7f8579e42740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c5a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.671+0000 7f8579e42740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.671+0000 7f8579e42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448914d0 0x563b44c5b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.671+0000 7f8579e42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b44bcc6f0 con 0x563b448914d0 2024-09-21T01:19:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.671+0000 7f8579e42740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563b44bbbb20 con 0x563b448b21b0 2024-09-21T01:19:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.671+0000 7f8579e42740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563b44bbf930 con 0x563b448892f0 2024-09-21T01:19:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.672+0000 7f8569ffb640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f85540b66e0 0x7f85540b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.674+0000 7f8569ffb640 1 -- 172.21.15.37:0/3757766020 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8564108400 con 0x7f856c10f830 2024-09-21T01:19:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.674+0000 7f857147a640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f85540b66e0 0x7f85540b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.677+0000 7f8570c79640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.677+0000 7f8570c79640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c5a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37302/0 (socket says 172.21.15.37:37302) 2024-09-21T01:19:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.677+0000 7f8570c79640 1 -- 172.21.15.37:0/1351279764 learned_addr learned my addr 172.21.15.37:0/1351279764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.677+0000 7f856bfff640 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c5a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.677+0000 7f856bfff640 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448914d0 0x563b44c5b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.678+0000 7f856bfff640 1 -- 172.21.15.37:0/1351279764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 msgr2=0x563b44c5a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.678+0000 7f856bfff640 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c5a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.678+0000 7f856bfff640 1 -- 172.21.15.37:0/1351279764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 msgr2=0x563b44c5a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.678+0000 7f856bfff640 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c5a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.678+0000 7f856bfff640 1 -- 172.21.15.37:0/1351279764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b44b81530 con 0x563b448914d0 2024-09-21T01:19:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.682+0000 7f856bfff640 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448914d0 0x563b44c5b200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8560009f90 tx=0x7f8560005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443ff5d5754a9cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.686+0000 7f857147a640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f85540b66e0 0x7f85540b8bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85640094e0 tx=0x7f856402a8f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.689+0000 7f8552ffd640 1 -- 172.21.15.37:0/1351279764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560013110 con 0x563b448914d0 2024-09-21T01:19:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.689+0000 7f8552ffd640 1 -- 172.21.15.37:0/1351279764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85600132b0 con 0x563b448914d0 2024-09-21T01:19:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.690+0000 7f8579e42740 1 -- 172.21.15.37:0/1351279764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448914d0 msgr2=0x563b44c5b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.690+0000 7f8579e42740 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448914d0 0x563b44c5b200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8560009f90 tx=0x7f8560005f90 comp rx=0 tx=0).stop 2024-09-21T01:19:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.691+0000 7f8579e42740 1 -- 172.21.15.37:0/1351279764 shutdown_connections 2024-09-21T01:19:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.691+0000 7f8579e42740 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448914d0 0x563b44c5b200 secure :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8560009f90 tx=0x7f8560005f90 comp rx=0 tx=0).stop 2024-09-21T01:19:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.691+0000 7f8579e42740 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c5a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.691+0000 7f8579e42740 1 --2- 172.21.15.37:0/1351279764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c5a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.691+0000 7f8579e42740 1 -- 172.21.15.37:0/1351279764 >> 172.21.15.37:0/1351279764 conn(0x563b448a6300 msgr2=0x563b44c55ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:11.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.700+0000 7f8579e42740 1 -- 172.21.15.37:0/1351279764 shutdown_connections 2024-09-21T01:19:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.701+0000 7f8579e42740 1 -- 172.21.15.37:0/1351279764 wait complete. 2024-09-21T01:19:11.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.701+0000 7f8579e42740 1 -- start start 2024-09-21T01:19:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.702+0000 7f8579e42740 1 Processor -- start 2024-09-21T01:19:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 0x563b44c63930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448b21b0 0x563b44c63ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b44870d80 0x563b44c64b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b44af3ab0 con 0x563b448b21b0 2024-09-21T01:19:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563b44b61730 con 0x563b448892f0 2024-09-21T01:19:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563b44c5bdc0 con 0x563b44870d80 2024-09-21T01:19:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.706+0000 7f8579e42740 10 client.0 _ll_register_callbacks cb 0x563b44bb56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.707+0000 7f856bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 0x563b44c63930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.707+0000 7f856bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b44870d80 0x563b44c64b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 0x563b44c63930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35950/0 (socket says 172.21.15.37:35950) 2024-09-21T01:19:11.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 -- 172.21.15.37:0/4121486113 learned_addr learned my addr 172.21.15.37:0/4121486113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 -- 172.21.15.37:0/4121486113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b44870d80 msgr2=0x563b44c64b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b44870d80 0x563b44c64b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 -- 172.21.15.37:0/4121486113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448b21b0 msgr2=0x563b44c63ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448b21b0 0x563b44c63ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.708+0000 7f856bfff640 1 -- 172.21.15.37:0/4121486113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4491d790 con 0x563b448892f0 2024-09-21T01:19:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.709+0000 7f856bfff640 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 0x563b44c63930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8560009c60 tx=0x7f8560015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa23746472d2e544 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.709+0000 7f854bfff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:19:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.710+0000 7f854bfff640 1 -- 172.21.15.37:0/4121486113 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560027070 con 0x563b448892f0 2024-09-21T01:19:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.710+0000 7f854bfff640 1 -- 172.21.15.37:0/4121486113 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f85600107d0 con 0x563b448892f0 2024-09-21T01:19:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.710+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85600132b0 con 0x563b448892f0 2024-09-21T01:19:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.712+0000 7f854bfff640 1 -- 172.21.15.37:0/4121486113 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f856002a040 con 0x563b448892f0 2024-09-21T01:19:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.714+0000 7f8579e42740 10 client.25619 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.714+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563b44996620 con 0x563b448892f0 2024-09-21T01:19:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f854bfff640 1 -- 172.21.15.37:0/4121486113 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85600132b0 con 0x563b448892f0 2024-09-21T01:19:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f854bfff640 1 -- 172.21.15.37:0/4121486113 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8560030440 con 0x563b448892f0 2024-09-21T01:19:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f8579e42740 10 client.25619 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f8579e42740 10 client.25619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f8579e42740 20 client.25619 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f8579e42740 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b448461c0 0x563b44c71350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f8579e42740 4 client.25619 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.715+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b44bce640 con 0x563b448461c0 2024-09-21T01:19:11.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.719+0000 7f8570c79640 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b448461c0 0x563b44c71350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.731+0000 7f854bfff640 10 client.25619 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.731+0000 7f8570c79640 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b448461c0 0x563b44c71350 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4feac39a3bf5b116 server_cookie=c129dd10423df73 in_seq=0 out_seq=0 2024-09-21T01:19:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.735+0000 7f854bfff640 1 -- 172.21.15.37:0/4121486113 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b44bce640 con 0x563b448461c0 2024-09-21T01:19:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.735+0000 7f854bfff640 10 client.25619 handle_command_reply: tid=0 2024-09-21T01:19:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.735+0000 7f8579e42740 1 client.25619 shutdown 2024-09-21T01:19:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.736+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 msgr2=0x563b44c63930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.736+0000 7f8579e42740 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 0x563b44c63930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8560009c60 tx=0x7f8560015040 comp rx=0 tx=0).stop 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 shutdown_connections 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f8579e42740 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b448461c0 0x563b44c71350 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f8579e42740 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b44870d80 0x563b44c64b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f8579e42740 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b448b21b0 0x563b44c63ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f8579e42740 1 --2- 172.21.15.37:0/4121486113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448892f0 0x563b44c63930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f854bfff640 0 client.25619 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.739+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 >> 172.21.15.37:0/4121486113 conn(0x563b448a6300 msgr2=0x563b44c54150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:11.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.743+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 shutdown_connections 2024-09-21T01:19:11.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.743+0000 7f8579e42740 1 -- 172.21.15.37:0/4121486113 wait complete. 2024-09-21T01:19:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.745+0000 7f8579e42740 20 client.25619 trim_cache size 0 max 16384 2024-09-21T01:19:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.785+0000 7f8579e42740 1 Processor -- start 2024-09-21T01:19:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 -- start start 2024-09-21T01:19:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c62290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c50870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c62b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1c24b0 con 0x563b44870d80 2024-09-21T01:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1c4020 con 0x563b448b21b0 2024-09-21T01:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.789+0000 7f8579e42740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1c2b80 con 0x563b448892f0 2024-09-21T01:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c50870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c50870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37328/0 (socket says 172.21.15.37:37328) 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 -- 172.21.15.37:0/2820287774 learned_addr learned my addr 172.21.15.37:0/2820287774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f856bfff640 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c62b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f856bfff640 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c62290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 -- 172.21.15.37:0/2820287774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 msgr2=0x563b44c62b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c62b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 -- 172.21.15.37:0/2820287774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 msgr2=0x563b44c62290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c62290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.790+0000 7f8570c79640 1 -- 172.21.15.37:0/2820287774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b44c4fdf0 con 0x563b448892f0 2024-09-21T01:19:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.791+0000 7f8570c79640 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c50870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f855c0045b0 tx=0x7f855c004120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49b4c6f0d039b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.792+0000 7f85527fc640 1 -- 172.21.15.37:0/2820287774 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c003d20 con 0x563b448892f0 2024-09-21T01:19:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.792+0000 7f85527fc640 1 -- 172.21.15.37:0/2820287774 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f855c01d030 con 0x563b448892f0 2024-09-21T01:19:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.792+0000 7f85527fc640 1 -- 172.21.15.37:0/2820287774 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c01a600 con 0x563b448892f0 2024-09-21T01:19:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.796+0000 7f8579e42740 1 -- 172.21.15.37:0/2820287774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 msgr2=0x563b44c50870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.796+0000 7f8579e42740 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c50870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f855c0045b0 tx=0x7f855c004120 comp rx=0 tx=0).stop 2024-09-21T01:19:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.799+0000 7f8579e42740 1 -- 172.21.15.37:0/2820287774 shutdown_connections 2024-09-21T01:19:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.799+0000 7f8579e42740 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c62b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.799+0000 7f8579e42740 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c50870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.799+0000 7f8579e42740 1 --2- 172.21.15.37:0/2820287774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c62290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.799+0000 7f8579e42740 1 -- 172.21.15.37:0/2820287774 >> 172.21.15.37:0/2820287774 conn(0x563b448a6300 msgr2=0x563b44c63660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.800+0000 7f8579e42740 1 -- 172.21.15.37:0/2820287774 shutdown_connections 2024-09-21T01:19:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.801+0000 7f8579e42740 1 -- 172.21.15.37:0/2820287774 wait complete. 2024-09-21T01:19:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.801+0000 7f8579e42740 1 -- start start 2024-09-21T01:19:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.801+0000 7f8579e42740 1 Processor -- start 2024-09-21T01:19:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c68200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c69430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1c3920 con 0x563b44870d80 2024-09-21T01:19:11.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1c3250 con 0x563b448b21b0 2024-09-21T01:19:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f856c118a10 con 0x563b448892f0 2024-09-21T01:19:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.802+0000 7f8579e42740 10 client.0 _ll_register_callbacks cb 0x7f8560009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.803+0000 7f856bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c69430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.803+0000 7f856bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c69430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35978/0 (socket says 172.21.15.37:35978) 2024-09-21T01:19:11.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.803+0000 7f856bfff640 1 -- 172.21.15.37:0/4056955438 learned_addr learned my addr 172.21.15.37:0/4056955438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:11.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.804+0000 7f856bfff640 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c68200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.805+0000 7f856bfff640 1 -- 172.21.15.37:0/4056955438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 msgr2=0x563b44c688c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.805+0000 7f856bfff640 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c688c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.805+0000 7f856bfff640 1 -- 172.21.15.37:0/4056955438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 msgr2=0x563b44c68200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.805+0000 7f856bfff640 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c68200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.805+0000 7f856bfff640 1 -- 172.21.15.37:0/4056955438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b44c69b90 con 0x563b448b21b0 2024-09-21T01:19:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.807+0000 7f856bfff640 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c69430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8560014fb0 tx=0x7f8560005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=402ffb9f1ba26166 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.809+0000 7f854bfff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:19:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.809+0000 7f854bfff640 1 -- 172.21.15.37:0/4056955438 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560027040 con 0x563b448b21b0 2024-09-21T01:19:11.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.809+0000 7f854bfff640 1 -- 172.21.15.37:0/4056955438 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8560030440 con 0x563b448b21b0 2024-09-21T01:19:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.810+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c01d030 con 0x563b448b21b0 2024-09-21T01:19:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.819+0000 7f854bfff640 1 -- 172.21.15.37:0/4056955438 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8560030640 con 0x563b448b21b0 2024-09-21T01:19:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.823+0000 7f8579e42740 10 client.25625 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.823+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563b44c6af80 con 0x563b448b21b0 2024-09-21T01:19:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f854bfff640 1 -- 172.21.15.37:0/4056955438 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f855c01d030 con 0x563b448b21b0 2024-09-21T01:19:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f854bfff640 1 -- 172.21.15.37:0/4056955438 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8560010c30 con 0x563b448b21b0 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8579e42740 10 client.25625 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8579e42740 10 client.25625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8579e42740 20 client.25625 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8579e42740 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b44c6b920 0x563b44cddd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8579e42740 4 client.25625 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563b44bca0f0 con 0x563b44c6b920 2024-09-21T01:19:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.830+0000 7f8570c79640 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b44c6b920 0x563b44cddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.832+0000 7f8570c79640 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b44c6b920 0x563b44cddd60 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6196bf1e59614504 server_cookie=a7b251d8b9702b49 in_seq=0 out_seq=0 2024-09-21T01:19:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:11.834+0000 7f854bfff640 10 client.25625 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:12.840 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:12 smithi037 ceph-mon[31105]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 830 MiB/s wr, 2.22k op/s 2024-09-21T01:19:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.841+0000 7fc4e4928640 1 -- 172.21.15.37:0/2536207347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e01083a0 msgr2=0x7fc4e01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.841+0000 7fc4e4928640 1 --2- 172.21.15.37:0/2536207347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e01083a0 0x7fc4e01087b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009900 tx=0x7fc4d002a410 comp rx=0 tx=0).stop 2024-09-21T01:19:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.843+0000 7fc4e4928640 1 -- 172.21.15.37:0/2536207347 shutdown_connections 2024-09-21T01:19:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.843+0000 7fc4e4928640 1 --2- 172.21.15.37:0/2536207347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0108cf0 0x7fc4e010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.843+0000 7fc4e4928640 1 --2- 172.21.15.37:0/2536207347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e01083a0 0x7fc4e01087b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.843+0000 7fc4e4928640 1 --2- 172.21.15.37:0/2536207347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e0102a60 0x7fc4e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.843+0000 7fc4e4928640 1 -- 172.21.15.37:0/2536207347 >> 172.21.15.37:0/2536207347 conn(0x7fc4e0079730 msgr2=0x7fc4e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.845+0000 7fc4e4928640 1 -- 172.21.15.37:0/2536207347 shutdown_connections 2024-09-21T01:19:12.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.846+0000 7fc4e4928640 1 -- 172.21.15.37:0/2536207347 wait complete. 2024-09-21T01:19:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.849+0000 7fc4e4928640 1 Processor -- start 2024-09-21T01:19:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.849+0000 7fc4e4928640 1 -- start start 2024-09-21T01:19:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.850+0000 7fc4e4928640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 0x7fc4e010bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.850+0000 7fc4e4928640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e01083a0 0x7fc4e010c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.850+0000 7fc4e4928640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e0108cf0 0x7fc4e01ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.851+0000 7fc4e4928640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01118a0 con 0x7fc4e0108cf0 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.851+0000 7fc4e4928640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111720 con 0x7fc4e0102a60 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.851+0000 7fc4e4928640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111a20 con 0x7fc4e01083a0 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.852+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 0x7fc4e010bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.853+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 0x7fc4e010bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36002/0 (socket says 172.21.15.37:36002) 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.853+0000 7fc4de59c640 1 -- 172.21.15.37:0/3352059094 learned_addr learned my addr 172.21.15.37:0/3352059094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.854+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e01083a0 0x7fc4e010c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.854+0000 7fc4ded9d640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e0108cf0 0x7fc4e01ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.860+0000 7fc4de59c640 1 -- 172.21.15.37:0/3352059094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e01083a0 msgr2=0x7fc4e010c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.860+0000 7fc4de59c640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e01083a0 0x7fc4e010c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.860+0000 7fc4de59c640 1 -- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e0108cf0 msgr2=0x7fc4e01ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.860+0000 7fc4de59c640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e0108cf0 0x7fc4e01ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.860+0000 7fc4de59c640 1 -- 172.21.15.37:0/3352059094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e01acb70 con 0x7fc4e0102a60 2024-09-21T01:19:12.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.864+0000 7fc4de59c640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 0x7fc4e010bd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800eab0 tx=0x7fc4d800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.870+0000 7fc4cf7fe640 1 -- 172.21.15.37:0/3352059094 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800ce40 con 0x7fc4e0102a60 2024-09-21T01:19:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.871+0000 7fc4cf7fe640 1 -- 172.21.15.37:0/3352059094 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d8011920 con 0x7fc4e0102a60 2024-09-21T01:19:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.871+0000 7fc4cf7fe640 1 -- 172.21.15.37:0/3352059094 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d801aa60 con 0x7fc4e0102a60 2024-09-21T01:19:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.871+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e01ace00 con 0x7fc4e0102a60 2024-09-21T01:19:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.871+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01ad260 con 0x7fc4e0102a60 2024-09-21T01:19:12.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.881+0000 7fc4eae9c740 1 Processor -- start 2024-09-21T01:19:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.882+0000 7fc4cf7fe640 1 -- 172.21.15.37:0/3352059094 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc4d801ac00 con 0x7fc4e0102a60 2024-09-21T01:19:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.884+0000 7fc4cf7fe640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4c80b6720 0x7fc4c80b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.885+0000 7fc4cf7fe640 1 -- 172.21.15.37:0/3352059094 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d80e79c0 con 0x7fc4e0102a60 2024-09-21T01:19:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.886+0000 7fc4eae9c740 1 -- start start 2024-09-21T01:19:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.888+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63d3a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.889+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d3a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.889+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d3ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.889+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f63cb0ea0 con 0x559f63993070 2024-09-21T01:19:12.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.889+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559f63ca02d0 con 0x559f63972390 2024-09-21T01:19:12.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.889+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559f63ca40e0 con 0x559f6396a1b0 2024-09-21T01:19:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.890+0000 7fc4ded9d640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4c80b6720 0x7fc4c80b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.894+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d3a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.894+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d3ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.894+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d3ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36018/0 (socket says 172.21.15.37:36018) 2024-09-21T01:19:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.894+0000 7fc4ded9d640 1 -- 172.21.15.37:0/534496843 learned_addr learned my addr 172.21.15.37:0/534496843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.899+0000 7fc4de59c640 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63d3a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.902+0000 7fc4de59c640 1 -- 172.21.15.37:0/534496843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 msgr2=0x559f63d3a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.902+0000 7fc4de59c640 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d3a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.902+0000 7fc4de59c640 1 -- 172.21.15.37:0/534496843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 msgr2=0x559f63d3ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.902+0000 7fc4de59c640 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d3ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.902+0000 7fc4de59c640 1 -- 172.21.15.37:0/534496843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f639fe650 con 0x559f63993070 2024-09-21T01:19:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.905+0000 7fc4ded9d640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4c80b6720 0x7fc4c80b8c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400bb70 tx=0x7fc4d400bf70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.908+0000 7fc4de59c640 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63d3a2c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80e5480 tx=0x7fc4d80ad460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4a220a28dbb0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.913+0000 7fc4ccff9640 1 -- 172.21.15.37:0/534496843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80b2070 con 0x559f63993070 2024-09-21T01:19:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.913+0000 7fc4ccff9640 1 -- 172.21.15.37:0/534496843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d80ae210 con 0x559f63993070 2024-09-21T01:19:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.915+0000 7fc4eae9c740 1 -- 172.21.15.37:0/534496843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 msgr2=0x559f63d3a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.915+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63d3a2c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80e5480 tx=0x7fc4d80ad460 comp rx=0 tx=0).stop 2024-09-21T01:19:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.917+0000 7fc4eae9c740 1 -- 172.21.15.37:0/534496843 shutdown_connections 2024-09-21T01:19:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.917+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d3ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.917+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d3a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.917+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/534496843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63d3a2c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.917+0000 7fc4eae9c740 1 -- 172.21.15.37:0/534496843 >> 172.21.15.37:0/534496843 conn(0x559f63987460 msgr2=0x559f63d381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:12.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:12 smithi144 ceph-mon[34818]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 830 MiB/s wr, 2.22k op/s 2024-09-21T01:19:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:12 smithi137 ceph-mon[34607]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 830 MiB/s wr, 2.22k op/s 2024-09-21T01:19:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.918+0000 7fc4eae9c740 1 -- 172.21.15.37:0/534496843 shutdown_connections 2024-09-21T01:19:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.919+0000 7fc4eae9c740 1 -- 172.21.15.37:0/534496843 wait complete. 2024-09-21T01:19:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.922+0000 7fc4eae9c740 1 -- start start 2024-09-21T01:19:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.922+0000 7fc4eae9c740 1 Processor -- start 2024-09-21T01:19:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.930+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 0x559f63d45950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.930+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d45e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.931+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d51e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.931+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f63b01700 con 0x559f6396a1b0 2024-09-21T01:19:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.931+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559f63c3b160 con 0x559f63972390 2024-09-21T01:19:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.931+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559f63d48af0 con 0x559f63993070 2024-09-21T01:19:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.932+0000 7fc4eae9c740 10 client.0 _ll_register_callbacks cb 0x559f63c549e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.932+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 0x559f63d45950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.932+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 0x559f63d45950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50194/0 (socket says 172.21.15.37:50194) 2024-09-21T01:19:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.932+0000 7fc4de59c640 1 -- 172.21.15.37:0/2411545897 learned_addr learned my addr 172.21.15.37:0/2411545897 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.933+0000 7fc4de59c640 1 -- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 msgr2=0x559f63d51e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.933+0000 7fc4de59c640 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d51e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.933+0000 7fc4de59c640 1 -- 172.21.15.37:0/2411545897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 msgr2=0x559f63d45e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:12.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.933+0000 7fc4de59c640 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d45e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.933+0000 7fc4de59c640 1 -- 172.21.15.37:0/2411545897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f63c68c90 con 0x559f6396a1b0 2024-09-21T01:19:12.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.936+0000 7fc4de59c640 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 0x559f63d45950 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80adaa0 tx=0x7fc4d80a9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6487dcea15534901 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.939+0000 7fc4c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.939+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/2411545897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80b2040 con 0x559f6396a1b0 2024-09-21T01:19:12.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.939+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d80ae210 con 0x559f6396a1b0 2024-09-21T01:19:12.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.939+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/2411545897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d80cfd20 con 0x559f6396a1b0 2024-09-21T01:19:12.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.946+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/2411545897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4d805d030 con 0x559f6396a1b0 2024-09-21T01:19:12.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.950+0000 7fc4eae9c740 10 client.16098 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:12.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.950+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f63d54820 con 0x559f6396a1b0 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.953+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/2411545897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d80ae210 con 0x559f6396a1b0 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.953+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/2411545897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc4d8022070 con 0x559f6396a1b0 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.953+0000 7fc4eae9c740 10 client.16098 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.953+0000 7fc4eae9c740 10 client.16098 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.953+0000 7fc4eae9c740 20 client.16098 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.954+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f639519f0 0x559f63d57e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.954+0000 7fc4eae9c740 4 client.16098 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:12.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.954+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f63cb2df0 con 0x559f639519f0 2024-09-21T01:19:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.959+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f639519f0 0x559f63d57e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.963+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f639519f0 0x559f63d57e00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b016c7168e78d1d1 server_cookie=8986b7a230eb5370 in_seq=0 out_seq=0 2024-09-21T01:19:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.964+0000 7fc4c5ffb640 10 client.16098 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:19:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.964+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/2411545897 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f63cb2df0 con 0x559f639519f0 2024-09-21T01:19:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.964+0000 7fc4c5ffb640 10 client.16098 handle_command_reply: tid=0 2024-09-21T01:19:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.964+0000 7fc4eae9c740 1 client.16098 shutdown 2024-09-21T01:19:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.968+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 msgr2=0x559f63d45950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:12.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.968+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 0x559f63d45950 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80adaa0 tx=0x7fc4d80a9690 comp rx=0 tx=0).stop 2024-09-21T01:19:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.973+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 shutdown_connections 2024-09-21T01:19:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.973+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f639519f0 0x559f63d57e00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.973+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d51e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.973+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d45e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.973+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/2411545897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f6396a1b0 0x559f63d45950 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.973+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 >> 172.21.15.37:0/2411545897 conn(0x559f63987460 msgr2=0x559f63d3d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:12.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.977+0000 7fc4c5ffb640 0 client.16098 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:19:12.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.978+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 shutdown_connections 2024-09-21T01:19:12.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.979+0000 7fc4eae9c740 1 -- 172.21.15.37:0/2411545897 wait complete. 2024-09-21T01:19:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:12.979+0000 7fc4eae9c740 20 client.16098 trim_cache size 0 max 16384 2024-09-21T01:19:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.012+0000 7fc4eae9c740 1 Processor -- start 2024-09-21T01:19:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.013+0000 7fc4eae9c740 1 -- start start 2024-09-21T01:19:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.014+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f6396a1b0 0x559f63d44840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.014+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63972390 0x559f63d3ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.014+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d37760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.014+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000e4f0 con 0x559f63972390 2024-09-21T01:19:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.014+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0010060 con 0x559f6396a1b0 2024-09-21T01:19:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.014+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000ebc0 con 0x559f63993070 2024-09-21T01:19:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.016+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d37760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.016+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d37760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37390/0 (socket says 172.21.15.37:37390) 2024-09-21T01:19:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.016+0000 7fc4ded9d640 1 -- 172.21.15.37:0/1886932412 learned_addr learned my addr 172.21.15.37:0/1886932412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.017+0000 7fc4de59c640 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f6396a1b0 0x559f63d44840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.021+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63972390 0x559f63d3ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.021+0000 7fc4ded9d640 1 -- 172.21.15.37:0/1886932412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f6396a1b0 msgr2=0x559f63d44840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.021+0000 7fc4ded9d640 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f6396a1b0 0x559f63d44840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.021+0000 7fc4ded9d640 1 -- 172.21.15.37:0/1886932412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63972390 msgr2=0x559f63d3ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.021+0000 7fc4ded9d640 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63972390 0x559f63d3ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.021+0000 7fc4ded9d640 1 -- 172.21.15.37:0/1886932412 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f63d405f0 con 0x559f63993070 2024-09-21T01:19:13.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.025+0000 7fc4ded9d640 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d37760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4004650 tx=0x7fc4d401d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d595ccc56641de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:13.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.027+0000 7fc4c7fff640 1 -- 172.21.15.37:0/1886932412 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4012d90 con 0x559f63993070 2024-09-21T01:19:13.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.027+0000 7fc4c7fff640 1 -- 172.21.15.37:0/1886932412 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d4024070 con 0x559f63993070 2024-09-21T01:19:13.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.028+0000 7fc4c7fff640 1 -- 172.21.15.37:0/1886932412 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4020790 con 0x559f63993070 2024-09-21T01:19:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.028+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1886932412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 msgr2=0x559f63d37760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.028+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d37760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4004650 tx=0x7fc4d401d000 comp rx=0 tx=0).stop 2024-09-21T01:19:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1886932412 shutdown_connections 2024-09-21T01:19:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f63993070 0x559f63d37760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63972390 0x559f63d3ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1886932412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f6396a1b0 0x559f63d44840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1886932412 >> 172.21.15.37:0/1886932412 conn(0x559f63987460 msgr2=0x559f63d3b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1886932412 shutdown_connections 2024-09-21T01:19:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.029+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1886932412 wait complete. 2024-09-21T01:19:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 -- start start 2024-09-21T01:19:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 Processor -- start 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d49590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d49ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63dc07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000f960 con 0x559f63993070 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000f290 con 0x559f63972390 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.030+0000 7fc4eae9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000c4b0 con 0x559f6396a1b0 2024-09-21T01:19:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.031+0000 7fc4eae9c740 10 client.0 _ll_register_callbacks cb 0x7fc4d4004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.031+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d49590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.031+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d49590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:37394/0 (socket says 172.21.15.37:37394) 2024-09-21T01:19:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.031+0000 7fc4de59c640 1 -- 172.21.15.37:0/1327790299 learned_addr learned my addr 172.21.15.37:0/1327790299 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.031+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d49ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4de59c640 1 -- 172.21.15.37:0/1327790299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 msgr2=0x559f63d49ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4de59c640 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d49ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4de59c640 1 -- 172.21.15.37:0/1327790299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 msgr2=0x559f63dc07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4de59c640 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63dc07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4de59c640 1 -- 172.21.15.37:0/1327790299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f63dc0d20 con 0x559f6396a1b0 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4de59c640 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d49590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80aad80 tx=0x7fc4d80acc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3385a2b44716a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.032+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/1327790299 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80ad080 con 0x559f6396a1b0 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.033+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d4024070 con 0x559f6396a1b0 2024-09-21T01:19:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.033+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/1327790299 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d80b3780 con 0x559f6396a1b0 2024-09-21T01:19:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.033+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/1327790299 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc4d80ae210 con 0x559f6396a1b0 2024-09-21T01:19:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.035+0000 7fc4eae9c740 10 client.25582 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.035+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f63dc1fa0 con 0x559f6396a1b0 2024-09-21T01:19:13.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.036+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/1327790299 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d4024070 con 0x559f6396a1b0 2024-09-21T01:19:13.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/1327790299 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc4d8022070 con 0x559f6396a1b0 2024-09-21T01:19:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4eae9c740 10 client.25582 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4eae9c740 10 client.25582 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:19:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4eae9c740 20 client.25582 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f63926da0 0x559f63dc4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4eae9c740 4 client.25582 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:19:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.037+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f63d41500 con 0x559f63926da0 2024-09-21T01:19:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.039+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f63926da0 0x559f63dc4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.040+0000 7fc4c5ffb640 10 client.25582 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:19:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.040+0000 7fc4ddd9b640 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f63926da0 0x559f63dc4490 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a13d72030d43a7c server_cookie=d5cdbf509662ea91 in_seq=0 out_seq=0 2024-09-21T01:19:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.041+0000 7fc4c5ffb640 1 -- 172.21.15.37:0/1327790299 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f63d41500 con 0x559f63926da0 2024-09-21T01:19:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.041+0000 7fc4c5ffb640 10 client.25582 handle_command_reply: tid=0 2024-09-21T01:19:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.041+0000 7fc4eae9c740 1 client.25582 shutdown 2024-09-21T01:19:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 msgr2=0x559f63d49590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d49590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80aad80 tx=0x7fc4d80acc60 comp rx=0 tx=0).stop 2024-09-21T01:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 shutdown_connections 2024-09-21T01:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x559f63926da0 0x559f63dc4490 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f63993070 0x559f63dc07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559f63972390 0x559f63d49ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 --2- 172.21.15.37:0/1327790299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6396a1b0 0x559f63d49590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 >> 172.21.15.37:0/1327790299 conn(0x559f63987460 msgr2=0x559f63d46c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.042+0000 7fc4c5ffb640 0 client.25582 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:19:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.043+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 shutdown_connections 2024-09-21T01:19:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.043+0000 7fc4eae9c740 1 -- 172.21.15.37:0/1327790299 wait complete. 2024-09-21T01:19:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.043+0000 7fc4eae9c740 20 client.25582 trim_cache size 0 max 16384 2024-09-21T01:19:13.047 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:19:13.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4c80b6720 msgr2=0x7fc4c80b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4c80b6720 0x7fc4c80b8c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400bb70 tx=0x7fc4d400bf70 comp rx=0 tx=0).stop 2024-09-21T01:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 msgr2=0x7fc4e010bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 0x7fc4e010bd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800eab0 tx=0x7fc4d800ef70 comp rx=0 tx=0).stop 2024-09-21T01:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 shutdown_connections 2024-09-21T01:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc4c80b6720 0x7fc4c80b8c30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e0108cf0 0x7fc4e01ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e01083a0 0x7fc4e010c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 --2- 172.21.15.37:0/3352059094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4e0102a60 0x7fc4e010bd30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 >> 172.21.15.37:0/3352059094 conn(0x7fc4e0079730 msgr2=0x7fc4e0104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 shutdown_connections 2024-09-21T01:19:13.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:13.047+0000 7fc4e4928640 1 -- 172.21.15.37:0/3352059094 wait complete. 2024-09-21T01:19:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.848+0000 7f854bfff640 1 -- 172.21.15.37:0/4056955438 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563b44bca0f0 con 0x563b44c6b920 2024-09-21T01:19:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.848+0000 7f854bfff640 10 client.25625 handle_command_reply: tid=0 2024-09-21T01:19:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.848+0000 7f8579e42740 1 client.25625 shutdown 2024-09-21T01:19:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 msgr2=0x563b44c69430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c69430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8560014fb0 tx=0x7f8560005420 comp rx=0 tx=0).stop 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 shutdown_connections 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563b44c6b920 0x563b44cddd60 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563b448b21b0 0x563b44c69430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b448892f0 0x563b44c688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 --2- 172.21.15.37:0/4056955438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b44870d80 0x563b44c68200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 >> 172.21.15.37:0/4056955438 conn(0x563b448a6300 msgr2=0x563b44c62290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.853+0000 7f854bfff640 0 client.25625 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.854+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 shutdown_connections 2024-09-21T01:19:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.854+0000 7f8579e42740 1 -- 172.21.15.37:0/4056955438 wait complete. 2024-09-21T01:19:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.854+0000 7f8579e42740 20 client.25625 trim_cache size 0 max 16384 2024-09-21T01:19:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.866+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f85540b66e0 msgr2=0x7f85540b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.866+0000 7f8571c7b640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f85540b66e0 0x7f85540b8bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85640094e0 tx=0x7f856402a8f0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.866+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 msgr2=0x7f856c1a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.866+0000 7f8571c7b640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c1a9d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8564030820 tx=0x7f8564030850 comp rx=0 tx=0).stop 2024-09-21T01:19:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.872+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 shutdown_connections 2024-09-21T01:19:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.872+0000 7f8571c7b640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f85540b66e0 0x7f85540b8bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.872+0000 7f8571c7b640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f856c10f830 0x7f856c1a9d30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.872+0000 7f8571c7b640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f856c10cd20 0x7f856c1a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.872+0000 7f8571c7b640 1 --2- 172.21.15.37:0/3757766020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f856c10a3c0 0x7f856c1a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.872+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 >> 172.21.15.37:0/3757766020 conn(0x7f856c070640 msgr2=0x7f856c10b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.874+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 shutdown_connections 2024-09-21T01:19:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:13.874+0000 7f8571c7b640 1 -- 172.21.15.37:0/3757766020 wait complete. 2024-09-21T01:19:14.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:13 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:19:14.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:13 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:19:14.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:13 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:19:15.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:14 smithi037 ceph-mon[31105]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 863 MiB/s wr, 2.49k op/s 2024-09-21T01:19:15.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:14 smithi137 ceph-mon[34607]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 863 MiB/s wr, 2.49k op/s 2024-09-21T01:19:15.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:14 smithi144 ceph-mon[34818]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 863 MiB/s wr, 2.49k op/s 2024-09-21T01:19:15.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:19:15.933 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:16.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:19:16.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:19:16.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:15 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:19:16.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:19:16.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:19:16.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:15 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:19:16.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:19:16.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:19:16.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:15 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:19:17.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:16 smithi037 ceph-mon[31105]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 965 MiB/s wr, 2.91k op/s 2024-09-21T01:19:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:16 smithi137 ceph-mon[34607]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 965 MiB/s wr, 2.91k op/s 2024-09-21T01:19:17.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:16 smithi144 ceph-mon[34818]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 965 MiB/s wr, 2.91k op/s 2024-09-21T01:19:18.614 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:19:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.424+0000 7f4c4ffff640 1 -- 172.21.15.37:0/999284220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c5010ac20 msgr2=0x7f4c5010fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.424+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/999284220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c5010ac20 0x7f4c5010fcf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009900 tx=0x7f4c4002a440 comp rx=0 tx=0).stop 2024-09-21T01:19:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.427+0000 7f4c4ffff640 1 -- 172.21.15.37:0/999284220 shutdown_connections 2024-09-21T01:19:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.427+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/999284220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c50110230 0x7f4c50110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.427+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/999284220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c5010ac20 0x7f4c5010fcf0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.427+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/999284220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c5006af90 0x7f4c5010a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.427+0000 7f4c4ffff640 1 -- 172.21.15.37:0/999284220 >> 172.21.15.37:0/999284220 conn(0x7f4c5006ee50 msgr2=0x7f4c5006f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.429+0000 7f4c4ffff640 1 -- 172.21.15.37:0/999284220 shutdown_connections 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.432+0000 7f4c4ffff640 1 -- 172.21.15.37:0/999284220 wait complete. 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.434+0000 7f4c4ffff640 1 Processor -- start 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.434+0000 7f4c4ffff640 1 -- start start 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.435+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c5006af90 0x7f4c5011dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.435+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c5010ac20 0x7f4c5011a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.436+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 0x7f4c5011a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50115fe0 con 0x7f4c50110230 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50115e60 con 0x7f4c5006af90 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5011e5c0 con 0x7f4c5010ac20 2024-09-21T01:19:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 0x7f4c5011a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c5006af90 0x7f4c5011dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 0x7f4c5011a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60908/0 (socket says 172.21.15.37:60908) 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.437+0000 7f4c4f7fe640 1 -- 172.21.15.37:0/3186609186 learned_addr learned my addr 172.21.15.37:0/3186609186 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c5010ac20 0x7f4c5011a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4f7fe640 1 -- 172.21.15.37:0/3186609186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c5010ac20 msgr2=0x7f4c5011a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4f7fe640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c5010ac20 0x7f4c5011a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4f7fe640 1 -- 172.21.15.37:0/3186609186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c5006af90 msgr2=0x7f4c5011dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4f7fe640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c5006af90 0x7f4c5011dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4f7fe640 1 -- 172.21.15.37:0/3186609186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c501b54d0 con 0x7f4c50110230 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.438+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c5010ac20 0x7f4c5011a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.439+0000 7f4c4f7fe640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 0x7f4c5011a9f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400b3f0 tx=0x7f4c4400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.439+0000 7f4c37fff640 1 -- 172.21.15.37:0/3186609186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44015020 con 0x7f4c50110230 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.439+0000 7f4c37fff640 1 -- 172.21.15.37:0/3186609186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c44011ce0 con 0x7f4c50110230 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.439+0000 7f4c37fff640 1 -- 172.21.15.37:0/3186609186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44010dc0 con 0x7f4c50110230 2024-09-21T01:19:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.440+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c501b5700 con 0x7f4c50110230 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.440+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c501b5bf0 con 0x7f4c50110230 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.447+0000 7f4c5b7e4740 1 Processor -- start 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 -- start start 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c37fff640 1 -- 172.21.15.37:0/3186609186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4c44018020 con 0x7f4c50110230 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d29957860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29957da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d299582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d298cdea0 con 0x564d295871b0 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d298bd2d0 con 0x564d295b0070 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.450+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564d298c10e0 con 0x564d2958f390 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.451+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d29957860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.451+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d29957860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39516/0 (socket says 172.21.15.37:39516) 2024-09-21T01:19:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.451+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/443714350 learned_addr learned my addr 172.21.15.37:0/443714350 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.451+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d299582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c37fff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c380b6720 0x7f4c380b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/443714350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 msgr2=0x564d299582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d299582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/443714350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 msgr2=0x564d29957da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29957da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c37fff640 1 -- 172.21.15.37:0/3186609186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4c440e6ae0 con 0x7f4c50110230 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.452+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/443714350 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2961b650 con 0x564d295b0070 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.453+0000 7f4c4f7fe640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c380b6720 0x7f4c380b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.454+0000 7f4c4f7fe640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c380b6720 0x7f4c380b8c30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c440a9200 tx=0x7f4c44000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.455+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d29957860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c40004590 tx=0x7f4c40031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11cf692448c265f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.456+0000 7f4c357fa640 1 -- 172.21.15.37:0/443714350 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40035040 con 0x564d295b0070 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.456+0000 7f4c357fa640 1 -- 172.21.15.37:0/443714350 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c40005050 con 0x564d295b0070 2024-09-21T01:19:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.457+0000 7f4c357fa640 1 -- 172.21.15.37:0/443714350 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40004990 con 0x564d295b0070 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/443714350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 msgr2=0x564d29957860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d29957860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c40004590 tx=0x7f4c40031400 comp rx=0 tx=0).stop 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/443714350 shutdown_connections 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d299582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29957da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/443714350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d29957860 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.458+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/443714350 >> 172.21.15.37:0/443714350 conn(0x564d295a4460 msgr2=0x564d29955750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.459+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/443714350 shutdown_connections 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.459+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/443714350 wait complete. 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.459+0000 7f4c5b7e4740 1 -- start start 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.459+0000 7f4c5b7e4740 1 Processor -- start 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.460+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29962fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.460+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d29963510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.460+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d299803b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d2971e700 con 0x564d295871b0 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564d29858160 con 0x564d295b0070 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564d29977040 con 0x564d2958f390 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c5b7e4740 10 client.0 _ll_register_callbacks cb 0x564d298719e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29962fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d299803b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29962fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60910/0 (socket says 172.21.15.37:60910) 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.461+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1323457950 learned_addr learned my addr 172.21.15.37:0/1323457950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 msgr2=0x564d29963510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d29963510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1323457950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 msgr2=0x564d299803b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d299803b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1323457950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d29885c90 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29962fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4c40005aa0 tx=0x7f4c40009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3860da37dbaa7951 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.462+0000 7f4c32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.463+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1323457950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40050060 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.463+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1323457950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4c400048c0 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.463+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c40005050 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.463+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1323457950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c40035040 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 10 client.16110 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d29982e30 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1323457950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c40005050 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1323457950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4c4003a040 con 0x564d295871b0 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 10 client.16110 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 10 client.16110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:19:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 20 client.16110 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d2956e9f0 0x564d29986190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 4 client.16110 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.464+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d298cfdf0 con 0x564d2956e9f0 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.465+0000 7f4c4effd640 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d2956e9f0 0x564d29986190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.466+0000 7f4c32ff5640 10 client.16110 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.466+0000 7f4c4effd640 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d2956e9f0 0x564d29986190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7fbc973a6de9fba server_cookie=f8ba024f14f6e91a in_seq=0 out_seq=0 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.467+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1323457950 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d298cfdf0 con 0x564d2956e9f0 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.467+0000 7f4c32ff5640 10 client.16110 handle_command_reply: tid=0 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.467+0000 7f4c5b7e4740 1 client.16110 shutdown 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 msgr2=0x564d29962fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29962fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4c40005aa0 tx=0x7f4c40009260 comp rx=0 tx=0).stop 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 shutdown_connections 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d2956e9f0 0x564d29986190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d295b0070 0x564d299803b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d2958f390 0x564d29963510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1323457950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d29962fd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 >> 172.21.15.37:0/1323457950 conn(0x564d295a4460 msgr2=0x564d2995a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c32ff5640 0 client.16110 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 shutdown_connections 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1323457950 wait complete. 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.468+0000 7f4c5b7e4740 20 client.16110 trim_cache size 0 max 16384 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.486+0000 7f4c5b7e4740 1 Processor -- start 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.486+0000 7f4c5b7e4740 1 -- start start 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295871b0 0x564d29958fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29980320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 0x564d299601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c501ad070 con 0x564d295b0070 2024-09-21T01:19:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c501b75c0 con 0x564d2958f390 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c501b6120 con 0x564d295871b0 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 0x564d299601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 0x564d299601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60922/0 (socket says 172.21.15.37:60922) 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.487+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/4173208342 learned_addr learned my addr 172.21.15.37:0/4173208342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/4173208342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295871b0 msgr2=0x564d29958fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295871b0 0x564d29958fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/4173208342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 msgr2=0x564d29980320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29980320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/4173208342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2995dc70 con 0x564d295b0070 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 0x564d299601c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4c40004650 tx=0x7f4c40005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2d3b26a05a8967 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c34ff9640 1 -- 172.21.15.37:0/4173208342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40050070 con 0x564d295b0070 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c34ff9640 1 -- 172.21.15.37:0/4173208342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c40005050 con 0x564d295b0070 2024-09-21T01:19:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.488+0000 7f4c34ff9640 1 -- 172.21.15.37:0/4173208342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4005a080 con 0x564d295b0070 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/4173208342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 msgr2=0x564d299601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 0x564d299601c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4c40004650 tx=0x7f4c40005fd0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/4173208342 shutdown_connections 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295b0070 0x564d299601c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29980320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/4173208342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295871b0 0x564d29958fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/4173208342 >> 172.21.15.37:0/4173208342 conn(0x564d295a4460 msgr2=0x564d29958890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/4173208342 shutdown_connections 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.490+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/4173208342 wait complete. 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.491+0000 7f4c5b7e4740 1 -- start start 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.491+0000 7f4c5b7e4740 1 Processor -- start 2024-09-21T01:19:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d299897b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29986c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295b0070 0x564d299871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c501b6ec0 con 0x564d295871b0 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c501b67f0 con 0x564d2958f390 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5011b5d0 con 0x564d295b0070 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c5b7e4740 10 client.0 _ll_register_callbacks cb 0x7f4c40004250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d299897b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d299897b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60932/0 (socket says 172.21.15.37:60932) 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.492+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1667835776 learned_addr learned my addr 172.21.15.37:0/1667835776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295b0070 0x564d299871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4effd640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29986c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295b0070 msgr2=0x564d299871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295b0070 0x564d299871c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1667835776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 msgr2=0x564d29986c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29986c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 -- 172.21.15.37:0/1667835776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d29987750 con 0x564d295871b0 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4effd640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29986c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c4e7fc640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d299897b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c40004010 tx=0x7f4c4004b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f564950e675d4f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1667835776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40050070 con 0x564d295871b0 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1667835776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4c40004ad0 con 0x564d295871b0 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.493+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c40005050 con 0x564d295871b0 2024-09-21T01:19:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1667835776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c4005a070 con 0x564d295871b0 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 10 client.16116 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d299f0650 con 0x564d295871b0 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1667835776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c40005050 con 0x564d295871b0 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1667835776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4c4005f060 con 0x564d295871b0 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 10 client.16116 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 10 client.16116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 20 client.16116 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d29543da0 0x564d299f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 4 client.16116 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.494+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d298cb8a0 con 0x564d29543da0 2024-09-21T01:19:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.495+0000 7f4c4effd640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d29543da0 0x564d299f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.497+0000 7f4c32ff5640 10 client.16116 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.497+0000 7f4c4effd640 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d29543da0 0x564d299f2b20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e5315bf68270144 server_cookie=e594ab28f093327b in_seq=0 out_seq=0 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.497+0000 7f4c32ff5640 1 -- 172.21.15.37:0/1667835776 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d298cb8a0 con 0x564d29543da0 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.498+0000 7f4c32ff5640 10 client.16116 handle_command_reply: tid=0 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.498+0000 7f4c5b7e4740 1 client.16116 shutdown 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 msgr2=0x564d299897b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d299897b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c40004010 tx=0x7f4c4004b6c0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 shutdown_connections 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x564d29543da0 0x564d299f2b20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c32ff5640 0 client.16116 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d295b0070 0x564d299871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564d2958f390 0x564d29986c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 --2- 172.21.15.37:0/1667835776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d295871b0 0x564d299897b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 >> 172.21.15.37:0/1667835776 conn(0x564d295a4460 msgr2=0x564d2995b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.499+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 shutdown_connections 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.500+0000 7f4c5b7e4740 1 -- 172.21.15.37:0/1667835776 wait complete. 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.500+0000 7f4c5b7e4740 20 client.16116 trim_cache size 0 max 16384 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.501+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c380b6720 msgr2=0x7f4c380b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.501+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c380b6720 0x7f4c380b8c30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c440a9200 tx=0x7f4c44000bc0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.501+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 msgr2=0x7f4c5011a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.501+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 0x7f4c5011a9f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400b3f0 tx=0x7f4c4400b8b0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 shutdown_connections 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4c380b6720 0x7f4c380b8c30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c50110230 0x7f4c5011a9f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c5010ac20 0x7f4c5011a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 --2- 172.21.15.37:0/3186609186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c5006af90 0x7f4c5011dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 >> 172.21.15.37:0/3186609186 conn(0x7f4c5006ee50 msgr2=0x7f4c5010cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 shutdown_connections 2024-09-21T01:19:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:18.503+0000 7f4c4ffff640 1 -- 172.21.15.37:0/3186609186 wait complete. 2024-09-21T01:19:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:18 smithi137 ceph-mon[34607]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 721 MiB/s wr, 2.42k op/s 2024-09-21T01:19:19.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:18 smithi144 ceph-mon[34818]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 721 MiB/s wr, 2.42k op/s 2024-09-21T01:19:19.258 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:18 smithi037 ceph-mon[31105]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 721 MiB/s wr, 2.42k op/s 2024-09-21T01:19:21.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:20 smithi144 ceph-mon[34818]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 956 MiB/s wr, 2.99k op/s 2024-09-21T01:19:21.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:20 smithi137 ceph-mon[34607]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 956 MiB/s wr, 2.99k op/s 2024-09-21T01:19:21.173 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:20 smithi037 ceph-mon[31105]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 956 MiB/s wr, 2.99k op/s 2024-09-21T01:19:21.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:19:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:22.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:21 smithi137 ceph-mon[34607]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 800 MiB/s wr, 2.35k op/s 2024-09-21T01:19:22.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:21 smithi144 ceph-mon[34818]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 800 MiB/s wr, 2.35k op/s 2024-09-21T01:19:22.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:21 smithi037 ceph-mon[31105]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 800 MiB/s wr, 2.35k op/s 2024-09-21T01:19:23.958 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:19:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.610+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2437638752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c111f40 msgr2=0x7f2b1c10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.610+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2437638752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c111f40 0x7f2b1c10a3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009860 tx=0x7f2b1002a340 comp rx=0 tx=0).stop 2024-09-21T01:19:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.611+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2437638752 shutdown_connections 2024-09-21T01:19:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.611+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2437638752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c11cc30 0x7f2b1c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.611+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2437638752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b1c10a9e0 0x7f2b1c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.611+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2437638752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c111f40 0x7f2b1c10a3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.611+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2437638752 >> 172.21.15.37:0/2437638752 conn(0x7f2b1c070ec0 msgr2=0x7f2b1c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.612+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2437638752 shutdown_connections 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.614+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2437638752 wait complete. 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.616+0000 7f2b21bc8640 1 Processor -- start 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.617+0000 7f2b21bc8640 1 -- start start 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.618+0000 7f2b21bc8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c10a9e0 0x7f2b1c11c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.618+0000 7f2b21bc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 0x7f2b1c1186a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.618+0000 7f2b21bc8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b1c11cc30 0x7f2b1c118be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.618+0000 7f2b21bc8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c114c10 con 0x7f2b1c111f40 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.618+0000 7f2b21bc8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c114a90 con 0x7f2b1c11cc30 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.618+0000 7f2b21bc8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c114d90 con 0x7f2b1c10a9e0 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.622+0000 7f2b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 0x7f2b1c1186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.623+0000 7f2b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 0x7f2b1c1186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60952/0 (socket says 172.21.15.37:60952) 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.623+0000 7f2b1affd640 1 -- 172.21.15.37:0/2241984695 learned_addr learned my addr 172.21.15.37:0/2241984695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.623+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b1c11cc30 0x7f2b1c118be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.624+0000 7f2b1affd640 1 -- 172.21.15.37:0/2241984695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c10a9e0 msgr2=0x7f2b1c11c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.624+0000 7f2b1affd640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c10a9e0 0x7f2b1c11c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.624+0000 7f2b1affd640 1 -- 172.21.15.37:0/2241984695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b1c11cc30 msgr2=0x7f2b1c118be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.625+0000 7f2b1affd640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b1c11cc30 0x7f2b1c118be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.625+0000 7f2b1affd640 1 -- 172.21.15.37:0/2241984695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c1193e0 con 0x7f2b1c111f40 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.626+0000 7f2b1affd640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 0x7f2b1c1186a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00c970 tx=0x7f2b0c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.627+0000 7f2b18ff9640 1 -- 172.21.15.37:0/2241984695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004220 con 0x7f2b1c111f40 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.627+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1c1ace30 con 0x7f2b1c111f40 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.627+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1c1ad2e0 con 0x7f2b1c111f40 2024-09-21T01:19:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.628+0000 7f2b18ff9640 1 -- 172.21.15.37:0/2241984695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0c0043c0 con 0x7f2b1c111f40 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.628+0000 7f2b18ff9640 1 -- 172.21.15.37:0/2241984695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00f450 con 0x7f2b1c111f40 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.637+0000 7f2b2813c740 1 Processor -- start 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.638+0000 7f2b2813c740 1 -- start start 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.638+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 0x5635b10e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.639+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d121b0 0x5635b10e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.639+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d1a390 0x5635b10e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.639+0000 7f2b2813c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5635b1058ea0 con 0x5635b0d3b070 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.639+0000 7f2b2813c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5635b10482d0 con 0x5635b0d121b0 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.639+0000 7f2b2813c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5635b104c0e0 con 0x5635b0d1a390 2024-09-21T01:19:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.641+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 0x5635b10e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.641+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 0x5635b10e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60960/0 (socket says 172.21.15.37:60960) 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.641+0000 7f2b1bfff640 1 -- 172.21.15.37:0/524009928 learned_addr learned my addr 172.21.15.37:0/524009928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.643+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d121b0 0x5635b10e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.651+0000 7f2b1bfff640 1 -- 172.21.15.37:0/524009928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d1a390 msgr2=0x5635b10e2d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.651+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d1a390 0x5635b10e2d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.651+0000 7f2b1bfff640 1 -- 172.21.15.37:0/524009928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d121b0 msgr2=0x5635b10e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.651+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d121b0 0x5635b10e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.651+0000 7f2b1bfff640 1 -- 172.21.15.37:0/524009928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b0da6650 con 0x5635b0d3b070 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.653+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 0x5635b10e22c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2b14020440 tx=0x7f2b14020900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16b262d7d860b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.654+0000 7f2b18ff9640 1 -- 172.21.15.37:0/2241984695 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2b0c003610 con 0x7f2b1c111f40 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.655+0000 7f2b18ff9640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2b040b65c0 0x7f2b040b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.656+0000 7f2b18ff9640 1 -- 172.21.15.37:0/2241984695 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2b0c0e4e50 con 0x7f2b1c111f40 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.657+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2b040b65c0 0x7f2b040b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.659+0000 7f2b01ffb640 1 -- 172.21.15.37:0/524009928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14004b20 con 0x5635b0d3b070 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.659+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2b040b65c0 0x7f2b040b8ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2b100303f0 tx=0x7f2b1002a840 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.659+0000 7f2b01ffb640 1 -- 172.21.15.37:0/524009928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b14004cc0 con 0x5635b0d3b070 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 -- 172.21.15.37:0/524009928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 msgr2=0x5635b10e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 0x5635b10e22c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2b14020440 tx=0x7f2b14020900 comp rx=0 tx=0).stop 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 -- 172.21.15.37:0/524009928 shutdown_connections 2024-09-21T01:19:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d1a390 0x5635b10e2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d121b0 0x5635b10e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 --2- 172.21.15.37:0/524009928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d3b070 0x5635b10e22c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.661+0000 7f2b2813c740 1 -- 172.21.15.37:0/524009928 >> 172.21.15.37:0/524009928 conn(0x5635b0d2f460 msgr2=0x5635b10e01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.663+0000 7f2b2813c740 1 -- 172.21.15.37:0/524009928 shutdown_connections 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.664+0000 7f2b2813c740 1 -- 172.21.15.37:0/524009928 wait complete. 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.665+0000 7f2b2813c740 1 -- start start 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.666+0000 7f2b2813c740 1 Processor -- start 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b10ed590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 0x5635b10edc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5635b0ea9700 con 0x5635b0cf99f0 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5635b0fe3160 con 0x5635b0d1a390 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5635b10f0b40 con 0x5635b0d121b0 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.667+0000 7f2b2813c740 10 client.0 _ll_register_callbacks cb 0x5635b0ffc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.668+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 0x5635b10edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.668+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 0x5635b10edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60966/0 (socket says 172.21.15.37:60966) 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.668+0000 7f2b1bfff640 1 -- 172.21.15.37:0/1935659423 learned_addr learned my addr 172.21.15.37:0/1935659423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.670+0000 7f2b1bfff640 1 -- 172.21.15.37:0/1935659423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 msgr2=0x5635b10f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.670+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.670+0000 7f2b1bfff640 1 -- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 msgr2=0x5635b10ed590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.670+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b10ed590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.670+0000 7f2b1bfff640 1 -- 172.21.15.37:0/1935659423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b1010c90 con 0x5635b0cf99f0 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.671+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 0x5635b10edc80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2b14005c00 tx=0x7f2b1401d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa31bfb0477c8d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.671+0000 7f2afaffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.672+0000 7f2afaffd640 1 -- 172.21.15.37:0/1935659423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1401a910 con 0x5635b0cf99f0 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.672+0000 7f2afaffd640 1 -- 172.21.15.37:0/1935659423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2b14004c10 con 0x5635b0cf99f0 2024-09-21T01:19:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.672+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635b105adf0 con 0x5635b0cf99f0 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.679+0000 7f2afaffd640 1 -- 172.21.15.37:0/1935659423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2b14004e10 con 0x5635b0cf99f0 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.682+0000 7f2b2813c740 10 client.16128 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.682+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5635b10fc540 con 0x5635b0cf99f0 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.684+0000 7f2afaffd640 1 -- 172.21.15.37:0/1935659423 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5635b105adf0 con 0x5635b0cf99f0 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.684+0000 7f2afaffd640 1 -- 172.21.15.37:0/1935659423 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f2b14031020 con 0x5635b0cf99f0 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.685+0000 7f2b2813c740 10 client.16128 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.685+0000 7f2b2813c740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.685+0000 7f2b2813c740 20 client.16128 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.685+0000 7f2b2813c740 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b0cceda0 0x5635b10ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.685+0000 7f2b2813c740 4 client.16128 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.685+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635b10568a0 con 0x5635b0cceda0 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.702+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b0cceda0 0x5635b10ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.704+0000 7f2afaffd640 10 client.16128 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.704+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b0cceda0 0x5635b10ffd90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=846aee83fef8d187 server_cookie=687d6ab061dadbf2 in_seq=0 out_seq=0 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.708+0000 7f2afaffd640 1 -- 172.21.15.37:0/1935659423 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635b10568a0 con 0x5635b0cceda0 2024-09-21T01:19:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.708+0000 7f2afaffd640 10 client.16128 handle_command_reply: tid=0 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.708+0000 7f2b2813c740 1 client.16128 shutdown 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.710+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 msgr2=0x5635b10edc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.710+0000 7f2b2813c740 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 0x5635b10edc80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2b14005c00 tx=0x7f2b1401d670 comp rx=0 tx=0).stop 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.712+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 shutdown_connections 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.712+0000 7f2b2813c740 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b0cceda0 0x5635b10ffd90 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.712+0000 7f2b2813c740 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0cf99f0 0x5635b10edc80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.712+0000 7f2b2813c740 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b10ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.712+0000 7f2b2813c740 1 --2- 172.21.15.37:0/1935659423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10f00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.712+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 >> 172.21.15.37:0/1935659423 conn(0x5635b0d2f460 msgr2=0x5635b10e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.713+0000 7f2afaffd640 0 client.16128 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.714+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 shutdown_connections 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.715+0000 7f2b2813c740 1 -- 172.21.15.37:0/1935659423 wait complete. 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.716+0000 7f2b2813c740 20 client.16128 trim_cache size 0 max 16384 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.753+0000 7f2b2813c740 1 Processor -- start 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 -- start start 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0cf99f0 0x5635b10e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 0x5635b10e7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800e5e0 con 0x5635b0d1a390 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b08010150 con 0x5635b0cf99f0 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.755+0000 7f2b2813c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800ecb0 con 0x5635b0d121b0 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.758+0000 7f2b1b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0cf99f0 0x5635b10e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.758+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 0x5635b10e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.758+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 0x5635b10e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60968/0 (socket says 172.21.15.37:60968) 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.758+0000 7f2b1bfff640 1 -- 172.21.15.37:0/3000663022 learned_addr learned my addr 172.21.15.37:0/3000663022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.758+0000 7f2b1affd640 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.759+0000 7f2b1bfff640 1 -- 172.21.15.37:0/3000663022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 msgr2=0x5635b10e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.759+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.759+0000 7f2b1bfff640 1 -- 172.21.15.37:0/3000663022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0cf99f0 msgr2=0x5635b10e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.759+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0cf99f0 0x5635b10e53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.759+0000 7f2b1bfff640 1 -- 172.21.15.37:0/3000663022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b10e45b0 con 0x5635b0d1a390 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.759+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 0x5635b10e7540 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2b14020940 tx=0x7f2b14005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12b0a113c9ba713 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.760+0000 7f2b017fa640 1 -- 172.21.15.37:0/3000663022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14004c10 con 0x5635b0d1a390 2024-09-21T01:19:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.760+0000 7f2b017fa640 1 -- 172.21.15.37:0/3000663022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1402ad30 con 0x5635b0d1a390 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.761+0000 7f2b017fa640 1 -- 172.21.15.37:0/3000663022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1401d810 con 0x5635b0d1a390 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 -- 172.21.15.37:0/3000663022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 msgr2=0x5635b10e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 0x5635b10e7540 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2b14020940 tx=0x7f2b14005ce0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 -- 172.21.15.37:0/3000663022 shutdown_connections 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d1a390 0x5635b10e7540 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0d121b0 0x5635b10e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 --2- 172.21.15.37:0/3000663022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0cf99f0 0x5635b10e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.762+0000 7f2b2813c740 1 -- 172.21.15.37:0/3000663022 >> 172.21.15.37:0/3000663022 conn(0x5635b0d2f460 msgr2=0x5635b10ed590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.763+0000 7f2b2813c740 1 -- 172.21.15.37:0/3000663022 shutdown_connections 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.763+0000 7f2b2813c740 1 -- 172.21.15.37:0/3000663022 wait complete. 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.763+0000 7f2b2813c740 1 -- start start 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 Processor -- start 2024-09-21T01:19:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0cf99f0 0x5635b10f1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 0x5635b10f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b1168780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800fa50 con 0x5635b0d121b0 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800f380 con 0x5635b0d1a390 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800c5a0 con 0x5635b0cf99f0 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.764+0000 7f2b2813c740 10 client.0 _ll_register_callbacks cb 0x7f2b10035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.765+0000 7f2b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 0x5635b10f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.765+0000 7f2b1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 0x5635b10f1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60980/0 (socket says 172.21.15.37:60980) 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.765+0000 7f2b1affd640 1 -- 172.21.15.37:0/435836628 learned_addr learned my addr 172.21.15.37:0/435836628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.765+0000 7f2b1bfff640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b1168780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.765+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0cf99f0 0x5635b10f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2b1affd640 1 -- 172.21.15.37:0/435836628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0cf99f0 msgr2=0x5635b10f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2b1affd640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0cf99f0 0x5635b10f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2b1affd640 1 -- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 msgr2=0x5635b1168780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2b1affd640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b1168780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2b1affd640 1 -- 172.21.15.37:0/435836628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b1168cc0 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2b1affd640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 0x5635b10f1b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c007590 tx=0x7f2b0c0a7a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba87535e2aca4157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.766+0000 7f2afaffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2afaffd640 1 -- 172.21.15.37:0/435836628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0a9bc0 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2afaffd640 1 -- 172.21.15.37:0/435836628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2b0c0b6b90 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b1402ad30 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2afaffd640 1 -- 172.21.15.37:0/435836628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2b0c0a9d60 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2b2813c740 10 client.16134 fetch_fsmap learned FSMap version 29 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5635b1169e80 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.767+0000 7f2afaffd640 1 -- 172.21.15.37:0/435836628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1402ad30 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2afaffd640 1 -- 172.21.15.37:0/435836628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f2b0c094b60 con 0x5635b0d121b0 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b2813c740 10 client.16134 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T01:19:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b2813c740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b2813c740 20 client.16134 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b2813c740 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b116a5f0 0x5635b116ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b2813c740 4 client.16134 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635b1053cd0 con 0x5635b116a5f0 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.768+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b116a5f0 0x5635b116ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.769+0000 7f2b1b7fe640 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b116a5f0 0x5635b116ca10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88d5385da97c7b6d server_cookie=876abb85c2d1db89 in_seq=0 out_seq=0 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.769+0000 7f2afaffd640 10 client.16134 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.773+0000 7f2afaffd640 1 -- 172.21.15.37:0/435836628 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635b1053cd0 con 0x5635b116a5f0 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.773+0000 7f2afaffd640 10 client.16134 handle_command_reply: tid=0 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.773+0000 7f2b2813c740 1 client.16134 shutdown 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.773+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 msgr2=0x5635b10f1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.773+0000 7f2b2813c740 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 0x5635b10f1b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c007590 tx=0x7f2b0c0a7a60 comp rx=0 tx=0).stop 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 shutdown_connections 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5635b116a5f0 0x5635b116ca10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5635b0d1a390 0x5635b1168780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5635b0d121b0 0x5635b10f1b50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 --2- 172.21.15.37:0/435836628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635b0cf99f0 0x5635b10f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 >> 172.21.15.37:0/435836628 conn(0x5635b0d2f460 msgr2=0x5635b10e53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2afaffd640 0 client.16134 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 shutdown_connections 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 1 -- 172.21.15.37:0/435836628 wait complete. 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.774+0000 7f2b2813c740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2b040b65c0 msgr2=0x7f2b040b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2b040b65c0 0x7f2b040b8ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2b100303f0 tx=0x7f2b1002a840 comp rx=0 tx=0).stop 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 msgr2=0x7f2b1c1186a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 0x7f2b1c1186a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00c970 tx=0x7f2b0c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 shutdown_connections 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2b040b65c0 0x7f2b040b8ad0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2b1c11cc30 0x7f2b1c118be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b1c111f40 0x7f2b1c1186a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 --2- 172.21.15.37:0/2241984695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b1c10a9e0 0x7f2b1c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.775+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 >> 172.21.15.37:0/2241984695 conn(0x7f2b1c070ec0 msgr2=0x7f2b1c10ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.776+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 shutdown_connections 2024-09-21T01:19:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:23.776+0000 7f2b21bc8640 1 -- 172.21.15.37:0/2241984695 wait complete. 2024-09-21T01:19:24.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:24 smithi037 ceph-mon[31105]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 850 MiB/s wr, 2.25k op/s 2024-09-21T01:19:24.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:24 smithi137 ceph-mon[34607]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 850 MiB/s wr, 2.25k op/s 2024-09-21T01:19:24.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:24 smithi144 ceph-mon[34818]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 850 MiB/s wr, 2.25k op/s 2024-09-21T01:19:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:26 smithi137 ceph-mon[34607]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 985 MiB/s wr, 2.29k op/s 2024-09-21T01:19:26.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:26 smithi144 ceph-mon[34818]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 985 MiB/s wr, 2.29k op/s 2024-09-21T01:19:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:26 smithi037 ceph-mon[31105]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 985 MiB/s wr, 2.29k op/s 2024-09-21T01:19:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.190+0000 7f3817420640 1 -- 172.21.15.37:0/2942717242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010a3c0 msgr2=0x7f381010c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.190+0000 7f3817420640 1 --2- 172.21.15.37:0/2942717242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010a3c0 0x7f381010c7e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3800009900 tx=0x7f380002a400 comp rx=0 tx=0).stop 2024-09-21T01:19:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.197+0000 7f3817420640 1 -- 172.21.15.37:0/2942717242 shutdown_connections 2024-09-21T01:19:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.197+0000 7f3817420640 1 --2- 172.21.15.37:0/2942717242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f381010f9d0 0x7f381011ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.197+0000 7f3817420640 1 --2- 172.21.15.37:0/2942717242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381010cdb0 0x7f381010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.197+0000 7f3817420640 1 --2- 172.21.15.37:0/2942717242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010a3c0 0x7f381010c7e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.197+0000 7f3817420640 1 -- 172.21.15.37:0/2942717242 >> 172.21.15.37:0/2942717242 conn(0x7f3810070810 msgr2=0x7f3810072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.202+0000 7f3817420640 1 -- 172.21.15.37:0/2942717242 shutdown_connections 2024-09-21T01:19:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.205+0000 7f3817420640 1 -- 172.21.15.37:0/2942717242 wait complete. 2024-09-21T01:19:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.207+0000 7f3817420640 1 Processor -- start 2024-09-21T01:19:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 -- start start 2024-09-21T01:19:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381010a3c0 0x7f38101a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 0x7f38101a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f381010f9d0 0x7f38101a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f381011e120 con 0x7f381010cdb0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f381011dfa0 con 0x7f381010f9d0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.208+0000 7f3817420640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f381011e2a0 con 0x7f381010a3c0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 0x7f38101a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 0x7f38101a9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46248/0 (socket says 172.21.15.37:46248) 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 -- 172.21.15.37:0/1033051977 learned_addr learned my addr 172.21.15.37:0/1033051977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 -- 172.21.15.37:0/1033051977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381010a3c0 msgr2=0x7f38101a8dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381010a3c0 0x7f38101a8dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 -- 172.21.15.37:0/1033051977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f381010f9d0 msgr2=0x7f38101a9ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.209+0000 7f38149bb640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f381010f9d0 0x7f38101a9ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f38149bb640 1 -- 172.21.15.37:0/1033051977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38101aa810 con 0x7f381010cdb0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f38149bb640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 0x7f38101a9440 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f380800ebc0 tx=0x7f380800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f38067fc640 1 -- 172.21.15.37:0/1033051977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808010630 con 0x7f381010cdb0 2024-09-21T01:19:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38101aab00 con 0x7f381010cdb0 2024-09-21T01:19:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38101b11f0 con 0x7f381010cdb0 2024-09-21T01:19:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f38067fc640 1 -- 172.21.15.37:0/1033051977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3808010c80 con 0x7f381010cdb0 2024-09-21T01:19:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.210+0000 7f38067fc640 1 -- 172.21.15.37:0/1033051977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808018b60 con 0x7f381010cdb0 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.216+0000 7f381e468740 1 Processor -- start 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.218+0000 7f38067fc640 1 -- 172.21.15.37:0/1033051977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3808018d00 con 0x7f381010cdb0 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 -- start start 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b326e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b3274c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b328010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557f7b2996f0 con 0x557f7af562f0 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557f7b288b20 con 0x557f7af7f1b0 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f381e468740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557f7b28c930 con 0x557f7af5e4d0 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f38067fc640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37fc0b65d0 0x7f37fc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f38151bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b3274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f38151bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b3274c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46262/0 (socket says 172.21.15.37:46262) 2024-09-21T01:19:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.219+0000 7f38151bc640 1 -- 172.21.15.37:0/1993096555 learned_addr learned my addr 172.21.15.37:0/1993096555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.220+0000 7f38067fc640 1 -- 172.21.15.37:0/1033051977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f38080e7980 con 0x7f381010cdb0 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.224+0000 7f38149bb640 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b328010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.225+0000 7f38159bd640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37fc0b65d0 0x7f37fc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.225+0000 7f38159bd640 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b326e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.227+0000 7f38151bc640 1 -- 172.21.15.37:0/1993096555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 msgr2=0x557f7b328010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.227+0000 7f38151bc640 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b328010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.227+0000 7f38151bc640 1 -- 172.21.15.37:0/1993096555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 msgr2=0x557f7b326e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.227+0000 7f38151bc640 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b326e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.227+0000 7f38151bc640 1 -- 172.21.15.37:0/1993096555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7b24e530 con 0x557f7af562f0 2024-09-21T01:19:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.228+0000 7f38159bd640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37fc0b65d0 0x7f37fc0b8ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f380c009f10 tx=0x7f380c009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.228+0000 7f38151bc640 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b3274c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3800031440 tx=0x7f38000050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc56235905015cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.229+0000 7f37fb7fe640 1 -- 172.21.15.37:0/1993096555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380003e030 con 0x557f7af562f0 2024-09-21T01:19:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.229+0000 7f37fb7fe640 1 -- 172.21.15.37:0/1993096555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38000046c0 con 0x557f7af562f0 2024-09-21T01:19:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 -- 172.21.15.37:0/1993096555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 msgr2=0x557f7b3274c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b3274c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3800031440 tx=0x7f38000050b0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 -- 172.21.15.37:0/1993096555 shutdown_connections 2024-09-21T01:19:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b328010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b3274c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 --2- 172.21.15.37:0/1993096555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b326e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.230+0000 7f381e468740 1 -- 172.21.15.37:0/1993096555 >> 172.21.15.37:0/1993096555 conn(0x557f7af73300 msgr2=0x557f7b3228e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.231+0000 7f381e468740 1 -- 172.21.15.37:0/1993096555 shutdown_connections 2024-09-21T01:19:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.231+0000 7f381e468740 1 -- 172.21.15.37:0/1993096555 wait complete. 2024-09-21T01:19:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 -- start start 2024-09-21T01:19:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 Processor -- start 2024-09-21T01:19:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b330570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b330c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b3317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557f7b1c0ab0 con 0x557f7af562f0 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557f7b22e730 con 0x557f7af7f1b0 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.232+0000 7f381e468740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557f7b328b20 con 0x557f7af5e4d0 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.233+0000 7f381e468740 10 client.0 _ll_register_callbacks cb 0x557f7b2826b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.233+0000 7f38159bd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b3317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.233+0000 7f38151bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b330570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.234+0000 7f38151bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b330570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46278/0 (socket says 172.21.15.37:46278) 2024-09-21T01:19:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.234+0000 7f38151bc640 1 -- 172.21.15.37:0/204816509 learned_addr learned my addr 172.21.15.37:0/204816509 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.234+0000 7f38149bb640 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b330c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.235+0000 7f38151bc640 1 -- 172.21.15.37:0/204816509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 msgr2=0x557f7b330c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.235+0000 7f38151bc640 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b330c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.235+0000 7f38151bc640 1 -- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 msgr2=0x557f7b3317a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.235+0000 7f38151bc640 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b3317a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.235+0000 7f38151bc640 1 -- 172.21.15.37:0/204816509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f7afea790 con 0x557f7af562f0 2024-09-21T01:19:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.236+0000 7f38151bc640 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b330570 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f38000096c0 tx=0x7f3800005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208ebbe073669371 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.236+0000 7f37f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.238+0000 7f37f8ff9640 1 -- 172.21.15.37:0/204816509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380003e040 con 0x557f7af562f0 2024-09-21T01:19:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.238+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38000046c0 con 0x557f7af562f0 2024-09-21T01:19:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.238+0000 7f37f8ff9640 1 -- 172.21.15.37:0/204816509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3800004b30 con 0x557f7af562f0 2024-09-21T01:19:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.240+0000 7f37f8ff9640 1 -- 172.21.15.37:0/204816509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3800004d30 con 0x557f7af562f0 2024-09-21T01:19:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.240+0000 7f381e468740 10 client.16146 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.240+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557f7b063620 con 0x557f7af562f0 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f37f8ff9640 1 -- 172.21.15.37:0/204816509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38000046c0 con 0x557f7af562f0 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f37f8ff9640 1 -- 172.21.15.37:0/204816509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f380004f3f0 con 0x557f7af562f0 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f381e468740 10 client.16146 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f381e468740 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f381e468740 20 client.16146 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f381e468740 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af3dd80 0x557f7b35fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f381e468740 4 client.16146 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.241+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f7b29b640 con 0x557f7af3dd80 2024-09-21T01:19:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.242+0000 7f38149bb640 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af3dd80 0x557f7b35fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.247+0000 7f38149bb640 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af3dd80 0x557f7b35fe60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73bc6abbdf16cd4e server_cookie=54ba613adda2a990 in_seq=0 out_seq=0 2024-09-21T01:19:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.247+0000 7f37f8ff9640 10 client.16146 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:27.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:27 smithi037 ceph-mon[31105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:19:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.255+0000 7f37f8ff9640 1 -- 172.21.15.37:0/204816509 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f7b29b640 con 0x557f7af3dd80 2024-09-21T01:19:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.255+0000 7f37f8ff9640 10 client.16146 handle_command_reply: tid=0 2024-09-21T01:19:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.259+0000 7f381e468740 1 client.16146 shutdown 2024-09-21T01:19:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 msgr2=0x557f7b330570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b330570 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f38000096c0 tx=0x7f3800005500 comp rx=0 tx=0).stop 2024-09-21T01:19:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 shutdown_connections 2024-09-21T01:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af3dd80 0x557f7b35fe60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af7f1b0 0x557f7b3317a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af5e4d0 0x557f7b330c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 --2- 172.21.15.37:0/204816509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b330570 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.260+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 >> 172.21.15.37:0/204816509 conn(0x557f7af73300 msgr2=0x557f7b320ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.261+0000 7f37f8ff9640 0 client.16146 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.261+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 shutdown_connections 2024-09-21T01:19:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.261+0000 7f381e468740 1 -- 172.21.15.37:0/204816509 wait complete. 2024-09-21T01:19:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.261+0000 7f381e468740 20 client.16146 trim_cache size 0 max 16384 2024-09-21T01:19:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.323+0000 7f381e468740 1 Processor -- start 2024-09-21T01:19:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.323+0000 7f381e468740 1 -- start start 2024-09-21T01:19:27.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.327+0000 7f381e468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b35fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.327+0000 7f381e468740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af5e4d0 0x557f7b326df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.328+0000 7f381e468740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b327330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.328+0000 7f381e468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37f400e5e0 con 0x557f7af562f0 2024-09-21T01:19:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.328+0000 7f381e468740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4010120 con 0x557f7af5e4d0 2024-09-21T01:19:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.328+0000 7f381e468740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37f400ecb0 con 0x557f7af7f1b0 2024-09-21T01:19:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.329+0000 7f38159bd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b327330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.329+0000 7f38151bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b35fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.329+0000 7f38151bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b35fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46282/0 (socket says 172.21.15.37:46282) 2024-09-21T01:19:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.329+0000 7f38151bc640 1 -- 172.21.15.37:0/3260313121 learned_addr learned my addr 172.21.15.37:0/3260313121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.329+0000 7f38149bb640 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af5e4d0 0x557f7b326df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.330+0000 7f38149bb640 1 -- 172.21.15.37:0/3260313121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 msgr2=0x557f7b327330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.330+0000 7f38149bb640 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b327330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.331+0000 7f38149bb640 1 -- 172.21.15.37:0/3260313121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 msgr2=0x557f7b35fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.331+0000 7f38149bb640 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b35fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.331+0000 7f38149bb640 1 -- 172.21.15.37:0/3260313121 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7b3283f0 con 0x557f7af5e4d0 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.331+0000 7f38149bb640 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af5e4d0 0x557f7b326df0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38080e5480 tx=0x7f3808095040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0e8dd5d8c9e151 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:27.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.333+0000 7f37faffd640 1 -- 172.21.15.37:0/3260313121 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38080ad620 con 0x557f7af5e4d0 2024-09-21T01:19:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.333+0000 7f37faffd640 1 -- 172.21.15.37:0/3260313121 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38080ae210 con 0x557f7af5e4d0 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 -- 172.21.15.37:0/3260313121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af5e4d0 msgr2=0x557f7b326df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af5e4d0 0x557f7b326df0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38080e5480 tx=0x7f3808095040 comp rx=0 tx=0).stop 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 -- 172.21.15.37:0/3260313121 shutdown_connections 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b327330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af5e4d0 0x557f7b326df0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 --2- 172.21.15.37:0/3260313121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af562f0 0x557f7b35fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.335+0000 7f381e468740 1 -- 172.21.15.37:0/3260313121 >> 172.21.15.37:0/3260313121 conn(0x557f7af73300 msgr2=0x557f7b327ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.343+0000 7f381e468740 1 -- 172.21.15.37:0/3260313121 shutdown_connections 2024-09-21T01:19:27.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.343+0000 7f381e468740 1 -- 172.21.15.37:0/3260313121 wait complete. 2024-09-21T01:19:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.344+0000 7f381e468740 1 -- start start 2024-09-21T01:19:27.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.344+0000 7f381e468740 1 Processor -- start 2024-09-21T01:19:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.346+0000 7f381e468740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af562f0 0x557f7b334d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.346+0000 7f381e468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af5e4d0 0x557f7b335400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.346+0000 7f381e468740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b335f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.346+0000 7f381e468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37f400fa50 con 0x557f7af5e4d0 2024-09-21T01:19:27.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.347+0000 7f381e468740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37f400f380 con 0x557f7af562f0 2024-09-21T01:19:27.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.347+0000 7f381e468740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37f400c5a0 con 0x557f7af7f1b0 2024-09-21T01:19:27.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.347+0000 7f381e468740 10 client.0 _ll_register_callbacks cb 0x7f38080093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.351+0000 7f38149bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af5e4d0 0x557f7b335400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.351+0000 7f38149bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af5e4d0 0x557f7b335400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46286/0 (socket says 172.21.15.37:46286) 2024-09-21T01:19:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.351+0000 7f38149bb640 1 -- 172.21.15.37:0/2014856805 learned_addr learned my addr 172.21.15.37:0/2014856805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.352+0000 7f38151bc640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af562f0 0x557f7b334d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.352+0000 7f38159bd640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b335f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f38151bc640 1 -- 172.21.15.37:0/2014856805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 msgr2=0x557f7b335f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f38151bc640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b335f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f38151bc640 1 -- 172.21.15.37:0/2014856805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af5e4d0 msgr2=0x557f7b335400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:27.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f38151bc640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af5e4d0 0x557f7b335400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:27.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f38151bc640 1 -- 172.21.15.37:0/2014856805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f7b3366d0 con 0x557f7af562f0 2024-09-21T01:19:27.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f38151bc640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af562f0 0x557f7b334d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x557f7b331cb0 tx=0x7f3800031650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e7593397877848 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:27.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.353+0000 7f37f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:19:27.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.356+0000 7f37f8ff9640 1 -- 172.21.15.37:0/2014856805 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380003e040 con 0x557f7af562f0 2024-09-21T01:19:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.365+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38080ae210 con 0x557f7af562f0 2024-09-21T01:19:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.365+0000 7f37f8ff9640 1 -- 172.21.15.37:0/2014856805 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f380004fc30 con 0x557f7af562f0 2024-09-21T01:19:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.366+0000 7f37f8ff9640 1 -- 172.21.15.37:0/2014856805 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f38000046c0 con 0x557f7af562f0 2024-09-21T01:19:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.366+0000 7f381e468740 10 client.25667 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.366+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557f7b3379c0 con 0x557f7af562f0 2024-09-21T01:19:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f37f8ff9640 1 -- 172.21.15.37:0/2014856805 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38080ae210 con 0x557f7af562f0 2024-09-21T01:19:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f37f8ff9640 1 -- 172.21.15.37:0/2014856805 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3800043410 con 0x557f7af562f0 2024-09-21T01:19:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f381e468740 10 client.25667 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f381e468740 10 client.25667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f381e468740 20 client.25667 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f381e468740 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af131c0 0x557f7b3383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f381e468740 4 client.25667 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:19:27.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.368+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f7b2970f0 con 0x557f7af131c0 2024-09-21T01:19:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.374+0000 7f38149bb640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af131c0 0x557f7b3383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.377+0000 7f38149bb640 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af131c0 0x557f7b3383a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ec753a785934a9 server_cookie=adf1c67f00791d53 in_seq=0 out_seq=0 2024-09-21T01:19:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:27.379+0000 7f37f8ff9640 10 client.25667 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:27.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:27 smithi137 ceph-mon[34607]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:19:27.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:27 smithi144 ceph-mon[34818]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:19:27.672 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:19:27.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:19:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:28.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:28 smithi037 ceph-mon[31105]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 770 MiB/s wr, 1.64k op/s 2024-09-21T01:19:28.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:28 smithi144 ceph-mon[34818]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 770 MiB/s wr, 1.64k op/s 2024-09-21T01:19:28.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:28 smithi137 ceph-mon[34607]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 770 MiB/s wr, 1.64k op/s 2024-09-21T01:19:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.802+0000 7f37f8ff9640 1 -- 172.21.15.37:0/2014856805 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f7b2970f0 con 0x557f7af131c0 2024-09-21T01:19:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.802+0000 7f37f8ff9640 10 client.25667 handle_command_reply: tid=0 2024-09-21T01:19:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.802+0000 7f381e468740 1 client.25667 shutdown 2024-09-21T01:19:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af562f0 msgr2=0x557f7b334d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af562f0 0x557f7b334d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x557f7b331cb0 tx=0x7f3800031650 comp rx=0 tx=0).stop 2024-09-21T01:19:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 shutdown_connections 2024-09-21T01:19:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557f7af131c0 0x557f7b3383a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f7af7f1b0 0x557f7b335f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f7af5e4d0 0x557f7b335400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 --2- 172.21.15.37:0/2014856805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557f7af562f0 0x557f7b334d40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 >> 172.21.15.37:0/2014856805 conn(0x557f7af73300 msgr2=0x557f7b327ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.803+0000 7f37f8ff9640 0 client.25667 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:28.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.805+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 shutdown_connections 2024-09-21T01:19:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.805+0000 7f381e468740 1 -- 172.21.15.37:0/2014856805 wait complete. 2024-09-21T01:19:28.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.806+0000 7f381e468740 20 client.25667 trim_cache size 0 max 16384 2024-09-21T01:19:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:19:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:19:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:19:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.812+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37fc0b65d0 msgr2=0x7f37fc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.812+0000 7f3817420640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37fc0b65d0 0x7f37fc0b8ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f380c009f10 tx=0x7f380c009520 comp rx=0 tx=0).stop 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.812+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 msgr2=0x7f38101a9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.812+0000 7f3817420640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 0x7f38101a9440 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f380800ebc0 tx=0x7f380800c6a0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.814+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 shutdown_connections 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.814+0000 7f3817420640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f37fc0b65d0 0x7f37fc0b8ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.814+0000 7f3817420640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f381010f9d0 0x7f38101a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.814+0000 7f3817420640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381010cdb0 0x7f38101a9440 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.814+0000 7f3817420640 1 --2- 172.21.15.37:0/1033051977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f381010a3c0 0x7f38101a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.814+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 >> 172.21.15.37:0/1033051977 conn(0x7f3810070810 msgr2=0x7f381010b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.819+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 shutdown_connections 2024-09-21T01:19:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:28.819+0000 7f3817420640 1 -- 172.21.15.37:0/1033051977 wait complete. 2024-09-21T01:19:30.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:30 smithi037 ceph-mon[31105]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1007 MiB/s wr, 2.23k op/s 2024-09-21T01:19:30.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:30 smithi137 ceph-mon[34607]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1007 MiB/s wr, 2.23k op/s 2024-09-21T01:19:30.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:30 smithi144 ceph-mon[34818]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1007 MiB/s wr, 2.23k op/s 2024-09-21T01:19:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.594+0000 7f3df3480640 1 -- 172.21.15.37:0/22933255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec11cc30 msgr2=0x7f3dec11f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.594+0000 7f3df3480640 1 --2- 172.21.15.37:0/22933255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec11cc30 0x7f3dec11f140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009ca0 tx=0x7f3de402a8f0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.595+0000 7f3df3480640 1 -- 172.21.15.37:0/22933255 shutdown_connections 2024-09-21T01:19:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.595+0000 7f3df3480640 1 --2- 172.21.15.37:0/22933255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec11cc30 0x7f3dec11f140 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.595+0000 7f3df3480640 1 --2- 172.21.15.37:0/22933255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec10a9e0 0x7f3dec10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.595+0000 7f3df3480640 1 --2- 172.21.15.37:0/22933255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dec111f40 0x7f3dec10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.595+0000 7f3df3480640 1 -- 172.21.15.37:0/22933255 >> 172.21.15.37:0/22933255 conn(0x7f3dec070ec0 msgr2=0x7f3dec0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.597+0000 7f3df3480640 1 -- 172.21.15.37:0/22933255 shutdown_connections 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.598+0000 7f3df3480640 1 -- 172.21.15.37:0/22933255 wait complete. 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.599+0000 7f3df3480640 1 Processor -- start 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 -- start start 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec10a9e0 0x7f3dec11c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dec111f40 0x7f3dec11c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 0x7f3dec115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1229e0 con 0x7f3dec111f40 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec122860 con 0x7f3dec115440 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.603+0000 7f3df3480640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec122b60 con 0x7f3dec10a9e0 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.606+0000 7f3df1a1d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 0x7f3dec115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.606+0000 7f3df121c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec10a9e0 0x7f3dec11c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.606+0000 7f3df1a1d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 0x7f3dec115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:53358/0 (socket says 172.21.15.37:53358) 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.606+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1119696522 learned_addr learned my addr 172.21.15.37:0/1119696522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.606+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dec111f40 0x7f3dec11c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.609+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1119696522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec10a9e0 msgr2=0x7f3dec11c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.609+0000 7f3df1a1d640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec10a9e0 0x7f3dec11c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.609+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dec111f40 msgr2=0x7f3dec11c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.609+0000 7f3df1a1d640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dec111f40 0x7f3dec11c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.609+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1119696522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec11ac30 con 0x7f3dec115440 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.610+0000 7f3df1a1d640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 0x7f3dec115920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3de402aee0 tx=0x7f3de4030b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.610+0000 7f3de27fc640 1 -- 172.21.15.37:0/1119696522 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de402f7a0 con 0x7f3dec115440 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.611+0000 7f3de27fc640 1 -- 172.21.15.37:0/1119696522 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3de4036040 con 0x7f3dec115440 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.612+0000 7f3de27fc640 1 -- 172.21.15.37:0/1119696522 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de403ba10 con 0x7f3dec115440 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.614+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dec11aec0 con 0x7f3dec115440 2024-09-21T01:19:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.614+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dec11b380 con 0x7f3dec115440 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.620+0000 7f3df99f4740 1 Processor -- start 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.623+0000 7f3df99f4740 1 -- start start 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a82a350 0x55ef8abd1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abd1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3df99f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef8ab47e60 con 0x55ef8a801490 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3df99f4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ef8ab37290 con 0x55ef8a82a350 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3df99f4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ef8ab3b0a0 con 0x55ef8a809670 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.624+0000 7f3de27fc640 1 -- 172.21.15.37:0/1119696522 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3de403bbb0 con 0x7f3dec115440 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.625+0000 7f3df121c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abd1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.625+0000 7f3df121c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abd1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46304/0 (socket says 172.21.15.37:46304) 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.625+0000 7f3df121c640 1 -- 172.21.15.37:0/2842506958 learned_addr learned my addr 172.21.15.37:0/2842506958 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a82a350 0x55ef8abd1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df121c640 1 -- 172.21.15.37:0/2842506958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 msgr2=0x55ef8abd1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df121c640 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df121c640 1 -- 172.21.15.37:0/2842506958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a82a350 msgr2=0x55ef8abd1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df121c640 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a82a350 0x55ef8abd1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.626+0000 7f3df121c640 1 -- 172.21.15.37:0/2842506958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef8a895930 con 0x55ef8a801490 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.628+0000 7f3df121c640 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abd1970 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009a70 tx=0x7f3ddc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a03d83fdcc9ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.628+0000 7f3de27fc640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3dd80b6580 0x7f3dd80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.628+0000 7f3dd77fe640 1 -- 172.21.15.37:0/2842506958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc017070 con 0x55ef8a801490 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.628+0000 7f3de27fc640 1 -- 172.21.15.37:0/1119696522 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3de4108040 con 0x7f3dec115440 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.628+0000 7f3dd77fe640 1 -- 172.21.15.37:0/2842506958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ddc013470 con 0x55ef8a801490 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.629+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3dd80b6580 0x7f3dd80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 -- 172.21.15.37:0/2842506958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 msgr2=0x55ef8abd1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3dd80b6580 0x7f3dd80b8a90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006a90 tx=0x7f3de80046e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abd1970 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009a70 tx=0x7f3ddc009f30 comp rx=0 tx=0).stop 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 -- 172.21.15.37:0/2842506958 shutdown_connections 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abd1970 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2842506958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a82a350 0x55ef8abd1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.630+0000 7f3df99f4740 1 -- 172.21.15.37:0/2842506958 >> 172.21.15.37:0/2842506958 conn(0x55ef8a81e740 msgr2=0x55ef8abcf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.631+0000 7f3df99f4740 1 -- 172.21.15.37:0/2842506958 shutdown_connections 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.631+0000 7f3df99f4740 1 -- 172.21.15.37:0/2842506958 wait complete. 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.631+0000 7f3df99f4740 1 -- start start 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.632+0000 7f3df99f4740 1 Processor -- start 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.632+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a801490 0x55ef8abdcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.633+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 0x55ef8abdd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a82a350 0x55ef8abe8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df99f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef8a998890 con 0x55ef8a809670 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df99f4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ef8aad1d40 con 0x55ef8a801490 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df99f4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ef8abdfc60 con 0x55ef8a82a350 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df99f4740 10 client.0 _ll_register_callbacks cb 0x55ef8ab35c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df121c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a801490 0x55ef8abdcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df0a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 0x55ef8abdd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df0a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 0x55ef8abdd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46318/0 (socket says 172.21.15.37:46318) 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.634+0000 7f3df0a1b640 1 -- 172.21.15.37:0/2170797920 learned_addr learned my addr 172.21.15.37:0/2170797920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.636+0000 7f3df0a1b640 1 -- 172.21.15.37:0/2170797920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a82a350 msgr2=0x55ef8abe8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.636+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a82a350 0x55ef8abe8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.636+0000 7f3df0a1b640 1 -- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a801490 msgr2=0x55ef8abdcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.636+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a801490 0x55ef8abdcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.636+0000 7f3df0a1b640 1 -- 172.21.15.37:0/2170797920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef8abe94e0 con 0x55ef8a809670 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.637+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 0x55ef8abdd4c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009db0 tx=0x7f3de8006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d54ea9ceec1c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.637+0000 7f3dd4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.638+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2170797920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de801b050 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.638+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2170797920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3de8020640 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.638+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ddc013470 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.639+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2170797920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3de8020840 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.639+0000 7f3df99f4740 10 client.16161 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.639+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef8abebe70 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.640+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2170797920 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3de8025070 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.640+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2170797920 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3de8029400 con 0x55ef8a809670 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.640+0000 7f3df99f4740 10 client.16161 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.640+0000 7f3df99f4740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.640+0000 7f3df99f4740 20 client.16161 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.640+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a7e8cd0 0x55ef8abef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.641+0000 7f3df99f4740 4 client.16161 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.641+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ddc013470 con 0x55ef8a7e8cd0 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.642+0000 7f3df121c640 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a7e8cd0 0x55ef8abef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.649+0000 7f3df121c640 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a7e8cd0 0x55ef8abef4c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2916833665df247 server_cookie=dada0b5ed6dc5770 in_seq=0 out_seq=0 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.649+0000 7f3dd4ff9640 10 client.16161 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.655+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2170797920 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3ddc013470 con 0x55ef8a7e8cd0 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.655+0000 7f3dd4ff9640 10 client.16161 handle_command_reply: tid=0 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.655+0000 7f3df99f4740 1 client.16161 shutdown 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.657+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 msgr2=0x55ef8abdd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.657+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 0x55ef8abdd4c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009db0 tx=0x7f3de8006a20 comp rx=0 tx=0).stop 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 shutdown_connections 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a7e8cd0 0x55ef8abef4c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a82a350 0x55ef8abe8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a809670 0x55ef8abdd4c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 --2- 172.21.15.37:0/2170797920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a801490 0x55ef8abdcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 >> 172.21.15.37:0/2170797920 conn(0x55ef8a81e740 msgr2=0x55ef8abd4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3dd4ff9640 0 client.16161 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 shutdown_connections 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.660+0000 7f3df99f4740 1 -- 172.21.15.37:0/2170797920 wait complete. 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.661+0000 7f3df99f4740 20 client.16161 trim_cache size 0 max 16384 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.702+0000 7f3df99f4740 1 Processor -- start 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.702+0000 7f3df99f4740 1 -- start start 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a81e740 0x55ef8abd7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abe8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df0a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abe8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df0a1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abe8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46322/0 (socket says 172.21.15.37:46322) 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df0a1b640 1 -- 172.21.15.37:0/966903268 learned_addr learned my addr 172.21.15.37:0/966903268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:30.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1c6a40 con 0x55ef8a801490 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1c8580 con 0x55ef8a81e740 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.703+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1c7110 con 0x55ef8a809670 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.704+0000 7f3df121c640 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a81e740 0x55ef8abd7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.704+0000 7f3df0a1b640 1 -- 172.21.15.37:0/966903268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 msgr2=0x55ef8abd9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.704+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.704+0000 7f3df0a1b640 1 -- 172.21.15.37:0/966903268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a81e740 msgr2=0x55ef8abd7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.704+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a81e740 0x55ef8abd7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.704+0000 7f3df0a1b640 1 -- 172.21.15.37:0/966903268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef8a7e8f00 con 0x55ef8a801490 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.705+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abe8ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3de8008010 tx=0x7f3de8009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8588d82ba060d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.706+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/966903268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de801b070 con 0x55ef8a801490 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.706+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/966903268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3de8025040 con 0x55ef8a801490 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.707+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 msgr2=0x55ef8abe8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.707+0000 7f3df99f4740 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abe8ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3de8008010 tx=0x7f3de8009240 comp rx=0 tx=0).stop 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.707+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/966903268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8034b90 con 0x55ef8a801490 2024-09-21T01:19:30.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 shutdown_connections 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a809670 0x55ef8abd9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a801490 0x55ef8abe8ea0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 --2- 172.21.15.37:0/966903268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a81e740 0x55ef8abd7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 >> 172.21.15.37:0/966903268 conn(0x55ef8abcf360 msgr2=0x55ef8abdb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 shutdown_connections 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.708+0000 7f3df99f4740 1 -- 172.21.15.37:0/966903268 wait complete. 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.709+0000 7f3df99f4740 1 -- start start 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.709+0000 7f3df99f4740 1 Processor -- start 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a801490 0x55ef8abe1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a809670 0x55ef8abe17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 0x55ef8ac58e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1c7eb0 con 0x55ef8a81e740 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1c77e0 con 0x55ef8a809670 2024-09-21T01:19:30.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec1c4a00 con 0x55ef8a801490 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df99f4740 10 client.0 _ll_register_callbacks cb 0x7f3de80095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.711+0000 7f3df1a1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 0x55ef8ac58e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 0x55ef8ac58e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46324/0 (socket says 172.21.15.37:46324) 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1798216738 learned_addr learned my addr 172.21.15.37:0/1798216738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df121c640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a801490 0x55ef8abe1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df0a1b640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a809670 0x55ef8abe17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1798216738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a801490 msgr2=0x55ef8abe1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a801490 0x55ef8abe1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a809670 msgr2=0x55ef8abe17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a809670 0x55ef8abe17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.712+0000 7f3df1a1d640 1 -- 172.21.15.37:0/1798216738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef8ac593c0 con 0x55ef8a81e740 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.713+0000 7f3df1a1d640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 0x55ef8ac58e80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3de40cde90 tx=0x7f3de4004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538c33d0e50c49b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.713+0000 7f3dd4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.713+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/1798216738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40cdae0 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.713+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/1798216738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3de40f1b10 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.713+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3de8025040 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.714+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/1798216738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3de402f340 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.714+0000 7f3df99f4740 10 client.16167 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.714+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef8ac5a4d0 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/1798216738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3de8025040 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/1798216738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3de40d3e00 con 0x55ef8a81e740 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3df99f4740 10 client.16167 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3df99f4740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3df99f4740 20 client.16167 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3df99f4740 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a82a350 0x55ef8ac5cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3df99f4740 4 client.16167 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.715+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ef8ab49db0 con 0x55ef8a82a350 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.716+0000 7f3df121c640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a82a350 0x55ef8ac5cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.722+0000 7f3dd4ff9640 10 client.16167 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:30.722+0000 7f3df121c640 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a82a350 0x55ef8ac5cc40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1adcf9e5d7c14bb1 server_cookie=4c546b9243742318 in_seq=0 out_seq=0 2024-09-21T01:19:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/1798216738 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ef8ab49db0 con 0x55ef8a82a350 2024-09-21T01:19:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3dd4ff9640 10 client.16167 handle_command_reply: tid=0 2024-09-21T01:19:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 client.16167 shutdown 2024-09-21T01:19:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 msgr2=0x55ef8ac58e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 0x55ef8ac58e80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3de40cde90 tx=0x7f3de4004f10 comp rx=0 tx=0).stop 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 shutdown_connections 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef8a82a350 0x55ef8ac5cc40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef8a81e740 0x55ef8ac58e80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef8a809670 0x55ef8abe17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 --2- 172.21.15.37:0/1798216738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef8a801490 0x55ef8abe1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 >> 172.21.15.37:0/1798216738 conn(0x55ef8abcf360 msgr2=0x55ef8abd2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.561+0000 7f3dd4ff9640 0 client.16167 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:31.566 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:19:31.566 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:19:31.566 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "9cca879a-4b6e-483b-a540-0b1516951102", 2024-09-21T01:19:31.566 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:19:31.566 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.562+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 shutdown_connections 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.562+0000 7f3df99f4740 1 -- 172.21.15.37:0/1798216738 wait complete. 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.562+0000 7f3df99f4740 20 client.16167 trim_cache size 0 max 16384 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3dd80b6580 msgr2=0x7f3dd80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3dd80b6580 0x7f3dd80b8a90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006a90 tx=0x7f3de80046e0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 msgr2=0x7f3dec115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 0x7f3dec115920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3de402aee0 tx=0x7f3de4030b90 comp rx=0 tx=0).stop 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 shutdown_connections 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3dd80b6580 0x7f3dd80b8a90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dec115440 0x7f3dec115920 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dec111f40 0x7f3dec11c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 --2- 172.21.15.37:0/1119696522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec10a9e0 0x7f3dec11c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 >> 172.21.15.37:0/1119696522 conn(0x7f3dec070ec0 msgr2=0x7f3dec10ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 shutdown_connections 2024-09-21T01:19:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:31.564+0000 7f3df3480640 1 -- 172.21.15.37:0/1119696522 wait complete. 2024-09-21T01:19:32.472 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:32 smithi137 ceph-mon[34607]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 878 MiB/s wr, 1.87k op/s 2024-09-21T01:19:32.472 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:32 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:19:32.472 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:32 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:32.472 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:32 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:19:32.472 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:32 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:19:32.472 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:32 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:32 smithi144 ceph-mon[34818]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 878 MiB/s wr, 1.87k op/s 2024-09-21T01:19:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:32 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:19:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:32 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:32 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:19:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:32 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:19:32.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:32 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:32.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:32 smithi037 ceph-mon[31105]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 878 MiB/s wr, 1.87k op/s 2024-09-21T01:19:32.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:32 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:19:32.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:32 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:32.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:32 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:19:32.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:32 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:19:32.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:32 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:33.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:33 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:33.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:33 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:33.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:33 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:19:34.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:19:34.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:34 smithi037 ceph-mon[31105]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 872 MiB/s wr, 1.80k op/s 2024-09-21T01:19:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:34 smithi137 ceph-mon[34607]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 872 MiB/s wr, 1.80k op/s 2024-09-21T01:19:34.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:34 smithi144 ceph-mon[34818]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 872 MiB/s wr, 1.80k op/s 2024-09-21T01:19:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:19:36.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:36 smithi037 ceph-mon[31105]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 981 MiB/s wr, 2.13k op/s 2024-09-21T01:19:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.452+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/1272714559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105ad0 msgr2=0x7f0d2410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.452+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/1272714559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105ad0 0x7f0d2410f560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009930 tx=0x7f0d1802a460 comp rx=0 tx=0).stop 2024-09-21T01:19:36.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/1272714559 shutdown_connections 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/1272714559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105ad0 0x7f0d2410f560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/1272714559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105180 0x7f0d24105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/1272714559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d24103100 0x7f0d24103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/1272714559 >> 172.21.15.37:0/1272714559 conn(0x7f0d24077c60 msgr2=0x7f0d240780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/1272714559 shutdown_connections 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.457+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/1272714559 wait complete. 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.459+0000 7f0d2b0f6640 1 Processor -- start 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.464+0000 7f0d2b0f6640 1 -- start start 2024-09-21T01:19:36.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.464+0000 7f0d2b0f6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d24103100 0x7f0d24074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.465+0000 7f0d2b0f6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105180 0x7f0d2406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.465+0000 7f0d2b0f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 0x7f0d2406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.465+0000 7f0d2b0f6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112a00 con 0x7f0d24105ad0 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.465+0000 7f0d2b0f6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112880 con 0x7f0d24103100 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.465+0000 7f0d2b0f6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112b80 con 0x7f0d24105180 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.466+0000 7f0d29693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 0x7f0d2406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.466+0000 7f0d29693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 0x7f0d2406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53588/0 (socket says 172.21.15.37:53588) 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.466+0000 7f0d29693640 1 -- 172.21.15.37:0/2322342073 learned_addr learned my addr 172.21.15.37:0/2322342073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.468+0000 7f0d29693640 1 -- 172.21.15.37:0/2322342073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105180 msgr2=0x7f0d2406df90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.468+0000 7f0d29693640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105180 0x7f0d2406df90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.468+0000 7f0d29693640 1 -- 172.21.15.37:0/2322342073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d24103100 msgr2=0x7f0d24074ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.468+0000 7f0d29693640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d24103100 0x7f0d24074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.469+0000 7f0d29693640 1 -- 172.21.15.37:0/2322342073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2406ebd0 con 0x7f0d24105ad0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.470+0000 7f0d29693640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 0x7f0d2406e4d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d18005d90 tx=0x7f0d180045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.470+0000 7f0d21ffb640 1 -- 172.21.15.37:0/2322342073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18040070 con 0x7f0d24105ad0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.471+0000 7f0d21ffb640 1 -- 172.21.15.37:0/2322342073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d180316d0 con 0x7f0d24105ad0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.471+0000 7f0d21ffb640 1 -- 172.21.15.37:0/2322342073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18040070 con 0x7f0d24105ad0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.472+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d241b5710 con 0x7f0d24105ad0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.472+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d241b5b30 con 0x7f0d24105ad0 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.480+0000 7f0d3166a740 1 Processor -- start 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.480+0000 7f0d3166a740 1 -- start start 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182b0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee01b0 0x5616182b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d3166a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561618226e50 con 0x561617ee01b0 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d3166a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561618216280 con 0x561617f09070 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d23fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.481+0000 7f0d23fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:48064/0 (socket says 172.21.15.37:48064) 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.482+0000 7f0d23fff640 1 -- 172.21.15.37:0/714810189 learned_addr learned my addr 172.21.15.37:0/714810189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.482+0000 7f0d3166a740 1 -- 172.21.15.37:0/714810189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56161821a090 con 0x561617ee8390 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.482+0000 7f0d23fff640 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.483+0000 7f0d28e92640 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee01b0 0x5616182b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.483+0000 7f0d23fff640 1 -- 172.21.15.37:0/714810189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 msgr2=0x5616182b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.483+0000 7f0d23fff640 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.483+0000 7f0d23fff640 1 -- 172.21.15.37:0/714810189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee01b0 msgr2=0x5616182b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.483+0000 7f0d23fff640 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee01b0 0x5616182b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.483+0000 7f0d23fff640 1 -- 172.21.15.37:0/714810189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561617f74650 con 0x561617f09070 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.485+0000 7f0d23fff640 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182b0650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d140143c0 tx=0x7f0d14009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1374f69279fc9375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.485+0000 7f0d0affd640 1 -- 172.21.15.37:0/714810189 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1401c070 con 0x561617f09070 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.485+0000 7f0d0affd640 1 -- 172.21.15.37:0/714810189 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d140044e0 con 0x561617f09070 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.487+0000 7f0d3166a740 1 -- 172.21.15.37:0/714810189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 msgr2=0x5616182b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.487+0000 7f0d3166a740 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182b0650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d140143c0 tx=0x7f0d14009060 comp rx=0 tx=0).stop 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.489+0000 7f0d21ffb640 1 -- 172.21.15.37:0/2322342073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0d18043070 con 0x7f0d24105ad0 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.491+0000 7f0d21ffb640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d0c0b6900 0x7f0d0c0b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.491+0000 7f0d21ffb640 1 -- 172.21.15.37:0/2322342073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0d18005020 con 0x7f0d24105ad0 2024-09-21T01:19:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.492+0000 7f0d3166a740 1 -- 172.21.15.37:0/714810189 shutdown_connections 2024-09-21T01:19:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.492+0000 7f0d3166a740 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.492+0000 7f0d3166a740 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee01b0 0x5616182b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.492+0000 7f0d3166a740 1 --2- 172.21.15.37:0/714810189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182b0650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.492+0000 7f0d3166a740 1 -- 172.21.15.37:0/714810189 >> 172.21.15.37:0/714810189 conn(0x561617efd460 msgr2=0x5616182ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.500+0000 7f0d23fff640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d0c0b6900 0x7f0d0c0b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.500+0000 7f0d3166a740 1 -- 172.21.15.37:0/714810189 shutdown_connections 2024-09-21T01:19:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.501+0000 7f0d3166a740 1 -- 172.21.15.37:0/714810189 wait complete. 2024-09-21T01:19:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.502+0000 7f0d3166a740 1 -- start start 2024-09-21T01:19:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.503+0000 7f0d3166a740 1 Processor -- start 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee01b0 0x5616182bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x5616182c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561618077700 con 0x561617f09070 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616181b1110 con 0x561617ee01b0 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5616182beed0 con 0x561617ee8390 2024-09-21T01:19:36.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.506+0000 7f0d3166a740 10 client.0 _ll_register_callbacks cb 0x5616181ca990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:36.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.508+0000 7f0d23fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.508+0000 7f0d23fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182bc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41676/0 (socket says 172.21.15.37:41676) 2024-09-21T01:19:36.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.508+0000 7f0d23fff640 1 -- 172.21.15.37:0/1838201022 learned_addr learned my addr 172.21.15.37:0/1838201022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:36.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.508+0000 7f0d29693640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x5616182c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.510+0000 7f0d23fff640 1 -- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee01b0 msgr2=0x5616182bbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.510+0000 7f0d23fff640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee01b0 0x5616182bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.510+0000 7f0d23fff640 1 -- 172.21.15.37:0/1838201022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 msgr2=0x5616182c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.510+0000 7f0d23fff640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x5616182c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.510+0000 7f0d23fff640 1 -- 172.21.15.37:0/1838201022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616181dec40 con 0x561617ee8390 2024-09-21T01:19:36.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.511+0000 7f0d29693640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x5616182c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:19:36.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.516+0000 7f0d23fff640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182bc1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d1401c1e0 tx=0x7f0d14004300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d0e7183ea440dac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:36.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.516+0000 7f0d03fff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:19:36.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.516+0000 7f0d03fff640 1 -- 172.21.15.37:0/1838201022 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1401c040 con 0x561617ee8390 2024-09-21T01:19:36.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.517+0000 7f0d23fff640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d0c0b6900 0x7f0d0c0b8e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0d1401a040 tx=0x7f0d14008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:36.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.517+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d140044e0 con 0x561617ee8390 2024-09-21T01:19:36.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.517+0000 7f0d03fff640 1 -- 172.21.15.37:0/1838201022 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0d14024a60 con 0x561617ee8390 2024-09-21T01:19:36.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.518+0000 7f0d03fff640 1 -- 172.21.15.37:0/1838201022 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0d1400f040 con 0x561617ee8390 2024-09-21T01:19:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.519+0000 7f0d3166a740 10 client.25624 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:36.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.519+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616182cac00 con 0x561617ee8390 2024-09-21T01:19:36.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.521+0000 7f0d03fff640 1 -- 172.21.15.37:0/1838201022 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d140044e0 con 0x561617ee8390 2024-09-21T01:19:36.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.521+0000 7f0d03fff640 1 -- 172.21.15.37:0/1838201022 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0d1402ec50 con 0x561617ee8390 2024-09-21T01:19:36.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.521+0000 7f0d3166a740 10 client.25624 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:36.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.521+0000 7f0d3166a740 10 client.25624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:36.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.521+0000 7f0d3166a740 20 client.25624 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:36.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.521+0000 7f0d3166a740 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617ec79f0 0x5616182cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.522+0000 7f0d3166a740 4 client.25624 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:36.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.522+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561618228da0 con 0x561617ec79f0 2024-09-21T01:19:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.528+0000 7f0d28e92640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617ec79f0 0x5616182cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.543+0000 7f0d28e92640 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617ec79f0 0x5616182cdf60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23631bfd71f935ba server_cookie=10622264f3f7f2a7 in_seq=0 out_seq=0 2024-09-21T01:19:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.543+0000 7f0d03fff640 10 client.25624 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.547+0000 7f0d03fff640 1 -- 172.21.15.37:0/1838201022 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561618228da0 con 0x561617ec79f0 2024-09-21T01:19:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.547+0000 7f0d03fff640 10 client.25624 handle_command_reply: tid=0 2024-09-21T01:19:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.547+0000 7f0d3166a740 1 client.25624 shutdown 2024-09-21T01:19:36.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.552+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 msgr2=0x5616182bc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.552+0000 7f0d3166a740 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182bc1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d1401c1e0 tx=0x7f0d14004300 comp rx=0 tx=0).stop 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.553+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 shutdown_connections 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.553+0000 7f0d3166a740 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617ec79f0 0x5616182cdf60 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.553+0000 7f0d3166a740 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x5616182c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.553+0000 7f0d3166a740 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee8390 0x5616182bc1e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.553+0000 7f0d3166a740 1 --2- 172.21.15.37:0/1838201022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee01b0 0x5616182bbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.553+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 >> 172.21.15.37:0/1838201022 conn(0x561617efd460 msgr2=0x5616182b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.554+0000 7f0d03fff640 0 client.25624 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:36.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.554+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 shutdown_connections 2024-09-21T01:19:36.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.554+0000 7f0d3166a740 1 -- 172.21.15.37:0/1838201022 wait complete. 2024-09-21T01:19:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.555+0000 7f0d3166a740 20 client.25624 trim_cache size 0 max 16384 2024-09-21T01:19:36.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.597+0000 7f0d3166a740 1 Processor -- start 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.598+0000 7f0d3166a740 1 -- start start 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.599+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.599+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee8390 0x5616182bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.599+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.599+0000 7f0d3166a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241be390 con 0x561617ee8390 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.599+0000 7f0d3166a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241bfed0 con 0x561617f09070 2024-09-21T01:19:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.599+0000 7f0d3166a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241bea60 con 0x561617ee01b0 2024-09-21T01:19:36.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.600+0000 7f0d29693640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.600+0000 7f0d29693640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:48078/0 (socket says 172.21.15.37:48078) 2024-09-21T01:19:36.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.600+0000 7f0d29693640 1 -- 172.21.15.37:0/4196005733 learned_addr learned my addr 172.21.15.37:0/4196005733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:36.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.600+0000 7f0d23fff640 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee8390 0x5616182bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.602+0000 7f0d28e92640 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.604+0000 7f0d23fff640 1 -- 172.21.15.37:0/4196005733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 msgr2=0x5616182b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.604+0000 7f0d23fff640 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.604+0000 7f0d23fff640 1 -- 172.21.15.37:0/4196005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 msgr2=0x5616182adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.604+0000 7f0d23fff640 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.604+0000 7f0d23fff640 1 -- 172.21.15.37:0/4196005733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616182bcf60 con 0x561617ee8390 2024-09-21T01:19:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.606+0000 7f0d23fff640 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee8390 0x5616182bd8d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0d14022640 tx=0x7f0d1400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beef8467c2004f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.608+0000 7f0d0a7fc640 1 -- 172.21.15.37:0/4196005733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1401c040 con 0x561617ee8390 2024-09-21T01:19:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.608+0000 7f0d0a7fc640 1 -- 172.21.15.37:0/4196005733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d14033070 con 0x561617ee8390 2024-09-21T01:19:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.610+0000 7f0d3166a740 1 -- 172.21.15.37:0/4196005733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee8390 msgr2=0x5616182bd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.610+0000 7f0d3166a740 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee8390 0x5616182bd8d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0d14022640 tx=0x7f0d1400da80 comp rx=0 tx=0).stop 2024-09-21T01:19:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.615+0000 7f0d3166a740 1 -- 172.21.15.37:0/4196005733 shutdown_connections 2024-09-21T01:19:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.615+0000 7f0d3166a740 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617f09070 0x5616182adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.615+0000 7f0d3166a740 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617ee8390 0x5616182bd8d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.615+0000 7f0d3166a740 1 --2- 172.21.15.37:0/4196005733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.615+0000 7f0d3166a740 1 -- 172.21.15.37:0/4196005733 >> 172.21.15.37:0/4196005733 conn(0x561617efd460 msgr2=0x5616182bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.621+0000 7f0d3166a740 1 -- 172.21.15.37:0/4196005733 shutdown_connections 2024-09-21T01:19:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.621+0000 7f0d3166a740 1 -- 172.21.15.37:0/4196005733 wait complete. 2024-09-21T01:19:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.622+0000 7f0d3166a740 1 -- start start 2024-09-21T01:19:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.622+0000 7f0d3166a740 1 Processor -- start 2024-09-21T01:19:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.623+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.623+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee8390 0x5616182c0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.623+0000 7f0d3166a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x561618330890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d3166a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241bf800 con 0x561617f09070 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d3166a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241bf130 con 0x561617ee8390 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d3166a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241bc350 con 0x561617ee01b0 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d3166a740 10 client.0 _ll_register_callbacks cb 0x7f0d1401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d28e92640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d28e92640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182bfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41694/0 (socket says 172.21.15.37:41694) 2024-09-21T01:19:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.624+0000 7f0d28e92640 1 -- 172.21.15.37:0/3802826303 learned_addr learned my addr 172.21.15.37:0/3802826303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.625+0000 7f0d28e92640 1 -- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee8390 msgr2=0x5616182c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.625+0000 7f0d28e92640 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee8390 0x5616182c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.625+0000 7f0d28e92640 1 -- 172.21.15.37:0/3802826303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 msgr2=0x561618330890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.625+0000 7f0d28e92640 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x561618330890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.625+0000 7f0d28e92640 1 -- 172.21.15.37:0/3802826303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561618330f00 con 0x561617ee01b0 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.626+0000 7f0d28e92640 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182bfa90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d241028e0 tx=0x7f0d1c0118f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8d9ce3ac391b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.626+0000 7f0d03fff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:19:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.627+0000 7f0d03fff640 1 -- 172.21.15.37:0/3802826303 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c025020 con 0x561617ee01b0 2024-09-21T01:19:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.627+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d14033070 con 0x561617ee01b0 2024-09-21T01:19:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.627+0000 7f0d03fff640 1 -- 172.21.15.37:0/3802826303 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0d1c004d20 con 0x561617ee01b0 2024-09-21T01:19:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.628+0000 7f0d03fff640 1 -- 172.21.15.37:0/3802826303 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0d1c00f690 con 0x561617ee01b0 2024-09-21T01:19:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.628+0000 7f0d3166a740 10 client.25630 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:36.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.628+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616183382f0 con 0x561617ee01b0 2024-09-21T01:19:36.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d03fff640 1 -- 172.21.15.37:0/3802826303 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d14033070 con 0x561617ee01b0 2024-09-21T01:19:36.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d03fff640 1 -- 172.21.15.37:0/3802826303 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0d1c020070 con 0x561617ee01b0 2024-09-21T01:19:36.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d3166a740 10 client.25630 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:36.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d3166a740 10 client.25630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d3166a740 20 client.25630 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d3166a740 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617e9cda0 0x56161833ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d3166a740 4 client.25630 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:19:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.629+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561618224850 con 0x561617e9cda0 2024-09-21T01:19:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.631+0000 7f0d23fff640 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617e9cda0 0x56161833ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.642+0000 7f0d03fff640 10 client.25630 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.642+0000 7f0d23fff640 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617e9cda0 0x56161833ab20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f796f1f7cf9089b server_cookie=53af6422f0f3c18 in_seq=0 out_seq=0 2024-09-21T01:19:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.646+0000 7f0d03fff640 1 -- 172.21.15.37:0/3802826303 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x561618224850 con 0x561617e9cda0 2024-09-21T01:19:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.646+0000 7f0d03fff640 10 client.25630 handle_command_reply: tid=0 2024-09-21T01:19:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.646+0000 7f0d3166a740 1 client.25630 shutdown 2024-09-21T01:19:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 msgr2=0x5616182bfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182bfa90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d241028e0 tx=0x7f0d1c0118f0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 shutdown_connections 2024-09-21T01:19:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561617e9cda0 0x56161833ab20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561617f09070 0x561618330890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561617ee8390 0x5616182c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 --2- 172.21.15.37:0/3802826303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561617ee01b0 0x5616182bfa90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.651+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 >> 172.21.15.37:0/3802826303 conn(0x561617efd460 msgr2=0x5616182b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.652+0000 7f0d03fff640 0 client.25630 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.652+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 shutdown_connections 2024-09-21T01:19:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.652+0000 7f0d3166a740 1 -- 172.21.15.37:0/3802826303 wait complete. 2024-09-21T01:19:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.653+0000 7f0d3166a740 20 client.25630 trim_cache size 0 max 16384 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "9cca879a-4b6e-483b-a540-0b1516951102", 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:19:36.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:19:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:19:36.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:19:36.662 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.663+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d0c0b6900 msgr2=0x7f0d0c0b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.663+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d0c0b6900 0x7f0d0c0b8e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0d1401a040 tx=0x7f0d14008040 comp rx=0 tx=0).stop 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.663+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 msgr2=0x7f0d2406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.663+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 0x7f0d2406e4d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d18005d90 tx=0x7f0d180045c0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 shutdown_connections 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0d0c0b6900 0x7f0d0c0b8e10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d24105ad0 0x7f0d2406e4d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d24105180 0x7f0d2406df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 --2- 172.21.15.37:0/2322342073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d24103100 0x7f0d24074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 >> 172.21.15.37:0/2322342073 conn(0x7f0d24077c60 msgr2=0x7f0d24106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 shutdown_connections 2024-09-21T01:19:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:19:36.664+0000 7f0d2b0f6640 1 -- 172.21.15.37:0/2322342073 wait complete. 2024-09-21T01:19:36.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:36 smithi144 ceph-mon[34818]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 981 MiB/s wr, 2.13k op/s 2024-09-21T01:19:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:36 smithi137 ceph-mon[34607]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 981 MiB/s wr, 2.13k op/s 2024-09-21T01:19:38.405 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:38 smithi037 ceph-mon[31105]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 746 MiB/s wr, 1.69k op/s 2024-09-21T01:19:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:38 smithi137 ceph-mon[34607]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 746 MiB/s wr, 1.69k op/s 2024-09-21T01:19:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:38 smithi144 ceph-mon[34818]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 746 MiB/s wr, 1.69k op/s 2024-09-21T01:19:40.027 INFO:tasks.cephfs.filesystem:scrub status for tag:9cca879a-4b6e-483b-a540-0b1516951102 - {'path': '/', 'tag': '9cca879a-4b6e-483b-a540-0b1516951102', 'options': 'recursive,force'} 2024-09-21T01:19:40.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:40 smithi037 ceph-mon[31105]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 980 MiB/s wr, 2.32k op/s 2024-09-21T01:19:40.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:40 smithi137 ceph-mon[34607]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 980 MiB/s wr, 2.32k op/s 2024-09-21T01:19:40.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:40 smithi144 ceph-mon[34818]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 980 MiB/s wr, 2.32k op/s 2024-09-21T01:19:41.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:41 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:19:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:41 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:19:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:41 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:19:41.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:41 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:19:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:41 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:19:41.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:41 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:19:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.185+0000 7fee75da8640 1 -- 172.21.15.37:0/3517548901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010f9d0 msgr2=0x7fee7011ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.185+0000 7fee75da8640 1 --2- 172.21.15.37:0/3517548901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010f9d0 0x7fee7011ab90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fee68009900 tx=0x7fee6802a420 comp rx=0 tx=0).stop 2024-09-21T01:19:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.186+0000 7fee75da8640 1 -- 172.21.15.37:0/3517548901 shutdown_connections 2024-09-21T01:19:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.186+0000 7fee75da8640 1 --2- 172.21.15.37:0/3517548901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010f9d0 0x7fee7011ab90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.186+0000 7fee75da8640 1 --2- 172.21.15.37:0/3517548901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7010cdb0 0x7fee7010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.186+0000 7fee75da8640 1 --2- 172.21.15.37:0/3517548901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee7010a3c0 0x7fee7010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.186+0000 7fee75da8640 1 -- 172.21.15.37:0/3517548901 >> 172.21.15.37:0/3517548901 conn(0x7fee70070810 msgr2=0x7fee70072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:42.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.200+0000 7fee75da8640 1 -- 172.21.15.37:0/3517548901 shutdown_connections 2024-09-21T01:19:42.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.201+0000 7fee75da8640 1 -- 172.21.15.37:0/3517548901 wait complete. 2024-09-21T01:19:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.203+0000 7fee75da8640 1 Processor -- start 2024-09-21T01:19:42.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 -- start start 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010a3c0 0x7fee701a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7010cdb0 0x7fee701a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 0x7fee701aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee7011e120 con 0x7fee7010a3c0 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee7011dfa0 con 0x7fee701a9c30 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.204+0000 7fee75da8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee7011e2a0 con 0x7fee7010cdb0 2024-09-21T01:19:42.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.206+0000 7fee6f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010a3c0 0x7fee701a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.208+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 0x7fee701aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.208+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 0x7fee701aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:48104/0 (socket says 172.21.15.37:48104) 2024-09-21T01:19:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.208+0000 7fee6ffff640 1 -- 172.21.15.37:0/2979961661 learned_addr learned my addr 172.21.15.37:0/2979961661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:42.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.210+0000 7fee6effd640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7010cdb0 0x7fee701a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.217+0000 7fee6ffff640 1 -- 172.21.15.37:0/2979961661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7010cdb0 msgr2=0x7fee701a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.217+0000 7fee6ffff640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7010cdb0 0x7fee701a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.218+0000 7fee6ffff640 1 -- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010a3c0 msgr2=0x7fee701a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.218+0000 7fee6ffff640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010a3c0 0x7fee701a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.218+0000 7fee6ffff640 1 -- 172.21.15.37:0/2979961661 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee701aa910 con 0x7fee701a9c30 2024-09-21T01:19:42.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.222+0000 7fee6ffff640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 0x7fee701aa0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee6802a990 tx=0x7fee680054d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.225+0000 7fee6cff9640 1 -- 172.21.15.37:0/2979961661 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68041070 con 0x7fee701a9c30 2024-09-21T01:19:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.227+0000 7fee6cff9640 1 -- 172.21.15.37:0/2979961661 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee6803db00 con 0x7fee701a9c30 2024-09-21T01:19:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.227+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee701b0c80 con 0x7fee701a9c30 2024-09-21T01:19:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.227+0000 7fee6cff9640 1 -- 172.21.15.37:0/2979961661 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68031c40 con 0x7fee701a9c30 2024-09-21T01:19:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.227+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701b11a0 con 0x7fee701a9c30 2024-09-21T01:19:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.238+0000 7fee6cff9640 1 -- 172.21.15.37:0/2979961661 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fee68044070 con 0x7fee701a9c30 2024-09-21T01:19:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.246+0000 7fee7cdf1740 1 Processor -- start 2024-09-21T01:19:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.249+0000 7fee7cdf1740 1 -- start start 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323985f1b0 0x563239c06e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 0x563239c08010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563239b796f0 con 0x5632398362f0 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563239b68b20 con 0x56323985f1b0 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563239b6c930 con 0x56323983e4d0 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.250+0000 7fee6cff9640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fee580b6690 0x7fee580b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.251+0000 7fee6cff9640 1 -- 172.21.15.37:0/2979961661 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fee68107e90 con 0x7fee701a9c30 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.251+0000 7fee6effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 0x563239c08010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.251+0000 7fee6effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 0x563239c08010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41714/0 (socket says 172.21.15.37:41714) 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.251+0000 7fee6effd640 1 -- 172.21.15.37:0/2117559986 learned_addr learned my addr 172.21.15.37:0/2117559986 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.251+0000 7fee6ffff640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fee580b6690 0x7fee580b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.252+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.253+0000 7fee6effd640 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323985f1b0 0x563239c06e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.253+0000 7fee6ffff640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fee580b6690 0x7fee580b8ba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee68005f70 tx=0x7fee68009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.254+0000 7fee6effd640 1 -- 172.21.15.37:0/2117559986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323985f1b0 msgr2=0x563239c06e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.254+0000 7fee6effd640 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323985f1b0 0x563239c06e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.254+0000 7fee6effd640 1 -- 172.21.15.37:0/2117559986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 msgr2=0x563239c074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.254+0000 7fee6effd640 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.254+0000 7fee6effd640 1 -- 172.21.15.37:0/2117559986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563239b2e530 con 0x56323983e4d0 2024-09-21T01:19:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.254+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:19:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.257+0000 7fee6effd640 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 0x563239c08010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee64012580 tx=0x7fee6400b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=984232d2e32711b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:42.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.260+0000 7fee55ffb640 1 -- 172.21.15.37:0/2117559986 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee640106b0 con 0x56323983e4d0 2024-09-21T01:19:42.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.260+0000 7fee55ffb640 1 -- 172.21.15.37:0/2117559986 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee64010d00 con 0x56323983e4d0 2024-09-21T01:19:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.262+0000 7fee55ffb640 1 -- 172.21.15.37:0/2117559986 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6401dda0 con 0x56323983e4d0 2024-09-21T01:19:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.262+0000 7fee7cdf1740 1 -- 172.21.15.37:0/2117559986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 msgr2=0x563239c08010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.262+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 0x563239c08010 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee64012580 tx=0x7fee6400b890 comp rx=0 tx=0).stop 2024-09-21T01:19:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.264+0000 7fee7cdf1740 1 -- 172.21.15.37:0/2117559986 shutdown_connections 2024-09-21T01:19:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.264+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323983e4d0 0x563239c08010 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.264+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.264+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/2117559986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323985f1b0 0x563239c06e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.264+0000 7fee7cdf1740 1 -- 172.21.15.37:0/2117559986 >> 172.21.15.37:0/2117559986 conn(0x563239853300 msgr2=0x563239c028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.269+0000 7fee7cdf1740 1 -- 172.21.15.37:0/2117559986 shutdown_connections 2024-09-21T01:19:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.269+0000 7fee7cdf1740 1 -- 172.21.15.37:0/2117559986 wait complete. 2024-09-21T01:19:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.270+0000 7fee7cdf1740 1 -- start start 2024-09-21T01:19:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.270+0000 7fee7cdf1740 1 Processor -- start 2024-09-21T01:19:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632398362f0 0x563239c10730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323983e4d0 0x563239c10df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c11960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563239aa0ab0 con 0x56323983e4d0 2024-09-21T01:19:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563239b0e730 con 0x5632398362f0 2024-09-21T01:19:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563239c08b80 con 0x56323985f1b0 2024-09-21T01:19:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.271+0000 7fee7cdf1740 10 client.0 _ll_register_callbacks cb 0x563239b626b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.274+0000 7fee6effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632398362f0 0x563239c10730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.275+0000 7fee6effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c11960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.275+0000 7fee6effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c11960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41722/0 (socket says 172.21.15.37:41722) 2024-09-21T01:19:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.275+0000 7fee6effd640 1 -- 172.21.15.37:0/424063649 learned_addr learned my addr 172.21.15.37:0/424063649 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.275+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323983e4d0 0x563239c10df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.277+0000 7fee6f7fe640 1 -- 172.21.15.37:0/424063649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 msgr2=0x563239c11960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.277+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c11960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.277+0000 7fee6f7fe640 1 -- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632398362f0 msgr2=0x563239c10730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.278+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632398362f0 0x563239c10730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.278+0000 7fee6f7fe640 1 -- 172.21.15.37:0/424063649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632398ca790 con 0x56323983e4d0 2024-09-21T01:19:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.279+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323983e4d0 0x563239c10df0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fee60009fd0 tx=0x7fee60004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a432d929fbd5f9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.280+0000 7fee4effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.288+0000 7fee4effd640 1 -- 172.21.15.37:0/424063649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60012ac0 con 0x56323983e4d0 2024-09-21T01:19:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.288+0000 7fee4effd640 1 -- 172.21.15.37:0/424063649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fee60012c60 con 0x56323983e4d0 2024-09-21T01:19:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.289+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee64010d00 con 0x56323983e4d0 2024-09-21T01:19:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.291+0000 7fee4effd640 1 -- 172.21.15.37:0/424063649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fee60012e60 con 0x56323983e4d0 2024-09-21T01:19:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.292+0000 7fee7cdf1740 10 client.16191 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.292+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563239943620 con 0x56323983e4d0 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.293+0000 7fee4effd640 1 -- 172.21.15.37:0/424063649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee64010d00 con 0x56323983e4d0 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.293+0000 7fee4effd640 1 -- 172.21.15.37:0/424063649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fee6000f040 con 0x56323983e4d0 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.293+0000 7fee7cdf1740 10 client.16191 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.294+0000 7fee7cdf1740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.294+0000 7fee7cdf1740 20 client.16191 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.294+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56323981dd80 0x563239c1e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.294+0000 7fee7cdf1740 4 client.16191 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.294+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563239b7b640 con 0x56323981dd80 2024-09-21T01:19:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.296+0000 7fee6effd640 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56323981dd80 0x563239c1e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.312+0000 7fee6effd640 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56323981dd80 0x563239c1e350 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b1efad7116d4b3 server_cookie=9eca66bf791ab0d in_seq=0 out_seq=0 2024-09-21T01:19:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.312+0000 7fee4effd640 10 client.16191 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.316+0000 7fee4effd640 1 -- 172.21.15.37:0/424063649 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563239b7b640 con 0x56323981dd80 2024-09-21T01:19:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.316+0000 7fee4effd640 10 client.16191 handle_command_reply: tid=0 2024-09-21T01:19:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.316+0000 7fee7cdf1740 1 client.16191 shutdown 2024-09-21T01:19:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.316+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323983e4d0 msgr2=0x563239c10df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.316+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323983e4d0 0x563239c10df0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fee60009fd0 tx=0x7fee60004410 comp rx=0 tx=0).stop 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.320+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 shutdown_connections 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.320+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56323981dd80 0x563239c1e350 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.320+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c11960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.320+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323983e4d0 0x563239c10df0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.320+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/424063649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632398362f0 0x563239c10730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.320+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 >> 172.21.15.37:0/424063649 conn(0x563239853300 msgr2=0x563239c00ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.321+0000 7fee4effd640 0 client.16191 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.321+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 shutdown_connections 2024-09-21T01:19:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.321+0000 7fee7cdf1740 1 -- 172.21.15.37:0/424063649 wait complete. 2024-09-21T01:19:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.321+0000 7fee7cdf1740 20 client.16191 trim_cache size 0 max 16384 2024-09-21T01:19:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 Processor -- start 2024-09-21T01:19:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 -- start start 2024-09-21T01:19:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5632398362f0 0x563239c073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 0x563239c0f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 0x563239c02220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c00e5a0 con 0x56323985f1b0 2024-09-21T01:19:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c0100e0 con 0x56323983e4d0 2024-09-21T01:19:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.349+0000 7fee7cdf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c00ec70 con 0x5632398362f0 2024-09-21T01:19:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 0x563239c02220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 0x563239c02220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53680/0 (socket says 172.21.15.37:53680) 2024-09-21T01:19:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 -- 172.21.15.37:0/667818653 learned_addr learned my addr 172.21.15.37:0/667818653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 -- 172.21.15.37:0/667818653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5632398362f0 msgr2=0x563239c073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5632398362f0 0x563239c073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 -- 172.21.15.37:0/667818653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 msgr2=0x563239c0f110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 0x563239c0f110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 -- 172.21.15.37:0/667818653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563239c0e770 con 0x56323985f1b0 2024-09-21T01:19:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.350+0000 7fee6effd640 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 0x563239c02220 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fee64012580 tx=0x7fee6400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ac848d13b4d085 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.351+0000 7fee557fa640 1 -- 172.21.15.37:0/667818653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64030070 con 0x56323985f1b0 2024-09-21T01:19:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.351+0000 7fee557fa640 1 -- 172.21.15.37:0/667818653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee640054f0 con 0x56323985f1b0 2024-09-21T01:19:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.351+0000 7fee557fa640 1 -- 172.21.15.37:0/667818653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64004640 con 0x56323985f1b0 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 -- 172.21.15.37:0/667818653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 msgr2=0x563239c02220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 0x563239c02220 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fee64012580 tx=0x7fee6400b890 comp rx=0 tx=0).stop 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 -- 172.21.15.37:0/667818653 shutdown_connections 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323985f1b0 0x563239c02220 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 0x563239c0f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/667818653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5632398362f0 0x563239c073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 -- 172.21.15.37:0/667818653 >> 172.21.15.37:0/667818653 conn(0x563239853300 msgr2=0x563239bfd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 -- 172.21.15.37:0/667818653 shutdown_connections 2024-09-21T01:19:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.352+0000 7fee7cdf1740 1 -- 172.21.15.37:0/667818653 wait complete. 2024-09-21T01:19:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.353+0000 7fee7cdf1740 1 -- start start 2024-09-21T01:19:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.353+0000 7fee7cdf1740 1 Processor -- start 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.353+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c15110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.353+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 0x563239c157d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee7cdf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c16260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c15110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c15110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53688/0 (socket says 172.21.15.37:53688) 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 -- 172.21.15.37:0/1481530682 learned_addr learned my addr 172.21.15.37:0/1481530682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c00fa10 con 0x5632398362f0 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c00f340 con 0x56323983e4d0 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c00c560 con 0x56323985f1b0 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee7cdf1740 10 client.0 _ll_register_callbacks cb 0x7fee60009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 -- 172.21.15.37:0/1481530682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 msgr2=0x563239c16260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c16260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 -- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 msgr2=0x563239c157d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 0x563239c157d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.354+0000 7fee6effd640 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563239c169c0 con 0x5632398362f0 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.355+0000 7fee6effd640 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c15110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fee64005890 tx=0x7fee640058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f32ba4939fe39df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.355+0000 7fee4effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.355+0000 7fee4effd640 1 -- 172.21.15.37:0/1481530682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64030040 con 0x5632398362f0 2024-09-21T01:19:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.355+0000 7fee4effd640 1 -- 172.21.15.37:0/1481530682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fee6401de20 con 0x5632398362f0 2024-09-21T01:19:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.355+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee640054f0 con 0x5632398362f0 2024-09-21T01:19:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.356+0000 7fee4effd640 1 -- 172.21.15.37:0/1481530682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fee640104b0 con 0x5632398362f0 2024-09-21T01:19:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.356+0000 7fee7cdf1740 10 client.16197 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.356+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563239c17c90 con 0x5632398362f0 2024-09-21T01:19:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.356+0000 7fee4effd640 1 -- 172.21.15.37:0/1481530682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee640054f0 con 0x5632398362f0 2024-09-21T01:19:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee4effd640 1 -- 172.21.15.37:0/1481530682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fee64029040 con 0x5632398362f0 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee7cdf1740 10 client.16197 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee7cdf1740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee7cdf1740 20 client.16197 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5632397f31c0 0x563239c18400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee7cdf1740 4 client.16197 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563239b770f0 con 0x5632397f31c0 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.357+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5632397f31c0 0x563239c18400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.359+0000 7fee6f7fe640 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5632397f31c0 0x563239c18400 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f8c149dad321be server_cookie=9879328217e38785 in_seq=0 out_seq=0 2024-09-21T01:19:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:42.359+0000 7fee4effd640 10 client.16197 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:42 smithi137 ceph-mon[34607]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 851 MiB/s wr, 2.08k op/s 2024-09-21T01:19:42.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:42 smithi144 ceph-mon[34818]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 851 MiB/s wr, 2.08k op/s 2024-09-21T01:19:42.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:42 smithi037 ceph-mon[31105]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 851 MiB/s wr, 2.08k op/s 2024-09-21T01:19:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.197+0000 7fee4effd640 1 -- 172.21.15.37:0/1481530682 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563239b770f0 con 0x5632397f31c0 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.197+0000 7fee4effd640 10 client.16197 handle_command_reply: tid=0 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.197+0000 7fee7cdf1740 1 client.16197 shutdown 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 msgr2=0x563239c15110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c15110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fee64005890 tx=0x7fee640058c0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 shutdown_connections 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5632397f31c0 0x563239c18400 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56323985f1b0 0x563239c16260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56323983e4d0 0x563239c157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 --2- 172.21.15.37:0/1481530682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5632398362f0 0x563239c15110 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 >> 172.21.15.37:0/1481530682 conn(0x563239853300 msgr2=0x563239c02220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee4effd640 0 client.16197 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 shutdown_connections 2024-09-21T01:19:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 1 -- 172.21.15.37:0/1481530682 wait complete. 2024-09-21T01:19:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.198+0000 7fee7cdf1740 20 client.16197 trim_cache size 0 max 16384 2024-09-21T01:19:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:19:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:19:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:19:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:19:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.203+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fee580b6690 msgr2=0x7fee580b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.203+0000 7fee75da8640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fee580b6690 0x7fee580b8ba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee68005f70 tx=0x7fee68009680 comp rx=0 tx=0).stop 2024-09-21T01:19:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.203+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 msgr2=0x7fee701aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:44.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.203+0000 7fee75da8640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 0x7fee701aa0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee6802a990 tx=0x7fee680054d0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.211+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 shutdown_connections 2024-09-21T01:19:44.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.211+0000 7fee75da8640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fee580b6690 0x7fee580b8ba0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.211+0000 7fee75da8640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee701a9c30 0x7fee701aa0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.211+0000 7fee75da8640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7010cdb0 0x7fee701a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.211+0000 7fee75da8640 1 --2- 172.21.15.37:0/2979961661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7010a3c0 0x7fee701a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:44.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.211+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 >> 172.21.15.37:0/2979961661 conn(0x7fee70070810 msgr2=0x7fee7010b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.228+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 shutdown_connections 2024-09-21T01:19:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:44.228+0000 7fee75da8640 1 -- 172.21.15.37:0/2979961661 wait complete. 2024-09-21T01:19:44.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:44 smithi137 ceph-mon[34607]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 850 MiB/s wr, 2.28k op/s 2024-09-21T01:19:44.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:44 smithi144 ceph-mon[34818]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 850 MiB/s wr, 2.28k op/s 2024-09-21T01:19:44.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:44 smithi037 ceph-mon[31105]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 850 MiB/s wr, 2.28k op/s 2024-09-21T01:19:46.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:46 smithi137 ceph-mon[34607]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 963 MiB/s wr, 2.65k op/s 2024-09-21T01:19:46.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:46 smithi144 ceph-mon[34818]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 963 MiB/s wr, 2.65k op/s 2024-09-21T01:19:46.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:46 smithi037 ceph-mon[31105]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 963 MiB/s wr, 2.65k op/s 2024-09-21T01:19:48.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:48 smithi144 ceph-mon[34818]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 735 MiB/s wr, 2.12k op/s 2024-09-21T01:19:48.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:48 smithi137 ceph-mon[34607]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 735 MiB/s wr, 2.12k op/s 2024-09-21T01:19:48.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:48 smithi037 ceph-mon[31105]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 735 MiB/s wr, 2.12k op/s 2024-09-21T01:19:50.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:50 smithi137 ceph-mon[34607]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 959 MiB/s wr, 2.47k op/s 2024-09-21T01:19:50.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:50 smithi144 ceph-mon[34818]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 959 MiB/s wr, 2.47k op/s 2024-09-21T01:19:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:50 smithi037 ceph-mon[31105]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 959 MiB/s wr, 2.47k op/s 2024-09-21T01:19:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:52 smithi137 ceph-mon[34607]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 847 MiB/s wr, 2.07k op/s 2024-09-21T01:19:52.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:52 smithi144 ceph-mon[34818]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 847 MiB/s wr, 2.07k op/s 2024-09-21T01:19:52.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:52 smithi037 ceph-mon[31105]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 847 MiB/s wr, 2.07k op/s 2024-09-21T01:19:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:54 smithi137 ceph-mon[34607]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 853 MiB/s wr, 1.94k op/s 2024-09-21T01:19:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:54 smithi144 ceph-mon[34818]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 853 MiB/s wr, 1.94k op/s 2024-09-21T01:19:54.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:54 smithi037 ceph-mon[31105]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 853 MiB/s wr, 1.94k op/s 2024-09-21T01:19:56.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:56 smithi137 ceph-mon[34607]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 975 MiB/s wr, 1.93k op/s 2024-09-21T01:19:56.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:56 smithi144 ceph-mon[34818]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 975 MiB/s wr, 1.93k op/s 2024-09-21T01:19:56.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:56 smithi037 ceph-mon[31105]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 975 MiB/s wr, 1.93k op/s 2024-09-21T01:19:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.515+0000 7f6bedace640 1 -- 172.21.15.37:0/3356881178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810cdb0 msgr2=0x7f6be810f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.515+0000 7f6bedace640 1 --2- 172.21.15.37:0/3356881178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810cdb0 0x7f6be810f290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009900 tx=0x7f6bd802a410 comp rx=0 tx=0).stop 2024-09-21T01:19:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.518+0000 7f6bedace640 1 -- 172.21.15.37:0/3356881178 shutdown_connections 2024-09-21T01:19:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.518+0000 7f6bedace640 1 --2- 172.21.15.37:0/3356881178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be811ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.518+0000 7f6bedace640 1 --2- 172.21.15.37:0/3356881178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810cdb0 0x7f6be810f290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.518+0000 7f6bedace640 1 --2- 172.21.15.37:0/3356881178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810a3c0 0x7f6be810c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.518+0000 7f6bedace640 1 -- 172.21.15.37:0/3356881178 >> 172.21.15.37:0/3356881178 conn(0x7f6be8070810 msgr2=0x7f6be8072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.520+0000 7f6bedace640 1 -- 172.21.15.37:0/3356881178 shutdown_connections 2024-09-21T01:19:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.524+0000 7f6bedace640 1 -- 172.21.15.37:0/3356881178 wait complete. 2024-09-21T01:19:57.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.528+0000 7f6bedace640 1 Processor -- start 2024-09-21T01:19:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.530+0000 7f6bedace640 1 -- start start 2024-09-21T01:19:57.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.532+0000 7f6bedace640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810a3c0 0x7f6be81a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.533+0000 7f6bedace640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810cdb0 0x7f6be81a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.533+0000 7f6bedace640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be81aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.534+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810cdb0 0x7f6be81a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.534+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810cdb0 0x7f6be81a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:50210/0 (socket says 172.21.15.37:50210) 2024-09-21T01:19:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.534+0000 7f6be7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be81aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.535+0000 7f6be7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be81aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34012/0 (socket says 172.21.15.37:34012) 2024-09-21T01:19:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.535+0000 7f6be6ffd640 1 -- 172.21.15.37:0/1731551970 learned_addr learned my addr 172.21.15.37:0/1731551970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.535+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6be811e190 con 0x7f6be810f9d0 2024-09-21T01:19:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.535+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6be811e010 con 0x7f6be810a3c0 2024-09-21T01:19:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.535+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6be811e310 con 0x7f6be810cdb0 2024-09-21T01:19:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.536+0000 7f6be77fe640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810a3c0 0x7f6be81a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.538+0000 7f6be7fff640 1 -- 172.21.15.37:0/1731551970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810cdb0 msgr2=0x7f6be81a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.538+0000 7f6be7fff640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810cdb0 0x7f6be81a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.538+0000 7f6be7fff640 1 -- 172.21.15.37:0/1731551970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810a3c0 msgr2=0x7f6be81a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.538+0000 7f6be7fff640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810a3c0 0x7f6be81a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.538+0000 7f6be7fff640 1 -- 172.21.15.37:0/1731551970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be81aa850 con 0x7f6be810f9d0 2024-09-21T01:19:57.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.539+0000 7f6be7fff640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be81aa030 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6be000be20 tx=0x7f6be000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:57.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.541+0000 7f6be4ff9640 1 -- 172.21.15.37:0/1731551970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0019070 con 0x7f6be810f9d0 2024-09-21T01:19:57.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.541+0000 7f6be4ff9640 1 -- 172.21.15.37:0/1731551970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be00148f0 con 0x7f6be810f9d0 2024-09-21T01:19:57.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.541+0000 7f6be4ff9640 1 -- 172.21.15.37:0/1731551970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0012840 con 0x7f6be810f9d0 2024-09-21T01:19:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.542+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be81aab40 con 0x7f6be810f9d0 2024-09-21T01:19:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.543+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be81b1230 con 0x7f6be810f9d0 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.555+0000 7f6bf4a36740 1 Processor -- start 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.555+0000 7f6bf4a36740 1 -- start start 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6be4ff9640 1 -- 172.21.15.37:0/1731551970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6be001c070 con 0x7f6be810f9d0 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540008fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x5654000904b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400091000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5654000026f0 con 0x5653ffcbf2f0 2024-09-21T01:19:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653ffff1b20 con 0x5653ffce81b0 2024-09-21T01:19:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5653ffff5930 con 0x5653ffcc74d0 2024-09-21T01:19:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.556+0000 7f6be77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x5654000904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.557+0000 7f6be77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x5654000904b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34026/0 (socket says 172.21.15.37:34026) 2024-09-21T01:19:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.557+0000 7f6be77fe640 1 -- 172.21.15.37:0/367582719 learned_addr learned my addr 172.21.15.37:0/367582719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.559+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540008fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.563+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400091000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.565+0000 7f6be4ff9640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6bd00b6720 0x7f6bd00b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.567+0000 7f6be6ffd640 1 -- 172.21.15.37:0/367582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 msgr2=0x56540008fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.567+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540008fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.567+0000 7f6be6ffd640 1 -- 172.21.15.37:0/367582719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 msgr2=0x5654000904b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.567+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x5654000904b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.567+0000 7f6be6ffd640 1 -- 172.21.15.37:0/367582719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653fffb7530 con 0x5653ffcc74d0 2024-09-21T01:19:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.568+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400091000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000c00 tx=0x7f6bd8009460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc466103300047f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.569+0000 7f6be4ff9640 1 -- 172.21.15.37:0/1731551970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6be00e6810 con 0x7f6be810f9d0 2024-09-21T01:19:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.569+0000 7f6be7fff640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6bd00b6720 0x7f6bd00b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.569+0000 7f6bcdffb640 1 -- 172.21.15.37:0/367582719 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8035040 con 0x5653ffcc74d0 2024-09-21T01:19:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.569+0000 7f6bcdffb640 1 -- 172.21.15.37:0/367582719 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd8003c30 con 0x5653ffcc74d0 2024-09-21T01:19:57.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.569+0000 7f6bcdffb640 1 -- 172.21.15.37:0/367582719 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8031c50 con 0x5653ffcc74d0 2024-09-21T01:19:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.572+0000 7f6bf4a36740 1 -- 172.21.15.37:0/367582719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 msgr2=0x565400091000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.572+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400091000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000c00 tx=0x7f6bd8009460 comp rx=0 tx=0).stop 2024-09-21T01:19:57.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.572+0000 7f6be7fff640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6bd00b6720 0x7f6bd00b8c30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6be00a8fe0 tx=0x7f6be000e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.584+0000 7f6bf4a36740 1 -- 172.21.15.37:0/367582719 shutdown_connections 2024-09-21T01:19:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.584+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400091000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.584+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x5654000904b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.584+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/367582719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540008fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.584+0000 7f6bf4a36740 1 -- 172.21.15.37:0/367582719 >> 172.21.15.37:0/367582719 conn(0x5653ffcdc300 msgr2=0x56540008b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.596+0000 7f6bf4a36740 1 -- 172.21.15.37:0/367582719 shutdown_connections 2024-09-21T01:19:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.600+0000 7f6bf4a36740 1 -- 172.21.15.37:0/367582719 wait complete. 2024-09-21T01:19:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.600+0000 7f6bf4a36740 1 -- start start 2024-09-21T01:19:57.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.601+0000 7f6bf4a36740 1 Processor -- start 2024-09-21T01:19:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x565400099650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400099d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540009a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5653fff29ab0 con 0x5653ffcbf2f0 2024-09-21T01:19:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653fff97730 con 0x5653ffce81b0 2024-09-21T01:19:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565400091ac0 con 0x5653ffcc74d0 2024-09-21T01:19:57.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.602+0000 7f6bf4a36740 10 client.0 _ll_register_callbacks cb 0x5653fffeb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:57.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.603+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540009a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.608+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540009a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:36458/0 (socket says 172.21.15.37:36458) 2024-09-21T01:19:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.608+0000 7f6be6ffd640 1 -- 172.21.15.37:0/2817736320 learned_addr learned my addr 172.21.15.37:0/2817736320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.608+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x565400099650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.610+0000 7f6be6ffd640 1 -- 172.21.15.37:0/2817736320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 msgr2=0x565400099d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:19:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.610+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400099d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.610+0000 7f6be6ffd640 1 -- 172.21.15.37:0/2817736320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 msgr2=0x565400099650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.610+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x565400099650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.610+0000 7f6be6ffd640 1 -- 172.21.15.37:0/2817736320 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ffd53790 con 0x5653ffce81b0 2024-09-21T01:19:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.617+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540009a880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8001eb0 tx=0x7f6bd8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461833d2a586cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.618+0000 7f6bc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:19:57.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.621+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/2817736320 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8035040 con 0x5653ffce81b0 2024-09-21T01:19:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.621+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd8003c30 con 0x5653ffce81b0 2024-09-21T01:19:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.621+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/2817736320 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6bd8031bd0 con 0x5653ffce81b0 2024-09-21T01:19:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.636+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/2817736320 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6bd8003a50 con 0x5653ffce81b0 2024-09-21T01:19:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.636+0000 7f6bf4a36740 10 client.25712 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.636+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653ffdcc620 con 0x5653ffce81b0 2024-09-21T01:19:57.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.638+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/2817736320 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd8003c30 con 0x5653ffce81b0 2024-09-21T01:19:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/2817736320 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6bd804a430 con 0x5653ffce81b0 2024-09-21T01:19:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bf4a36740 10 client.25712 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bf4a36740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bf4a36740 20 client.25712 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5653ffca6d80 0x5654000a6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bf4a36740 4 client.25712 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:19:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.641+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565400004640 con 0x5653ffca6d80 2024-09-21T01:19:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.650+0000 7f6be77fe640 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5653ffca6d80 0x5654000a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.662+0000 7f6bc6ffd640 10 client.25712 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.662+0000 7f6be77fe640 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5653ffca6d80 0x5654000a6960 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb197c0f60114ae server_cookie=cd51b633a9de687b in_seq=0 out_seq=0 2024-09-21T01:19:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.668+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/2817736320 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565400004640 con 0x5653ffca6d80 2024-09-21T01:19:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.668+0000 7f6bc6ffd640 10 client.25712 handle_command_reply: tid=0 2024-09-21T01:19:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.668+0000 7f6bf4a36740 1 client.25712 shutdown 2024-09-21T01:19:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 msgr2=0x56540009a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540009a880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8001eb0 tx=0x7f6bd8009260 comp rx=0 tx=0).stop 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 shutdown_connections 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5653ffca6d80 0x5654000a6960 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffce81b0 0x56540009a880 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8001eb0 tx=0x7f6bd8009260 comp rx=0 tx=0).stop 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcc74d0 0x565400099d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/2817736320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcbf2f0 0x565400099650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 >> 172.21.15.37:0/2817736320 conn(0x5653ffcdc300 msgr2=0x565400089ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.675+0000 7f6bc6ffd640 0 client.25712 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.676+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 shutdown_connections 2024-09-21T01:19:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.678+0000 7f6bf4a36740 1 -- 172.21.15.37:0/2817736320 wait complete. 2024-09-21T01:19:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.678+0000 7f6bf4a36740 20 client.25712 trim_cache size 0 max 16384 2024-09-21T01:19:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.710+0000 7f6bf4a36740 1 Processor -- start 2024-09-21T01:19:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.710+0000 7f6bf4a36740 1 -- start start 2024-09-21T01:19:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.710+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcbf2f0 0x565400098f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcc74d0 0x56540008b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 0x56540008b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400e440 con 0x5653ffc7c1c0 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400ff80 con 0x5653ffcc74d0 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400eb10 con 0x5653ffcbf2f0 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 0x56540008b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 0x56540008b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34046/0 (socket says 172.21.15.37:34046) 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.711+0000 7f6be6ffd640 1 -- 172.21.15.37:0/1336999065 learned_addr learned my addr 172.21.15.37:0/1336999065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.712+0000 7f6be6ffd640 1 -- 172.21.15.37:0/1336999065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcbf2f0 msgr2=0x565400098f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.712+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcbf2f0 0x565400098f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.712+0000 7f6be6ffd640 1 -- 172.21.15.37:0/1336999065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcc74d0 msgr2=0x56540008b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.712+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcc74d0 0x56540008b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.712+0000 7f6be6ffd640 1 -- 172.21.15.37:0/1336999065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654000977e0 con 0x5653ffc7c1c0 2024-09-21T01:19:57.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.713+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 0x56540008b750 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6bd804a990 tx=0x7f6bd8031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845777cc03985843 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.714+0000 7f6bcd7fa640 1 -- 172.21.15.37:0/1336999065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd804ae60 con 0x5653ffc7c1c0 2024-09-21T01:19:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.715+0000 7f6bcd7fa640 1 -- 172.21.15.37:0/1336999065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd804a430 con 0x5653ffc7c1c0 2024-09-21T01:19:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.715+0000 7f6bcd7fa640 1 -- 172.21.15.37:0/1336999065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8031bd0 con 0x5653ffc7c1c0 2024-09-21T01:19:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.717+0000 7f6bf4a36740 1 -- 172.21.15.37:0/1336999065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 msgr2=0x56540008b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.717+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 0x56540008b750 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6bd804a990 tx=0x7f6bd8031430 comp rx=0 tx=0).stop 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 -- 172.21.15.37:0/1336999065 shutdown_connections 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffc7c1c0 0x56540008b750 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcc74d0 0x56540008b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/1336999065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffcbf2f0 0x565400098f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 -- 172.21.15.37:0/1336999065 >> 172.21.15.37:0/1336999065 conn(0x5653ffcdc300 msgr2=0x565400098850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 -- 172.21.15.37:0/1336999065 shutdown_connections 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.718+0000 7f6bf4a36740 1 -- 172.21.15.37:0/1336999065 wait complete. 2024-09-21T01:19:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.719+0000 7f6bf4a36740 1 -- start start 2024-09-21T01:19:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.720+0000 7f6bf4a36740 1 Processor -- start 2024-09-21T01:19:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.720+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffc7c1c0 0x56540009c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcbf2f0 0x56540009cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6bf4a36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcc74d0 0x56540009d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6bf4a36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400f8b0 con 0x5653ffcc74d0 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffc7c1c0 0x56540009c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6be6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffc7c1c0 0x56540009c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:50242/0 (socket says 172.21.15.37:50242) 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6be6ffd640 1 -- 172.21.15.37:0/3233587602 learned_addr learned my addr 172.21.15.37:0/3233587602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6be77fe640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcbf2f0 0x56540009cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.721+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400f1e0 con 0x5653ffcbf2f0 2024-09-21T01:19:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd400c4d0 con 0x5653ffc7c1c0 2024-09-21T01:19:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcc74d0 0x56540009d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6bf4a36740 10 client.0 _ll_register_callbacks cb 0x7f6bdc0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6be6ffd640 1 -- 172.21.15.37:0/3233587602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffc7c1c0 msgr2=0x56540009c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffc7c1c0 0x56540009c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6be6ffd640 1 -- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcbf2f0 msgr2=0x56540009cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcbf2f0 0x56540009cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.722+0000 7f6be6ffd640 1 -- 172.21.15.37:0/3233587602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540009de40 con 0x5653ffcc74d0 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.723+0000 7f6be6ffd640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcc74d0 0x56540009d6e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005ab0 tx=0x7f6bd8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac02733cf9dbdc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.723+0000 7f6bc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.723+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd804a430 con 0x5653ffcc74d0 2024-09-21T01:19:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.723+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/3233587602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8031d60 con 0x5653ffcc74d0 2024-09-21T01:19:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.724+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/3233587602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6bd804a9c0 con 0x5653ffcc74d0 2024-09-21T01:19:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.724+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/3233587602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6bd804abc0 con 0x5653ffcc74d0 2024-09-21T01:19:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.724+0000 7f6bf4a36740 10 client.16212 fetch_fsmap learned FSMap version 30 2024-09-21T01:19:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.724+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5654000a1090 con 0x5653ffcc74d0 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/3233587602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6bd804c110 con 0x5653ffcc74d0 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bf4a36740 10 client.16212 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bf4a36740 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bf4a36740 20 client.16212 populate_metadata read hostname 'smithi037' 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5654001112c0 0x5654001136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bf4a36740 4 client.16212 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.725+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6bd804a430 con 0x5654001112c0 2024-09-21T01:19:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.726+0000 7f6be77fe640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5654001112c0 0x5654001136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:19:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.727+0000 7f6be77fe640 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5654001112c0 0x5654001136e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=952be71f15f81084 server_cookie=3e38d4a2913da33e in_seq=0 out_seq=0 2024-09-21T01:19:57.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:57.727+0000 7f6bc6ffd640 10 client.16212 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:58.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:19:58 smithi137 ceph-mon[34607]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 754 MiB/s wr, 1.35k op/s 2024-09-21T01:19:58.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:19:58 smithi144 ceph-mon[34818]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 754 MiB/s wr, 1.35k op/s 2024-09-21T01:19:58.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:19:58 smithi037 ceph-mon[31105]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 754 MiB/s wr, 1.35k op/s 2024-09-21T01:19:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.096+0000 7f6bc6ffd640 1 -- 172.21.15.37:0/3233587602 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6bd804a430 con 0x5654001112c0 2024-09-21T01:19:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.096+0000 7f6bc6ffd640 10 client.16212 handle_command_reply: tid=0 2024-09-21T01:19:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.096+0000 7f6bf4a36740 1 client.16212 shutdown 2024-09-21T01:19:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.097+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcc74d0 msgr2=0x56540009d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.097+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcc74d0 0x56540009d6e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005ab0 tx=0x7f6bd8009260 comp rx=0 tx=0).stop 2024-09-21T01:19:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 shutdown_connections 2024-09-21T01:19:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5654001112c0 0x5654001136e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653ffcc74d0 0x56540009d6e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653ffcbf2f0 0x56540009cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bf4a36740 1 --2- 172.21.15.37:0/3233587602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653ffc7c1c0 0x56540009c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 >> 172.21.15.37:0/3233587602 conn(0x5653ffcdc300 msgr2=0x56540008b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.098+0000 7f6bc6ffd640 0 client.16212 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:19:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.099+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 shutdown_connections 2024-09-21T01:19:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.099+0000 7f6bf4a36740 1 -- 172.21.15.37:0/3233587602 wait complete. 2024-09-21T01:19:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.099+0000 7f6bf4a36740 20 client.16212 trim_cache size 0 max 16384 2024-09-21T01:19:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:19:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:19:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:19:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:19:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.112+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6bd00b6720 msgr2=0x7f6bd00b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.112+0000 7f6bedace640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6bd00b6720 0x7f6bd00b8c30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6be00a8fe0 tx=0x7f6be000e040 comp rx=0 tx=0).stop 2024-09-21T01:19:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.112+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 msgr2=0x7f6be81aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:19:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.112+0000 7f6bedace640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be81aa030 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6be000be20 tx=0x7f6be000bf10 comp rx=0 tx=0).stop 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.115+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 shutdown_connections 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.115+0000 7f6bedace640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6bd00b6720 0x7f6bd00b8c30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.115+0000 7f6bedace640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6be810f9d0 0x7f6be81aa030 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.115+0000 7f6bedace640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be810cdb0 0x7f6be81a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.115+0000 7f6bedace640 1 --2- 172.21.15.37:0/1731551970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6be810a3c0 0x7f6be81a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.115+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 >> 172.21.15.37:0/1731551970 conn(0x7f6be8070810 msgr2=0x7f6be810b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:19:59.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.116+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 shutdown_connections 2024-09-21T01:19:59.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:19:59.116+0000 7f6bedace640 1 -- 172.21.15.37:0/1731551970 wait complete. 2024-09-21T01:20:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:00 smithi137 ceph-mon[34607]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 974 MiB/s wr, 1.85k op/s 2024-09-21T01:20:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:00 smithi137 ceph-mon[34607]: overall HEALTH_OK 2024-09-21T01:20:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:00 smithi144 ceph-mon[34818]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 974 MiB/s wr, 1.85k op/s 2024-09-21T01:20:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:00 smithi144 ceph-mon[34818]: overall HEALTH_OK 2024-09-21T01:20:00.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:00 smithi037 ceph-mon[31105]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 974 MiB/s wr, 1.85k op/s 2024-09-21T01:20:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:00 smithi037 ceph-mon[31105]: overall HEALTH_OK 2024-09-21T01:20:02.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:02 smithi144 ceph-mon[34818]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 1.82k op/s 2024-09-21T01:20:02.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:02 smithi137 ceph-mon[34607]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 1.82k op/s 2024-09-21T01:20:02.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:02 smithi037 ceph-mon[31105]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 1.82k op/s 2024-09-21T01:20:04.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:04 smithi137 ceph-mon[34607]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 853 MiB/s wr, 2.04k op/s 2024-09-21T01:20:04.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:04 smithi144 ceph-mon[34818]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 853 MiB/s wr, 2.04k op/s 2024-09-21T01:20:04.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:04 smithi037 ceph-mon[31105]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 853 MiB/s wr, 2.04k op/s 2024-09-21T01:20:06.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:06 smithi137 ceph-mon[34607]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 960 MiB/s wr, 2.64k op/s 2024-09-21T01:20:06.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:06 smithi144 ceph-mon[34818]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 960 MiB/s wr, 2.64k op/s 2024-09-21T01:20:06.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:06 smithi037 ceph-mon[31105]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 960 MiB/s wr, 2.64k op/s 2024-09-21T01:20:08.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:08 smithi137 ceph-mon[34607]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 732 MiB/s wr, 2.25k op/s 2024-09-21T01:20:08.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:08 smithi144 ceph-mon[34818]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 732 MiB/s wr, 2.25k op/s 2024-09-21T01:20:08.755 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:08 smithi037 ceph-mon[31105]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 732 MiB/s wr, 2.25k op/s 2024-09-21T01:20:10.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:20:10.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:10 smithi137 ceph-mon[34607]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 982 MiB/s wr, 3.16k op/s 2024-09-21T01:20:10.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:10 smithi144 ceph-mon[34818]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 982 MiB/s wr, 3.16k op/s 2024-09-21T01:20:10.692 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:10.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:10 smithi037 ceph-mon[31105]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 982 MiB/s wr, 3.16k op/s 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.072+0000 7f8d89329640 1 -- 172.21.15.37:0/2253943759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d84110440 msgr2=0x7f8d84116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.072+0000 7f8d89329640 1 --2- 172.21.15.37:0/2253943759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d84110440 0x7f8d84116c70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009860 tx=0x7f8d7802a360 comp rx=0 tx=0).stop 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.074+0000 7f8d89329640 1 -- 172.21.15.37:0/2253943759 shutdown_connections 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.074+0000 7f8d89329640 1 --2- 172.21.15.37:0/2253943759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d84110440 0x7f8d84116c70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.074+0000 7f8d89329640 1 --2- 172.21.15.37:0/2253943759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 0x7f8d8410ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.074+0000 7f8d89329640 1 --2- 172.21.15.37:0/2253943759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d8410a1b0 0x7f8d8410a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.074+0000 7f8d89329640 1 -- 172.21.15.37:0/2253943759 >> 172.21.15.37:0/2253943759 conn(0x7f8d840780e0 msgr2=0x7f8d841081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.079+0000 7f8d89329640 1 -- 172.21.15.37:0/2253943759 shutdown_connections 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.082+0000 7f8d89329640 1 -- 172.21.15.37:0/2253943759 wait complete. 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.083+0000 7f8d89329640 1 Processor -- start 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.084+0000 7f8d89329640 1 -- start start 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.085+0000 7f8d89329640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d8410a1b0 0x7f8d841a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.085+0000 7f8d89329640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 0x7f8d841a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.086+0000 7f8d89329640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d84110440 0x7f8d841a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.086+0000 7f8d89329640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8411a140 con 0x7f8d8410faf0 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.086+0000 7f8d89329640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84119fc0 con 0x7f8d84110440 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.086+0000 7f8d89329640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8411a2c0 con 0x7f8d8410a1b0 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.086+0000 7f8d82ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d8410a1b0 0x7f8d841a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.087+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 0x7f8d841a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.087+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 0x7f8d841a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49344/0 (socket says 172.21.15.37:49344) 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.087+0000 7f8d827fc640 1 -- 172.21.15.37:0/3543787861 learned_addr learned my addr 172.21.15.37:0/3543787861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.088+0000 7f8d837fe640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d84110440 0x7f8d841a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.089+0000 7f8d82ffd640 1 -- 172.21.15.37:0/3543787861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d84110440 msgr2=0x7f8d841a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.089+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d84110440 0x7f8d841a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.089+0000 7f8d82ffd640 1 -- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 msgr2=0x7f8d841a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.089+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 0x7f8d841a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.089+0000 7f8d82ffd640 1 -- 172.21.15.37:0/3543787861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d841a69a0 con 0x7f8d8410a1b0 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.092+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d8410a1b0 0x7f8d841a0a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400e790 tx=0x7f8d7400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.093+0000 7f8d6bfff640 1 -- 172.21.15.37:0/3543787861 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400eea0 con 0x7f8d8410a1b0 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.093+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d841a6c90 con 0x7f8d8410a1b0 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.094+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841ad3f0 con 0x7f8d8410a1b0 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.099+0000 7f8d8f89d740 1 Processor -- start 2024-09-21T01:20:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.099+0000 7f8d8f89d740 1 -- start start 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.100+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb2d070 0x562bdfed4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.100+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb041b0 0x562bdfed4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.099+0000 7f8d6bfff640 1 -- 172.21.15.37:0/3543787861 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7400ccc0 con 0x7f8d8410a1b0 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.100+0000 7f8d6bfff640 1 -- 172.21.15.37:0/3543787861 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74018680 con 0x7f8d8410a1b0 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.101+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb0c390 0x562bdfed50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.102+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bdfe4ae50 con 0x562bdfb041b0 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.102+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb2d070 0x562bdfed4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.102+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb2d070 0x562bdfed4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:40654/0 (socket says 172.21.15.37:40654) 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.102+0000 7f8d837fe640 1 -- 172.21.15.37:0/505577278 learned_addr learned my addr 172.21.15.37:0/505577278 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.102+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb041b0 0x562bdfed4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.102+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562bdfe3a280 con 0x562bdfb2d070 2024-09-21T01:20:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.103+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562bdfe3e090 con 0x562bdfb0c390 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.104+0000 7f8d6bfff640 1 -- 172.21.15.37:0/3543787861 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8d74018900 con 0x7f8d8410a1b0 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.107+0000 7f8d82ffd640 1 -- 172.21.15.37:0/505577278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb0c390 msgr2=0x562bdfed50d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.107+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb0c390 0x562bdfed50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.107+0000 7f8d82ffd640 1 -- 172.21.15.37:0/505577278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb2d070 msgr2=0x562bdfed4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.107+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb2d070 0x562bdfed4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.107+0000 7f8d82ffd640 1 -- 172.21.15.37:0/505577278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bdfb98650 con 0x562bdfb041b0 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.107+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb041b0 0x562bdfed4b90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d74011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649503b953fc6de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.110+0000 7f8d6bfff640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8d6c0b6710 0x7f8d6c0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.110+0000 7f8d6bfff640 1 -- 172.21.15.37:0/3543787861 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8d740e8420 con 0x7f8d8410a1b0 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.111+0000 7f8d697fa640 1 -- 172.21.15.37:0/505577278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740ea5e0 con 0x562bdfb041b0 2024-09-21T01:20:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.111+0000 7f8d697fa640 1 -- 172.21.15.37:0/505577278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d740e8d00 con 0x562bdfb041b0 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.111+0000 7f8d697fa640 1 -- 172.21.15.37:0/505577278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740f5c80 con 0x562bdfb041b0 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.111+0000 7f8d837fe640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8d6c0b6710 0x7f8d6c0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.112+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb041b0 msgr2=0x562bdfed4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.113+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb041b0 0x562bdfed4b90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d74011000 comp rx=0 tx=0).stop 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.116+0000 7f8d837fe640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8d6c0b6710 0x7f8d6c0b8c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009860 tx=0x7f8d78030340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.117+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 shutdown_connections 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.117+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb0c390 0x562bdfed50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.117+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb041b0 0x562bdfed4b90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.117+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/505577278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb2d070 0x562bdfed4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.117+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 >> 172.21.15.37:0/505577278 conn(0x562bdfb21460 msgr2=0x562bdfed2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.121+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 shutdown_connections 2024-09-21T01:20:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.121+0000 7f8d8f89d740 1 -- 172.21.15.37:0/505577278 wait complete. 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.122+0000 7f8d8f89d740 1 -- start start 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.123+0000 7f8d8f89d740 1 Processor -- start 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.124+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfedfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.124+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 0x562bdfee0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.124+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb2d070 0x562bdfeec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.125+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bdfc9b700 con 0x562bdfb0c390 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.125+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562bdfdd5110 con 0x562bdfb041b0 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.125+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562bdfee2e30 con 0x562bdfb2d070 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.125+0000 7f8d8f89d740 10 client.0 _ll_register_callbacks cb 0x562bdfdee990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.126+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 0x562bdfee0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.126+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 0x562bdfee0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49356/0 (socket says 172.21.15.37:49356) 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.126+0000 7f8d827fc640 1 -- 172.21.15.37:0/3278063439 learned_addr learned my addr 172.21.15.37:0/3278063439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.127+0000 7f8d827fc640 1 -- 172.21.15.37:0/3278063439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb2d070 msgr2=0x562bdfeec1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.127+0000 7f8d827fc640 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb2d070 0x562bdfeec1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.128+0000 7f8d827fc640 1 -- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 msgr2=0x562bdfedfd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.128+0000 7f8d827fc640 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfedfd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.128+0000 7f8d827fc640 1 -- 172.21.15.37:0/3278063439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bdfe02c40 con 0x562bdfb0c390 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.129+0000 7f8d827fc640 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 0x562bdfee0260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c010670 tx=0x7f8d7c010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61de96d2b186fcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.129+0000 7f8d66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.140+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3278063439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00e8b0 con 0x562bdfb0c390 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.140+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d740e8d00 con 0x562bdfb0c390 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.141+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3278063439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8d7c00ea50 con 0x562bdfb0c390 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.147+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3278063439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c00ec50 con 0x562bdfb0c390 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.147+0000 7f8d8f89d740 10 client.16224 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:12.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.147+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562bdfeeec40 con 0x562bdfb0c390 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.153+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3278063439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d740e8d00 con 0x562bdfb0c390 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.153+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3278063439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8d7c01a430 con 0x562bdfb0c390 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.153+0000 7f8d8f89d740 10 client.16224 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.153+0000 7f8d8f89d740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.153+0000 7f8d8f89d740 20 client.16224 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.154+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdfaeb9f0 0x562bdfef2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.154+0000 7f8d8f89d740 4 client.16224 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.154+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bdfe4cda0 con 0x562bdfaeb9f0 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.156+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdfaeb9f0 0x562bdfef2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.162+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdfaeb9f0 0x562bdfef2600 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67dabb97733a7311 server_cookie=31f45eb77d1bfe15 in_seq=0 out_seq=0 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.163+0000 7f8d66ff5640 10 client.16224 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.166+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3278063439 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bdfe4cda0 con 0x562bdfaeb9f0 2024-09-21T01:20:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.166+0000 7f8d66ff5640 10 client.16224 handle_command_reply: tid=0 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.168+0000 7f8d8f89d740 1 client.16224 shutdown 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.170+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 msgr2=0x562bdfee0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.170+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 0x562bdfee0260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c010670 tx=0x7f8d7c010b30 comp rx=0 tx=0).stop 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.170+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 shutdown_connections 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.170+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdfaeb9f0 0x562bdfef2600 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.170+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb2d070 0x562bdfeec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb0c390 0x562bdfee0260 secure :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c010670 tx=0x7f8d7c010b30 comp rx=0 tx=0).stop 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3278063439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfedfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 >> 172.21.15.37:0/3278063439 conn(0x562bdfb21460 msgr2=0x562bdfed77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d66ff5640 0 client.16224 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 shutdown_connections 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3278063439 wait complete. 2024-09-21T01:20:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.171+0000 7f8d8f89d740 20 client.16224 trim_cache size 0 max 16384 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.213+0000 7f8d8f89d740 1 Processor -- start 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.214+0000 7f8d8f89d740 1 -- start start 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.214+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfeec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.215+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfede5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.215+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfac0da0 0x562bdfedeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.215+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7000e5e0 con 0x562bdfb2d070 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.215+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70010120 con 0x562bdfb041b0 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.215+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7000ecb0 con 0x562bdfac0da0 2024-09-21T01:20:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.215+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfede5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.216+0000 7f8d827fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfede5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49366/0 (socket says 172.21.15.37:49366) 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.216+0000 7f8d827fc640 1 -- 172.21.15.37:0/2102241250 learned_addr learned my addr 172.21.15.37:0/2102241250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.216+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfeec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d827fc640 1 -- 172.21.15.37:0/2102241250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfac0da0 msgr2=0x562bdfedeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d827fc640 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfac0da0 0x562bdfedeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d827fc640 1 -- 172.21.15.37:0/2102241250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 msgr2=0x562bdfeec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d827fc640 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfeec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d827fc640 1 -- 172.21.15.37:0/2102241250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bdfed2eb0 con 0x562bdfb2d070 2024-09-21T01:20:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfeec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:20:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.217+0000 7f8d827fc640 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfede5a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c01a970 tx=0x7f8d7c010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b20d18a42b6df6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.218+0000 7f8d68ff9640 1 -- 172.21.15.37:0/2102241250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c02a070 con 0x562bdfb2d070 2024-09-21T01:20:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.218+0000 7f8d68ff9640 1 -- 172.21.15.37:0/2102241250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7c01a430 con 0x562bdfb2d070 2024-09-21T01:20:12.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.218+0000 7f8d68ff9640 1 -- 172.21.15.37:0/2102241250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c005040 con 0x562bdfb2d070 2024-09-21T01:20:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.220+0000 7f8d8f89d740 1 -- 172.21.15.37:0/2102241250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 msgr2=0x562bdfede5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.221+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfede5a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c01a970 tx=0x7f8d7c010fd0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.222+0000 7f8d8f89d740 1 -- 172.21.15.37:0/2102241250 shutdown_connections 2024-09-21T01:20:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.222+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfac0da0 0x562bdfedeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.222+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfede5a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.222+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/2102241250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfb041b0 0x562bdfeec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.222+0000 7f8d8f89d740 1 -- 172.21.15.37:0/2102241250 >> 172.21.15.37:0/2102241250 conn(0x562bdfb21460 msgr2=0x562bdfedae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.224+0000 7f8d8f89d740 1 -- 172.21.15.37:0/2102241250 shutdown_connections 2024-09-21T01:20:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.224+0000 7f8d8f89d740 1 -- 172.21.15.37:0/2102241250 wait complete. 2024-09-21T01:20:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.225+0000 7f8d8f89d740 1 -- start start 2024-09-21T01:20:12.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.226+0000 7f8d8f89d740 1 Processor -- start 2024-09-21T01:20:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.227+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfac0da0 0x562bdfee8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.227+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb041b0 0x562bdfee3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.228+0000 7f8d8f89d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfee4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.228+0000 7f8d8f89d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7000fa50 con 0x562bdfb2d070 2024-09-21T01:20:12.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.229+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfee4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.229+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfee4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49378/0 (socket says 172.21.15.37:49378) 2024-09-21T01:20:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.229+0000 7f8d837fe640 1 -- 172.21.15.37:0/3134176988 learned_addr learned my addr 172.21.15.37:0/3134176988 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.229+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfac0da0 0x562bdfee8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.229+0000 7f8d827fc640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb041b0 0x562bdfee3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.229+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7000f380 con 0x562bdfac0da0 2024-09-21T01:20:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.230+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7000c5a0 con 0x562bdfb041b0 2024-09-21T01:20:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.230+0000 7f8d8f89d740 10 client.0 _ll_register_callbacks cb 0x7f8d7c009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:12.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.231+0000 7f8d837fe640 1 -- 172.21.15.37:0/3134176988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb041b0 msgr2=0x562bdfee3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.231+0000 7f8d837fe640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb041b0 0x562bdfee3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.231+0000 7f8d837fe640 1 -- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfac0da0 msgr2=0x562bdfee8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.231+0000 7f8d837fe640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfac0da0 0x562bdfee8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.231+0000 7f8d837fe640 1 -- 172.21.15.37:0/3134176988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bdfee4580 con 0x562bdfb2d070 2024-09-21T01:20:12.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.233+0000 7f8d837fe640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfee4040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8d780057c0 tx=0x7f8d78009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b9f7b08f84bbc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.236+0000 7f8d66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.236+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3134176988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7804d020 con 0x562bdfb2d070 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.236+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3134176988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8d78004450 con 0x562bdfb2d070 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.236+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7c01a430 con 0x562bdfb2d070 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.237+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3134176988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8d78037040 con 0x562bdfb2d070 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.237+0000 7f8d8f89d740 10 client.16230 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.237+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562bdff5cbd0 con 0x562bdfb2d070 2024-09-21T01:20:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3134176988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d78003aa0 con 0x562bdfb2d070 2024-09-21T01:20:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3134176988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8d78032930 con 0x562bdfb2d070 2024-09-21T01:20:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d8f89d740 10 client.16230 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d8f89d740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d8f89d740 20 client.16230 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdff5d380 0x562bdff5f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d8f89d740 4 client.16230 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:20:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.238+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f8d7c01a430 con 0x562bdff5d380 2024-09-21T01:20:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.242+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdff5d380 0x562bdff5f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.246+0000 7f8d82ffd640 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdff5d380 0x562bdff5f7a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafd1d1813107dee server_cookie=936ab63eb81d4df8 in_seq=0 out_seq=0 2024-09-21T01:20:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.246+0000 7f8d66ff5640 10 client.16230 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.249+0000 7f8d66ff5640 1 -- 172.21.15.37:0/3134176988 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x7f8d7c01a430 con 0x562bdff5d380 2024-09-21T01:20:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.249+0000 7f8d66ff5640 10 client.16230 handle_command_reply: tid=0 2024-09-21T01:20:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.249+0000 7f8d8f89d740 1 client.16230 shutdown 2024-09-21T01:20:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.249+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 msgr2=0x562bdfee4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.249+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfee4040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8d780057c0 tx=0x7f8d78009500 comp rx=0 tx=0).stop 2024-09-21T01:20:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.250+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 shutdown_connections 2024-09-21T01:20:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.250+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562bdff5d380 0x562bdff5f7a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.250+0000 7f8d66ff5640 0 client.16230 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.250+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bdfb2d070 0x562bdfee4040 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.250+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bdfb041b0 0x562bdfee3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.250+0000 7f8d8f89d740 1 --2- 172.21.15.37:0/3134176988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bdfac0da0 0x562bdfee8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.251+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 >> 172.21.15.37:0/3134176988 conn(0x562bdfb21460 msgr2=0x562bdfede560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.251+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 shutdown_connections 2024-09-21T01:20:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.251+0000 7f8d8f89d740 1 -- 172.21.15.37:0/3134176988 wait complete. 2024-09-21T01:20:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.252+0000 7f8d8f89d740 20 client.16230 trim_cache size 0 max 16384 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:12.254 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:20:12.255 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:12.256 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:12.256 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:12.256 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:12.256 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:12.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:12.257 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:20:12.257 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:20:12.257 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:20:12.258 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.253+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8d6c0b6710 msgr2=0x7f8d6c0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.253+0000 7f8d89329640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8d6c0b6710 0x7f8d6c0b8c20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009860 tx=0x7f8d78030340 comp rx=0 tx=0).stop 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.253+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d8410a1b0 msgr2=0x7f8d841a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.253+0000 7f8d89329640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d8410a1b0 0x7f8d841a0a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400e790 tx=0x7f8d7400ec50 comp rx=0 tx=0).stop 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.254+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 shutdown_connections 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.254+0000 7f8d89329640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8d6c0b6710 0x7f8d6c0b8c20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.254+0000 7f8d89329640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d84110440 0x7f8d841a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.254+0000 7f8d89329640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8410faf0 0x7f8d841a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.254+0000 7f8d89329640 1 --2- 172.21.15.37:0/3543787861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d8410a1b0 0x7f8d841a0a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.254+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 >> 172.21.15.37:0/3543787861 conn(0x7f8d840780e0 msgr2=0x7f8d8410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.255+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 shutdown_connections 2024-09-21T01:20:12.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:12.256+0000 7f8d89329640 1 -- 172.21.15.37:0/3543787861 wait complete. 2024-09-21T01:20:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.404+0000 7f33effff640 1 -- 172.21.15.37:0/1686431518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809d980 msgr2=0x7f33e809ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.404+0000 7f33effff640 1 --2- 172.21.15.37:0/1686431518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809d980 0x7f33e809ddf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33f0069690 tx=0x7f33f0097fc0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.405+0000 7f33effff640 1 -- 172.21.15.37:0/1686431518 shutdown_connections 2024-09-21T01:20:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.405+0000 7f33effff640 1 --2- 172.21.15.37:0/1686431518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e809d030 0x7f33e80a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.405+0000 7f33effff640 1 --2- 172.21.15.37:0/1686431518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809c690 0x7f33e809caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.405+0000 7f33effff640 1 --2- 172.21.15.37:0/1686431518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809d980 0x7f33e809ddf0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33f0069690 tx=0x7f33f0097fc0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.405+0000 7f33effff640 1 -- 172.21.15.37:0/1686431518 >> 172.21.15.37:0/1686431518 conn(0x7f33e800b6d0 msgr2=0x7f33e800bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.408+0000 7f33effff640 1 -- 172.21.15.37:0/1686431518 shutdown_connections 2024-09-21T01:20:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.409+0000 7f33effff640 1 -- 172.21.15.37:0/1686431518 wait complete. 2024-09-21T01:20:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.411+0000 7f33effff640 1 Processor -- start 2024-09-21T01:20:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 -- start start 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809c690 0x7f33e8143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 0x7f33e8144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e8144e20 0x7f33e8145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80a7ef0 con 0x7f33e809d030 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80a7d70 con 0x7f33e8144e20 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.412+0000 7f33effff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80a8070 con 0x7f33e809c690 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.413+0000 7f33ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 0x7f33e8144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.413+0000 7f33ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 0x7f33e8144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49392/0 (socket says 172.21.15.37:49392) 2024-09-21T01:20:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.413+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1292782068 learned_addr learned my addr 172.21.15.37:0/1292782068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.417+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1292782068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809c690 msgr2=0x7f33e8143cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:20:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.417+0000 7f33ee7fc640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809c690 0x7f33e8143cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.417+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1292782068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e8144e20 msgr2=0x7f33e8145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.417+0000 7f33ee7fc640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e8144e20 0x7f33e8145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.417+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1292782068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e8145b40 con 0x7f33e809d030 2024-09-21T01:20:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.419+0000 7f33ee7fc640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 0x7f33e8144360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f33e000e9c0 tx=0x7f33e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.424+0000 7f33f4989640 1 -- 172.21.15.37:0/1292782068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e000ccc0 con 0x7f33e809d030 2024-09-21T01:20:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.424+0000 7f33f4989640 1 -- 172.21.15.37:0/1292782068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e00054d0 con 0x7f33e809d030 2024-09-21T01:20:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.426+0000 7f33f4989640 1 -- 172.21.15.37:0/1292782068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0010430 con 0x7f33e809d030 2024-09-21T01:20:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.434+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e800d100 con 0x7f33e809d030 2024-09-21T01:20:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.435+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e800d5d0 con 0x7f33e809d030 2024-09-21T01:20:12.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.449+0000 7f33fc9d8740 1 Processor -- start 2024-09-21T01:20:12.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.451+0000 7f33fc9d8740 1 -- start start 2024-09-21T01:20:12.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:12 smithi037 ceph-mon[31105]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 872 MiB/s wr, 2.93k op/s 2024-09-21T01:20:12.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.455+0000 7f33f4989640 1 -- 172.21.15.37:0/1292782068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f33e0004f30 con 0x7f33e809d030 2024-09-21T01:20:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.461+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ecc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.461+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ecc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.461+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ecd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.461+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9b7e3e6f0 con 0x55a9b7b034d0 2024-09-21T01:20:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.461+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a9b7e2db20 con 0x55a9b7b241b0 2024-09-21T01:20:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.461+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a9b7e31930 con 0x55a9b7afb2f0 2024-09-21T01:20:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.462+0000 7f33ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ecd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.463+0000 7f33f4989640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f33d80b6530 0x7f33d80b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.463+0000 7f33ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ecd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49394/0 (socket says 172.21.15.37:49394) 2024-09-21T01:20:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.463+0000 7f33ee7fc640 1 -- 172.21.15.37:0/3168040393 learned_addr learned my addr 172.21.15.37:0/3168040393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.464+0000 7f33eeffd640 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ecc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.464+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ecc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f33d80b6530 0x7f33d80b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33eeffd640 1 -- 172.21.15.37:0/3168040393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 msgr2=0x55a9b7ecc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33eeffd640 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ecc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33eeffd640 1 -- 172.21.15.37:0/3168040393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 msgr2=0x55a9b7ecd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33eeffd640 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ecd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33eeffd640 1 -- 172.21.15.37:0/3168040393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b7df3530 con 0x55a9b7afb2f0 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.466+0000 7f33f4989640 1 -- 172.21.15.37:0/1292782068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f33e00e76c0 con 0x7f33e809d030 2024-09-21T01:20:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.468+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ecc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:20:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.469+0000 7f33eeffd640 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ecc6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33f0000b60 tx=0x7f33f0051680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82b45a069235aafe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.470+0000 7f33d5ffb640 1 -- 172.21.15.37:0/3168040393 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0075410 con 0x55a9b7afb2f0 2024-09-21T01:20:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.470+0000 7f33d5ffb640 1 -- 172.21.15.37:0/3168040393 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33f009c050 con 0x55a9b7afb2f0 2024-09-21T01:20:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.470+0000 7f33d5ffb640 1 -- 172.21.15.37:0/3168040393 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f009a330 con 0x55a9b7afb2f0 2024-09-21T01:20:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.475+0000 7f33fc9d8740 1 -- 172.21.15.37:0/3168040393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 msgr2=0x55a9b7ecc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.475+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ecc6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33f0000b60 tx=0x7f33f0051680 comp rx=0 tx=0).stop 2024-09-21T01:20:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.475+0000 7f33fc9d8740 1 -- 172.21.15.37:0/3168040393 shutdown_connections 2024-09-21T01:20:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.475+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ecd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.475+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ecc6b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.475+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/3168040393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ecc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.476+0000 7f33fc9d8740 1 -- 172.21.15.37:0/3168040393 >> 172.21.15.37:0/3168040393 conn(0x55a9b7b18300 msgr2=0x55a9b7ec7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.483+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f33d80b6530 0x7f33d80b8a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009460 tx=0x7f33e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.484+0000 7f33fc9d8740 1 -- 172.21.15.37:0/3168040393 shutdown_connections 2024-09-21T01:20:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.487+0000 7f33fc9d8740 1 -- 172.21.15.37:0/3168040393 wait complete. 2024-09-21T01:20:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.489+0000 7f33fc9d8740 1 -- start start 2024-09-21T01:20:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.490+0000 7f33fc9d8740 1 Processor -- start 2024-09-21T01:20:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.491+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ed5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.491+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ed5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.491+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ed69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.491+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9b7d65ab0 con 0x55a9b7b034d0 2024-09-21T01:20:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.491+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a9b7dd3730 con 0x55a9b7b241b0 2024-09-21T01:20:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.492+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a9b7ecdcc0 con 0x55a9b7afb2f0 2024-09-21T01:20:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.492+0000 7f33ef7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ed69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.492+0000 7f33ef7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ed69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:40720/0 (socket says 172.21.15.37:40720) 2024-09-21T01:20:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.492+0000 7f33ef7fe640 1 -- 172.21.15.37:0/1316039667 learned_addr learned my addr 172.21.15.37:0/1316039667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.493+0000 7f33fc9d8740 10 client.0 _ll_register_callbacks cb 0x55a9b7e276b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.493+0000 7f33ef7fe640 1 -- 172.21.15.37:0/1316039667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 msgr2=0x55a9b7ed5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.493+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ed5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.493+0000 7f33ef7fe640 1 -- 172.21.15.37:0/1316039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 msgr2=0x55a9b7ed5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.493+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ed5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.493+0000 7f33ef7fe640 1 -- 172.21.15.37:0/1316039667 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b7b8f790 con 0x55a9b7b241b0 2024-09-21T01:20:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.497+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ed69c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f33e4012010 tx=0x7f33e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc47286f764620c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.503+0000 7f33ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:20:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.503+0000 7f33ceffd640 1 -- 172.21.15.37:0/1316039667 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004240 con 0x55a9b7b241b0 2024-09-21T01:20:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.503+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f009c050 con 0x55a9b7b241b0 2024-09-21T01:20:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.503+0000 7f33ceffd640 1 -- 172.21.15.37:0/1316039667 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f33e40043e0 con 0x55a9b7b241b0 2024-09-21T01:20:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.506+0000 7f33ceffd640 1 -- 172.21.15.37:0/1316039667 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f33e4022020 con 0x55a9b7b241b0 2024-09-21T01:20:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.506+0000 7f33fc9d8740 10 client.25736 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.506+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a9b7c08620 con 0x55a9b7b241b0 2024-09-21T01:20:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.508+0000 7f33ceffd640 1 -- 172.21.15.37:0/1316039667 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33f009c050 con 0x55a9b7b241b0 2024-09-21T01:20:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33ceffd640 1 -- 172.21.15.37:0/1316039667 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f33e40109b0 con 0x55a9b7b241b0 2024-09-21T01:20:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33fc9d8740 10 client.25736 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33fc9d8740 10 client.25736 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33fc9d8740 20 client.25736 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ae2d80 0x55a9b7ee3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33fc9d8740 4 client.25736 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.509+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9b7e40640 con 0x55a9b7ae2d80 2024-09-21T01:20:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.518+0000 7f33eeffd640 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ae2d80 0x55a9b7ee3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.532+0000 7f33ceffd640 10 client.25736 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.532+0000 7f33eeffd640 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ae2d80 0x55a9b7ee3430 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b747dc5540883a68 server_cookie=10d63eb28003ca05 in_seq=0 out_seq=0 2024-09-21T01:20:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.543+0000 7f33ceffd640 1 -- 172.21.15.37:0/1316039667 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a9b7e40640 con 0x55a9b7ae2d80 2024-09-21T01:20:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.544+0000 7f33ceffd640 10 client.25736 handle_command_reply: tid=0 2024-09-21T01:20:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.544+0000 7f33fc9d8740 1 client.25736 shutdown 2024-09-21T01:20:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 msgr2=0x55a9b7ed69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ed69c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f33e4012010 tx=0x7f33e40046c0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 shutdown_connections 2024-09-21T01:20:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ae2d80 0x55a9b7ee3430 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b241b0 0x55a9b7ed69c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b034d0 0x55a9b7ed5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1316039667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ed5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.549+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 >> 172.21.15.37:0/1316039667 conn(0x55a9b7b18300 msgr2=0x55a9b7ec6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.550+0000 7f33ceffd640 0 client.25736 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.552+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 shutdown_connections 2024-09-21T01:20:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.556+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1316039667 wait complete. 2024-09-21T01:20:12.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.558+0000 7f33fc9d8740 20 client.25736 trim_cache size 0 max 16384 2024-09-21T01:20:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.600+0000 7f33fc9d8740 1 Processor -- start 2024-09-21T01:20:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.600+0000 7f33fc9d8740 1 -- start start 2024-09-21T01:20:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.602+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ec2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.602+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b034d0 0x55a9b7edd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.602+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b241b0 0x55a9b7ec7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.603+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33e815d8e0 con 0x55a9b7afb2f0 2024-09-21T01:20:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.603+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33e815f420 con 0x55a9b7b034d0 2024-09-21T01:20:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.603+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33e815dfb0 con 0x55a9b7b241b0 2024-09-21T01:20:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.604+0000 7f33ef7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b241b0 0x55a9b7ec7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.605+0000 7f33ef7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b241b0 0x55a9b7ec7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51244/0 (socket says 172.21.15.37:51244) 2024-09-21T01:20:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.605+0000 7f33ef7fe640 1 -- 172.21.15.37:0/105067823 learned_addr learned my addr 172.21.15.37:0/105067823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.603+0000 7f33eeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ec2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.607+0000 7f33eeffd640 1 -- 172.21.15.37:0/105067823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b241b0 msgr2=0x55a9b7ec7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.607+0000 7f33eeffd640 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b241b0 0x55a9b7ec7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.607+0000 7f33eeffd640 1 -- 172.21.15.37:0/105067823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b034d0 msgr2=0x55a9b7edd8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.607+0000 7f33eeffd640 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b034d0 0x55a9b7edd8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.607+0000 7f33eeffd640 1 -- 172.21.15.37:0/105067823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b7ae2fb0 con 0x55a9b7afb2f0 2024-09-21T01:20:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.608+0000 7f33eeffd640 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ec2870 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f33f0069100 tx=0x7f33f0068ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98783329952234e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.614+0000 7f33d57fa640 1 -- 172.21.15.37:0/105067823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0098980 con 0x55a9b7afb2f0 2024-09-21T01:20:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.614+0000 7f33d57fa640 1 -- 172.21.15.37:0/105067823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33f009c050 con 0x55a9b7afb2f0 2024-09-21T01:20:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.614+0000 7f33d57fa640 1 -- 172.21.15.37:0/105067823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f009a540 con 0x55a9b7afb2f0 2024-09-21T01:20:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.616+0000 7f33fc9d8740 1 -- 172.21.15.37:0/105067823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7afb2f0 msgr2=0x55a9b7ec2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.617+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ec2870 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f33f0069100 tx=0x7f33f0068ee0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.618+0000 7f33fc9d8740 1 -- 172.21.15.37:0/105067823 shutdown_connections 2024-09-21T01:20:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.618+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b241b0 0x55a9b7ec7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.619+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7b034d0 0x55a9b7edd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.619+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/105067823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7afb2f0 0x55a9b7ec2870 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.619+0000 7f33fc9d8740 1 -- 172.21.15.37:0/105067823 >> 172.21.15.37:0/105067823 conn(0x55a9b7b18300 msgr2=0x55a9b7ee3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.619+0000 7f33fc9d8740 1 -- 172.21.15.37:0/105067823 shutdown_connections 2024-09-21T01:20:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.619+0000 7f33fc9d8740 1 -- 172.21.15.37:0/105067823 wait complete. 2024-09-21T01:20:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.620+0000 7f33fc9d8740 1 -- start start 2024-09-21T01:20:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.627+0000 7f33fc9d8740 1 Processor -- start 2024-09-21T01:20:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.628+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7afb2f0 0x55a9b7eda0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.628+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 0x55a9b7eda770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33fc9d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b241b0 0x55a9b7edb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33e815ed50 con 0x55a9b7b241b0 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33fc9d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33e815e680 con 0x55a9b7afb2f0 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33ee7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 0x55a9b7eda770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33ee7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 0x55a9b7eda770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51250/0 (socket says 172.21.15.37:51250) 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1014082835 learned_addr learned my addr 172.21.15.37:0/1014082835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8014350 con 0x55a9b7b034d0 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.629+0000 7f33eeffd640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7afb2f0 0x55a9b7eda0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.630+0000 7f33ef7fe640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b241b0 0x55a9b7edb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.630+0000 7f33fc9d8740 10 client.0 _ll_register_callbacks cb 0x7f33e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.631+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7afb2f0 msgr2=0x55a9b7eda0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.631+0000 7f33ee7fc640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7afb2f0 0x55a9b7eda0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.631+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1014082835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b241b0 msgr2=0x55a9b7edb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.631+0000 7f33ee7fc640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b241b0 0x55a9b7edb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.631+0000 7f33ee7fc640 1 -- 172.21.15.37:0/1014082835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b7edba40 con 0x55a9b7b034d0 2024-09-21T01:20:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.632+0000 7f33ee7fc640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 0x55a9b7eda770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33e0012020 tx=0x7f33e00a9f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d73d4540924a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.633+0000 7f33ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:20:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.633+0000 7f33ceffd640 1 -- 172.21.15.37:0/1014082835 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e00acf80 con 0x55a9b7b034d0 2024-09-21T01:20:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.638+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33f009c050 con 0x55a9b7b034d0 2024-09-21T01:20:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.638+0000 7f33ceffd640 1 -- 172.21.15.37:0/1014082835 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f33e00aca70 con 0x55a9b7b034d0 2024-09-21T01:20:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.639+0000 7f33ceffd640 1 -- 172.21.15.37:0/1014082835 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f33e000ce60 con 0x55a9b7b034d0 2024-09-21T01:20:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.646+0000 7f33fc9d8740 10 client.25675 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.646+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a9b7edcda0 con 0x55a9b7b034d0 2024-09-21T01:20:12.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.646+0000 7f33ceffd640 1 -- 172.21.15.37:0/1014082835 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33e0005680 con 0x55a9b7b034d0 2024-09-21T01:20:12.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33ceffd640 1 -- 172.21.15.37:0/1014082835 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f33e00e7ab0 con 0x55a9b7b034d0 2024-09-21T01:20:12.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33fc9d8740 10 client.25675 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33fc9d8740 10 client.25675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33fc9d8740 20 client.25675 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ab81c0 0x55a9b7edd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33fc9d8740 4 client.25675 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:20:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.647+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f33f009c050 con 0x55a9b7ab81c0 2024-09-21T01:20:12.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.648+0000 7f33eeffd640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ab81c0 0x55a9b7edd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.650+0000 7f33ceffd640 10 client.25675 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:12.650+0000 7f33eeffd640 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ab81c0 0x55a9b7edd780 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86864ce31c2cb826 server_cookie=f7d5f719214f4a3a in_seq=0 out_seq=0 2024-09-21T01:20:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:12 smithi137 ceph-mon[34607]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 872 MiB/s wr, 2.93k op/s 2024-09-21T01:20:12.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:12 smithi144 ceph-mon[34818]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 872 MiB/s wr, 2.93k op/s 2024-09-21T01:20:14.740 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:14 smithi037 ceph-mon[31105]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 869 MiB/s wr, 2.74k op/s 2024-09-21T01:20:14.854 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:20:14.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:20:14.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:14 smithi137 ceph-mon[34607]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 869 MiB/s wr, 2.74k op/s 2024-09-21T01:20:14.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:14 smithi144 ceph-mon[34818]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 869 MiB/s wr, 2.74k op/s 2024-09-21T01:20:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:16.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:16 smithi037 ceph-mon[31105]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 927 MiB/s wr, 2.55k op/s 2024-09-21T01:20:16.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:16 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:20:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:16 smithi137 ceph-mon[34607]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 927 MiB/s wr, 2.55k op/s 2024-09-21T01:20:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:16 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:20:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:16 smithi144 ceph-mon[34818]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 927 MiB/s wr, 2.55k op/s 2024-09-21T01:20:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:16 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:20:17.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.127+0000 7f33ceffd640 1 -- 172.21.15.37:0/1014082835 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f33f009c050 con 0x55a9b7ab81c0 2024-09-21T01:20:17.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.127+0000 7f33ceffd640 10 client.25675 handle_command_reply: tid=0 2024-09-21T01:20:17.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.128+0000 7f33fc9d8740 1 client.25675 shutdown 2024-09-21T01:20:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 msgr2=0x55a9b7eda770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 0x55a9b7eda770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33e0012020 tx=0x7f33e00a9f90 comp rx=0 tx=0).stop 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 shutdown_connections 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a9b7ab81c0 0x55a9b7edd780 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b7b241b0 0x55a9b7edb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9b7b034d0 0x55a9b7eda770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 --2- 172.21.15.37:0/1014082835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b7afb2f0 0x55a9b7eda0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 >> 172.21.15.37:0/1014082835 conn(0x55a9b7b18300 msgr2=0x55a9b7ee3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.129+0000 7f33ceffd640 0 client.25675 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.132+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 shutdown_connections 2024-09-21T01:20:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.132+0000 7f33fc9d8740 1 -- 172.21.15.37:0/1014082835 wait complete. 2024-09-21T01:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.133+0000 7f33fc9d8740 20 client.25675 trim_cache size 0 max 16384 2024-09-21T01:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f33d80b6530 msgr2=0x7f33d80b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f33d80b6530 0x7f33d80b8a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009460 tx=0x7f33e4005f90 comp rx=0 tx=0).stop 2024-09-21T01:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 msgr2=0x7f33e8144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 0x7f33e8144360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f33e000e9c0 tx=0x7f33e000ee80 comp rx=0 tx=0).stop 2024-09-21T01:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 shutdown_connections 2024-09-21T01:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f33d80b6530 0x7f33d80b8a40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f33e8144e20 0x7f33e8145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33e809d030 0x7f33e8144360 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 --2- 172.21.15.37:0/1292782068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33e809c690 0x7f33e8143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.145+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 >> 172.21.15.37:0/1292782068 conn(0x7f33e800b6d0 msgr2=0x7f33e80a06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.146+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 shutdown_connections 2024-09-21T01:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:17.146+0000 7f33effff640 1 -- 172.21.15.37:0/1292782068 wait complete. 2024-09-21T01:20:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 -- 172.21.15.37:0/2762271927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf7811cc30 msgr2=0x7fbf7811f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 --2- 172.21.15.37:0/2762271927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf7811cc30 0x7fbf7811f140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009ca0 tx=0x7fbf7002a8f0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 -- 172.21.15.37:0/2762271927 shutdown_connections 2024-09-21T01:20:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 --2- 172.21.15.37:0/2762271927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf7811cc30 0x7fbf7811f140 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 --2- 172.21.15.37:0/2762271927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf7810a9e0 0x7fbf7810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 --2- 172.21.15.37:0/2762271927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf78111f40 0x7fbf7810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.367+0000 7fbf807a2640 1 -- 172.21.15.37:0/2762271927 >> 172.21.15.37:0/2762271927 conn(0x7fbf78070ec0 msgr2=0x7fbf780712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.370+0000 7fbf807a2640 1 -- 172.21.15.37:0/2762271927 shutdown_connections 2024-09-21T01:20:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.370+0000 7fbf807a2640 1 -- 172.21.15.37:0/2762271927 wait complete. 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.372+0000 7fbf807a2640 1 Processor -- start 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.372+0000 7fbf807a2640 1 -- start start 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.372+0000 7fbf807a2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf7810a9e0 0x7fbf781a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.372+0000 7fbf807a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 0x7fbf781a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf807a2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf7811cc30 0x7fbf781aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf807a2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf781229e0 con 0x7fbf78111f40 2024-09-21T01:20:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf807a2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78122860 con 0x7fbf7811cc30 2024-09-21T01:20:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf807a2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78122b60 con 0x7fbf7810a9e0 2024-09-21T01:20:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf7dd3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 0x7fbf781a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf7dd3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 0x7fbf781a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55932/0 (socket says 172.21.15.37:55932) 2024-09-21T01:20:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf7dd3d640 1 -- 172.21.15.37:0/170664307 learned_addr learned my addr 172.21.15.37:0/170664307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.373+0000 7fbf7e53e640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf7810a9e0 0x7fbf781a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.375+0000 7fbf7dd3d640 1 -- 172.21.15.37:0/170664307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf7810a9e0 msgr2=0x7fbf781a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.375+0000 7fbf7dd3d640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf7810a9e0 0x7fbf781a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.375+0000 7fbf7dd3d640 1 -- 172.21.15.37:0/170664307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf7811cc30 msgr2=0x7fbf781aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.375+0000 7fbf7dd3d640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf7811cc30 0x7fbf781aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.375+0000 7fbf7dd3d640 1 -- 172.21.15.37:0/170664307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf781af270 con 0x7fbf78111f40 2024-09-21T01:20:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.376+0000 7fbf7dd3d640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 0x7fbf781a98d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbf68006fd0 tx=0x7fbf6800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.377+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68015020 con 0x7fbf78111f40 2024-09-21T01:20:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.377+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf781af560 con 0x7fbf78111f40 2024-09-21T01:20:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.377+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf78112380 con 0x7fbf78111f40 2024-09-21T01:20:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.378+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf68011ce0 con 0x7fbf78111f40 2024-09-21T01:20:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.378+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68010d20 con 0x7fbf78111f40 2024-09-21T01:20:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.382+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c0052c0 con 0x7fbf78111f40 2024-09-21T01:20:17.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.385+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fbf68018020 con 0x7fbf78111f40 2024-09-21T01:20:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.387+0000 7fbf6f7fe640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf640b6740 0x7fbf640b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.388+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbf680e6850 con 0x7fbf78111f40 2024-09-21T01:20:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.389+0000 7fbf7e53e640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf640b6740 0x7fbf640b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.390+0000 7fbf7e53e640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf640b6740 0x7fbf640b8c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009990 tx=0x7fbf74009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:17.397+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf6801f020 con 0x7fbf78111f40 2024-09-21T01:20:17.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:20:17.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:20:17.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:17 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:20:17.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:20:17.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:20:17.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:17 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:20:17.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:20:17.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:20:17.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:17 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:20:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.008+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf5c0055b0 con 0x7fbf78111f40 2024-09-21T01:20:18.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:20:18.028 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-21T01:19:26:088830+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:19:25.613490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:20:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.023+0000 7fbf6f7fe640 1 -- 172.21.15.37:0/170664307 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11976 (secure 0 0 0) 0x7fbf680ad0a0 con 0x7fbf78111f40 2024-09-21T01:20:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-21T01:20:18.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf640b6740 msgr2=0x7fbf640b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:18.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf640b6740 0x7fbf640b8c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009990 tx=0x7fbf74009110 comp rx=0 tx=0).stop 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 msgr2=0x7fbf781a98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 0x7fbf781a98d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbf68006fd0 tx=0x7fbf6800b820 comp rx=0 tx=0).stop 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 shutdown_connections 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbf640b6740 0x7fbf640b8c50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf7811cc30 0x7fbf781aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78111f40 0x7fbf781a98d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 --2- 172.21.15.37:0/170664307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf7810a9e0 0x7fbf781a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.030+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 >> 172.21.15.37:0/170664307 conn(0x7fbf78070ec0 msgr2=0x7fbf7811d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:18.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.032+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 shutdown_connections 2024-09-21T01:20:18.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:18.033+0000 7fbf807a2640 1 -- 172.21.15.37:0/170664307 wait complete. 2024-09-21T01:20:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:18 smithi137 ceph-mon[34607]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 755 MiB/s wr, 1.82k op/s 2024-09-21T01:20:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:18 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/170664307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:20:18.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:18 smithi144 ceph-mon[34818]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 755 MiB/s wr, 1.82k op/s 2024-09-21T01:20:18.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:18 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/170664307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:20:18.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:18 smithi037 ceph-mon[31105]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 755 MiB/s wr, 1.82k op/s 2024-09-21T01:20:18.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:18 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/170664307' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:20:20.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:20:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:20 smithi137 ceph-mon[34607]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1001 MiB/s wr, 2.29k op/s 2024-09-21T01:20:20.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:20 smithi144 ceph-mon[34818]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1001 MiB/s wr, 2.29k op/s 2024-09-21T01:20:20.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:20 smithi037 ceph-mon[31105]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1001 MiB/s wr, 2.29k op/s 2024-09-21T01:20:21.019 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:22.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:22 smithi037 ceph-mon[31105]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 868 MiB/s wr, 1.58k op/s 2024-09-21T01:20:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:22 smithi137 ceph-mon[34607]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 868 MiB/s wr, 1.58k op/s 2024-09-21T01:20:22.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:22 smithi144 ceph-mon[34818]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 868 MiB/s wr, 1.58k op/s 2024-09-21T01:20:23.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.097+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/3991580351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c09c720 msgr2=0x7f5e3c09cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.097+0000 7f5e4c3b7640 1 --2- 172.21.15.37:0/3991580351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c09c720 0x7f5e3c09cb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009900 tx=0x7f5e4002a440 comp rx=0 tx=0).stop 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/3991580351 shutdown_connections 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 --2- 172.21.15.37:0/3991580351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e3c0a29b0 0x7f5e3c0a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 --2- 172.21.15.37:0/3991580351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a2060 0x7f5e3c0a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 --2- 172.21.15.37:0/3991580351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c09c720 0x7f5e3c09cb30 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009900 tx=0x7f5e4002a440 comp rx=0 tx=0).stop 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/3991580351 >> 172.21.15.37:0/3991580351 conn(0x7f5e3c00ba90 msgr2=0x7f5e3c00bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/3991580351 shutdown_connections 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.098+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/3991580351 wait complete. 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.100+0000 7f5e4c3b7640 1 Processor -- start 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.100+0000 7f5e4c3b7640 1 -- start start 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.101+0000 7f5e4c3b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e3c0a2060 0x7f5e3c015f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.105+0000 7f5e4c3b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a29b0 0x7f5e3c00f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e4c3b7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c00f790 0x7f5e3c014b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e4c3b7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0ac720 con 0x7f5e3c0a2060 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e4c3b7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0ac5a0 con 0x7f5e3c0a29b0 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e4c3b7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c0ac8a0 con 0x7f5e3c00f790 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e49952640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a29b0 0x7f5e3c00f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e49952640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a29b0 0x7f5e3c00f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:52980/0 (socket says 172.21.15.37:52980) 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.106+0000 7f5e49952640 1 -- 172.21.15.37:0/4070515678 learned_addr learned my addr 172.21.15.37:0/4070515678 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.105+0000 7f5e4a153640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e3c0a2060 0x7f5e3c015f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.107+0000 7f5e4a954640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c00f790 0x7f5e3c014b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.108+0000 7f5e4a954640 1 -- 172.21.15.37:0/4070515678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a29b0 msgr2=0x7f5e3c00f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.108+0000 7f5e4a954640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a29b0 0x7f5e3c00f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.108+0000 7f5e4a954640 1 -- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e3c0a2060 msgr2=0x7f5e3c015f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.108+0000 7f5e4a954640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e3c0a2060 0x7f5e3c015f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.108+0000 7f5e4a954640 1 -- 172.21.15.37:0/4070515678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c00ff70 con 0x7f5e3c00f790 2024-09-21T01:20:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.109+0000 7f5e4a954640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c00f790 0x7f5e3c014b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e44051d10 tx=0x7f5e440769d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.114+0000 7f5e3b7fe640 1 -- 172.21.15.37:0/4070515678 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44086070 con 0x7f5e3c00f790 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.114+0000 7f5e3b7fe640 1 -- 172.21.15.37:0/4070515678 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e4407fbc0 con 0x7f5e3c00f790 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.114+0000 7f5e3b7fe640 1 -- 172.21.15.37:0/4070515678 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44081ba0 con 0x7f5e3c00f790 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.116+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/4070515678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c015180 con 0x7f5e3c00f790 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.116+0000 7f5e4c3b7640 1 -- 172.21.15.37:0/4070515678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c0155e0 con 0x7f5e3c00f790 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.121+0000 7f5e5292b740 1 Processor -- start 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 -- start start 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dd51b0 0x55f1041a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f10411bea0 con 0x55f103dfe070 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f10410b2d0 con 0x55f103ddd390 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.122+0000 7f5e5292b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f10410f0e0 con 0x55f103dd51b0 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.124+0000 7f5e4a153640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dd51b0 0x55f1041a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.126+0000 7f5e3b7fe640 1 -- 172.21.15.37:0/4070515678 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5e4406cdb0 con 0x7f5e3c00f790 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.126+0000 7f5e49952640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.126+0000 7f5e49952640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041a5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55954/0 (socket says 172.21.15.37:55954) 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.126+0000 7f5e49952640 1 -- 172.21.15.37:0/2989680406 learned_addr learned my addr 172.21.15.37:0/2989680406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.127+0000 7f5e49952640 1 -- 172.21.15.37:0/2989680406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dd51b0 msgr2=0x55f1041a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.127+0000 7f5e49952640 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dd51b0 0x55f1041a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.127+0000 7f5e49952640 1 -- 172.21.15.37:0/2989680406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 msgr2=0x55f1041a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.127+0000 7f5e49952640 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.127+0000 7f5e49952640 1 -- 172.21.15.37:0/2989680406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f103e69650 con 0x55f103dfe070 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.128+0000 7f5e49952640 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041a5b50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e34013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12d3574796f262b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.128+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2989680406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3401c470 con 0x55f103dfe070 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.128+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2989680406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e34017070 con 0x55f103dfe070 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.129+0000 7f5e3b7fe640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e300b6720 0x7f5e300b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.129+0000 7f5e3b7fe640 1 -- 172.21.15.37:0/4070515678 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5e4414b280 con 0x7f5e3c00f790 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.130+0000 7f5e5292b740 1 -- 172.21.15.37:0/2989680406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 msgr2=0x55f1041a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.130+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041a5b50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e34013830 comp rx=0 tx=0).stop 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.132+0000 7f5e5292b740 1 -- 172.21.15.37:0/2989680406 shutdown_connections 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.132+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.132+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dd51b0 0x55f1041a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.132+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2989680406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041a5b50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.133+0000 7f5e5292b740 1 -- 172.21.15.37:0/2989680406 >> 172.21.15.37:0/2989680406 conn(0x55f103df2460 msgr2=0x55f1041a3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.135+0000 7f5e5292b740 1 -- 172.21.15.37:0/2989680406 shutdown_connections 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.135+0000 7f5e4a153640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e300b6720 0x7f5e300b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.138+0000 7f5e5292b740 1 -- 172.21.15.37:0/2989680406 wait complete. 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.138+0000 7f5e5292b740 1 -- start start 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.138+0000 7f5e5292b740 1 Processor -- start 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103ddd390 0x55f1041c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103dbc9f0 0x55f1041c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f103f6c700 con 0x55f103dfe070 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f1040a6160 con 0x55f103dbc9f0 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f1041c5250 con 0x55f103ddd390 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.139+0000 7f5e5292b740 10 client.0 _ll_register_callbacks cb 0x55f1040bf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.141+0000 7f5e4a954640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103dbc9f0 0x55f1041c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.141+0000 7f5e4a954640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103dbc9f0 0x55f1041c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:52992/0 (socket says 172.21.15.37:52992) 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.141+0000 7f5e4a954640 1 -- 172.21.15.37:0/314757746 learned_addr learned my addr 172.21.15.37:0/314757746 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.142+0000 7f5e49952640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.142+0000 7f5e4a153640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103ddd390 0x55f1041c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.145+0000 7f5e49952640 1 -- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103ddd390 msgr2=0x55f1041c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.145+0000 7f5e49952640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103ddd390 0x55f1041c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.145+0000 7f5e49952640 1 -- 172.21.15.37:0/314757746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103dbc9f0 msgr2=0x55f1041c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.145+0000 7f5e49952640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103dbc9f0 0x55f1041c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.145+0000 7f5e49952640 1 -- 172.21.15.37:0/314757746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1040d3c90 con 0x55f103dfe070 2024-09-21T01:20:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.145+0000 7f5e4a153640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e300b6720 0x7f5e300b8c30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e40000c00 tx=0x7f5e40005f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.147+0000 7f5e49952640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041c2610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e34009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48289869a1bdaa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.147+0000 7f5e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.148+0000 7f5e2dffb640 1 -- 172.21.15.37:0/314757746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34009a00 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.148+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f10411ddf0 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.148+0000 7f5e2dffb640 1 -- 172.21.15.37:0/314757746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5e340052d0 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.149+0000 7f5e2dffb640 1 -- 172.21.15.37:0/314757746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5e3402d050 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.150+0000 7f5e5292b740 10 client.16260 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.150+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f1041ad6f0 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e2dffb640 1 -- 172.21.15.37:0/314757746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f10411ddf0 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e2dffb640 1 -- 172.21.15.37:0/314757746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5e34024070 con 0x55f103dfe070 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e5292b740 10 client.16260 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e5292b740 10 client.16260 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e5292b740 20 client.16260 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e5292b740 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f103d91da0 0x55f1041b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e5292b740 4 client.16260 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.152+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1041198a0 con 0x55f103d91da0 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.154+0000 7f5e4a153640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f103d91da0 0x55f1041b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.157+0000 7f5e4a153640 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f103d91da0 0x55f1041b0ec0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e3c5eca79f53dab1 server_cookie=46c8c9643519b21c in_seq=0 out_seq=0 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.157+0000 7f5e2dffb640 10 client.16260 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.159+0000 7f5e2dffb640 1 -- 172.21.15.37:0/314757746 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1041198a0 con 0x55f103d91da0 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.160+0000 7f5e2dffb640 10 client.16260 handle_command_reply: tid=0 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.160+0000 7f5e5292b740 1 client.16260 shutdown 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 msgr2=0x55f1041c2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041c2610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e34009750 comp rx=0 tx=0).stop 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 shutdown_connections 2024-09-21T01:20:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f103d91da0 0x55f1041b0ec0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103dbc9f0 0x55f1041c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103dfe070 0x55f1041c2610 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 --2- 172.21.15.37:0/314757746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103ddd390 0x55f1041c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 >> 172.21.15.37:0/314757746 conn(0x55f103df2460 msgr2=0x55f1041a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e2dffb640 0 client.16260 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.162+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 shutdown_connections 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.163+0000 7f5e5292b740 1 -- 172.21.15.37:0/314757746 wait complete. 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.163+0000 7f5e5292b740 20 client.16260 trim_cache size 0 max 16384 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.206+0000 7f5e5292b740 1 Processor -- start 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.207+0000 7f5e5292b740 1 -- start start 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.208+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 0x55f1041bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.208+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041bf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.208+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1041bfd40 0x55f1041c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.208+0000 7f5e5292b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c150f40 con 0x55f1041bfd40 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.208+0000 7f5e5292b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c152a80 con 0x55f103ddd390 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.208+0000 7f5e5292b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c151610 con 0x55f103dbc9f0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.209+0000 7f5e4a153640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 0x55f1041bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.210+0000 7f5e4a153640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 0x55f1041bf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:49404/0 (socket says 172.21.15.37:49404) 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.210+0000 7f5e4a153640 1 -- 172.21.15.37:0/3320182600 learned_addr learned my addr 172.21.15.37:0/3320182600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.211+0000 7f5e49952640 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.211+0000 7f5e4a954640 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1041bfd40 0x55f1041c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.214+0000 7f5e4a153640 1 -- 172.21.15.37:0/3320182600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 msgr2=0x55f1041bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.214+0000 7f5e4a153640 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.214+0000 7f5e4a153640 1 -- 172.21.15.37:0/3320182600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1041bfd40 msgr2=0x55f1041c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.214+0000 7f5e4a153640 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1041bfd40 0x55f1041c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.214+0000 7f5e4a153640 1 -- 172.21.15.37:0/3320182600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f10417e650 con 0x55f103dbc9f0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.217+0000 7f5e4a153640 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 0x55f1041bf2c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e4002a9b0 tx=0x7f5e40048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a819b7814058c7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.220+0000 7f5e2f7fe640 1 -- 172.21.15.37:0/3320182600 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40058070 con 0x55f103dbc9f0 2024-09-21T01:20:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.220+0000 7f5e2f7fe640 1 -- 172.21.15.37:0/3320182600 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e40004490 con 0x55f103dbc9f0 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.220+0000 7f5e2f7fe640 1 -- 172.21.15.37:0/3320182600 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40003dc0 con 0x55f103dbc9f0 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 -- 172.21.15.37:0/3320182600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 msgr2=0x55f1041bf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 0x55f1041bf2c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e4002a9b0 tx=0x7f5e40048000 comp rx=0 tx=0).stop 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 -- 172.21.15.37:0/3320182600 shutdown_connections 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f1041bfd40 0x55f1041c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f103ddd390 0x55f1041bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 --2- 172.21.15.37:0/3320182600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f103dbc9f0 0x55f1041bf2c0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e4002a9b0 tx=0x7f5e40048000 comp rx=0 tx=0).stop 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 -- 172.21.15.37:0/3320182600 >> 172.21.15.37:0/3320182600 conn(0x55f103df2460 msgr2=0x55f1041c0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 -- 172.21.15.37:0/3320182600 shutdown_connections 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.224+0000 7f5e5292b740 1 -- 172.21.15.37:0/3320182600 wait complete. 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.225+0000 7f5e5292b740 1 -- start start 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.225+0000 7f5e5292b740 1 Processor -- start 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.226+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103ddd390 0x55f1041ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1041bfd40 0x55f1041caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e5292b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1041c55f0 0x55f1041c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e5292b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1523b0 con 0x55f103ddd390 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e5292b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c151ce0 con 0x55f1041bfd40 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e5292b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c14ef00 con 0x55f1041c55f0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e5292b740 10 client.0 _ll_register_callbacks cb 0x7f5e34009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e4a954640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1041c55f0 0x55f1041c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e4a954640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1041c55f0 0x55f1041c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:49406/0 (socket says 172.21.15.37:49406) 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e4a954640 1 -- 172.21.15.37:0/2248870553 learned_addr learned my addr 172.21.15.37:0/2248870553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.227+0000 7f5e49952640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1041bfd40 0x55f1041caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.228+0000 7f5e4a153640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103ddd390 0x55f1041ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e49952640 1 -- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1041c55f0 msgr2=0x55f1041c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e49952640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1041c55f0 0x55f1041c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e49952640 1 -- 172.21.15.37:0/2248870553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103ddd390 msgr2=0x55f1041ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e49952640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103ddd390 0x55f1041ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e49952640 1 -- 172.21.15.37:0/2248870553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1041c6220 con 0x55f1041bfd40 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e49952640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1041bfd40 0x55f1041caf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55f104107ff0 tx=0x7f5e34010a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=732cf9394e8a3582 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.229+0000 7f5e2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:20:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.230+0000 7f5e2d7fa640 1 -- 172.21.15.37:0/2248870553 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34013d30 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.230+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e40004490 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.234+0000 7f5e2d7fa640 1 -- 172.21.15.37:0/2248870553 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5e34026dc0 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.236+0000 7f5e2d7fa640 1 -- 172.21.15.37:0/2248870553 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5e34009a00 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.240+0000 7f5e5292b740 10 client.25751 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.240+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f1042508c0 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e2d7fa640 1 -- 172.21.15.37:0/2248870553 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e40004490 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e2d7fa640 1 -- 172.21.15.37:0/2248870553 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5e34024040 con 0x55f1041bfd40 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e5292b740 10 client.25751 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e5292b740 10 client.25751 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e5292b740 20 client.25751 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f104250ec0 0x55f1042532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e5292b740 4 client.25751 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.244+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f104116cd0 con 0x55f104250ec0 2024-09-21T01:20:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.247+0000 7f5e4a153640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f104250ec0 0x55f1042532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.261+0000 7f5e4a153640 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f104250ec0 0x55f1042532e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=784b4290c8d3348d server_cookie=94e96923fc4834b2 in_seq=0 out_seq=0 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.261+0000 7f5e2d7fa640 10 client.25751 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.262+0000 7f5e2d7fa640 1 -- 172.21.15.37:0/2248870553 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f104116cd0 con 0x55f104250ec0 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.262+0000 7f5e2d7fa640 10 client.25751 handle_command_reply: tid=0 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.263+0000 7f5e5292b740 1 client.25751 shutdown 2024-09-21T01:20:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1041bfd40 msgr2=0x55f1041caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1041bfd40 0x55f1041caf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55f104107ff0 tx=0x7f5e34010a30 comp rx=0 tx=0).stop 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 shutdown_connections 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55f104250ec0 0x55f1042532e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1041c55f0 0x55f1041c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f1041bfd40 0x55f1041caf30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 --2- 172.21.15.37:0/2248870553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f103ddd390 0x55f1041ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e2d7fa640 0 client.25751 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.266+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 >> 172.21.15.37:0/2248870553 conn(0x55f103df2460 msgr2=0x55f1041c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.268+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 shutdown_connections 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.268+0000 7f5e5292b740 1 -- 172.21.15.37:0/2248870553 wait complete. 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.269+0000 7f5e5292b740 20 client.25751 trim_cache size 0 max 16384 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 -- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e300b6720 msgr2=0x7f5e300b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e300b6720 0x7f5e300b8c30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e40000c00 tx=0x7f5e40005f30 comp rx=0 tx=0).stop 2024-09-21T01:20:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 -- 172.21.15.37:0/4070515678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c00f790 msgr2=0x7f5e3c014b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c00f790 0x7f5e3c014b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e44051d10 tx=0x7f5e440769d0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 -- 172.21.15.37:0/4070515678 shutdown_connections 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5e300b6720 0x7f5e300b8c30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c00f790 0x7f5e3c014b20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.274+0000 7f5e3959b640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5e3c0a29b0 0x7f5e3c00f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.275+0000 7f5e3959b640 1 --2- 172.21.15.37:0/4070515678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e3c0a2060 0x7f5e3c015f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.275+0000 7f5e3959b640 1 -- 172.21.15.37:0/4070515678 >> 172.21.15.37:0/4070515678 conn(0x7f5e3c00ba90 msgr2=0x7f5e3c09a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.275+0000 7f5e3959b640 1 -- 172.21.15.37:0/4070515678 shutdown_connections 2024-09-21T01:20:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:23.275+0000 7f5e3959b640 1 -- 172.21.15.37:0/4070515678 wait complete. 2024-09-21T01:20:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:24 smithi137 ceph-mon[34607]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 1.59k op/s 2024-09-21T01:20:24.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:24 smithi144 ceph-mon[34818]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 1.59k op/s 2024-09-21T01:20:24.935 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:24 smithi037 ceph-mon[31105]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 1.59k op/s 2024-09-21T01:20:26.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:20:26.879 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:26.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:26 smithi137 ceph-mon[34607]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 926 MiB/s wr, 1.95k op/s 2024-09-21T01:20:26.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:26 smithi144 ceph-mon[34818]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 926 MiB/s wr, 1.95k op/s 2024-09-21T01:20:27.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:26 smithi037 ceph-mon[31105]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 926 MiB/s wr, 1.95k op/s 2024-09-21T01:20:28.610 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:28 smithi037 ceph-mon[31105]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 797 MiB/s wr, 1.80k op/s 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.532+0000 7f50e3fff640 1 -- 172.21.15.37:0/2915562765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc035020 con 0x7f50ec1030f0 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.533+0000 7f50f32be640 1 -- 172.21.15.37:0/2915562765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 msgr2=0x7f50ec107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.533+0000 7f50f32be640 1 --2- 172.21.15.37:0/2915562765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec107620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009930 tx=0x7f50dc02a440 comp rx=0 tx=0).stop 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.534+0000 7f50f32be640 1 -- 172.21.15.37:0/2915562765 shutdown_connections 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.534+0000 7f50f32be640 1 --2- 172.21.15.37:0/2915562765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50ec107be0 0x7f50ec1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.534+0000 7f50f32be640 1 --2- 172.21.15.37:0/2915562765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec107620 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.534+0000 7f50f32be640 1 --2- 172.21.15.37:0/2915562765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 0x7f50ec102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.534+0000 7f50f32be640 1 -- 172.21.15.37:0/2915562765 >> 172.21.15.37:0/2915562765 conn(0x7f50ec079730 msgr2=0x7f50ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.536+0000 7f50f32be640 1 -- 172.21.15.37:0/2915562765 shutdown_connections 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.537+0000 7f50f32be640 1 -- 172.21.15.37:0/2915562765 wait complete. 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.538+0000 7f50f32be640 1 Processor -- start 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.538+0000 7f50f32be640 1 -- start start 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.538+0000 7f50f32be640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 0x7f50ec1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f32be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec1a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f32be640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50ec107be0 0x7f50ec1a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f32be640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec11a090 con 0x7f50ec1030f0 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f105a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 0x7f50ec1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f105a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 0x7f50ec1a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56950/0 (socket says 172.21.15.37:56950) 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f105a640 1 -- 172.21.15.37:0/2444759144 learned_addr learned my addr 172.21.15.37:0/2444759144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec119f10 con 0x7f50ec107be0 2024-09-21T01:20:28.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec11a210 con 0x7f50ec1027a0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f185b640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50ec107be0 0x7f50ec1a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.539+0000 7f50f0859640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec1a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.540+0000 7f50f0859640 1 -- 172.21.15.37:0/2444759144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 msgr2=0x7f50ec1a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.540+0000 7f50f0859640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 0x7f50ec1a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.540+0000 7f50f0859640 1 -- 172.21.15.37:0/2444759144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50ec107be0 msgr2=0x7f50ec1a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.540+0000 7f50f0859640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50ec107be0 0x7f50ec1a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.540+0000 7f50f0859640 1 -- 172.21.15.37:0/2444759144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec1a6a50 con 0x7f50ec1030f0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.541+0000 7f50f0859640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec1a1080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f50dc000c00 tx=0x7f50dc032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.543+0000 7f50e27fc640 1 -- 172.21.15.37:0/2444759144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc03f070 con 0x7f50ec1030f0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.544+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec1a6ce0 con 0x7f50ec1030f0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.544+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec1ad4a0 con 0x7f50ec1030f0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.546+0000 7f50e27fc640 1 -- 172.21.15.37:0/2444759144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50dc03b460 con 0x7f50ec1030f0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.546+0000 7f50e27fc640 1 -- 172.21.15.37:0/2444759144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc03f070 con 0x7f50ec1030f0 2024-09-21T01:20:28.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.550+0000 7f50f9832740 1 Processor -- start 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.550+0000 7f50f9832740 1 -- start start 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.550+0000 7f50f9832740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.551+0000 7f50f9832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 0x5584f55abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.551+0000 7f50f9832740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.551+0000 7f50f9832740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584f5521ea0 con 0x5584f51e3390 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.551+0000 7f50f9832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5584f55112d0 con 0x5584f51db1b0 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.551+0000 7f50f9832740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5584f55150e0 con 0x5584f5204070 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.552+0000 7f50f105a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 0x5584f55abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.552+0000 7f50f105a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 0x5584f55abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43004/0 (socket says 172.21.15.37:43004) 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.552+0000 7f50f105a640 1 -- 172.21.15.37:0/2390056800 learned_addr learned my addr 172.21.15.37:0/2390056800 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.553+0000 7f50f105a640 1 -- 172.21.15.37:0/2390056800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 msgr2=0x5584f55ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.553+0000 7f50f105a640 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.553+0000 7f50f105a640 1 -- 172.21.15.37:0/2390056800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 msgr2=0x5584f55ac120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:20:28.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.553+0000 7f50f105a640 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55ac120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.553+0000 7f50f105a640 1 -- 172.21.15.37:0/2390056800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f526f650 con 0x5584f51db1b0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.553+0000 7f50e27fc640 1 -- 172.21.15.37:0/2444759144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f50dc003a00 con 0x7f50ec1030f0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.554+0000 7f50f105a640 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 0x5584f55abbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50e800ace0 tx=0x7f50e800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b0130f66a6bc92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.554+0000 7f50e27fc640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50d80b6900 0x7f50d80b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.555+0000 7f50e27fc640 1 -- 172.21.15.37:0/2444759144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f50dc003800 con 0x7f50ec1030f0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.555+0000 7f50f185b640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50d80b6900 0x7f50d80b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.555+0000 7f50d77fe640 1 -- 172.21.15.37:0/2390056800 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8004220 con 0x5584f51db1b0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.555+0000 7f50d77fe640 1 -- 172.21.15.37:0/2390056800 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e80043c0 con 0x5584f51db1b0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.555+0000 7f50d77fe640 1 -- 172.21.15.37:0/2390056800 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8018850 con 0x5584f51db1b0 2024-09-21T01:20:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 -- 172.21.15.37:0/2390056800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 msgr2=0x5584f55abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 0x5584f55abbe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50e800ace0 tx=0x7f50e800f790 comp rx=0 tx=0).stop 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f185b640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50d80b6900 0x7f50d80b8e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50e400ad20 tx=0x7f50e400a330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 -- 172.21.15.37:0/2390056800 shutdown_connections 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51db1b0 0x5584f55abbe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 --2- 172.21.15.37:0/2390056800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.557+0000 7f50f9832740 1 -- 172.21.15.37:0/2390056800 >> 172.21.15.37:0/2390056800 conn(0x5584f51f8460 msgr2=0x5584f55a9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.558+0000 7f50f9832740 1 -- 172.21.15.37:0/2390056800 shutdown_connections 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.558+0000 7f50f9832740 1 -- 172.21.15.37:0/2390056800 wait complete. 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.558+0000 7f50f9832740 1 -- start start 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.558+0000 7f50f9832740 1 Processor -- start 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.560+0000 7f50f9832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51e3390 0x5584f55b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.560+0000 7f50f9832740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.560+0000 7f50f9832740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.560+0000 7f50f9832740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584f5372700 con 0x5584f51c29f0 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.561+0000 7f50f9832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5584f54ac160 con 0x5584f51e3390 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.561+0000 7f50f9832740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5584f55b9e80 con 0x5584f5204070 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.561+0000 7f50f9832740 10 client.0 _ll_register_callbacks cb 0x5584f54c59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.562+0000 7f50f105a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51e3390 0x5584f55b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.562+0000 7f50f105a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51e3390 0x5584f55b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43010/0 (socket says 172.21.15.37:43010) 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.562+0000 7f50f105a640 1 -- 172.21.15.37:0/490051897 learned_addr learned my addr 172.21.15.37:0/490051897 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.562+0000 7f50f185b640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.562+0000 7f50f0859640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.563+0000 7f50f185b640 1 -- 172.21.15.37:0/490051897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 msgr2=0x5584f55b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.563+0000 7f50f185b640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.563+0000 7f50f185b640 1 -- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51e3390 msgr2=0x5584f55b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.563+0000 7f50f185b640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51e3390 0x5584f55b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.563+0000 7f50f185b640 1 -- 172.21.15.37:0/490051897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f54d9c90 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.564+0000 7f50f185b640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55c3200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f50e4005c40 tx=0x7f50e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef13a68ba9eb4e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.564+0000 7f50d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.577+0000 7f50d4ff9640 1 -- 172.21.15.37:0/490051897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4021070 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.577+0000 7f50d4ff9640 1 -- 172.21.15.37:0/490051897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f50e400ad50 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.577+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e80043c0 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.580+0000 7f50d4ff9640 1 -- 172.21.15.37:0/490051897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f50e402a050 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.580+0000 7f50f9832740 10 client.16275 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.580+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5584f55c5de0 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.581+0000 7f50d4ff9640 1 -- 172.21.15.37:0/490051897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e4003e20 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50d4ff9640 1 -- 172.21.15.37:0/490051897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f50e401d450 con 0x5584f51c29f0 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50f9832740 10 client.16275 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50f9832740 10 client.16275 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50f9832740 20 client.16275 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50f9832740 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5197da0 0x5584f55c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50f9832740 4 client.16275 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.582+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f50e80043c0 con 0x5584f5197da0 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.586+0000 7f50f105a640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5197da0 0x5584f55c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.599+0000 7f50f105a640 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5197da0 0x5584f55c97f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1cb645469223baa1 server_cookie=ae7aa4eb31db307 in_seq=0 out_seq=0 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.599+0000 7f50d4ff9640 10 client.16275 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.600+0000 7f50d4ff9640 1 -- 172.21.15.37:0/490051897 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f50e80043c0 con 0x5584f5197da0 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.600+0000 7f50d4ff9640 10 client.16275 handle_command_reply: tid=0 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.600+0000 7f50f9832740 1 client.16275 shutdown 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.602+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 msgr2=0x5584f55c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.602+0000 7f50f9832740 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55c3200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f50e4005c40 tx=0x7f50e4004ab0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.602+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 shutdown_connections 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.602+0000 7f50f9832740 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5197da0 0x5584f55c97f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.603+0000 7f50f9832740 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55c3200 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.603+0000 7f50f9832740 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f5204070 0x5584f55b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.603+0000 7f50f9832740 1 --2- 172.21.15.37:0/490051897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f51e3390 0x5584f55b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.603+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 >> 172.21.15.37:0/490051897 conn(0x5584f51f8460 msgr2=0x5584f55ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.603+0000 7f50d4ff9640 0 client.16275 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.614+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 shutdown_connections 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.614+0000 7f50f9832740 1 -- 172.21.15.37:0/490051897 wait complete. 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.616+0000 7f50f9832740 20 client.16275 trim_cache size 0 max 16384 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.661+0000 7f50f9832740 1 Processor -- start 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 -- start start 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51c29f0 0x5584f55b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55c3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50d000e420 con 0x5584f51e3390 2024-09-21T01:20:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50d000ff60 con 0x5584f5204070 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.662+0000 7f50f9832740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50d000eaf0 con 0x5584f51c29f0 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.664+0000 7f50f105a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51c29f0 0x5584f55b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.664+0000 7f50f0859640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.664+0000 7f50f185b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.664+0000 7f50f0859640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53642/0 (socket says 172.21.15.37:53642) 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.664+0000 7f50f0859640 1 -- 172.21.15.37:0/1652202883 learned_addr learned my addr 172.21.15.37:0/1652202883 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.670+0000 7f50f0859640 1 -- 172.21.15.37:0/1652202883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51c29f0 msgr2=0x5584f55b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.670+0000 7f50f0859640 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51c29f0 0x5584f55b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.670+0000 7f50f0859640 1 -- 172.21.15.37:0/1652202883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 msgr2=0x5584f55c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.670+0000 7f50f0859640 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.670+0000 7f50f0859640 1 -- 172.21.15.37:0/1652202883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f55ad990 con 0x5584f51e3390 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.674+0000 7f50f0859640 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55c3100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f50dc02a960 tx=0x7f50dc0c97d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809e223f193e72af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.677+0000 7f50d6ffd640 1 -- 172.21.15.37:0/1652202883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc03f040 con 0x5584f51e3390 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.677+0000 7f50d6ffd640 1 -- 172.21.15.37:0/1652202883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50dc0ccba0 con 0x5584f51e3390 2024-09-21T01:20:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.677+0000 7f50d6ffd640 1 -- 172.21.15.37:0/1652202883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0c89e0 con 0x5584f51e3390 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.680+0000 7f50f9832740 1 -- 172.21.15.37:0/1652202883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 msgr2=0x5584f55c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.680+0000 7f50f9832740 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55c3100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f50dc02a960 tx=0x7f50dc0c97d0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.681+0000 7f50f9832740 1 -- 172.21.15.37:0/1652202883 shutdown_connections 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.681+0000 7f50f9832740 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.681+0000 7f50f9832740 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51e3390 0x5584f55c3100 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.681+0000 7f50f9832740 1 --2- 172.21.15.37:0/1652202883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51c29f0 0x5584f55b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.681+0000 7f50f9832740 1 -- 172.21.15.37:0/1652202883 >> 172.21.15.37:0/1652202883 conn(0x5584f51f8460 msgr2=0x5584f55b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.686+0000 7f50f9832740 1 -- 172.21.15.37:0/1652202883 shutdown_connections 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.686+0000 7f50f9832740 1 -- 172.21.15.37:0/1652202883 wait complete. 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.687+0000 7f50f9832740 1 -- start start 2024-09-21T01:20:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.687+0000 7f50f9832740 1 Processor -- start 2024-09-21T01:20:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.688+0000 7f50f9832740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55bb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.693+0000 7f50f9832740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51e3390 0x5584f55bb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.694+0000 7f50f9832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.694+0000 7f50f9832740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50d000f890 con 0x5584f51c29f0 2024-09-21T01:20:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.694+0000 7f50f9832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50d000f1c0 con 0x5584f5204070 2024-09-21T01:20:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.694+0000 7f50f9832740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50d000c4b0 con 0x5584f51e3390 2024-09-21T01:20:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.699+0000 7f50f9832740 10 client.0 _ll_register_callbacks cb 0x7f50e4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.696+0000 7f50f185b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.700+0000 7f50f185b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55bbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43024/0 (socket says 172.21.15.37:43024) 2024-09-21T01:20:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.700+0000 7f50f185b640 1 -- 172.21.15.37:0/3020860855 learned_addr learned my addr 172.21.15.37:0/3020860855 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.696+0000 7f50f0859640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51e3390 0x5584f55bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.709+0000 7f50f105a640 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.710+0000 7f50f185b640 1 -- 172.21.15.37:0/3020860855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51e3390 msgr2=0x5584f55bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.710+0000 7f50f185b640 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51e3390 0x5584f55bb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.711+0000 7f50f185b640 1 -- 172.21.15.37:0/3020860855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 msgr2=0x5584f55bb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.711+0000 7f50f185b640 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55bb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.711+0000 7f50f185b640 1 -- 172.21.15.37:0/3020860855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f5644300 con 0x5584f5204070 2024-09-21T01:20:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.717+0000 7f50f185b640 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55bbcb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f50e400afe0 tx=0x7f50e4010a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af0b5433657b65d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.718+0000 7f50d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:20:28.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.720+0000 7f50d4ff9640 1 -- 172.21.15.37:0/3020860855 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e403e060 con 0x5584f5204070 2024-09-21T01:20:28.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.720+0000 7f50d4ff9640 1 -- 172.21.15.37:0/3020860855 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f50e4003b70 con 0x5584f5204070 2024-09-21T01:20:28.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.722+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50dc0ccba0 con 0x5584f5204070 2024-09-21T01:20:28.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.723+0000 7f50d4ff9640 1 -- 172.21.15.37:0/3020860855 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f50e4021040 con 0x5584f5204070 2024-09-21T01:20:28.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.723+0000 7f50f9832740 10 client.25766 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:28.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.724+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5584f5645580 con 0x5584f5204070 2024-09-21T01:20:28.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.725+0000 7f50d4ff9640 1 -- 172.21.15.37:0/3020860855 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50dc0ccba0 con 0x5584f5204070 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.726+0000 7f50d4ff9640 1 -- 172.21.15.37:0/3020860855 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f50e4039480 con 0x5584f5204070 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.726+0000 7f50f9832740 10 client.25766 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.726+0000 7f50f9832740 10 client.25766 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.726+0000 7f50f9832740 20 client.25766 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.726+0000 7f50f9832740 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5645c50 0x5584f5648070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.727+0000 7f50f9832740 4 client.25766 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:20:28.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.727+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584f5523df0 con 0x5584f5645c50 2024-09-21T01:20:28.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.728+0000 7f50f105a640 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5645c50 0x5584f5648070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:28.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.732+0000 7f50f105a640 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5645c50 0x5584f5648070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9cf767b7f9998fbd server_cookie=4b82d69f47a6bb03 in_seq=0 out_seq=0 2024-09-21T01:20:28.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.732+0000 7f50d4ff9640 10 client.25766 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:20:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.733+0000 7f50d4ff9640 1 -- 172.21.15.37:0/3020860855 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584f5523df0 con 0x5584f5645c50 2024-09-21T01:20:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.733+0000 7f50d4ff9640 10 client.25766 handle_command_reply: tid=0 2024-09-21T01:20:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.733+0000 7f50f9832740 1 client.25766 shutdown 2024-09-21T01:20:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.734+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 msgr2=0x5584f55bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.734+0000 7f50f9832740 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55bbcb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f50e400afe0 tx=0x7f50e4010a90 comp rx=0 tx=0).stop 2024-09-21T01:20:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.735+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 shutdown_connections 2024-09-21T01:20:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.735+0000 7f50f9832740 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5584f5645c50 0x5584f5648070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50f9832740 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5584f5204070 0x5584f55bbcb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50f9832740 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f51e3390 0x5584f55bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50f9832740 1 --2- 172.21.15.37:0/3020860855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584f51c29f0 0x5584f55bb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 >> 172.21.15.37:0/3020860855 conn(0x5584f51f8460 msgr2=0x5584f55b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50d4ff9640 0 client.25766 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:20:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 shutdown_connections 2024-09-21T01:20:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.736+0000 7f50f9832740 1 -- 172.21.15.37:0/3020860855 wait complete. 2024-09-21T01:20:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.739+0000 7f50f9832740 20 client.25766 trim_cache size 0 max 16384 2024-09-21T01:20:28.745 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50d80b6900 msgr2=0x7f50d80b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50d80b6900 0x7f50d80b8e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50e400ad20 tx=0x7f50e400a330 comp rx=0 tx=0).stop 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 msgr2=0x7f50ec1a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec1a1080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f50dc000c00 tx=0x7f50dc032d00 comp rx=0 tx=0).stop 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 shutdown_connections 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50d80b6900 0x7f50d80b8e10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.747+0000 7f50f32be640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50ec107be0 0x7f50ec1a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.748+0000 7f50f32be640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec1030f0 0x7f50ec1a1080 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.748+0000 7f50f32be640 1 --2- 172.21.15.37:0/2444759144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50ec1027a0 0x7f50ec1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.748+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 >> 172.21.15.37:0/2444759144 conn(0x7f50ec079730 msgr2=0x7f50ec1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.748+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 shutdown_connections 2024-09-21T01:20:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:28.748+0000 7f50f32be640 1 -- 172.21.15.37:0/2444759144 wait complete. 2024-09-21T01:20:28.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:28 smithi137 ceph-mon[34607]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 797 MiB/s wr, 1.80k op/s 2024-09-21T01:20:28.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:28 smithi144 ceph-mon[34818]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 797 MiB/s wr, 1.80k op/s 2024-09-21T01:20:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.557+0000 7f831b59e640 1 -- 172.21.15.37:0/2301922931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10f830 msgr2=0x7f831c10fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.557+0000 7f831b59e640 1 --2- 172.21.15.37:0/2301922931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10f830 0x7f831c10fd10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8310009900 tx=0x7f831002a420 comp rx=0 tx=0).stop 2024-09-21T01:20:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.568+0000 7f831b59e640 1 -- 172.21.15.37:0/2301922931 shutdown_connections 2024-09-21T01:20:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.568+0000 7f831b59e640 1 --2- 172.21.15.37:0/2301922931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10f830 0x7f831c10fd10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.568+0000 7f831b59e640 1 --2- 172.21.15.37:0/2301922931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f831c10cd20 0x7f831c10f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.568+0000 7f831b59e640 1 --2- 172.21.15.37:0/2301922931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c10a3c0 0x7f831c10c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.568+0000 7f831b59e640 1 -- 172.21.15.37:0/2301922931 >> 172.21.15.37:0/2301922931 conn(0x7f831c070640 msgr2=0x7f831c072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:30.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.571+0000 7f831b59e640 1 -- 172.21.15.37:0/2301922931 shutdown_connections 2024-09-21T01:20:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.573+0000 7f831b59e640 1 -- 172.21.15.37:0/2301922931 wait complete. 2024-09-21T01:20:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.575+0000 7f831b59e640 1 Processor -- start 2024-09-21T01:20:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.575+0000 7f831b59e640 1 -- start start 2024-09-21T01:20:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.576+0000 7f831b59e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f831c10a3c0 0x7f831c1a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.576+0000 7f831b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 0x7f831c1a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.576+0000 7f831b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c10f830 0x7f831c1a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.576+0000 7f831b59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f831c11dfd0 con 0x7f831c10f830 2024-09-21T01:20:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.576+0000 7f831b59e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f831c11de50 con 0x7f831c10cd20 2024-09-21T01:20:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.576+0000 7f831b59e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f831c11e150 con 0x7f831c10a3c0 2024-09-21T01:20:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.577+0000 7f8319d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 0x7f831c1a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.577+0000 7f8319d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 0x7f831c1a8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43040/0 (socket says 172.21.15.37:43040) 2024-09-21T01:20:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.577+0000 7f8319d9b640 1 -- 172.21.15.37:0/1314926597 learned_addr learned my addr 172.21.15.37:0/1314926597 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.577+0000 7f831ad9d640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c10f830 0x7f831c1a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.578+0000 7f8319d9b640 1 -- 172.21.15.37:0/1314926597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f831c10a3c0 msgr2=0x7f831c1a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.578+0000 7f8319d9b640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f831c10a3c0 0x7f831c1a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.578+0000 7f8319d9b640 1 -- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c10f830 msgr2=0x7f831c1a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.578+0000 7f8319d9b640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c10f830 0x7f831c1a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.578+0000 7f8319d9b640 1 -- 172.21.15.37:0/1314926597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c1aa3a0 con 0x7f831c10cd20 2024-09-21T01:20:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.580+0000 7f8319d9b640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 0x7f831c1a8fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f830c00c890 tx=0x7f830c00cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.581+0000 7f830b7fe640 1 -- 172.21.15.37:0/1314926597 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c004220 con 0x7f831c10cd20 2024-09-21T01:20:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.582+0000 7f830b7fe640 1 -- 172.21.15.37:0/1314926597 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f830c0043c0 con 0x7f831c10cd20 2024-09-21T01:20:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.582+0000 7f830b7fe640 1 -- 172.21.15.37:0/1314926597 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c004a00 con 0x7f831c10cd20 2024-09-21T01:20:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.584+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c1aa690 con 0x7f831c10cd20 2024-09-21T01:20:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.584+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c1b0d80 con 0x7f831c10cd20 2024-09-21T01:20:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.593+0000 7f830b7fe640 1 -- 172.21.15.37:0/1314926597 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f830c0050b0 con 0x7f831c10cd20 2024-09-21T01:20:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.596+0000 7f8327bd8740 1 Processor -- start 2024-09-21T01:20:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.597+0000 7f8327bd8740 1 -- start start 2024-09-21T01:20:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.598+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6643040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.598+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa62722f0 0x562aa66436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.598+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6644200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.599+0000 7f8327bd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562aa65b56f0 con 0x562aa627a4d0 2024-09-21T01:20:30.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.599+0000 7f8319d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6644200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.599+0000 7f8319d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6644200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53690/0 (socket says 172.21.15.37:53690) 2024-09-21T01:20:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.599+0000 7f8319d9b640 1 -- 172.21.15.37:0/568777356 learned_addr learned my addr 172.21.15.37:0/568777356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.599+0000 7f831a59c640 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa62722f0 0x562aa66436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.599+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562aa65a4b20 con 0x562aa62722f0 2024-09-21T01:20:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.600+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562aa65a8930 con 0x562aa629b1b0 2024-09-21T01:20:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.600+0000 7f831ad9d640 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6643040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.601+0000 7f831a59c640 1 -- 172.21.15.37:0/568777356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 msgr2=0x562aa6643040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.601+0000 7f831a59c640 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6643040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.601+0000 7f831a59c640 1 -- 172.21.15.37:0/568777356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 msgr2=0x562aa6644200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.601+0000 7f831a59c640 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6644200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.601+0000 7f831a59c640 1 -- 172.21.15.37:0/568777356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa656a530 con 0x562aa62722f0 2024-09-21T01:20:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.602+0000 7f831a59c640 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa62722f0 0x562aa66436b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d40 tx=0x7f831400b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b512a4d6e397c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.603+0000 7f830b7fe640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f83040b6590 0x7f83040b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.604+0000 7f830b7fe640 1 -- 172.21.15.37:0/1314926597 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f830c0e7340 con 0x7f831c10cd20 2024-09-21T01:20:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.604+0000 7f831ad9d640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f83040b6590 0x7f83040b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.605+0000 7f831ad9d640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f83040b6590 0x7f83040b8aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8310009850 tx=0x7f8310009580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:30.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.609+0000 7f8308ff9640 1 -- 172.21.15.37:0/568777356 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314018070 con 0x562aa62722f0 2024-09-21T01:20:30.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.609+0000 7f8308ff9640 1 -- 172.21.15.37:0/568777356 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83140119d0 con 0x562aa62722f0 2024-09-21T01:20:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.610+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa62722f0 msgr2=0x562aa66436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.611+0000 7f8327bd8740 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa62722f0 0x562aa66436b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d40 tx=0x7f831400b7e0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.611+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 shutdown_connections 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.611+0000 7f8327bd8740 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6644200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.611+0000 7f8327bd8740 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa62722f0 0x562aa66436b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.611+0000 7f8327bd8740 1 --2- 172.21.15.37:0/568777356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6643040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.611+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 >> 172.21.15.37:0/568777356 conn(0x562aa628f300 msgr2=0x562aa663ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.612+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 shutdown_connections 2024-09-21T01:20:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.612+0000 7f8327bd8740 1 -- 172.21.15.37:0/568777356 wait complete. 2024-09-21T01:20:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.613+0000 7f8327bd8740 1 -- start start 2024-09-21T01:20:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.613+0000 7f8327bd8740 1 Processor -- start 2024-09-21T01:20:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.615+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 0x562aa664c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.615+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa664ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.615+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa664d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f8327bd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562aa64dcab0 con 0x562aa6259d80 2024-09-21T01:20:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f8327bd8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562aa654a730 con 0x562aa629b1b0 2024-09-21T01:20:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f8327bd8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562aa6644dc0 con 0x562aa627a4d0 2024-09-21T01:20:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f8327bd8740 10 client.0 _ll_register_callbacks cb 0x562aa659e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f831a59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 0x562aa664c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f831a59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 0x562aa664c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:57030/0 (socket says 172.21.15.37:57030) 2024-09-21T01:20:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.616+0000 7f831a59c640 1 -- 172.21.15.37:0/2553974542 learned_addr learned my addr 172.21.15.37:0/2553974542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.619+0000 7f8319d9b640 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa664ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.620+0000 7f831a59c640 1 -- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 msgr2=0x562aa664ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.620+0000 7f831a59c640 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa664ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.620+0000 7f831a59c640 1 -- 172.21.15.37:0/2553974542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 msgr2=0x562aa664d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.620+0000 7f831a59c640 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa664d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.620+0000 7f831a59c640 1 -- 172.21.15.37:0/2553974542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa6306790 con 0x562aa627a4d0 2024-09-21T01:20:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.625+0000 7f831a59c640 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 0x562aa664c630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8314016040 tx=0x7f8314013e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6c555a6afe2b47a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.626+0000 7f8301ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:20:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.626+0000 7f8301ffb640 1 -- 172.21.15.37:0/2553974542 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314018040 con 0x562aa627a4d0 2024-09-21T01:20:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.626+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562aa65b7640 con 0x562aa627a4d0 2024-09-21T01:20:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.627+0000 7f8301ffb640 1 -- 172.21.15.37:0/2553974542 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8314011520 con 0x562aa627a4d0 2024-09-21T01:20:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.627+0000 7f8301ffb640 1 -- 172.21.15.37:0/2553974542 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8314011720 con 0x562aa627a4d0 2024-09-21T01:20:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.628+0000 7f8327bd8740 10 client.25711 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.628+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562aa637f620 con 0x562aa627a4d0 2024-09-21T01:20:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.630+0000 7f8301ffb640 1 -- 172.21.15.37:0/2553974542 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562aa65b7640 con 0x562aa627a4d0 2024-09-21T01:20:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.632+0000 7f8301ffb640 1 -- 172.21.15.37:0/2553974542 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f831401e9d0 con 0x562aa627a4d0 2024-09-21T01:20:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.633+0000 7f8327bd8740 10 client.25711 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.633+0000 7f8327bd8740 10 client.25711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:30.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.633+0000 7f8327bd8740 20 client.25711 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:30.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.633+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa622f1c0 0x562aa6659be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.633+0000 7f8327bd8740 4 client.25711 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:30.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.633+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aa65b30f0 con 0x562aa622f1c0 2024-09-21T01:20:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.636+0000 7f8319d9b640 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa622f1c0 0x562aa6659be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.645+0000 7f8319d9b640 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa622f1c0 0x562aa6659be0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de36f103d93a2b95 server_cookie=d8d4692bdf3b599f in_seq=0 out_seq=0 2024-09-21T01:20:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.645+0000 7f8301ffb640 10 client.25711 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:30.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.650+0000 7f8301ffb640 1 -- 172.21.15.37:0/2553974542 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562aa65b30f0 con 0x562aa622f1c0 2024-09-21T01:20:30.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.650+0000 7f8301ffb640 10 client.25711 handle_command_reply: tid=0 2024-09-21T01:20:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.650+0000 7f8327bd8740 1 client.25711 shutdown 2024-09-21T01:20:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 msgr2=0x562aa664c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 0x562aa664c630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8314016040 tx=0x7f8314013e40 comp rx=0 tx=0).stop 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 shutdown_connections 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa622f1c0 0x562aa6659be0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa664d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa664ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2553974542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa627a4d0 0x562aa664c630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 >> 172.21.15.37:0/2553974542 conn(0x562aa628f300 msgr2=0x562aa663d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8301ffb640 0 client.25711 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.651+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 shutdown_connections 2024-09-21T01:20:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.652+0000 7f8327bd8740 1 -- 172.21.15.37:0/2553974542 wait complete. 2024-09-21T01:20:30.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.652+0000 7f8327bd8740 20 client.25711 trim_cache size 0 max 16384 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.684+0000 7f8327bd8740 1 Processor -- start 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.684+0000 7f8327bd8740 1 -- start start 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa6647910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa627a4d0 0x562aa66483d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6648910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8327bd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1b9be0 con 0x562aa6259d80 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8327bd8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1bb720 con 0x562aa627a4d0 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8327bd8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1ba2b0 con 0x562aa629b1b0 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f831a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa6647910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f831a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa6647910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53698/0 (socket says 172.21.15.37:53698) 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f831a59c640 1 -- 172.21.15.37:0/2514363168 learned_addr learned my addr 172.21.15.37:0/2514363168 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f831ad9d640 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6648910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.685+0000 7f8319d9b640 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa627a4d0 0x562aa66483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f831a59c640 1 -- 172.21.15.37:0/2514363168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 msgr2=0x562aa6648910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f831a59c640 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6648910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f831a59c640 1 -- 172.21.15.37:0/2514363168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa627a4d0 msgr2=0x562aa66483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f831a59c640 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa627a4d0 0x562aa66483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f831a59c640 1 -- 172.21.15.37:0/2514363168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa6272530 con 0x562aa6259d80 2024-09-21T01:20:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f831a59c640 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa6647910 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8314009690 tx=0x7f8314009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aeeccbefbe398f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.686+0000 7f8303fff640 1 -- 172.21.15.37:0/2514363168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314037070 con 0x562aa6259d80 2024-09-21T01:20:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.687+0000 7f8303fff640 1 -- 172.21.15.37:0/2514363168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8314023070 con 0x562aa6259d80 2024-09-21T01:20:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.687+0000 7f8303fff640 1 -- 172.21.15.37:0/2514363168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314018040 con 0x562aa6259d80 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.687+0000 7f8327bd8740 1 -- 172.21.15.37:0/2514363168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 msgr2=0x562aa6647910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.687+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa6647910 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8314009690 tx=0x7f8314009fc0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 -- 172.21.15.37:0/2514363168 shutdown_connections 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa629b1b0 0x562aa6648910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa627a4d0 0x562aa66483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 --2- 172.21.15.37:0/2514363168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa6259d80 0x562aa6647910 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 -- 172.21.15.37:0/2514363168 >> 172.21.15.37:0/2514363168 conn(0x562aa628f300 msgr2=0x562aa664c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 -- 172.21.15.37:0/2514363168 shutdown_connections 2024-09-21T01:20:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.688+0000 7f8327bd8740 1 -- 172.21.15.37:0/2514363168 wait complete. 2024-09-21T01:20:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 -- start start 2024-09-21T01:20:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 Processor -- start 2024-09-21T01:20:30.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa6259d80 0x562aa6654390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6652c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa66531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1bb050 con 0x562aa627a4d0 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1ba980 con 0x562aa629b1b0 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.689+0000 7f8327bd8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1b7c70 con 0x562aa6259d80 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6652c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6652c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53714/0 (socket says 172.21.15.37:53714) 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 -- 172.21.15.37:0/3867049943 learned_addr learned my addr 172.21.15.37:0/3867049943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8327bd8740 10 client.0 _ll_register_callbacks cb 0x7f831400bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:30.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f831a59c640 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa6259d80 0x562aa6654390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 -- 172.21.15.37:0/3867049943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa6259d80 msgr2=0x562aa6654390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa6259d80 0x562aa6654390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 -- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 msgr2=0x562aa66531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa66531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.690+0000 7f8319d9b640 1 -- 172.21.15.37:0/3867049943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa6653930 con 0x562aa627a4d0 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.691+0000 7f8319d9b640 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6652c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f830c0ad460 tx=0x7f830c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70be420ff2f9d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:30.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.691+0000 7f8301ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.691+0000 7f8301ffb640 1 -- 172.21.15.37:0/3867049943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c0adbd0 con 0x562aa627a4d0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.691+0000 7f8301ffb640 1 -- 172.21.15.37:0/3867049943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f830c0ac730 con 0x562aa627a4d0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.691+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8314023070 con 0x562aa627a4d0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8301ffb640 1 -- 172.21.15.37:0/3867049943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f830c0b1fb0 con 0x562aa627a4d0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8327bd8740 10 client.16293 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562aa66c35d0 con 0x562aa627a4d0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8301ffb640 1 -- 172.21.15.37:0/3867049943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8314023070 con 0x562aa627a4d0 2024-09-21T01:20:30.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8301ffb640 1 -- 172.21.15.37:0/3867049943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f830c0a8f30 con 0x562aa627a4d0 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8327bd8740 10 client.16293 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8327bd8740 10 client.16293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.692+0000 7f8327bd8740 20 client.16293 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.693+0000 7f8327bd8740 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa66c3f40 0x562aa66c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.693+0000 7f8327bd8740 4 client.16293 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.693+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562aa65b0520 con 0x562aa66c3f40 2024-09-21T01:20:30.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.694+0000 7f831a59c640 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa66c3f40 0x562aa66c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.697+0000 7f831a59c640 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa66c3f40 0x562aa66c63c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7670563fb8d2858 server_cookie=b89789e4e760d5bb in_seq=0 out_seq=0 2024-09-21T01:20:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:30.697+0000 7f8301ffb640 10 client.16293 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:30.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:30 smithi144 ceph-mon[34818]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 932 MiB/s wr, 1.98k op/s 2024-09-21T01:20:30.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:30 smithi137 ceph-mon[34607]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 932 MiB/s wr, 1.98k op/s 2024-09-21T01:20:31.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:30 smithi037 ceph-mon[31105]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 932 MiB/s wr, 1.98k op/s 2024-09-21T01:20:31.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:32.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:32 smithi137 ceph-mon[34607]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 863 MiB/s wr, 1.71k op/s 2024-09-21T01:20:32.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:32 smithi144 ceph-mon[34818]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 863 MiB/s wr, 1.71k op/s 2024-09-21T01:20:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:32 smithi037 ceph-mon[31105]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 863 MiB/s wr, 1.71k op/s 2024-09-21T01:20:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.183+0000 7f9db2ffd640 1 -- 172.21.15.37:0/3046000616 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80308b0 con 0x7f9db410f6c0 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.183+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3046000616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410f6c0 msgr2=0x7f9db410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.183+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3046000616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410f6c0 0x7f9db410a3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009860 tx=0x7f9da802a380 comp rx=0 tx=0).stop 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3046000616 shutdown_connections 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3046000616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db410a900 0x7f9db410ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3046000616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410f6c0 0x7f9db410a3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3046000616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db410f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3046000616 >> 172.21.15.37:0/3046000616 conn(0x7f9db40712f0 msgr2=0x7f9db4073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3046000616 shutdown_connections 2024-09-21T01:20:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.185+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3046000616 wait complete. 2024-09-21T01:20:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.186+0000 7f9dba6ff640 1 Processor -- start 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.188+0000 7f9dba6ff640 1 -- start start 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.189+0000 7f9dba6ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db411b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.189+0000 7f9dba6ff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410a900 0x7f9db411bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.189+0000 7f9dba6ff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db410f6c0 0x7f9db411c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.189+0000 7f9dba6ff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9db4116140 con 0x7f9db406af90 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.189+0000 7f9dba6ff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9db4115fc0 con 0x7f9db410f6c0 2024-09-21T01:20:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.189+0000 7f9dba6ff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9db411e6f0 con 0x7f9db410a900 2024-09-21T01:20:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.190+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db411b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.190+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db411b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53740/0 (socket says 172.21.15.37:53740) 2024-09-21T01:20:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.190+0000 7f9db3fff640 1 -- 172.21.15.37:0/3274633069 learned_addr learned my addr 172.21.15.37:0/3274633069 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.192+0000 7f9db37fe640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410a900 0x7f9db411bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.193+0000 7f9db3fff640 1 -- 172.21.15.37:0/3274633069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410a900 msgr2=0x7f9db411bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.193+0000 7f9db3fff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410a900 0x7f9db411bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.193+0000 7f9db3fff640 1 -- 172.21.15.37:0/3274633069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db410f6c0 msgr2=0x7f9db411c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.193+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db410f6c0 0x7f9db411c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.193+0000 7f9db3fff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db410f6c0 0x7f9db411c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.193+0000 7f9db3fff640 1 -- 172.21.15.37:0/3274633069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db41b5410 con 0x7f9db406af90 2024-09-21T01:20:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.194+0000 7f9db3fff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db411b620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9da400d950 tx=0x7f9da400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.194+0000 7f9db17fa640 1 -- 172.21.15.37:0/3274633069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4017070 con 0x7f9db406af90 2024-09-21T01:20:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.195+0000 7f9db17fa640 1 -- 172.21.15.37:0/3274633069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da4009c30 con 0x7f9db406af90 2024-09-21T01:20:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.195+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db41b5700 con 0x7f9db406af90 2024-09-21T01:20:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.195+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db41b5c10 con 0x7f9db406af90 2024-09-21T01:20:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.195+0000 7f9db17fa640 1 -- 172.21.15.37:0/3274633069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da400f620 con 0x7f9db406af90 2024-09-21T01:20:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.199+0000 7f9dc0c73740 1 Processor -- start 2024-09-21T01:20:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.199+0000 7f9dc0c73740 1 -- start start 2024-09-21T01:20:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.201+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.201+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e08be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a40390 0x556962e09120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556962d7eea0 con 0x556962a61070 2024-09-21T01:20:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556962d6e2d0 con 0x556962a381b0 2024-09-21T01:20:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556962d720e0 con 0x556962a40390 2024-09-21T01:20:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9db8c9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9db8c9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53748/0 (socket says 172.21.15.37:53748) 2024-09-21T01:20:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.202+0000 7f9db8c9c640 1 -- 172.21.15.37:0/921311612 learned_addr learned my addr 172.21.15.37:0/921311612 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:34.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.203+0000 7f9db37fe640 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a40390 0x556962e09120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.204+0000 7f9db3fff640 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e08be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.204+0000 7f9db37fe640 1 -- 172.21.15.37:0/921311612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 msgr2=0x556962e08be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.204+0000 7f9db37fe640 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e08be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.204+0000 7f9db37fe640 1 -- 172.21.15.37:0/921311612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 msgr2=0x556962e086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.204+0000 7f9db37fe640 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.204+0000 7f9db37fe640 1 -- 172.21.15.37:0/921311612 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556962acc650 con 0x556962a40390 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.205+0000 7f9db17fa640 1 -- 172.21.15.37:0/3274633069 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9da400f7c0 con 0x7f9db406af90 2024-09-21T01:20:34.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.205+0000 7f9db37fe640 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a40390 0x556962e09120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9da802a8a0 tx=0x7f9da80094c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a50d68d31286fc7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.207+0000 7f9db17fa640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d9c0b66e0 0x7f9d9c0b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.207+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/921311612 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8042020 con 0x556962a40390 2024-09-21T01:20:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.207+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/921311612 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da8038040 con 0x556962a40390 2024-09-21T01:20:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.208+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d9c0b66e0 0x7f9d9c0b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.208+0000 7f9db17fa640 1 -- 172.21.15.37:0/3274633069 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9da40e6cd0 con 0x7f9db406af90 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 -- 172.21.15.37:0/921311612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a40390 msgr2=0x556962e09120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a40390 0x556962e09120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9da802a8a0 tx=0x7f9da80094c0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 -- 172.21.15.37:0/921311612 shutdown_connections 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a40390 0x556962e09120 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9da802a8a0 tx=0x7f9da80094c0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e08be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/921311612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.209+0000 7f9dc0c73740 1 -- 172.21.15.37:0/921311612 >> 172.21.15.37:0/921311612 conn(0x556962a55460 msgr2=0x556962e06590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.210+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d9c0b66e0 0x7f9d9c0b8bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9dac007e60 tx=0x7f9dac007650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.211+0000 7f9dc0c73740 1 -- 172.21.15.37:0/921311612 shutdown_connections 2024-09-21T01:20:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.211+0000 7f9dc0c73740 1 -- 172.21.15.37:0/921311612 wait complete. 2024-09-21T01:20:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.212+0000 7f9dc0c73740 1 -- start start 2024-09-21T01:20:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.213+0000 7f9dc0c73740 1 Processor -- start 2024-09-21T01:20:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.214+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 0x556962e13d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a61070 0x556962e14250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a1f9f0 0x556962e147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556962bcf700 con 0x556962a381b0 2024-09-21T01:20:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556962d09160 con 0x556962a61070 2024-09-21T01:20:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556962e16e70 con 0x556962a1f9f0 2024-09-21T01:20:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 0x556962e13d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 0x556962e13d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53756/0 (socket says 172.21.15.37:53756) 2024-09-21T01:20:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.215+0000 7f9db3fff640 1 -- 172.21.15.37:0/1394272726 learned_addr learned my addr 172.21.15.37:0/1394272726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:34.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.216+0000 7f9db37fe640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a61070 0x556962e14250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.216+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a1f9f0 0x556962e147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.216+0000 7f9dc0c73740 10 client.0 _ll_register_callbacks cb 0x556962d229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.217+0000 7f9db3fff640 1 -- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a1f9f0 msgr2=0x556962e147b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.217+0000 7f9db3fff640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a1f9f0 0x556962e147b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.217+0000 7f9db3fff640 1 -- 172.21.15.37:0/1394272726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a61070 msgr2=0x556962e14250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.217+0000 7f9db3fff640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a61070 0x556962e14250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.217+0000 7f9db3fff640 1 -- 172.21.15.37:0/1394272726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556962d36c90 con 0x556962a381b0 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.217+0000 7f9db3fff640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 0x556962e13d10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9da40e4730 tx=0x7f9da40a8db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f0a0a7c5c78064 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.218+0000 7f9d937fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.218+0000 7f9d937fe640 1 -- 172.21.15.37:0/1394272726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4020070 con 0x556962a381b0 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.218+0000 7f9d937fe640 1 -- 172.21.15.37:0/1394272726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9da40a8980 con 0x556962a381b0 2024-09-21T01:20:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.218+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da8038040 con 0x556962a381b0 2024-09-21T01:20:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.218+0000 7f9d937fe640 1 -- 172.21.15.37:0/1394272726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9da40ac590 con 0x556962a381b0 2024-09-21T01:20:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.218+0000 7f9dc0c73740 10 client.16305 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.219+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556962e22bd0 con 0x556962a381b0 2024-09-21T01:20:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.219+0000 7f9d937fe640 1 -- 172.21.15.37:0/1394272726 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da8038040 con 0x556962a381b0 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.219+0000 7f9d937fe640 1 -- 172.21.15.37:0/1394272726 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9da40ec070 con 0x556962a381b0 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.220+0000 7f9dc0c73740 10 client.16305 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.220+0000 7f9dc0c73740 10 client.16305 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.220+0000 7f9dc0c73740 20 client.16305 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.220+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5569629f4da0 0x556962e261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.220+0000 7f9dc0c73740 4 client.16305 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.220+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556962d80df0 con 0x5569629f4da0 2024-09-21T01:20:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.221+0000 7f9db37fe640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5569629f4da0 0x556962e261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.223+0000 7f9db37fe640 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5569629f4da0 0x556962e261e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=faeec39d3721f78f server_cookie=2fa03dd7c3f81c97 in_seq=0 out_seq=0 2024-09-21T01:20:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.224+0000 7f9d937fe640 10 client.16305 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:20:34.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.225+0000 7f9d937fe640 1 -- 172.21.15.37:0/1394272726 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556962d80df0 con 0x5569629f4da0 2024-09-21T01:20:34.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.225+0000 7f9d937fe640 10 client.16305 handle_command_reply: tid=0 2024-09-21T01:20:34.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.225+0000 7f9dc0c73740 1 client.16305 shutdown 2024-09-21T01:20:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.226+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 msgr2=0x556962e13d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.226+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 0x556962e13d10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9da40e4730 tx=0x7f9da40a8db0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 shutdown_connections 2024-09-21T01:20:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5569629f4da0 0x556962e261e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a1f9f0 0x556962e147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a61070 0x556962e14250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1394272726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a381b0 0x556962e13d10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 >> 172.21.15.37:0/1394272726 conn(0x556962a55460 msgr2=0x556962e0b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9d937fe640 0 client.16305 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 shutdown_connections 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1394272726 wait complete. 2024-09-21T01:20:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.227+0000 7f9dc0c73740 20 client.16305 trim_cache size 0 max 16384 2024-09-21T01:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.249+0000 7f9dc0c73740 1 Processor -- start 2024-09-21T01:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.249+0000 7f9dc0c73740 1 -- start start 2024-09-21T01:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a1f9f0 0x556962e12590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a381b0 0x556962e12ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e10f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9da000e620 con 0x556962a61070 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9da0010160 con 0x556962a1f9f0 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9da000ecf0 con 0x556962a381b0 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.250+0000 7f9db8c9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e10f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a1f9f0 0x556962e12590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a1f9f0 0x556962e12590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43128/0 (socket says 172.21.15.37:43128) 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db3fff640 1 -- 172.21.15.37:0/1768120674 learned_addr learned my addr 172.21.15.37:0/1768120674 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db37fe640 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a381b0 0x556962e12ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db8c9c640 1 -- 172.21.15.37:0/1768120674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a381b0 msgr2=0x556962e12ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a381b0 0x556962e12ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db8c9c640 1 -- 172.21.15.37:0/1768120674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a1f9f0 msgr2=0x556962e12590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a1f9f0 0x556962e12590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.251+0000 7f9db8c9c640 1 -- 172.21.15.37:0/1768120674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556962e14b20 con 0x556962a61070 2024-09-21T01:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.252+0000 7f9db8c9c640 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e10f00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x556962e14cf0 tx=0x7f9dac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da69a4a231cc2f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.252+0000 7f9d99ffb640 1 -- 172.21.15.37:0/1768120674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00d040 con 0x556962a61070 2024-09-21T01:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.252+0000 7f9d99ffb640 1 -- 172.21.15.37:0/1768120674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dac018030 con 0x556962a61070 2024-09-21T01:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.252+0000 7f9d99ffb640 1 -- 172.21.15.37:0/1768120674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac020860 con 0x556962a61070 2024-09-21T01:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.253+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1768120674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 msgr2=0x556962e10f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.253+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e10f00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x556962e14cf0 tx=0x7f9dac012000 comp rx=0 tx=0).stop 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1768120674 shutdown_connections 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a61070 0x556962e10f00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a381b0 0x556962e12ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/1768120674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a1f9f0 0x556962e12590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1768120674 >> 172.21.15.37:0/1768120674 conn(0x556962a55460 msgr2=0x556962e0eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1768120674 shutdown_connections 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.254+0000 7f9dc0c73740 1 -- 172.21.15.37:0/1768120674 wait complete. 2024-09-21T01:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.255+0000 7f9dc0c73740 1 -- start start 2024-09-21T01:20:34.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.255+0000 7f9dc0c73740 1 Processor -- start 2024-09-21T01:20:34.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 0x556962e18300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e18840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a61070 0x556962e18d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9da000fa90 con 0x556962a1f9f0 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9da000f3c0 con 0x556962a381b0 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9da000c5e0 con 0x556962a61070 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9dc0c73740 10 client.0 _ll_register_callbacks cb 0x7f9da40a9500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 0x556962e18300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 0x556962e18300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53774/0 (socket says 172.21.15.37:53774) 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.256+0000 7f9db3fff640 1 -- 172.21.15.37:0/2771656957 learned_addr learned my addr 172.21.15.37:0/2771656957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9db3fff640 1 -- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a61070 msgr2=0x556962e18d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9db3fff640 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a61070 0x556962e18d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9db3fff640 1 -- 172.21.15.37:0/2771656957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 msgr2=0x556962e18840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9db3fff640 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e18840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9db3fff640 1 -- 172.21.15.37:0/2771656957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556962e8fd50 con 0x556962a1f9f0 2024-09-21T01:20:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9db3fff640 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 0x556962e18300 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9da40b6840 tx=0x7f9da40aca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bd86dffacdf3ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.257+0000 7f9d937fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.258+0000 7f9d937fe640 1 -- 172.21.15.37:0/2771656957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4020070 con 0x556962a1f9f0 2024-09-21T01:20:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.258+0000 7f9d937fe640 1 -- 172.21.15.37:0/2771656957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9da40b2a90 con 0x556962a1f9f0 2024-09-21T01:20:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.258+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dac018030 con 0x556962a1f9f0 2024-09-21T01:20:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.259+0000 7f9d937fe640 1 -- 172.21.15.37:0/2771656957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9da4009de0 con 0x556962a1f9f0 2024-09-21T01:20:34.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.259+0000 7f9dc0c73740 10 client.16311 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:34.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.259+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556962e90fd0 con 0x556962a1f9f0 2024-09-21T01:20:34.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9d937fe640 1 -- 172.21.15.37:0/2771656957 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da40b1900 con 0x556962a1f9f0 2024-09-21T01:20:34.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9d937fe640 1 -- 172.21.15.37:0/2771656957 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9da40ec070 con 0x556962a1f9f0 2024-09-21T01:20:34.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9dc0c73740 10 client.16311 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9dc0c73740 10 client.16311 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:20:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9dc0c73740 20 client.16311 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x556962e913a0 0x556962e938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9dc0c73740 4 client.16311 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:20:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9dac018030 con 0x556962e913a0 2024-09-21T01:20:34.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.261+0000 7f9db37fe640 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x556962e913a0 0x556962e938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:34.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.264+0000 7f9db37fe640 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x556962e913a0 0x556962e938b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bde550363c57e33b server_cookie=c27dbeb610f39a99 in_seq=0 out_seq=0 2024-09-21T01:20:34.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.265+0000 7f9d937fe640 10 client.16311 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:20:34.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.265+0000 7f9d937fe640 1 -- 172.21.15.37:0/2771656957 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9dac018030 con 0x556962e913a0 2024-09-21T01:20:34.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.265+0000 7f9d937fe640 10 client.16311 handle_command_reply: tid=0 2024-09-21T01:20:34.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.265+0000 7f9dc0c73740 1 client.16311 shutdown 2024-09-21T01:20:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.266+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 msgr2=0x556962e18300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.266+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 0x556962e18300 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9da40b6840 tx=0x7f9da40aca20 comp rx=0 tx=0).stop 2024-09-21T01:20:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.266+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 shutdown_connections 2024-09-21T01:20:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.267+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x556962e913a0 0x556962e938b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.267+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556962a61070 0x556962e18d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.267+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556962a381b0 0x556962e18840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.267+0000 7f9dc0c73740 1 --2- 172.21.15.37:0/2771656957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962a1f9f0 0x556962e18300 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.267+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 >> 172.21.15.37:0/2771656957 conn(0x556962a55460 msgr2=0x556962e0eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.268+0000 7f9d937fe640 0 client.16311 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:20:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.268+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 shutdown_connections 2024-09-21T01:20:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.268+0000 7f9dc0c73740 1 -- 172.21.15.37:0/2771656957 wait complete. 2024-09-21T01:20:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.268+0000 7f9dc0c73740 20 client.16311 trim_cache size 0 max 16384 2024-09-21T01:20:34.271 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:20:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d9c0b66e0 msgr2=0x7f9d9c0b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d9c0b66e0 0x7f9d9c0b8bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9dac007e60 tx=0x7f9dac007650 comp rx=0 tx=0).stop 2024-09-21T01:20:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 msgr2=0x7f9db411b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db411b620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9da400d950 tx=0x7f9da400de10 comp rx=0 tx=0).stop 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 shutdown_connections 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9d9c0b66e0 0x7f9d9c0b8bf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9db410f6c0 0x7f9db411c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9db410a900 0x7f9db411bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.271+0000 7f9dba6ff640 1 --2- 172.21.15.37:0/3274633069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db406af90 0x7f9db411b620 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.272+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 >> 172.21.15.37:0/3274633069 conn(0x7f9db40712f0 msgr2=0x7f9db410bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.272+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 shutdown_connections 2024-09-21T01:20:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:34.272+0000 7f9dba6ff640 1 -- 172.21.15.37:0/3274633069 wait complete. 2024-09-21T01:20:34.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:34 smithi137 ceph-mon[34607]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 861 MiB/s wr, 1.72k op/s 2024-09-21T01:20:34.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:34 smithi144 ceph-mon[34818]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 861 MiB/s wr, 1.72k op/s 2024-09-21T01:20:35.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:34 smithi037 ceph-mon[31105]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 861 MiB/s wr, 1.72k op/s 2024-09-21T01:20:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.181+0000 7f8301ffb640 1 -- 172.21.15.37:0/3867049943 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aa65b0520 con 0x562aa66c3f40 2024-09-21T01:20:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.181+0000 7f8301ffb640 10 client.16293 handle_command_reply: tid=0 2024-09-21T01:20:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.181+0000 7f8327bd8740 1 client.16293 shutdown 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 msgr2=0x562aa6652c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6652c20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f830c0ad460 tx=0x7f830c000bc0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 shutdown_connections 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562aa66c3f40 0x562aa66c63c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562aa629b1b0 0x562aa66531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562aa627a4d0 0x562aa6652c20 secure :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f830c0ad460 tx=0x7f830c000bc0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 --2- 172.21.15.37:0/3867049943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562aa6259d80 0x562aa6654390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8301ffb640 0 client.16293 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.185+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 >> 172.21.15.37:0/3867049943 conn(0x562aa628f300 msgr2=0x562aa664b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:36.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.190+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 shutdown_connections 2024-09-21T01:20:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.190+0000 7f8327bd8740 1 -- 172.21.15.37:0/3867049943 wait complete. 2024-09-21T01:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.192+0000 7f8327bd8740 20 client.16293 trim_cache size 0 max 16384 2024-09-21T01:20:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:20:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:20:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:20:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:20:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.203+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f83040b6590 msgr2=0x7f83040b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.203+0000 7f831b59e640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f83040b6590 0x7f83040b8aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8310009850 tx=0x7f8310009580 comp rx=0 tx=0).stop 2024-09-21T01:20:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.203+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 msgr2=0x7f831c1a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.203+0000 7f831b59e640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 0x7f831c1a8fd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f830c00c890 tx=0x7f830c00cd50 comp rx=0 tx=0).stop 2024-09-21T01:20:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.205+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 shutdown_connections 2024-09-21T01:20:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.205+0000 7f831b59e640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f83040b6590 0x7f83040b8aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.205+0000 7f831b59e640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f831c10f830 0x7f831c1a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.205+0000 7f831b59e640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c10cd20 0x7f831c1a8fd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.205+0000 7f831b59e640 1 --2- 172.21.15.37:0/1314926597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f831c10a3c0 0x7f831c1a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.205+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 >> 172.21.15.37:0/1314926597 conn(0x7f831c070640 msgr2=0x7f831c11bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.209+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 shutdown_connections 2024-09-21T01:20:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:36.209+0000 7f831b59e640 1 -- 172.21.15.37:0/1314926597 wait complete. 2024-09-21T01:20:36.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:20:36.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:36 smithi137 ceph-mon[34607]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 930 MiB/s wr, 1.79k op/s 2024-09-21T01:20:36.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:36 smithi144 ceph-mon[34818]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 930 MiB/s wr, 1.79k op/s 2024-09-21T01:20:36.922 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:36 smithi037 ceph-mon[31105]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 930 MiB/s wr, 1.79k op/s 2024-09-21T01:20:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:38.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:38 smithi137 ceph-mon[34607]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 808 MiB/s wr, 1.38k op/s 2024-09-21T01:20:38.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:38 smithi144 ceph-mon[34818]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 808 MiB/s wr, 1.38k op/s 2024-09-21T01:20:39.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:38 smithi037 ceph-mon[31105]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 808 MiB/s wr, 1.38k op/s 2024-09-21T01:20:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.312+0000 7f23850c8640 1 -- 172.21.15.37:0/1998715031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 msgr2=0x7f238010d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.312+0000 7f23850c8640 1 --2- 172.21.15.37:0/1998715031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f238010d6b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2378009ca0 tx=0x7f237802a8e0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.314+0000 7f23850c8640 1 -- 172.21.15.37:0/1998715031 shutdown_connections 2024-09-21T01:20:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.314+0000 7f23850c8640 1 --2- 172.21.15.37:0/1998715031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238011cba0 0x7f238011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.314+0000 7f23850c8640 1 --2- 172.21.15.37:0/1998715031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238010dbf0 0x7f238010e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.314+0000 7f23850c8640 1 --2- 172.21.15.37:0/1998715031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f238010d6b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.314+0000 7f23850c8640 1 -- 172.21.15.37:0/1998715031 >> 172.21.15.37:0/1998715031 conn(0x7f238006e9f0 msgr2=0x7f238006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.318+0000 7f23850c8640 1 -- 172.21.15.37:0/1998715031 shutdown_connections 2024-09-21T01:20:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.323+0000 7f23850c8640 1 -- 172.21.15.37:0/1998715031 wait complete. 2024-09-21T01:20:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.325+0000 7f23850c8640 1 Processor -- start 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.327+0000 7f23850c8640 1 -- start start 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.328+0000 7f23850c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238010dbf0 0x7f23801a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.329+0000 7f23850c8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f23801a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.329+0000 7f23850c8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238011cba0 0x7f23801ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.330+0000 7f23850c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2380122720 con 0x7f238010dbf0 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.330+0000 7f23850c8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23801225a0 con 0x7f238011cba0 2024-09-21T01:20:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.330+0000 7f23850c8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23801228a0 con 0x7f2380111cd0 2024-09-21T01:20:39.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.330+0000 7f237f7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f23801a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.330+0000 7f237f7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f23801a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35754/0 (socket says 172.21.15.37:35754) 2024-09-21T01:20:39.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.330+0000 7f237f7fe640 1 -- 172.21.15.37:0/3110715110 learned_addr learned my addr 172.21.15.37:0/3110715110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:39.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.331+0000 7f237ffff640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238010dbf0 0x7f23801a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.331+0000 7f237f7fe640 1 -- 172.21.15.37:0/3110715110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238011cba0 msgr2=0x7f23801ae930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T01:20:39.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.331+0000 7f237f7fe640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238011cba0 0x7f23801ae930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.331+0000 7f237f7fe640 1 -- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238010dbf0 msgr2=0x7f23801a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.331+0000 7f237f7fe640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238010dbf0 0x7f23801a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.331+0000 7f237f7fe640 1 -- 172.21.15.37:0/3110715110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23801af060 con 0x7f2380111cd0 2024-09-21T01:20:39.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.333+0000 7f237f7fe640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f23801a9690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f237000d740 tx=0x7f237000dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:39.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.333+0000 7f237d7fa640 1 -- 172.21.15.37:0/3110715110 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370017070 con 0x7f2380111cd0 2024-09-21T01:20:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.333+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23801af350 con 0x7f2380111cd0 2024-09-21T01:20:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.334+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23801b5ab0 con 0x7f2380111cd0 2024-09-21T01:20:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.338+0000 7f238c89e740 1 Processor -- start 2024-09-21T01:20:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.338+0000 7f237d7fa640 1 -- 172.21.15.37:0/3110715110 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f237000de50 con 0x7f2380111cd0 2024-09-21T01:20:39.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.338+0000 7f237d7fa640 1 -- 172.21.15.37:0/3110715110 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237000f620 con 0x7f2380111cd0 2024-09-21T01:20:39.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.340+0000 7f238c89e740 1 -- start start 2024-09-21T01:20:39.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.344+0000 7f237d7fa640 1 -- 172.21.15.37:0/3110715110 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f237001a070 con 0x7f2380111cd0 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.345+0000 7f238c89e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2652070 0x55aeb29f9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.345+0000 7f238c89e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 0x55aeb29f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.345+0000 7f238c89e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2631390 0x55aeb29f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.345+0000 7f238c89e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aeb296fea0 con 0x55aeb2631390 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.345+0000 7f238c89e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aeb295f2d0 con 0x55aeb2652070 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.345+0000 7f238c89e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aeb29630e0 con 0x55aeb26291b0 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.346+0000 7f237ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 0x55aeb29f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.346+0000 7f237ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 0x55aeb29f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35760/0 (socket says 172.21.15.37:35760) 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.346+0000 7f237ffff640 1 -- 172.21.15.37:0/271905471 learned_addr learned my addr 172.21.15.37:0/271905471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.347+0000 7f237d7fa640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23680b6610 0x7f23680b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.347+0000 7f237d7fa640 1 -- 172.21.15.37:0/3110715110 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f23700e6d80 con 0x7f2380111cd0 2024-09-21T01:20:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.348+0000 7f237ffff640 1 -- 172.21.15.37:0/271905471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2652070 msgr2=0x55aeb29f9460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.348+0000 7f237ffff640 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2652070 0x55aeb29f9460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.348+0000 7f237ffff640 1 -- 172.21.15.37:0/271905471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2631390 msgr2=0x55aeb29f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.348+0000 7f237ffff640 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2631390 0x55aeb29f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.348+0000 7f237ffff640 1 -- 172.21.15.37:0/271905471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeb26bd650 con 0x55aeb26291b0 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.350+0000 7f237ffff640 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 0x55aeb29f99a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2380110950 tx=0x7f2378030770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98be8a55a7e3bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.350+0000 7f23667fc640 1 -- 172.21.15.37:0/271905471 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378003970 con 0x55aeb26291b0 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.351+0000 7f23667fc640 1 -- 172.21.15.37:0/271905471 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2378036030 con 0x55aeb26291b0 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.352+0000 7f238c89e740 1 -- 172.21.15.37:0/271905471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 msgr2=0x55aeb29f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.352+0000 7f238c89e740 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 0x55aeb29f99a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2380110950 tx=0x7f2378030770 comp rx=0 tx=0).stop 2024-09-21T01:20:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.353+0000 7f23848c7640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23680b6610 0x7f23680b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.355+0000 7f238c89e740 1 -- 172.21.15.37:0/271905471 shutdown_connections 2024-09-21T01:20:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.355+0000 7f238c89e740 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2631390 0x55aeb29f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.355+0000 7f238c89e740 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb26291b0 0x55aeb29f99a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.355+0000 7f238c89e740 1 --2- 172.21.15.37:0/271905471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2652070 0x55aeb29f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.355+0000 7f238c89e740 1 -- 172.21.15.37:0/271905471 >> 172.21.15.37:0/271905471 conn(0x55aeb2646460 msgr2=0x55aeb29f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.356+0000 7f23848c7640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23680b6610 0x7f23680b8b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f237400b9a0 tx=0x7f237400b450 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.357+0000 7f238c89e740 1 -- 172.21.15.37:0/271905471 shutdown_connections 2024-09-21T01:20:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.357+0000 7f238c89e740 1 -- 172.21.15.37:0/271905471 wait complete. 2024-09-21T01:20:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.358+0000 7f238c89e740 1 -- start start 2024-09-21T01:20:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.358+0000 7f238c89e740 1 Processor -- start 2024-09-21T01:20:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.360+0000 7f238c89e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb26291b0 0x55aeb2a04a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.361+0000 7f238c89e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2631390 0x55aeb2a04f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.361+0000 7f238c89e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2652070 0x55aeb2a054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.361+0000 7f238c89e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aeb27c0700 con 0x55aeb2652070 2024-09-21T01:20:39.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.361+0000 7f238c89e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aeb28fa160 con 0x55aeb26291b0 2024-09-21T01:20:39.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.361+0000 7f238c89e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aeb2a07c80 con 0x55aeb2631390 2024-09-21T01:20:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.362+0000 7f238c89e740 10 client.0 _ll_register_callbacks cb 0x55aeb29139e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:39.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.363+0000 7f237ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb26291b0 0x55aeb2a04a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.363+0000 7f237ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb26291b0 0x55aeb2a04a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50240/0 (socket says 172.21.15.37:50240) 2024-09-21T01:20:39.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.363+0000 7f237ffff640 1 -- 172.21.15.37:0/3098975141 learned_addr learned my addr 172.21.15.37:0/3098975141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:39.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.363+0000 7f237f7fe640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2631390 0x55aeb2a04f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.364+0000 7f23848c7640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2652070 0x55aeb2a054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.365+0000 7f23848c7640 1 -- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2631390 msgr2=0x55aeb2a04f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.365+0000 7f23848c7640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2631390 0x55aeb2a04f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.365+0000 7f23848c7640 1 -- 172.21.15.37:0/3098975141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb26291b0 msgr2=0x55aeb2a04a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.365+0000 7f23848c7640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb26291b0 0x55aeb2a04a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.366+0000 7f23848c7640 1 -- 172.21.15.37:0/3098975141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeb2927c90 con 0x55aeb2652070 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.366+0000 7f237f7fe640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2631390 0x55aeb2a04f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:20:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.367+0000 7f23848c7640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2652070 0x55aeb2a054a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f237400d6b0 tx=0x7f2374004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eab6f99b7bdff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.368+0000 7f235f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.368+0000 7f235f7fe640 1 -- 172.21.15.37:0/3098975141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374021020 con 0x55aeb2652070 2024-09-21T01:20:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.369+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aeb2971df0 con 0x55aeb2652070 2024-09-21T01:20:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.369+0000 7f235f7fe640 1 -- 172.21.15.37:0/3098975141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f237401d440 con 0x55aeb2652070 2024-09-21T01:20:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.369+0000 7f235f7fe640 1 -- 172.21.15.37:0/3098975141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f237401d640 con 0x55aeb2652070 2024-09-21T01:20:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.371+0000 7f238c89e740 10 client.16320 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.371+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aeb2a13a90 con 0x55aeb2652070 2024-09-21T01:20:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f235f7fe640 1 -- 172.21.15.37:0/3098975141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aeb2971df0 con 0x55aeb2652070 2024-09-21T01:20:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f235f7fe640 1 -- 172.21.15.37:0/3098975141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f23740288c0 con 0x55aeb2652070 2024-09-21T01:20:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f238c89e740 10 client.16320 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f238c89e740 10 client.16320 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:20:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f238c89e740 20 client.16320 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f238c89e740 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb26109f0 0x55aeb2a17460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f238c89e740 4 client.16320 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.376+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeb296d8a0 con 0x55aeb26109f0 2024-09-21T01:20:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.378+0000 7f237ffff640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb26109f0 0x55aeb2a17460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.383+0000 7f237ffff640 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb26109f0 0x55aeb2a17460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37663b72d3f9c45e server_cookie=f9bec958d232910a in_seq=0 out_seq=0 2024-09-21T01:20:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.383+0000 7f235f7fe640 10 client.16320 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:20:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.384+0000 7f235f7fe640 1 -- 172.21.15.37:0/3098975141 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aeb296d8a0 con 0x55aeb26109f0 2024-09-21T01:20:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.385+0000 7f235f7fe640 10 client.16320 handle_command_reply: tid=0 2024-09-21T01:20:39.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.385+0000 7f238c89e740 1 client.16320 shutdown 2024-09-21T01:20:39.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2652070 msgr2=0x55aeb2a054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2652070 0x55aeb2a054a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f237400d6b0 tx=0x7f2374004730 comp rx=0 tx=0).stop 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 shutdown_connections 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb26109f0 0x55aeb2a17460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb2652070 0x55aeb2a054a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2631390 0x55aeb2a04f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 --2- 172.21.15.37:0/3098975141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb26291b0 0x55aeb2a04a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 >> 172.21.15.37:0/3098975141 conn(0x55aeb2646460 msgr2=0x55aeb29fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.387+0000 7f235f7fe640 0 client.16320 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.388+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 shutdown_connections 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.388+0000 7f238c89e740 1 -- 172.21.15.37:0/3098975141 wait complete. 2024-09-21T01:20:39.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.388+0000 7f238c89e740 20 client.16320 trim_cache size 0 max 16384 2024-09-21T01:20:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.432+0000 7f238c89e740 1 Processor -- start 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 -- start start 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb29faba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a1cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a1d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f236c00e620 con 0x55aeb26291b0 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f236c010160 con 0x55aeb2631390 2024-09-21T01:20:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.435+0000 7f238c89e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f236c00ecf0 con 0x55aeb2652070 2024-09-21T01:20:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.438+0000 7f237ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb29faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.438+0000 7f237ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb29faba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45196/0 (socket says 172.21.15.37:45196) 2024-09-21T01:20:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.438+0000 7f237ffff640 1 -- 172.21.15.37:0/3485124495 learned_addr learned my addr 172.21.15.37:0/3485124495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.438+0000 7f237f7fe640 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a1cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.440+0000 7f23848c7640 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a1d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.443+0000 7f237ffff640 1 -- 172.21.15.37:0/3485124495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 msgr2=0x55aeb2a1d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.443+0000 7f237ffff640 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a1d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.443+0000 7f237ffff640 1 -- 172.21.15.37:0/3485124495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 msgr2=0x55aeb2a1cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.443+0000 7f237ffff640 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a1cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.443+0000 7f237ffff640 1 -- 172.21.15.37:0/3485124495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeb29f7c40 con 0x55aeb26291b0 2024-09-21T01:20:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.445+0000 7f237ffff640 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb29faba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2378009ca0 tx=0x7f237802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37588f1b50d52c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.450+0000 7f2365ffb640 1 -- 172.21.15.37:0/3485124495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378009540 con 0x55aeb26291b0 2024-09-21T01:20:39.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.450+0000 7f2365ffb640 1 -- 172.21.15.37:0/3485124495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2378036040 con 0x55aeb26291b0 2024-09-21T01:20:39.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.450+0000 7f2365ffb640 1 -- 172.21.15.37:0/3485124495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378031ca0 con 0x55aeb26291b0 2024-09-21T01:20:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.451+0000 7f238c89e740 1 -- 172.21.15.37:0/3485124495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 msgr2=0x55aeb29faba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.451+0000 7f238c89e740 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb29faba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2378009ca0 tx=0x7f237802a8e0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.452+0000 7f238c89e740 1 -- 172.21.15.37:0/3485124495 shutdown_connections 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.452+0000 7f238c89e740 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a1d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.452+0000 7f238c89e740 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a1cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.452+0000 7f238c89e740 1 --2- 172.21.15.37:0/3485124495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb29faba0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.452+0000 7f238c89e740 1 -- 172.21.15.37:0/3485124495 >> 172.21.15.37:0/3485124495 conn(0x55aeb2646460 msgr2=0x55aeb29fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.454+0000 7f238c89e740 1 -- 172.21.15.37:0/3485124495 shutdown_connections 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.454+0000 7f238c89e740 1 -- 172.21.15.37:0/3485124495 wait complete. 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.455+0000 7f238c89e740 1 -- start start 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.455+0000 7f238c89e740 1 Processor -- start 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.456+0000 7f238c89e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb2a083a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.456+0000 7f238c89e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f238c89e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a7fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f238c89e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f236c00fa90 con 0x55aeb26291b0 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f238c89e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f236c00f3c0 con 0x55aeb2631390 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f237f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f237f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a088e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50270/0 (socket says 172.21.15.37:50270) 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f237f7fe640 1 -- 172.21.15.37:0/1433362672 learned_addr learned my addr 172.21.15.37:0/1433362672 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f23848c7640 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a7fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.457+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f236c00c5e0 con 0x55aeb2652070 2024-09-21T01:20:39.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.458+0000 7f238c89e740 10 client.0 _ll_register_callbacks cb 0x7f2374005f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.460+0000 7f237f7fe640 1 -- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 msgr2=0x55aeb2a7fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.460+0000 7f237f7fe640 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a7fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.460+0000 7f237f7fe640 1 -- 172.21.15.37:0/1433362672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 msgr2=0x55aeb2a083a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.460+0000 7f237f7fe640 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb2a083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.460+0000 7f237f7fe640 1 -- 172.21.15.37:0/1433362672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeb2a80370 con 0x55aeb2631390 2024-09-21T01:20:39.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.463+0000 7f237f7fe640 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a088e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23700add00 tx=0x7f2370009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=925bc10bc2515324 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.464+0000 7f235f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:20:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.464+0000 7f235f7fe640 1 -- 172.21.15.37:0/1433362672 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370021040 con 0x55aeb2631390 2024-09-21T01:20:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.464+0000 7f235f7fe640 1 -- 172.21.15.37:0/1433362672 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f23700ad1d0 con 0x55aeb2631390 2024-09-21T01:20:39.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.464+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2378036040 con 0x55aeb2631390 2024-09-21T01:20:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.467+0000 7f235f7fe640 1 -- 172.21.15.37:0/1433362672 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2370099140 con 0x55aeb2631390 2024-09-21T01:20:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.467+0000 7f238c89e740 10 client.25802 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.467+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aeb2a81430 con 0x55aeb2631390 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.468+0000 7f235f7fe640 1 -- 172.21.15.37:0/1433362672 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23700ae470 con 0x55aeb2631390 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f235f7fe640 1 -- 172.21.15.37:0/1433362672 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f23700a96c0 con 0x55aeb2631390 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f238c89e740 10 client.25802 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f238c89e740 10 client.25802 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f238c89e740 20 client.25802 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f238c89e740 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb25e5da0 0x55aeb2a83b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f238c89e740 4 client.25802 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:20:39.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.469+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2378036040 con 0x55aeb25e5da0 2024-09-21T01:20:39.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.470+0000 7f237ffff640 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb25e5da0 0x55aeb2a83b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.472+0000 7f237ffff640 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb25e5da0 0x55aeb2a83b90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9169cbd32be444b1 server_cookie=9ef9ab88b6f51f37 in_seq=0 out_seq=0 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.473+0000 7f235f7fe640 10 client.25802 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.473+0000 7f235f7fe640 1 -- 172.21.15.37:0/1433362672 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2378036040 con 0x55aeb25e5da0 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.473+0000 7f235f7fe640 10 client.25802 handle_command_reply: tid=0 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.473+0000 7f238c89e740 1 client.25802 shutdown 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.473+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 msgr2=0x55aeb2a088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.473+0000 7f238c89e740 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a088e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23700add00 tx=0x7f2370009ca0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 shutdown_connections 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f238c89e740 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55aeb25e5da0 0x55aeb2a83b90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f238c89e740 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aeb2652070 0x55aeb2a7fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f238c89e740 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aeb2631390 0x55aeb2a088e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f238c89e740 1 --2- 172.21.15.37:0/1433362672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aeb26291b0 0x55aeb2a083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 >> 172.21.15.37:0/1433362672 conn(0x55aeb2646460 msgr2=0x55aeb29fad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.474+0000 7f235f7fe640 0 client.25802 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.476+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 shutdown_connections 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.476+0000 7f238c89e740 1 -- 172.21.15.37:0/1433362672 wait complete. 2024-09-21T01:20:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.476+0000 7f238c89e740 20 client.25802 trim_cache size 0 max 16384 2024-09-21T01:20:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23680b6610 msgr2=0x7f23680b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23680b6610 0x7f23680b8b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f237400b9a0 tx=0x7f237400b450 comp rx=0 tx=0).stop 2024-09-21T01:20:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 msgr2=0x7f23801a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f23801a9690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f237000d740 tx=0x7f237000dc00 comp rx=0 tx=0).stop 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 shutdown_connections 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f23680b6610 0x7f23680b8b20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238011cba0 0x7f23801ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2380111cd0 0x7f23801a9690 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 --2- 172.21.15.37:0/3110715110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238010dbf0 0x7f23801a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 >> 172.21.15.37:0/3110715110 conn(0x7f238006e9f0 msgr2=0x7f238010f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 shutdown_connections 2024-09-21T01:20:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:39.478+0000 7f23850c8640 1 -- 172.21.15.37:0/3110715110 wait complete. 2024-09-21T01:20:41.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:40 smithi037 ceph-mon[31105]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 951 MiB/s wr, 1.55k op/s 2024-09-21T01:20:41.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:40 smithi137 ceph-mon[34607]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 951 MiB/s wr, 1.55k op/s 2024-09-21T01:20:41.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:40 smithi144 ceph-mon[34818]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 951 MiB/s wr, 1.55k op/s 2024-09-21T01:20:42.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:20:42.804 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:42 smithi037 ceph-mon[31105]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 933 MiB/s wr, 1.62k op/s 2024-09-21T01:20:43.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:42 smithi137 ceph-mon[34607]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 933 MiB/s wr, 1.62k op/s 2024-09-21T01:20:43.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:42 smithi144 ceph-mon[34818]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 933 MiB/s wr, 1.62k op/s 2024-09-21T01:20:43.432 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:44.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.530+0000 7f6896ee2640 1 -- 172.21.15.37:0/3825318483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 msgr2=0x7f68901087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.530+0000 7f6896ee2640 1 --2- 172.21.15.37:0/3825318483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 0x7f68901087b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6888009ca0 tx=0x7f688802a8b0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.533+0000 7f6896ee2640 1 -- 172.21.15.37:0/3825318483 shutdown_connections 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.533+0000 7f6896ee2640 1 --2- 172.21.15.37:0/3825318483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890108cf0 0x7f689010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.533+0000 7f6896ee2640 1 --2- 172.21.15.37:0/3825318483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 0x7f68901087b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.533+0000 7f6896ee2640 1 --2- 172.21.15.37:0/3825318483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6890102a60 0x7f6890102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.533+0000 7f6896ee2640 1 -- 172.21.15.37:0/3825318483 >> 172.21.15.37:0/3825318483 conn(0x7f6890079730 msgr2=0x7f6890079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.533+0000 7f6896ee2640 1 -- 172.21.15.37:0/3825318483 shutdown_connections 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.535+0000 7f6896ee2640 1 -- 172.21.15.37:0/3825318483 wait complete. 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.538+0000 7f6896ee2640 1 Processor -- start 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.538+0000 7f6896ee2640 1 -- start start 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.541+0000 7f6896ee2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 0x7f6890199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.542+0000 7f6896ee2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 0x7f68901999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.544+0000 7f6894c7e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 0x7f6890199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.544+0000 7f6894c7e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 0x7f6890199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35806/0 (socket says 172.21.15.37:35806) 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.546+0000 7f6894c7e640 1 -- 172.21.15.37:0/1742292777 learned_addr learned my addr 172.21.15.37:0/1742292777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.546+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6890108cf0 0x7f689019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.546+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68901129f0 con 0x7f68901083a0 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.546+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6890112870 con 0x7f6890108cf0 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.546+0000 7f688ffff640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 0x7f68901999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.548+0000 7f689547f640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6890108cf0 0x7f689019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.549+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6890112b70 con 0x7f6890102a60 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.551+0000 7f6894c7e640 1 -- 172.21.15.37:0/1742292777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6890108cf0 msgr2=0x7f689019ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.551+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6890108cf0 0x7f689019ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.551+0000 7f6894c7e640 1 -- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 msgr2=0x7f68901999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.552+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 0x7f68901999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.552+0000 7f6894c7e640 1 -- 172.21.15.37:0/1742292777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689019f390 con 0x7f6890102a60 2024-09-21T01:20:44.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.556+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 0x7f6890199420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f688000b4a0 tx=0x7f688000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.557+0000 7f688dffb640 1 -- 172.21.15.37:0/1742292777 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880014070 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.558+0000 7f688dffb640 1 -- 172.21.15.37:0/1742292777 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6880010ac0 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.571+0000 7f688dffb640 1 -- 172.21.15.37:0/1742292777 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880017c30 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.571+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689019f680 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.572+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68901a5de0 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.578+0000 7f688dffb640 1 -- 172.21.15.37:0/1742292777 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6880017070 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.580+0000 7f688dffb640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68780b6570 0x7f68780b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.580+0000 7f688dffb640 1 -- 172.21.15.37:0/1742292777 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6880017dd0 con 0x7f6890102a60 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.582+0000 7f688ffff640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68780b6570 0x7f68780b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.585+0000 7f688ffff640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68780b6570 0x7f68780b8a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6890107160 tx=0x7f6888000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.588+0000 7f689d456740 1 Processor -- start 2024-09-21T01:20:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 -- start start 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65d971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65d97710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65daac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a65d0aea0 con 0x561a659cc390 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561a65cfa2d0 con 0x561a659ed070 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.605+0000 7f689d456740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561a65cfe0e0 con 0x561a659c41b0 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.612+0000 7f689547f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65daac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.612+0000 7f689547f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65daac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45238/0 (socket says 172.21.15.37:45238) 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.612+0000 7f689547f640 1 -- 172.21.15.37:0/1683447786 learned_addr learned my addr 172.21.15.37:0/1683447786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.612+0000 7f688ffff640 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65d97710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.612+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65d971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.621+0000 7f689547f640 1 -- 172.21.15.37:0/1683447786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 msgr2=0x561a65d97710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.621+0000 7f689547f640 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65d97710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.621+0000 7f689547f640 1 -- 172.21.15.37:0/1683447786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 msgr2=0x561a65d971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.621+0000 7f689547f640 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65d971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.621+0000 7f689547f640 1 -- 172.21.15.37:0/1683447786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a65a58650 con 0x561a659cc390 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.621+0000 7f688ffff640 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65d97710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.628+0000 7f689547f640 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65daac00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f688400ab80 tx=0x7f688400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f9641a1851ee5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.630+0000 7f6876ffd640 1 -- 172.21.15.37:0/1683447786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688401d070 con 0x561a659cc390 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.630+0000 7f6876ffd640 1 -- 172.21.15.37:0/1683447786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6884018af0 con 0x561a659cc390 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.630+0000 7f6876ffd640 1 -- 172.21.15.37:0/1683447786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884010a60 con 0x561a659cc390 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.632+0000 7f689d456740 1 -- 172.21.15.37:0/1683447786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 msgr2=0x561a65daac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.632+0000 7f689d456740 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65daac00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f688400ab80 tx=0x7f688400f790 comp rx=0 tx=0).stop 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.633+0000 7f689d456740 1 -- 172.21.15.37:0/1683447786 shutdown_connections 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.633+0000 7f689d456740 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65daac00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.633+0000 7f689d456740 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65d97710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.633+0000 7f689d456740 1 --2- 172.21.15.37:0/1683447786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65d971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.633+0000 7f689d456740 1 -- 172.21.15.37:0/1683447786 >> 172.21.15.37:0/1683447786 conn(0x561a659e1460 msgr2=0x561a65d91e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.637+0000 7f689d456740 1 -- 172.21.15.37:0/1683447786 shutdown_connections 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.640+0000 7f689d456740 1 -- 172.21.15.37:0/1683447786 wait complete. 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.641+0000 7f689d456740 1 -- start start 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.641+0000 7f689d456740 1 Processor -- start 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.643+0000 7f689d456740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65da8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.643+0000 7f689d456740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659cc390 0x561a65da89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.643+0000 7f689d456740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659ed070 0x561a65db4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.644+0000 7f689547f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659ed070 0x561a65db4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.645+0000 7f689547f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659ed070 0x561a65db4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45254/0 (socket says 172.21.15.37:45254) 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.645+0000 7f689547f640 1 -- 172.21.15.37:0/2540456256 learned_addr learned my addr 172.21.15.37:0/2540456256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.645+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a65b5b700 con 0x561a659ed070 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.645+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561a65c95160 con 0x561a659cc390 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.645+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561a65dab5d0 con 0x561a659c41b0 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.645+0000 7f689d456740 10 client.0 _ll_register_callbacks cb 0x561a65cae9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:44.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.648+0000 7f6894c7e640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65da8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.649+0000 7f688ffff640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659cc390 0x561a65da89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.655+0000 7f6894c7e640 1 -- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659cc390 msgr2=0x561a65da89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.655+0000 7f6894c7e640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659cc390 0x561a65da89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.655+0000 7f6894c7e640 1 -- 172.21.15.37:0/2540456256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659ed070 msgr2=0x561a65db4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.655+0000 7f6894c7e640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659ed070 0x561a65db4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.655+0000 7f6894c7e640 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a65cc2c90 con 0x561a659c41b0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.662+0000 7f6894c7e640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65da8470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68800a6fb0 tx=0x7f68800a6fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404c632facd742c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.664+0000 7f686ffff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.666+0000 7f686ffff640 1 -- 172.21.15.37:0/2540456256 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800a9140 con 0x561a659c41b0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.666+0000 7f686ffff640 1 -- 172.21.15.37:0/2540456256 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f68800b1310 con 0x561a659c41b0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.666+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6884018af0 con 0x561a659c41b0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.669+0000 7f686ffff640 1 -- 172.21.15.37:0/2540456256 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f68800a92e0 con 0x561a659c41b0 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.669+0000 7f689d456740 10 client.25759 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:44.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.669+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561a65db7380 con 0x561a659c41b0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.672+0000 7f686ffff640 1 -- 172.21.15.37:0/2540456256 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6880019e50 con 0x561a659c41b0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.672+0000 7f686ffff640 1 -- 172.21.15.37:0/2540456256 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f68800a8bc0 con 0x561a659c41b0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.672+0000 7f689d456740 10 client.25759 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.672+0000 7f689d456740 10 client.25759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.672+0000 7f689d456740 20 client.25759 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.674+0000 7f689d456740 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a659ab9f0 0x561a65dba890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.674+0000 7f689d456740 4 client.25759 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.674+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6884018af0 con 0x561a659ab9f0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.676+0000 7f688ffff640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a659ab9f0 0x561a65dba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.684+0000 7f686ffff640 10 client.25759 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.684+0000 7f688ffff640 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a659ab9f0 0x561a65dba890 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc3e80d106268c0 server_cookie=4a25fbd9dedcadac in_seq=0 out_seq=0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.689+0000 7f686ffff640 1 -- 172.21.15.37:0/2540456256 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f6884018af0 con 0x561a659ab9f0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f686ffff640 10 client.25759 handle_command_reply: tid=0 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 client.25759 shutdown 2024-09-21T01:20:44.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 msgr2=0x561a65da8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65da8470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68800a6fb0 tx=0x7f68800a6fe0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 shutdown_connections 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a659ab9f0 0x561a65dba890 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659ed070 0x561a65db4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659cc390 0x561a65da89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 --2- 172.21.15.37:0/2540456256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65da8470 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 >> 172.21.15.37:0/2540456256 conn(0x561a659e1460 msgr2=0x561a65d91e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.690+0000 7f686ffff640 0 client.25759 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.691+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 shutdown_connections 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.691+0000 7f689d456740 1 -- 172.21.15.37:0/2540456256 wait complete. 2024-09-21T01:20:44.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.692+0000 7f689d456740 20 client.25759 trim_cache size 0 max 16384 2024-09-21T01:20:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.733+0000 7f689d456740 1 Processor -- start 2024-09-21T01:20:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.733+0000 7f689d456740 1 -- start start 2024-09-21T01:20:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f689d456740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65db4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f689d456740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65da5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f689d456740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65da5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f689d456740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6890073e80 con 0x561a659cc390 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f689d456740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68901a6390 con 0x561a659ed070 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f689d456740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6890074550 con 0x561a659c41b0 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f688ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65da5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f688ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65da5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45260/0 (socket says 172.21.15.37:45260) 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.734+0000 7f688ffff640 1 -- 172.21.15.37:0/555754388 learned_addr learned my addr 172.21.15.37:0/555754388 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.735+0000 7f6894c7e640 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65db4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.735+0000 7f688ffff640 1 -- 172.21.15.37:0/555754388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 msgr2=0x561a65db4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.735+0000 7f688ffff640 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65db4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.735+0000 7f688ffff640 1 -- 172.21.15.37:0/555754388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 msgr2=0x561a65da5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.736+0000 7f688ffff640 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65da5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.736+0000 7f688ffff640 1 -- 172.21.15.37:0/555754388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a65dab420 con 0x561a659cc390 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.737+0000 7f688ffff640 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65da5660 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6888009ca0 tx=0x7f688803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb650725dde056fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:44.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.737+0000 7f68767fc640 1 -- 172.21.15.37:0/555754388 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888058070 con 0x561a659cc390 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.738+0000 7f68767fc640 1 -- 172.21.15.37:0/555754388 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6888036040 con 0x561a659cc390 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.738+0000 7f68767fc640 1 -- 172.21.15.37:0/555754388 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888058070 con 0x561a659cc390 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.740+0000 7f689d456740 1 -- 172.21.15.37:0/555754388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 msgr2=0x561a65da5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.740+0000 7f689d456740 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65da5660 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6888009ca0 tx=0x7f688803e000 comp rx=0 tx=0).stop 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.742+0000 7f689d456740 1 -- 172.21.15.37:0/555754388 shutdown_connections 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.742+0000 7f689d456740 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65da5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.742+0000 7f689d456740 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65da5660 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.742+0000 7f689d456740 1 --2- 172.21.15.37:0/555754388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65db4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.742+0000 7f689d456740 1 -- 172.21.15.37:0/555754388 >> 172.21.15.37:0/555754388 conn(0x561a659e1460 msgr2=0x561a65da35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.743+0000 7f689d456740 1 -- 172.21.15.37:0/555754388 shutdown_connections 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.743+0000 7f689d456740 1 -- 172.21.15.37:0/555754388 wait complete. 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.744+0000 7f689d456740 1 -- start start 2024-09-21T01:20:44.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.744+0000 7f689d456740 1 Processor -- start 2024-09-21T01:20:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.745+0000 7f689d456740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65dacca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.745+0000 7f689d456740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65dad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.745+0000 7f689d456740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65e24250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.745+0000 7f688ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65dad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f688ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65dad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45264/0 (socket says 172.21.15.37:45264) 2024-09-21T01:20:44.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f688ffff640 1 -- 172.21.15.37:0/1396805373 learned_addr learned my addr 172.21.15.37:0/1396805373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68900752f0 con 0x561a659cc390 2024-09-21T01:20:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6890074c20 con 0x561a659ed070 2024-09-21T01:20:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6890071e40 con 0x561a659c41b0 2024-09-21T01:20:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f689d456740 10 client.0 _ll_register_callbacks cb 0x7f6884005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:44.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.746+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65dacca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f689547f640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65e24250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f688ffff640 1 -- 172.21.15.37:0/1396805373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 msgr2=0x561a65dacca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f688ffff640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65dacca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f688ffff640 1 -- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 msgr2=0x561a65e24250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f688ffff640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65e24250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f688ffff640 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a65e24790 con 0x561a659cc390 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.747+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65dacca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.748+0000 7f688ffff640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65dad220 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f688802aea0 tx=0x7f68880044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531934f86b65d52b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.748+0000 7f686ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:44.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.749+0000 7f686ffff640 1 -- 172.21.15.37:0/1396805373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888058070 con 0x561a659cc390 2024-09-21T01:20:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.750+0000 7f686ffff640 1 -- 172.21.15.37:0/1396805373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6888004b40 con 0x561a659cc390 2024-09-21T01:20:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.750+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6888036040 con 0x561a659cc390 2024-09-21T01:20:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.750+0000 7f686ffff640 1 -- 172.21.15.37:0/1396805373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6888004d40 con 0x561a659cc390 2024-09-21T01:20:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.750+0000 7f689d456740 10 client.16341 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.750+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561a65e258e0 con 0x561a659cc390 2024-09-21T01:20:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.751+0000 7f686ffff640 1 -- 172.21.15.37:0/1396805373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f688804e020 con 0x561a659cc390 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f686ffff640 1 -- 172.21.15.37:0/1396805373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f688805b070 con 0x561a659cc390 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f689d456740 10 client.16341 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f689d456740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f689d456740 20 client.16341 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f689d456740 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a65980da0 0x561a65e28010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f689d456740 4 client.16341 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:20:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.752+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6888036040 con 0x561a65980da0 2024-09-21T01:20:44.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.756+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a65980da0 0x561a65e28010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:44.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.765+0000 7f6894c7e640 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a65980da0 0x561a65e28010 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc5d655ebde1b8de server_cookie=788989a5b9337fdf in_seq=0 out_seq=0 2024-09-21T01:20:44.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.765+0000 7f686ffff640 10 client.16341 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f686ffff640 1 -- 172.21.15.37:0/1396805373 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6888036040 con 0x561a65980da0 2024-09-21T01:20:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f686ffff640 10 client.16341 handle_command_reply: tid=0 2024-09-21T01:20:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 client.16341 shutdown 2024-09-21T01:20:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 msgr2=0x561a65dad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65dad220 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f688802aea0 tx=0x7f68880044f0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 shutdown_connections 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561a65980da0 0x561a65e28010 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561a659ed070 0x561a65e24250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a659cc390 0x561a65dad220 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 --2- 172.21.15.37:0/1396805373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a659c41b0 0x561a65dacca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.772+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 >> 172.21.15.37:0/1396805373 conn(0x561a659e1460 msgr2=0x561a65d95ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.773+0000 7f686ffff640 0 client.16341 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.773+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 shutdown_connections 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.773+0000 7f689d456740 1 -- 172.21.15.37:0/1396805373 wait complete. 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.773+0000 7f689d456740 20 client.16341 trim_cache size 0 max 16384 2024-09-21T01:20:44.777 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68780b6570 msgr2=0x7f68780b8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68780b6570 0x7f68780b8a80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6890107160 tx=0x7f6888000f40 comp rx=0 tx=0).stop 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 msgr2=0x7f6890199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 0x7f6890199420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f688000b4a0 tx=0x7f688000b960 comp rx=0 tx=0).stop 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 shutdown_connections 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f68780b6570 0x7f68780b8a80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.775+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6890108cf0 0x7f689019ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.776+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68901083a0 0x7f68901999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.776+0000 7f6896ee2640 1 --2- 172.21.15.37:0/1742292777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6890102a60 0x7f6890199420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:44.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.776+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 >> 172.21.15.37:0/1742292777 conn(0x7f6890079730 msgr2=0x7f6890105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:44.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.776+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 shutdown_connections 2024-09-21T01:20:44.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:44.776+0000 7f6896ee2640 1 -- 172.21.15.37:0/1742292777 wait complete. 2024-09-21T01:20:44.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:44 smithi037 ceph-mon[31105]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 859 MiB/s wr, 1.68k op/s 2024-09-21T01:20:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:44 smithi137 ceph-mon[34607]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 859 MiB/s wr, 1.68k op/s 2024-09-21T01:20:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:44 smithi144 ceph-mon[34818]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 859 MiB/s wr, 1.68k op/s 2024-09-21T01:20:47.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:46 smithi037 ceph-mon[31105]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 923 MiB/s wr, 1.94k op/s 2024-09-21T01:20:47.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:46 smithi144 ceph-mon[34818]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 923 MiB/s wr, 1.94k op/s 2024-09-21T01:20:47.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:46 smithi137 ceph-mon[34607]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 923 MiB/s wr, 1.94k op/s 2024-09-21T01:20:49.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:48 smithi037 ceph-mon[31105]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 801 MiB/s wr, 1.65k op/s 2024-09-21T01:20:49.159 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:20:49.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:20:49.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:48 smithi137 ceph-mon[34607]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 801 MiB/s wr, 1.65k op/s 2024-09-21T01:20:49.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:48 smithi144 ceph-mon[34818]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 801 MiB/s wr, 1.65k op/s 2024-09-21T01:20:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.454+0000 7f13cce64640 1 -- 172.21.15.37:0/3072385759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a65c0 msgr2=0x7f13c00aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.454+0000 7f13cce64640 1 --2- 172.21.15.37:0/3072385759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a65c0 0x7f13c00aaf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13c8066480 tx=0x7f13c808f840 comp rx=0 tx=0).stop 2024-09-21T01:20:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.457+0000 7f13cce64640 1 -- 172.21.15.37:0/3072385759 shutdown_connections 2024-09-21T01:20:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.457+0000 7f13cce64640 1 --2- 172.21.15.37:0/3072385759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a65c0 0x7f13c00aaf30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.457+0000 7f13cce64640 1 --2- 172.21.15.37:0/3072385759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a5c20 0x7f13c00a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.457+0000 7f13cce64640 1 --2- 172.21.15.37:0/3072385759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c00a4d30 0x7f13c00a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.457+0000 7f13cce64640 1 -- 172.21.15.37:0/3072385759 >> 172.21.15.37:0/3072385759 conn(0x7f13c00a04c0 msgr2=0x7f13c00a2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:49.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.459+0000 7f13cce64640 1 -- 172.21.15.37:0/3072385759 shutdown_connections 2024-09-21T01:20:49.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.461+0000 7f13cce64640 1 -- 172.21.15.37:0/3072385759 wait complete. 2024-09-21T01:20:49.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.462+0000 7f13cce64640 1 Processor -- start 2024-09-21T01:20:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 -- start start 2024-09-21T01:20:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c00a4d30 0x7f13c00b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a5c20 0x7f13c00b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 0x7f13c00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00b8f90 con 0x7f13c00a65c0 2024-09-21T01:20:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00b8e10 con 0x7f13c00a4d30 2024-09-21T01:20:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.463+0000 7f13cce64640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13c00b9110 con 0x7f13c00a5c20 2024-09-21T01:20:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.464+0000 7f13c6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 0x7f13c00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.464+0000 7f13c6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 0x7f13c00b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60974/0 (socket says 172.21.15.37:60974) 2024-09-21T01:20:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.464+0000 7f13c6d9d640 1 -- 172.21.15.37:0/1772567501 learned_addr learned my addr 172.21.15.37:0/1772567501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.468+0000 7f13c6d9d640 1 -- 172.21.15.37:0/1772567501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a5c20 msgr2=0x7f13c00b2520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:20:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.468+0000 7f13c6d9d640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a5c20 0x7f13c00b2520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.468+0000 7f13c6d9d640 1 -- 172.21.15.37:0/1772567501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c00a4d30 msgr2=0x7f13c00b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.468+0000 7f13c6d9d640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c00a4d30 0x7f13c00b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.468+0000 7f13c6d9d640 1 -- 172.21.15.37:0/1772567501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c00b38f0 con 0x7f13c00a65c0 2024-09-21T01:20:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.476+0000 7f13c6d9d640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 0x7f13c00b30d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f13c8052860 tx=0x7f13c8097610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.479+0000 7f13bf7fe640 1 -- 172.21.15.37:0/1772567501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80a8070 con 0x7f13c00a65c0 2024-09-21T01:20:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.480+0000 7f13bf7fe640 1 -- 172.21.15.37:0/1772567501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c8097cf0 con 0x7f13c00a65c0 2024-09-21T01:20:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.480+0000 7f13bf7fe640 1 -- 172.21.15.37:0/1772567501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80646a0 con 0x7f13c00a65c0 2024-09-21T01:20:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.482+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c00b3b80 con 0x7f13c00a65c0 2024-09-21T01:20:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.482+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c00b40c0 con 0x7f13c00a65c0 2024-09-21T01:20:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.487+0000 7f13d3dce740 1 Processor -- start 2024-09-21T01:20:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.493+0000 7f13bf7fe640 1 -- 172.21.15.37:0/1772567501 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f13c80a0070 con 0x7f13c00a65c0 2024-09-21T01:20:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.494+0000 7f13bf7fe640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13b40b65c0 0x7f13b40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.495+0000 7f13bf7fe640 1 -- 172.21.15.37:0/1772567501 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f13c816bde0 con 0x7f13c00a65c0 2024-09-21T01:20:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.498+0000 7f13d3dce740 1 -- start start 2024-09-21T01:20:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 0x559e400f3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd222f0 0x559e400f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 0x559e400f4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13d3dce740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e400656f0 con 0x559e3fd4b1b0 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13d3dce740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559e40054b20 con 0x559e3fd222f0 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13d3dce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e40058930 con 0x559e3fd2a4d0 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 0x559e400f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 0x559e400f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60986/0 (socket says 172.21.15.37:60986) 2024-09-21T01:20:49.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.499+0000 7f13c659c640 1 -- 172.21.15.37:0/1911940143 learned_addr learned my addr 172.21.15.37:0/1911940143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.501+0000 7f13c659c640 1 -- 172.21.15.37:0/1911940143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 msgr2=0x559e400f4200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.501+0000 7f13c659c640 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 0x559e400f4200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.501+0000 7f13c659c640 1 -- 172.21.15.37:0/1911940143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd222f0 msgr2=0x559e400f36b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.501+0000 7f13c659c640 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd222f0 0x559e400f36b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.501+0000 7f13c659c640 1 -- 172.21.15.37:0/1911940143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4001a530 con 0x559e3fd4b1b0 2024-09-21T01:20:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.503+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13b40b65c0 0x7f13b40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.506+0000 7f13c659c640 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 0x559e400f3040 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f13b800bb10 tx=0x7f13b800d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee909bbcf59be5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.510+0000 7f13bcff9640 1 -- 172.21.15.37:0/1911940143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8016070 con 0x559e3fd4b1b0 2024-09-21T01:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.511+0000 7f13bcff9640 1 -- 172.21.15.37:0/1911940143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13b800dce0 con 0x559e3fd4b1b0 2024-09-21T01:20:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.513+0000 7f13d3dce740 1 -- 172.21.15.37:0/1911940143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 msgr2=0x559e400f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.513+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 0x559e400f3040 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f13b800bb10 tx=0x7f13b800d2e0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.515+0000 7f13d3dce740 1 -- 172.21.15.37:0/1911940143 shutdown_connections 2024-09-21T01:20:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.515+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 0x559e400f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.515+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd222f0 0x559e400f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.515+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1911940143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd4b1b0 0x559e400f3040 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.515+0000 7f13d3dce740 1 -- 172.21.15.37:0/1911940143 >> 172.21.15.37:0/1911940143 conn(0x559e3fd3f300 msgr2=0x559e400eead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.515+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13b40b65c0 0x7f13b40b8ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f13b0005d00 tx=0x7f13b0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.517+0000 7f13d3dce740 1 -- 172.21.15.37:0/1911940143 shutdown_connections 2024-09-21T01:20:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.520+0000 7f13d3dce740 1 -- 172.21.15.37:0/1911940143 wait complete. 2024-09-21T01:20:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.520+0000 7f13d3dce740 1 -- start start 2024-09-21T01:20:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.521+0000 7f13d3dce740 1 Processor -- start 2024-09-21T01:20:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.521+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.521+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd2a4d0 0x559e400fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.521+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd4b1b0 0x559e400fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.521+0000 7f13d3dce740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e3ff8cab0 con 0x559e3fd222f0 2024-09-21T01:20:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.522+0000 7f13d3dce740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559e3fffa730 con 0x559e3fd2a4d0 2024-09-21T01:20:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.522+0000 7f13d3dce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e400f4d70 con 0x559e3fd4b1b0 2024-09-21T01:20:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.522+0000 7f13d3dce740 10 client.0 _ll_register_callbacks cb 0x559e4004e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.524+0000 7f13c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.524+0000 7f13c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60994/0 (socket says 172.21.15.37:60994) 2024-09-21T01:20:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.524+0000 7f13c659c640 1 -- 172.21.15.37:0/3081753002 learned_addr learned my addr 172.21.15.37:0/3081753002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.524+0000 7f13c6d9d640 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd4b1b0 0x559e400fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.525+0000 7f13c659c640 1 -- 172.21.15.37:0/3081753002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd4b1b0 msgr2=0x559e400fdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.525+0000 7f13c659c640 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd4b1b0 0x559e400fdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.525+0000 7f13c659c640 1 -- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd2a4d0 msgr2=0x559e400fd130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.525+0000 7f13c659c640 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd2a4d0 0x559e400fd130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.525+0000 7f13c659c640 1 -- 172.21.15.37:0/3081753002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3fdb6790 con 0x559e3fd222f0 2024-09-21T01:20:49.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.526+0000 7f13c659c640 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fca70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13b800bfd0 tx=0x7f13b8004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811bc0700581405a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:49.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.529+0000 7f13adffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.529+0000 7f13adffb640 1 -- 172.21.15.37:0/3081753002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8016070 con 0x559e3fd222f0 2024-09-21T01:20:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.529+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e40067640 con 0x559e3fd222f0 2024-09-21T01:20:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.529+0000 7f13adffb640 1 -- 172.21.15.37:0/3081753002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f13b8004040 con 0x559e3fd222f0 2024-09-21T01:20:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.530+0000 7f13adffb640 1 -- 172.21.15.37:0/3081753002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13b8004240 con 0x559e3fd222f0 2024-09-21T01:20:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.530+0000 7f13d3dce740 10 client.16353 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.530+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559e3fe2f620 con 0x559e3fd222f0 2024-09-21T01:20:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.533+0000 7f13adffb640 1 -- 172.21.15.37:0/3081753002 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559e40067640 con 0x559e3fd222f0 2024-09-21T01:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.533+0000 7f13adffb640 1 -- 172.21.15.37:0/3081753002 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f13b8022020 con 0x559e3fd222f0 2024-09-21T01:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.534+0000 7f13d3dce740 10 client.16353 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.534+0000 7f13d3dce740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.534+0000 7f13d3dce740 20 client.16353 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.534+0000 7f13d3dce740 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fd09d80 0x559e4010a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.534+0000 7f13d3dce740 4 client.16353 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.534+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e400630f0 con 0x559e3fd09d80 2024-09-21T01:20:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.536+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fd09d80 0x559e4010a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.539+0000 7f13adffb640 10 client.16353 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.539+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fd09d80 0x559e4010a010 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e246959406f5b305 server_cookie=479a847944758605 in_seq=0 out_seq=0 2024-09-21T01:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.543+0000 7f13adffb640 1 -- 172.21.15.37:0/3081753002 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e400630f0 con 0x559e3fd09d80 2024-09-21T01:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.543+0000 7f13adffb640 10 client.16353 handle_command_reply: tid=0 2024-09-21T01:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.543+0000 7f13d3dce740 1 client.16353 shutdown 2024-09-21T01:20:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 msgr2=0x559e400fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fca70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13b800bfd0 tx=0x7f13b8004b10 comp rx=0 tx=0).stop 2024-09-21T01:20:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 shutdown_connections 2024-09-21T01:20:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fd09d80 0x559e4010a010 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd4b1b0 0x559e400fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd2a4d0 0x559e400fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 --2- 172.21.15.37:0/3081753002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fca70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13adffb640 0 client.16353 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.545+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 >> 172.21.15.37:0/3081753002 conn(0x559e3fd3f300 msgr2=0x559e400ed150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.546+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 shutdown_connections 2024-09-21T01:20:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.546+0000 7f13d3dce740 1 -- 172.21.15.37:0/3081753002 wait complete. 2024-09-21T01:20:49.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.556+0000 7f13d3dce740 20 client.16353 trim_cache size 0 max 16384 2024-09-21T01:20:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.617+0000 7f13d3dce740 1 Processor -- start 2024-09-21T01:20:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.619+0000 7f13d3dce740 1 -- start start 2024-09-21T01:20:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.620+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.620+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 0x559e400fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.620+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e400fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.620+0000 7f13d3dce740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015d420 con 0x559e3fd222f0 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.620+0000 7f13d3dce740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015ef60 con 0x559e3fd4b1b0 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.620+0000 7f13d3dce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015daf0 con 0x559e3fd2a4d0 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.622+0000 7f13c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.622+0000 7f13c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32778/0 (socket says 172.21.15.37:32778) 2024-09-21T01:20:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.622+0000 7f13c659c640 1 -- 172.21.15.37:0/1578196287 learned_addr learned my addr 172.21.15.37:0/1578196287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.623+0000 7f13c6d9d640 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e400fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.625+0000 7f13c659c640 1 -- 172.21.15.37:0/1578196287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 msgr2=0x559e400fb7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.625+0000 7f13c659c640 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 0x559e400fb7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.625+0000 7f13c659c640 1 -- 172.21.15.37:0/1578196287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 msgr2=0x559e400fbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.625+0000 7f13c659c640 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e400fbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.625+0000 7f13c659c640 1 -- 172.21.15.37:0/1578196287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e400ef200 con 0x559e3fd222f0 2024-09-21T01:20:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.627+0000 7f13c659c640 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fb290 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f13b8010a80 tx=0x7f13b8010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06c35743ea48146 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.631+0000 7f13affff640 1 -- 172.21.15.37:0/1578196287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8033070 con 0x559e3fd222f0 2024-09-21T01:20:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.632+0000 7f13affff640 1 -- 172.21.15.37:0/1578196287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13b800dcf0 con 0x559e3fd222f0 2024-09-21T01:20:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.632+0000 7f13affff640 1 -- 172.21.15.37:0/1578196287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8016050 con 0x559e3fd222f0 2024-09-21T01:20:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.645+0000 7f13d3dce740 1 -- 172.21.15.37:0/1578196287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 msgr2=0x559e400fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.645+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fb290 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f13b8010a80 tx=0x7f13b8010e10 comp rx=0 tx=0).stop 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.645+0000 7f13d3dce740 1 -- 172.21.15.37:0/1578196287 shutdown_connections 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.646+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e400fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.646+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd2a4d0 0x559e400fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.646+0000 7f13d3dce740 1 --2- 172.21.15.37:0/1578196287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd222f0 0x559e400fb290 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.646+0000 7f13d3dce740 1 -- 172.21.15.37:0/1578196287 >> 172.21.15.37:0/1578196287 conn(0x559e3fd3f300 msgr2=0x559e400e9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.646+0000 7f13d3dce740 1 -- 172.21.15.37:0/1578196287 shutdown_connections 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.646+0000 7f13d3dce740 1 -- 172.21.15.37:0/1578196287 wait complete. 2024-09-21T01:20:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.647+0000 7f13d3dce740 1 -- start start 2024-09-21T01:20:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.647+0000 7f13d3dce740 1 Processor -- start 2024-09-21T01:20:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.648+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd222f0 0x559e401017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.649+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 0x559e40101e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.649+0000 7f13d3dce740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e401029e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.649+0000 7f13d3dce740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015e890 con 0x559e3fd2a4d0 2024-09-21T01:20:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.649+0000 7f13c659c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd222f0 0x559e401017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.651+0000 7f13c6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e401029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.651+0000 7f13c5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 0x559e40101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.652+0000 7f13c5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 0x559e40101e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32784/0 (socket says 172.21.15.37:32784) 2024-09-21T01:20:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.652+0000 7f13c5d9b640 1 -- 172.21.15.37:0/2416331915 learned_addr learned my addr 172.21.15.37:0/2416331915 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.652+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015e1c0 con 0x559e3fd4b1b0 2024-09-21T01:20:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.652+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015b3e0 con 0x559e3fd222f0 2024-09-21T01:20:49.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.653+0000 7f13d3dce740 10 client.0 _ll_register_callbacks cb 0x7f13b800b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.655+0000 7f13c5d9b640 1 -- 172.21.15.37:0/2416331915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd222f0 msgr2=0x559e401017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.655+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd222f0 0x559e401017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.655+0000 7f13c5d9b640 1 -- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 msgr2=0x559e401029e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.655+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e401029e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:49.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.656+0000 7f13c5d9b640 1 -- 172.21.15.37:0/2416331915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e40103140 con 0x559e3fd2a4d0 2024-09-21T01:20:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.657+0000 7f13c5d9b640 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 0x559e40101e70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f13b0005fd0 tx=0x7f13b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba36a43d49d9be7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.658+0000 7f13adffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.659+0000 7f13adffb640 1 -- 172.21.15.37:0/2416331915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0029070 con 0x559e3fd2a4d0 2024-09-21T01:20:49.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.659+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b800dcf0 con 0x559e3fd2a4d0 2024-09-21T01:20:49.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.659+0000 7f13adffb640 1 -- 172.21.15.37:0/2416331915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f13b0010cc0 con 0x559e3fd2a4d0 2024-09-21T01:20:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.661+0000 7f13adffb640 1 -- 172.21.15.37:0/2416331915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13b0034050 con 0x559e3fd2a4d0 2024-09-21T01:20:49.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.661+0000 7f13d3dce740 10 client.16359 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:49.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.661+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559e40104530 con 0x559e3fd2a4d0 2024-09-21T01:20:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.670+0000 7f13adffb640 1 -- 172.21.15.37:0/2416331915 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13b0016070 con 0x559e3fd2a4d0 2024-09-21T01:20:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.671+0000 7f13adffb640 1 -- 172.21.15.37:0/2416331915 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f13b0004ab0 con 0x559e3fd2a4d0 2024-09-21T01:20:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.678+0000 7f13d3dce740 10 client.16359 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.678+0000 7f13d3dce740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.678+0000 7f13d3dce740 20 client.16359 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.678+0000 7f13d3dce740 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fcdf1c0 0x559e40176af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.678+0000 7f13d3dce740 4 client.16359 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:20:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.678+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f13b800dcf0 con 0x559e3fcdf1c0 2024-09-21T01:20:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.685+0000 7f13c659c640 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fcdf1c0 0x559e40176af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.694+0000 7f13c659c640 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fcdf1c0 0x559e40176af0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e0238b60faa8b29 server_cookie=8d0493359aa94a28 in_seq=0 out_seq=0 2024-09-21T01:20:49.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:49.696+0000 7f13adffb640 10 client.16359 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:51.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:50 smithi037 ceph-mon[31105]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 926 MiB/s wr, 1.82k op/s 2024-09-21T01:20:51.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:50 smithi144 ceph-mon[34818]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 926 MiB/s wr, 1.82k op/s 2024-09-21T01:20:51.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:50 smithi137 ceph-mon[34607]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 926 MiB/s wr, 1.82k op/s 2024-09-21T01:20:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.027+0000 7f13adffb640 1 -- 172.21.15.37:0/2416331915 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f13b800dcf0 con 0x559e3fcdf1c0 2024-09-21T01:20:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.027+0000 7f13adffb640 10 client.16359 handle_command_reply: tid=0 2024-09-21T01:20:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.027+0000 7f13d3dce740 1 client.16359 shutdown 2024-09-21T01:20:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.027+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 msgr2=0x559e40101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.027+0000 7f13d3dce740 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 0x559e40101e70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f13b0005fd0 tx=0x7f13b0004730 comp rx=0 tx=0).stop 2024-09-21T01:20:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 shutdown_connections 2024-09-21T01:20:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13d3dce740 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x559e3fcdf1c0 0x559e40176af0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13d3dce740 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e3fd4b1b0 0x559e401029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13d3dce740 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e3fd2a4d0 0x559e40101e70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13d3dce740 1 --2- 172.21.15.37:0/2416331915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e3fd222f0 0x559e401017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 >> 172.21.15.37:0/2416331915 conn(0x559e3fd3f300 msgr2=0x559e400f6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.028+0000 7f13adffb640 0 client.16359 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.031+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 shutdown_connections 2024-09-21T01:20:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.031+0000 7f13d3dce740 1 -- 172.21.15.37:0/2416331915 wait complete. 2024-09-21T01:20:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.032+0000 7f13d3dce740 20 client.16359 trim_cache size 0 max 16384 2024-09-21T01:20:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.036+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13b40b65c0 msgr2=0x7f13b40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.036+0000 7f13cce64640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13b40b65c0 0x7f13b40b8ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f13b0005d00 tx=0x7f13b0005850 comp rx=0 tx=0).stop 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.036+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 msgr2=0x7f13c00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.036+0000 7f13cce64640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 0x7f13c00b30d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f13c8052860 tx=0x7f13c8097610 comp rx=0 tx=0).stop 2024-09-21T01:20:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.040+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 shutdown_connections 2024-09-21T01:20:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.040+0000 7f13cce64640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f13b40b65c0 0x7f13b40b8ad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.040+0000 7f13cce64640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00a65c0 0x7f13c00b30d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.040+0000 7f13cce64640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13c00a5c20 0x7f13c00b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.040+0000 7f13cce64640 1 --2- 172.21.15.37:0/1772567501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c00a4d30 0x7f13c00b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.040+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 >> 172.21.15.37:0/1772567501 conn(0x7f13c00a04c0 msgr2=0x7f13c00a6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.042+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 shutdown_connections 2024-09-21T01:20:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:20:52.043+0000 7f13cce64640 1 -- 172.21.15.37:0/1772567501 wait complete. 2024-09-21T01:20:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.271+0000 7f1f51c59640 1 -- 172.21.15.37:0/1161011194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c06d560 msgr2=0x7f1f4c06d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.271+0000 7f1f51c59640 1 --2- 172.21.15.37:0/1161011194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c06d560 0x7f1f4c06d970 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009900 tx=0x7f1f3c02a440 comp rx=0 tx=0).stop 2024-09-21T01:20:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.273+0000 7f1f51c59640 1 -- 172.21.15.37:0/1161011194 shutdown_connections 2024-09-21T01:20:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.273+0000 7f1f51c59640 1 --2- 172.21.15.37:0/1161011194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c11ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.273+0000 7f1f51c59640 1 --2- 172.21.15.37:0/1161011194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c06d560 0x7f1f4c06d970 secure :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009900 tx=0x7f1f3c02a440 comp rx=0 tx=0).stop 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.273+0000 7f1f51c59640 1 --2- 172.21.15.37:0/1161011194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4c06eb10 0x7f1f4c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.273+0000 7f1f51c59640 1 -- 172.21.15.37:0/1161011194 >> 172.21.15.37:0/1161011194 conn(0x7f1f4c072f60 msgr2=0x7f1f4c10a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.278+0000 7f1f51c59640 1 -- 172.21.15.37:0/1161011194 shutdown_connections 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.278+0000 7f1f51c59640 1 -- 172.21.15.37:0/1161011194 wait complete. 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.280+0000 7f1f51c59640 1 Processor -- start 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.280+0000 7f1f51c59640 1 -- start start 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.282+0000 7f1f51c59640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4c06eb10 0x7f1f4c1a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.282+0000 7f1f51c59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c1a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.282+0000 7f1f51c59640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f4c1aeb70 0x7f1f4c1aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.282+0000 7f1f51c59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c122800 con 0x7f1f4c11ca70 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.282+0000 7f1f51c59640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c122680 con 0x7f1f4c1aeb70 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.282+0000 7f1f51c59640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c122980 con 0x7f1f4c06eb10 2024-09-21T01:20:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.283+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c1a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.283+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c1a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32804/0 (socket says 172.21.15.37:32804) 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.283+0000 7f1f4bfff640 1 -- 172.21.15.37:0/3251209353 learned_addr learned my addr 172.21.15.37:0/3251209353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.284+0000 7f1f4bfff640 1 -- 172.21.15.37:0/3251209353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4c06eb10 msgr2=0x7f1f4c1a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.284+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4c06eb10 0x7f1f4c1a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.284+0000 7f1f4bfff640 1 -- 172.21.15.37:0/3251209353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f4c1aeb70 msgr2=0x7f1f4c1aef80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.284+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f4c1aeb70 0x7f1f4c1aef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.284+0000 7f1f4bfff640 1 -- 172.21.15.37:0/3251209353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c1af750 con 0x7f1f4c11ca70 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.285+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c1a9990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c02a9b0 tx=0x7f1f3c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.285+0000 7f1f49ffb640 1 -- 172.21.15.37:0/3251209353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c03f020 con 0x7f1f4c11ca70 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.285+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c1b5cf0 con 0x7f1f4c11ca70 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.286+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c1b6090 con 0x7f1f4c11ca70 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.288+0000 7f1f49ffb640 1 -- 172.21.15.37:0/3251209353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f3c031d60 con 0x7f1f4c11ca70 2024-09-21T01:20:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.288+0000 7f1f49ffb640 1 -- 172.21.15.37:0/3251209353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c035070 con 0x7f1f4c11ca70 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.293+0000 7f1f5942f740 1 Processor -- start 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 -- start start 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feacb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3fead090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c3fe22e60 con 0x557c3fb05350 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557c3fe12290 con 0x557c3fae4670 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.294+0000 7f1f5942f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557c3fe160a0 con 0x557c3fadc490 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.298+0000 7f1f51458640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.298+0000 7f1f51458640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32812/0 (socket says 172.21.15.37:32812) 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.298+0000 7f1f51458640 1 -- 172.21.15.37:0/1209668409 learned_addr learned my addr 172.21.15.37:0/1209668409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.299+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3fead090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.301+0000 7f1f4bfff640 1 -- 172.21.15.37:0/1209668409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 msgr2=0x557c3feacb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.302+0000 7f1f49ffb640 1 -- 172.21.15.37:0/3251209353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1f3c042020 con 0x7f1f4c11ca70 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.299+0000 7f1f50c57640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feacb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.302+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feacb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.302+0000 7f1f4bfff640 1 -- 172.21.15.37:0/1209668409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 msgr2=0x557c3feac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.302+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.302+0000 7f1f4bfff640 1 -- 172.21.15.37:0/1209668409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c3fb70930 con 0x557c3fae4670 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.303+0000 7f1f51458640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.303+0000 7f1f50c57640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feacb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.305+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3fead090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c104fa0 tx=0x7f1f3c10d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22413d40c9345c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.305+0000 7f1f49ffb640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1f340b6650 0x7f1f340b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.306+0000 7f1f32ffd640 1 -- 172.21.15.37:0/1209668409 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0c9ce0 con 0x557c3fae4670 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.306+0000 7f1f49ffb640 1 -- 172.21.15.37:0/3251209353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1f3c107540 con 0x7f1f4c11ca70 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.306+0000 7f1f51458640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1f340b6650 0x7f1f340b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.306+0000 7f1f32ffd640 1 -- 172.21.15.37:0/1209668409 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f3c114030 con 0x557c3fae4670 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.307+0000 7f1f32ffd640 1 -- 172.21.15.37:0/1209668409 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0ccfe0 con 0x557c3fae4670 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.308+0000 7f1f5942f740 1 -- 172.21.15.37:0/1209668409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 msgr2=0x557c3fead090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.308+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3fead090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c104fa0 tx=0x7f1f3c10d710 comp rx=0 tx=0).stop 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.309+0000 7f1f51458640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1f340b6650 0x7f1f340b8b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009f10 tx=0x7f1f44009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.309+0000 7f1f5942f740 1 -- 172.21.15.37:0/1209668409 shutdown_connections 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.309+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3fead090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.309+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feacb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.309+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1209668409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.309+0000 7f1f5942f740 1 -- 172.21.15.37:0/1209668409 >> 172.21.15.37:0/1209668409 conn(0x557c3faf9740 msgr2=0x557c3feaa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.310+0000 7f1f5942f740 1 -- 172.21.15.37:0/1209668409 shutdown_connections 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.310+0000 7f1f5942f740 1 -- 172.21.15.37:0/1209668409 wait complete. 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.311+0000 7f1f5942f740 1 -- start start 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.311+0000 7f1f5942f740 1 Processor -- start 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3feb86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3fec3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c3fc73890 con 0x557c3fae4670 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557c3fdacd40 con 0x557c3fb05350 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557c3febabb0 con 0x557c3fadc490 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.312+0000 7f1f5942f740 10 client.0 _ll_register_callbacks cb 0x557c3fe10c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.313+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3feb86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.313+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3feb86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32826/0 (socket says 172.21.15.37:32826) 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.313+0000 7f1f4bfff640 1 -- 172.21.15.37:0/2477276193 learned_addr learned my addr 172.21.15.37:0/2477276193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.314+0000 7f1f4bfff640 1 -- 172.21.15.37:0/2477276193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 msgr2=0x557c3feb8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.314+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.314+0000 7f1f4bfff640 1 -- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 msgr2=0x557c3fec3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.314+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3fec3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.314+0000 7f1f4bfff640 1 -- 172.21.15.37:0/2477276193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c3fec4400 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.314+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3feb86c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0c9c60 tx=0x7f1f3c031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbab5062e9c1c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.315+0000 7f1f2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.315+0000 7f1f2bfff640 1 -- 172.21.15.37:0/2477276193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0cd1d0 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.315+0000 7f1f2bfff640 1 -- 172.21.15.37:0/2477276193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1f3c041d50 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.315+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f3c114030 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.315+0000 7f1f2bfff640 1 -- 172.21.15.37:0/2477276193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1f3c0cd460 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 10 client.16371 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c3fec6c00 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f2bfff640 1 -- 172.21.15.37:0/2477276193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f3c114030 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f2bfff640 1 -- 172.21.15.37:0/2477276193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1f3c0c9900 con 0x557c3fae4670 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 10 client.16371 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 20 client.16371 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fac3cd0 0x557c3fec9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 4 client.16371 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.316+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c3fe24db0 con 0x557c3fac3cd0 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.317+0000 7f1f50c57640 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fac3cd0 0x557c3fec9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.320+0000 7f1f50c57640 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fac3cd0 0x557c3fec9fe0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4ae9e70b590b841 server_cookie=be9ab60f43e55faf in_seq=0 out_seq=0 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.321+0000 7f1f2bfff640 10 client.16371 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.324+0000 7f1f2bfff640 1 -- 172.21.15.37:0/2477276193 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c3fe24db0 con 0x557c3fac3cd0 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.324+0000 7f1f2bfff640 10 client.16371 handle_command_reply: tid=0 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.325+0000 7f1f5942f740 1 client.16371 shutdown 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 msgr2=0x557c3feb86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3feb86c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0c9c60 tx=0x7f1f3c031f10 comp rx=0 tx=0).stop 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 shutdown_connections 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fac3cd0 0x557c3fec9fe0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3fec3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3feb86c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 --2- 172.21.15.37:0/2477276193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 >> 172.21.15.37:0/2477276193 conn(0x557c3faf9740 msgr2=0x557c3feaf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f2bfff640 0 client.16371 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 shutdown_connections 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 1 -- 172.21.15.37:0/2477276193 wait complete. 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.326+0000 7f1f5942f740 20 client.16371 trim_cache size 0 max 16384 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.367+0000 7f1f5942f740 1 Processor -- start 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 -- start start 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3feb7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feadd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800e590 con 0x557c3fb05350 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380100d0 con 0x557c3fae4670 2024-09-21T01:20:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.377+0000 7f1f5942f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800ec60 con 0x557c3fadc490 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:53164/0 (socket says 172.21.15.37:53164) 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 -- 172.21.15.37:0/1002101075 learned_addr learned my addr 172.21.15.37:0/1002101075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 -- 172.21.15.37:0/1002101075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 msgr2=0x557c3feb7810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3feb7810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 -- 172.21.15.37:0/1002101075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 msgr2=0x557c3feadd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feadd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.379+0000 7f1f50c57640 1 -- 172.21.15.37:0/1002101075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c3feba950 con 0x557c3fadc490 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.382+0000 7f1f50c57640 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb2730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f4000acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72d95cb86d7dc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.389+0000 7f1f327fc640 1 -- 172.21.15.37:0/1002101075 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4001e020 con 0x557c3fadc490 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.389+0000 7f1f327fc640 1 -- 172.21.15.37:0/1002101075 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f40013d80 con 0x557c3fadc490 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.390+0000 7f1f5942f740 1 -- 172.21.15.37:0/1002101075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 msgr2=0x557c3feb2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.390+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb2730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f4000acc0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.391+0000 7f1f5942f740 1 -- 172.21.15.37:0/1002101075 shutdown_connections 2024-09-21T01:20:52.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.391+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fb05350 0x557c3feadd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.391+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fae4670 0x557c3feb7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.391+0000 7f1f5942f740 1 --2- 172.21.15.37:0/1002101075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3feb2730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.391+0000 7f1f5942f740 1 -- 172.21.15.37:0/1002101075 >> 172.21.15.37:0/1002101075 conn(0x557c3faf9740 msgr2=0x557c3fead640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.398+0000 7f1f5942f740 1 -- 172.21.15.37:0/1002101075 shutdown_connections 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.398+0000 7f1f5942f740 1 -- 172.21.15.37:0/1002101075 wait complete. 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.399+0000 7f1f5942f740 1 -- start start 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.399+0000 7f1f5942f740 1 Processor -- start 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.400+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3febbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.400+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3febc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.400+0000 7f1f5942f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3febc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.401+0000 7f1f5942f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800fa00 con 0x557c3fae4670 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.401+0000 7f1f5942f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800f330 con 0x557c3fb05350 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.401+0000 7f1f5942f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3800c550 con 0x557c3fadc490 2024-09-21T01:20:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.401+0000 7f1f5942f740 10 client.0 _ll_register_callbacks cb 0x7f1f3c10d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.404+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3febc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.405+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3febc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32856/0 (socket says 172.21.15.37:32856) 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.405+0000 7f1f4bfff640 1 -- 172.21.15.37:0/196088744 learned_addr learned my addr 172.21.15.37:0/196088744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.408+0000 7f1f51458640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3febc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.408+0000 7f1f50c57640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3febbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.415+0000 7f1f50c57640 1 -- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 msgr2=0x557c3febc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.415+0000 7f1f50c57640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3febc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.415+0000 7f1f50c57640 1 -- 172.21.15.37:0/196088744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 msgr2=0x557c3febc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.415+0000 7f1f50c57640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3febc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.415+0000 7f1f50c57640 1 -- 172.21.15.37:0/196088744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c3ff33b30 con 0x557c3fadc490 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.418+0000 7f1f50c57640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3febbf30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f4001f000 tx=0x7f1f40006bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad311691aebfb966 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.419+0000 7f1f2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.420+0000 7f1f2bfff640 1 -- 172.21.15.37:0/196088744 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400138d0 con 0x557c3fadc490 2024-09-21T01:20:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.421+0000 7f1f2bfff640 1 -- 172.21.15.37:0/196088744 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1f40013a70 con 0x557c3fadc490 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.421+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c3fe20860 con 0x557c3fadc490 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.423+0000 7f1f2bfff640 1 -- 172.21.15.37:0/196088744 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1f40013c70 con 0x557c3fadc490 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.423+0000 7f1f5942f740 10 client.25777 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.423+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c3ff34e80 con 0x557c3fadc490 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.424+0000 7f1f2bfff640 1 -- 172.21.15.37:0/196088744 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557c3fe20860 con 0x557c3fadc490 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f2bfff640 1 -- 172.21.15.37:0/196088744 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1f40006400 con 0x557c3fadc490 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f5942f740 10 client.25777 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f5942f740 10 client.25777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f5942f740 20 client.25777 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f5942f740 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fa99080 0x557c3ff37510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f5942f740 4 client.25777 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.425+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557c3fe1dc90 con 0x557c3fa99080 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.434+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fa99080 0x557c3ff37510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.443+0000 7f1f2bfff640 10 client.25777 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:52.443+0000 7f1f4bfff640 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fa99080 0x557c3ff37510 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd0481dbf1da7dc server_cookie=b6f7ba9da820a86 in_seq=0 out_seq=0 2024-09-21T01:20:53.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:52 smithi037 ceph-mon[31105]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 901 MiB/s wr, 1.83k op/s 2024-09-21T01:20:53.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:52 smithi137 ceph-mon[34607]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 901 MiB/s wr, 1.83k op/s 2024-09-21T01:20:53.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:52 smithi144 ceph-mon[34818]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 901 MiB/s wr, 1.83k op/s 2024-09-21T01:20:53.471 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:20:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:20:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "5a2712c0-9041-4bb0-9189-f394a9406090", 2024-09-21T01:20:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:20:53.472 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:20:53.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.467+0000 7f1f2bfff640 1 -- 172.21.15.37:0/196088744 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557c3fe1dc90 con 0x557c3fa99080 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f2bfff640 10 client.25777 handle_command_reply: tid=0 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 client.25777 shutdown 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 msgr2=0x557c3febbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3febbf30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f4001f000 tx=0x7f1f40006bf0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 shutdown_connections 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557c3fa99080 0x557c3ff37510 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557c3fb05350 0x557c3febc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c3fae4670 0x557c3febc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 --2- 172.21.15.37:0/196088744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c3fadc490 0x557c3febbf30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 >> 172.21.15.37:0/196088744 conn(0x557c3faf9740 msgr2=0x557c3feaa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.468+0000 7f1f2bfff640 0 client.25777 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.469+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 shutdown_connections 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.469+0000 7f1f5942f740 1 -- 172.21.15.37:0/196088744 wait complete. 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.469+0000 7f1f5942f740 20 client.25777 trim_cache size 0 max 16384 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.470+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1f340b6650 msgr2=0x7f1f340b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.470+0000 7f1f51c59640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1f340b6650 0x7f1f340b8b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009f10 tx=0x7f1f44009530 comp rx=0 tx=0).stop 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.470+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 msgr2=0x7f1f4c1a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.470+0000 7f1f51c59640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c1a9990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c02a9b0 tx=0x7f1f3c003d80 comp rx=0 tx=0).stop 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 shutdown_connections 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1f340b6650 0x7f1f340b8b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f4c1aeb70 0x7f1f4c1aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f4c11ca70 0x7f1f4c1a9990 secure :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c02a9b0 tx=0x7f1f3c003d80 comp rx=0 tx=0).stop 2024-09-21T01:20:53.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 --2- 172.21.15.37:0/3251209353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4c06eb10 0x7f1f4c1a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:53.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 >> 172.21.15.37:0/3251209353 conn(0x7f1f4c072f60 msgr2=0x7f1f4c118970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:53.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 shutdown_connections 2024-09-21T01:20:53.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:53.471+0000 7f1f51c59640 1 -- 172.21.15.37:0/3251209353 wait complete. 2024-09-21T01:20:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:54 smithi037 ceph-mon[31105]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 849 MiB/s wr, 1.75k op/s 2024-09-21T01:20:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:54 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:20:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:54 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:54 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:20:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:54 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:20:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:54 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:55.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:54 smithi137 ceph-mon[34607]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 849 MiB/s wr, 1.75k op/s 2024-09-21T01:20:55.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:54 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:20:55.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:54 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:55.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:54 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:54 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:54 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:54 smithi144 ceph-mon[34818]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 849 MiB/s wr, 1.75k op/s 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:54 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:54 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:54 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:54 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:20:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:54 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:56.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:20:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:56 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:56 smithi137 ceph-mon[34607]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 932 MiB/s wr, 2.00k op/s 2024-09-21T01:20:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:56 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:56 smithi144 ceph-mon[34818]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 932 MiB/s wr, 2.00k op/s 2024-09-21T01:20:57.257 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:56 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:20:57.257 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:56 smithi037 ceph-mon[31105]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 932 MiB/s wr, 2.00k op/s 2024-09-21T01:20:57.398 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:20:59.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:20:58 smithi137 ceph-mon[34607]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 796 MiB/s wr, 1.68k op/s 2024-09-21T01:20:59.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:20:58 smithi144 ceph-mon[34818]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 796 MiB/s wr, 1.68k op/s 2024-09-21T01:20:59.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:20:58 smithi037 ceph-mon[31105]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 796 MiB/s wr, 1.68k op/s 2024-09-21T01:20:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.252+0000 7fc3bf7fe640 1 -- 172.21.15.37:0/4048639959 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b802f340 con 0x7fc3c0110420 2024-09-21T01:20:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.254+0000 7fc3c6d64640 1 -- 172.21.15.37:0/4048639959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c0110420 msgr2=0x7fc3c0116c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.254+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/4048639959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c0110420 0x7fc3c0116c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009ca0 tx=0x7fc3b802a8f0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.255+0000 7fc3c6d64640 1 -- 172.21.15.37:0/4048639959 shutdown_connections 2024-09-21T01:20:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.255+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/4048639959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c0110420 0x7fc3c0116c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.255+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/4048639959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c010fad0 0x7fc3c010fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.255+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/4048639959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c010a190 0x7fc3c010a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.255+0000 7fc3c6d64640 1 -- 172.21.15.37:0/4048639959 >> 172.21.15.37:0/4048639959 conn(0x7fc3c00780f0 msgr2=0x7fc3c01081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.259+0000 7fc3c6d64640 1 -- 172.21.15.37:0/4048639959 shutdown_connections 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.264+0000 7fc3c6d64640 1 -- 172.21.15.37:0/4048639959 wait complete. 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.266+0000 7fc3c6d64640 1 Processor -- start 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.266+0000 7fc3c6d64640 1 -- start start 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.266+0000 7fc3c6d64640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c010a190 0x7fc3c01a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.266+0000 7fc3c6d64640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c010fad0 0x7fc3c01a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.266+0000 7fc3c6d64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c0110420 0x7fc3c01a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.266+0000 7fc3c6d64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c011a210 con 0x7fc3c0110420 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.267+0000 7fc3c6d64640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c011a090 con 0x7fc3c010fad0 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.267+0000 7fc3c6d64640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c011a390 con 0x7fc3c010a190 2024-09-21T01:20:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.270+0000 7fc3c5301640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c0110420 0x7fc3c01a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.270+0000 7fc3c5301640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c0110420 0x7fc3c01a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51862/0 (socket says 172.21.15.37:51862) 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.270+0000 7fc3c5301640 1 -- 172.21.15.37:0/821721446 learned_addr learned my addr 172.21.15.37:0/821721446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.271+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c010a190 0x7fc3c01a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.271+0000 7fc3bffff640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c010fad0 0x7fc3c01a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.272+0000 7fc3c4b00640 1 -- 172.21.15.37:0/821721446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c010fad0 msgr2=0x7fc3c01a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.272+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c010fad0 0x7fc3c01a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.272+0000 7fc3c4b00640 1 -- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c0110420 msgr2=0x7fc3c01a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.272+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c0110420 0x7fc3c01a6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.272+0000 7fc3c4b00640 1 -- 172.21.15.37:0/821721446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c01a6b00 con 0x7fc3c010a190 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.273+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c010a190 0x7fc3c01a0bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400b3e0 tx=0x7fc3b400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.275+0000 7fc3bdffb640 1 -- 172.21.15.37:0/821721446 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4015020 con 0x7fc3c010a190 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.275+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c01a6df0 con 0x7fc3c010a190 2024-09-21T01:20:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.276+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c007bc10 con 0x7fc3c010a190 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.276+0000 7fc3bdffb640 1 -- 172.21.15.37:0/821721446 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3b4011ce0 con 0x7fc3c010a190 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.276+0000 7fc3bdffb640 1 -- 172.21.15.37:0/821721446 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4010dc0 con 0x7fc3c010a190 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.284+0000 7fc3cd2d8740 1 Processor -- start 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.285+0000 7fc3cd2d8740 1 -- start start 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.286+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefd4070 0x55afbf37b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.286+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf37b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.286+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 0x55afbf37bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.288+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afbf2f1e50 con 0x55afbefd4070 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.288+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55afbf2e1280 con 0x55afbefab1b0 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.288+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55afbf2e5090 con 0x55afbefb3390 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.293+0000 7fc3bffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 0x55afbf37bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.293+0000 7fc3bffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 0x55afbf37bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:34810/0 (socket says 172.21.15.37:34810) 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.293+0000 7fc3bffff640 1 -- 172.21.15.37:0/951965002 learned_addr learned my addr 172.21.15.37:0/951965002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.294+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf37b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.295+0000 7fc3c5301640 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefd4070 0x55afbf37b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.295+0000 7fc3bdffb640 1 -- 172.21.15.37:0/821721446 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc3b4018020 con 0x7fc3c010a190 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.297+0000 7fc3bffff640 1 -- 172.21.15.37:0/951965002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 msgr2=0x55afbf37b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.297+0000 7fc3bffff640 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf37b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.297+0000 7fc3bffff640 1 -- 172.21.15.37:0/951965002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefd4070 msgr2=0x55afbf37b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.297+0000 7fc3bffff640 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefd4070 0x55afbf37b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.297+0000 7fc3bffff640 1 -- 172.21.15.37:0/951965002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbf03f650 con 0x55afbefb3390 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.301+0000 7fc3bdffb640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc3b00b66e0 0x7fc3b00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.302+0000 7fc3bdffb640 1 -- 172.21.15.37:0/821721446 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc3b40e6770 con 0x7fc3c010a190 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.303+0000 7fc3bffff640 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 0x55afbf37bcf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00a830 tx=0x7fc3ac00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0cc503f082327ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.304+0000 7fc3c5301640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc3b00b66e0 0x7fc3b00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.306+0000 7fc3aaffd640 1 -- 172.21.15.37:0/951965002 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac015070 con 0x55afbefb3390 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.307+0000 7fc3aaffd640 1 -- 172.21.15.37:0/951965002 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3ac0113f0 con 0x55afbefb3390 2024-09-21T01:20:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.310+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/951965002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 msgr2=0x55afbf37bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.310+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 0x55afbf37bcf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00a830 tx=0x7fc3ac00acf0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.311+0000 7fc3c5301640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc3b00b66e0 0x7fc3b00b8bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009a60 tx=0x7fc3b8009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.311+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/951965002 shutdown_connections 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.311+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefb3390 0x55afbf37bcf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.312+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf37b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.312+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/951965002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefd4070 0x55afbf37b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.312+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/951965002 >> 172.21.15.37:0/951965002 conn(0x55afbefc8460 msgr2=0x55afbf379160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.312+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/951965002 shutdown_connections 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.313+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/951965002 wait complete. 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.314+0000 7fc3cd2d8740 1 -- start start 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.315+0000 7fc3cd2d8740 1 Processor -- start 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.316+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf389090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.316+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf3865a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.317+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf386cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.317+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55afbf142700 con 0x55afbef929f0 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.317+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55afbf27c110 con 0x55afbefab1b0 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.317+0000 7fc3bffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf3865a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.318+0000 7fc3bffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf3865a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:34814/0 (socket says 172.21.15.37:34814) 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.318+0000 7fc3bffff640 1 -- 172.21.15.37:0/1547316994 learned_addr learned my addr 172.21.15.37:0/1547316994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.318+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55afbf389aa0 con 0x55afbefd4070 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.321+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf389090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.327+0000 7fc3bffff640 1 -- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 msgr2=0x55afbf389090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.327+0000 7fc3bffff640 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf389090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.327+0000 7fc3bffff640 1 -- 172.21.15.37:0/1547316994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 msgr2=0x55afbf386cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.327+0000 7fc3bffff640 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf386cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.327+0000 7fc3bffff640 1 -- 172.21.15.37:0/1547316994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbf2a9c40 con 0x55afbefd4070 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.333+0000 7fc3cd2d8740 10 client.0 _ll_register_callbacks cb 0x55afbf295990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.333+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afbf2f3da0 con 0x55afbefd4070 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.335+0000 7fc3bffff640 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf3865a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac010580 tx=0x7fc3ac010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a435368b324d9ace server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.335+0000 7fc39ffff640 10 client.25789 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.340+0000 7fc39ffff640 1 -- 172.21.15.37:0/1547316994 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac015070 con 0x55afbefd4070 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.341+0000 7fc39ffff640 1 -- 172.21.15.37:0/1547316994 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc3ac010df0 con 0x55afbefd4070 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.341+0000 7fc39ffff640 1 -- 172.21.15.37:0/1547316994 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3ac004030 con 0x55afbefd4070 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.341+0000 7fc3cd2d8740 10 client.25789 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.341+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55afbf395320 con 0x55afbefd4070 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.343+0000 7fc39ffff640 1 -- 172.21.15.37:0/1547316994 <== mon.1 v2:172.21.15.144:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc3ac021020 con 0x55afbefd4070 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.344+0000 7fc3cd2d8740 10 client.25789 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.344+0000 7fc3cd2d8740 10 client.25789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.344+0000 7fc3cd2d8740 20 client.25789 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.344+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbef67da0 0x55afbf398ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.344+0000 7fc3cd2d8740 4 client.25789 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:20:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.344+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afbf2ef850 con 0x55afbef67da0 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.346+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbef67da0 0x55afbf398ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.351+0000 7fc39ffff640 10 client.25789 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.351+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbef67da0 0x55afbf398ab0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d1e6c311c2a1156 server_cookie=781be716ff535518 in_seq=0 out_seq=0 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.358+0000 7fc39ffff640 1 -- 172.21.15.37:0/1547316994 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55afbf2ef850 con 0x55afbef67da0 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.358+0000 7fc39ffff640 10 client.25789 handle_command_reply: tid=0 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.358+0000 7fc3cd2d8740 1 client.25789 shutdown 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 msgr2=0x55afbf3865a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf3865a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac010580 tx=0x7fc3ac010a40 comp rx=0 tx=0).stop 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 shutdown_connections 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbef67da0 0x55afbf398ab0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf386cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf3865a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/1547316994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefab1b0 0x55afbf389090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 >> 172.21.15.37:0/1547316994 conn(0x55afbefc8460 msgr2=0x55afbf37e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.359+0000 7fc39ffff640 0 client.25789 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.360+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 shutdown_connections 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.360+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/1547316994 wait complete. 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.360+0000 7fc3cd2d8740 20 client.25789 trim_cache size 0 max 16384 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.412+0000 7fc3cd2d8740 1 Processor -- start 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.412+0000 7fc3cd2d8740 1 -- start start 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.414+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf384de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.415+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefab1b0 0x55afbf385320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.415+0000 7fc3c4b00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf384de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.415+0000 7fc3c4b00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf384de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51868/0 (socket says 172.21.15.37:51868) 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.416+0000 7fc3c4b00640 1 -- 172.21.15.37:0/2075223213 learned_addr learned my addr 172.21.15.37:0/2075223213 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.416+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefd4070 0x55afbf37e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.416+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a400e5d0 con 0x55afbef929f0 2024-09-21T01:20:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.416+0000 7fc3bffff640 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefab1b0 0x55afbf385320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.416+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4010110 con 0x55afbefd4070 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.416+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a400eca0 con 0x55afbefab1b0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.417+0000 7fc3c4b00640 1 -- 172.21.15.37:0/2075223213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefab1b0 msgr2=0x55afbf385320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.417+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefab1b0 0x55afbf385320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.417+0000 7fc3c4b00640 1 -- 172.21.15.37:0/2075223213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefd4070 msgr2=0x55afbf37e370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.417+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefd4070 0x55afbf37e370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.417+0000 7fc3c4b00640 1 -- 172.21.15.37:0/2075223213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbef67fd0 con 0x55afbef929f0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.419+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf384de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40ac850 tx=0x7fc3b4010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b01e2d5659f81a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.420+0000 7fc3aa7fc640 1 -- 172.21.15.37:0/2075223213 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40ac3d0 con 0x55afbef929f0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.420+0000 7fc3aa7fc640 1 -- 172.21.15.37:0/2075223213 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3b40acfc0 con 0x55afbef929f0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.420+0000 7fc3aa7fc640 1 -- 172.21.15.37:0/2075223213 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40e8d00 con 0x55afbef929f0 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.422+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 msgr2=0x55afbf384de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.422+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf384de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40ac850 tx=0x7fc3b4010a00 comp rx=0 tx=0).stop 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 shutdown_connections 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbefd4070 0x55afbf37e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefab1b0 0x55afbf385320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/2075223213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbef929f0 0x55afbf384de0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 >> 172.21.15.37:0/2075223213 conn(0x55afbefc8460 msgr2=0x55afbf373df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 shutdown_connections 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.426+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/2075223213 wait complete. 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.427+0000 7fc3cd2d8740 1 -- start start 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.428+0000 7fc3cd2d8740 1 Processor -- start 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.429+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbef929f0 0x55afbf38a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.430+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefab1b0 0x55afbf38aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.430+0000 7fc3cd2d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf401460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.430+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a400fa40 con 0x55afbefab1b0 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.430+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a400f370 con 0x55afbef929f0 2024-09-21T01:20:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.430+0000 7fc3cd2d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a400c590 con 0x55afbefd4070 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.431+0000 7fc3cd2d8740 10 client.0 _ll_register_callbacks cb 0x7fc3b8009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.431+0000 7fc3c5301640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf401460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.431+0000 7fc3c5301640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf401460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:34824/0 (socket says 172.21.15.37:34824) 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.431+0000 7fc3c5301640 1 -- 172.21.15.37:0/325123097 learned_addr learned my addr 172.21.15.37:0/325123097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.433+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbef929f0 0x55afbf38a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.433+0000 7fc3bffff640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefab1b0 0x55afbf38aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.434+0000 7fc3bffff640 1 -- 172.21.15.37:0/325123097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 msgr2=0x55afbf401460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.434+0000 7fc3bffff640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf401460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.434+0000 7fc3bffff640 1 -- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbef929f0 msgr2=0x55afbf38a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.434+0000 7fc3bffff640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbef929f0 0x55afbf38a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.434+0000 7fc3bffff640 1 -- 172.21.15.37:0/325123097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbf4019a0 con 0x55afbefab1b0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.434+0000 7fc3bffff640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefab1b0 0x55afbf38aae0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac010550 tx=0x7fc3ac01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e956d4c9e200a1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.435+0000 7fc39ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:20:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.439+0000 7fc39ffff640 1 -- 172.21.15.37:0/325123097 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac033020 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.439+0000 7fc39ffff640 1 -- 172.21.15.37:0/325123097 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc3ac01a450 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.439+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3b40acfc0 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.440+0000 7fc39ffff640 1 -- 172.21.15.37:0/325123097 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3ac0045f0 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.440+0000 7fc3cd2d8740 10 client.16386 fetch_fsmap learned FSMap version 30 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.441+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55afbf402c10 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.442+0000 7fc39ffff640 1 -- 172.21.15.37:0/325123097 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55afbf2f3da0 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.442+0000 7fc39ffff640 1 -- 172.21.15.37:0/325123097 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc3ac021070 con 0x55afbefab1b0 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.442+0000 7fc3cd2d8740 10 client.16386 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.442+0000 7fc3cd2d8740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.442+0000 7fc3cd2d8740 20 client.16386 populate_metadata read hostname 'smithi037' 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.442+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbf403250 0x55afbf405670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.443+0000 7fc3cd2d8740 4 client.16386 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.443+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc3b40acfc0 con 0x55afbf403250 2024-09-21T01:20:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.449+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbf403250 0x55afbf405670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.472+0000 7fc3c4b00640 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbf403250 0x55afbf405670 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca0d4aef3535631 server_cookie=f23d8f1206055bd1 in_seq=0 out_seq=0 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.472+0000 7fc39ffff640 10 client.16386 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.481+0000 7fc39ffff640 1 -- 172.21.15.37:0/325123097 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x7fc3b40acfc0 con 0x55afbf403250 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.481+0000 7fc39ffff640 10 client.16386 handle_command_reply: tid=0 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.481+0000 7fc3cd2d8740 1 client.16386 shutdown 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.482+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefab1b0 msgr2=0x55afbf38aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.482+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefab1b0 0x55afbf38aae0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac010550 tx=0x7fc3ac01c040 comp rx=0 tx=0).stop 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 shutdown_connections 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55afbf403250 0x55afbf405670 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc39ffff640 0 client.16386 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55afbefd4070 0x55afbf401460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55afbefab1b0 0x55afbf38aae0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc3cd2d8740 1 --2- 172.21.15.37:0/325123097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55afbef929f0 0x55afbf38a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.483+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 >> 172.21.15.37:0/325123097 conn(0x55afbefc8460 msgr2=0x55afbf3816a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.484+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 shutdown_connections 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "5a2712c0-9041-4bb0-9189-f394a9406090", 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:20:59.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:59.516 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:20:59.517 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:20:59.518 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.485+0000 7fc3cd2d8740 1 -- 172.21.15.37:0/325123097 wait complete. 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.485+0000 7fc3cd2d8740 20 client.16386 trim_cache size 0 max 16384 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc3b00b66e0 msgr2=0x7fc3b00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc3b00b66e0 0x7fc3b00b8bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009a60 tx=0x7fc3b8009800 comp rx=0 tx=0).stop 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c010a190 msgr2=0x7fc3c01a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c010a190 0x7fc3c01a0bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400b3e0 tx=0x7fc3b400b8a0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 shutdown_connections 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc3b00b66e0 0x7fc3b00b8bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c0110420 0x7fc3c01a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc3c010fad0 0x7fc3c01a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 --2- 172.21.15.37:0/821721446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c010a190 0x7fc3c01a0bc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:20:59.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 >> 172.21.15.37:0/821721446 conn(0x7fc3c00780f0 msgr2=0x7fc3c01081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:20:59.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 shutdown_connections 2024-09-21T01:20:59.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:20:59.487+0000 7fc3c6d64640 1 -- 172.21.15.37:0/821721446 wait complete. 2024-09-21T01:21:01.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:00 smithi137 ceph-mon[34607]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 899 MiB/s wr, 2.29k op/s 2024-09-21T01:21:01.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:00 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:21:01.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:00 smithi144 ceph-mon[34818]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 899 MiB/s wr, 2.29k op/s 2024-09-21T01:21:01.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:00 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:21:01.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:00 smithi037 ceph-mon[31105]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 899 MiB/s wr, 2.29k op/s 2024-09-21T01:21:01.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:00 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:21:02.071 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:01 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:21:02.071 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:01 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:21:02.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:01 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:21:02.978 INFO:tasks.cephfs.filesystem:scrub status for tag:5a2712c0-9041-4bb0-9189-f394a9406090 - {'path': '/', 'tag': '5a2712c0-9041-4bb0-9189-f394a9406090', 'options': 'recursive,force'} 2024-09-21T01:21:03.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:02 smithi137 ceph-mon[34607]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 883 MiB/s wr, 2.46k op/s 2024-09-21T01:21:03.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:02 smithi144 ceph-mon[34818]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 883 MiB/s wr, 2.46k op/s 2024-09-21T01:21:03.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:02 smithi037 ceph-mon[31105]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 883 MiB/s wr, 2.46k op/s 2024-09-21T01:21:05.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:04 smithi137 ceph-mon[34607]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.27k op/s 2024-09-21T01:21:05.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:04 smithi144 ceph-mon[34818]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.27k op/s 2024-09-21T01:21:05.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:04 smithi037 ceph-mon[31105]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.27k op/s 2024-09-21T01:21:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.952+0000 7fa448f90640 1 -- 172.21.15.37:0/3031894156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410f9d0 msgr2=0x7fa44411ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.952+0000 7fa448f90640 1 --2- 172.21.15.37:0/3031894156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410f9d0 0x7fa44411ab90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009ca0 tx=0x7fa43c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.954+0000 7fa448f90640 1 -- 172.21.15.37:0/3031894156 shutdown_connections 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.954+0000 7fa448f90640 1 --2- 172.21.15.37:0/3031894156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410f9d0 0x7fa44411ab90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.954+0000 7fa448f90640 1 --2- 172.21.15.37:0/3031894156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410cdb0 0x7fa44410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.954+0000 7fa448f90640 1 --2- 172.21.15.37:0/3031894156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa44410a3c0 0x7fa44410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.954+0000 7fa448f90640 1 -- 172.21.15.37:0/3031894156 >> 172.21.15.37:0/3031894156 conn(0x7fa444070810 msgr2=0x7fa444072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.955+0000 7fa448f90640 1 -- 172.21.15.37:0/3031894156 shutdown_connections 2024-09-21T01:21:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.955+0000 7fa448f90640 1 -- 172.21.15.37:0/3031894156 wait complete. 2024-09-21T01:21:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.956+0000 7fa448f90640 1 Processor -- start 2024-09-21T01:21:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.957+0000 7fa448f90640 1 -- start start 2024-09-21T01:21:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.957+0000 7fa448f90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410a3c0 0x7fa4441a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa448f90640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa44410cdb0 0x7fa4441a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa448f90640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 0x7fa4441a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa44259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410a3c0 0x7fa4441a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa448f90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa44411e210 con 0x7fa44410a3c0 2024-09-21T01:21:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa448f90640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa44411e090 con 0x7fa44410cdb0 2024-09-21T01:21:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa448f90640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa44411e390 con 0x7fa44410f9d0 2024-09-21T01:21:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 0x7fa4441a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.958+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 0x7fa4441a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43020/0 (socket says 172.21.15.37:43020) 2024-09-21T01:21:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.959+0000 7fa442d9d640 1 -- 172.21.15.37:0/1156107425 learned_addr learned my addr 172.21.15.37:0/1156107425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.959+0000 7fa441d9b640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa44410cdb0 0x7fa4441a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.960+0000 7fa442d9d640 1 -- 172.21.15.37:0/1156107425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa44410cdb0 msgr2=0x7fa4441a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.960+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa44410cdb0 0x7fa4441a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.960+0000 7fa442d9d640 1 -- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410a3c0 msgr2=0x7fa4441a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.960+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410a3c0 0x7fa4441a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.960+0000 7fa442d9d640 1 -- 172.21.15.37:0/1156107425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4441aa6d0 con 0x7fa44410f9d0 2024-09-21T01:21:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.961+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 0x7fa4441a9eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009bf0 tx=0x7fa43c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.963+0000 7fa4337fe640 1 -- 172.21.15.37:0/1156107425 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c004040 con 0x7fa44410f9d0 2024-09-21T01:21:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.963+0000 7fa4337fe640 1 -- 172.21.15.37:0/1156107425 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43c004690 con 0x7fa44410f9d0 2024-09-21T01:21:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.963+0000 7fa4337fe640 1 -- 172.21.15.37:0/1156107425 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0305c0 con 0x7fa44410f9d0 2024-09-21T01:21:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.963+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4441aa960 con 0x7fa44410f9d0 2024-09-21T01:21:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.963+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4441b10b0 con 0x7fa44410f9d0 2024-09-21T01:21:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.972+0000 7fa4337fe640 1 -- 172.21.15.37:0/1156107425 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa43c02f610 con 0x7fa44410f9d0 2024-09-21T01:21:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.974+0000 7fa4337fe640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b66e0 0x7fa42c0b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.974+0000 7fa4337fe640 1 -- 172.21.15.37:0/1156107425 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa43c108960 con 0x7fa44410f9d0 2024-09-21T01:21:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.975+0000 7fa44259c640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b66e0 0x7fa42c0b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:05.984+0000 7fa44259c640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b66e0 0x7fa42c0b8bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa438009990 tx=0x7fa438009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.003+0000 7fa44ffdc740 1 Processor -- start 2024-09-21T01:21:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.005+0000 7fa44ffdc740 1 -- start start 2024-09-21T01:21:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.006+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f84e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.006+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f85480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.006+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f85fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.006+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bc00ef76f0 con 0x55bc00bb42f0 2024-09-21T01:21:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.006+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bc00ee6b20 con 0x55bc00bbc4d0 2024-09-21T01:21:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.006+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc00eea930 con 0x55bc00bdd1b0 2024-09-21T01:21:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.007+0000 7fa44259c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f84e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.007+0000 7fa44259c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f84e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43026/0 (socket says 172.21.15.37:43026) 2024-09-21T01:21:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.007+0000 7fa44259c640 1 -- 172.21.15.37:0/567336707 learned_addr learned my addr 172.21.15.37:0/567336707 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.010+0000 7fa442d9d640 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f85fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.018+0000 7fa442d9d640 1 -- 172.21.15.37:0/567336707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 msgr2=0x55bc00f84e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.018+0000 7fa442d9d640 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f84e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.018+0000 7fa442d9d640 1 -- 172.21.15.37:0/567336707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 msgr2=0x55bc00f85480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.018+0000 7fa442d9d640 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f85480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.018+0000 7fa442d9d640 1 -- 172.21.15.37:0/567336707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc00eac530 con 0x55bc00bbc4d0 2024-09-21T01:21:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.021+0000 7fa442d9d640 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f85fd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa43c106420 tx=0x7fa43c0ce940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d825941eb5ac1c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.024+0000 7fa430ff9640 1 -- 172.21.15.37:0/567336707 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0ce5c0 con 0x55bc00bbc4d0 2024-09-21T01:21:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.024+0000 7fa430ff9640 1 -- 172.21.15.37:0/567336707 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43c036040 con 0x55bc00bbc4d0 2024-09-21T01:21:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.024+0000 7fa430ff9640 1 -- 172.21.15.37:0/567336707 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c009870 con 0x55bc00bbc4d0 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.025+0000 7fa44ffdc740 1 -- 172.21.15.37:0/567336707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 msgr2=0x55bc00f85fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.025+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f85fd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa43c106420 tx=0x7fa43c0ce940 comp rx=0 tx=0).stop 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.026+0000 7fa44ffdc740 1 -- 172.21.15.37:0/567336707 shutdown_connections 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.026+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f85fd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.026+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f85480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.026+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/567336707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f84e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.026+0000 7fa44ffdc740 1 -- 172.21.15.37:0/567336707 >> 172.21.15.37:0/567336707 conn(0x55bc00bd1300 msgr2=0x55bc00f808a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.027+0000 7fa44ffdc740 1 -- 172.21.15.37:0/567336707 shutdown_connections 2024-09-21T01:21:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.040+0000 7fa44ffdc740 1 -- 172.21.15.37:0/567336707 wait complete. 2024-09-21T01:21:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.041+0000 7fa44ffdc740 1 -- start start 2024-09-21T01:21:06.042 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.041+0000 7fa44ffdc740 1 Processor -- start 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f9f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e1eab0 con 0x55bc00bb42f0 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e8c730 con 0x55bc00bdd1b0 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc00ee6b20 con 0x55bc00bbc4d0 2024-09-21T01:21:06.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.044+0000 7fa44ffdc740 10 client.0 _ll_register_callbacks cb 0x55bc00ee06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.047+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.047+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.055+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:58798/0 (socket says 172.21.15.37:58798) 2024-09-21T01:21:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.055+0000 7fa442d9d640 1 -- 172.21.15.37:0/874178545 learned_addr learned my addr 172.21.15.37:0/874178545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.056+0000 7fa441d9b640 1 -- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 msgr2=0x55bc00fa0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.056+0000 7fa441d9b640 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.056+0000 7fa441d9b640 1 -- 172.21.15.37:0/874178545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 msgr2=0x55bc00f9f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.056+0000 7fa441d9b640 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f9f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.056+0000 7fa441d9b640 1 -- 172.21.15.37:0/874178545 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc00c48790 con 0x55bc00bbc4d0 2024-09-21T01:21:06.059 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.059+0000 7fa441d9b640 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9f820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa43400bf60 tx=0x7fa43400bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d1b0c31c144d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.059+0000 7fa429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.068+0000 7fa429ffb640 1 -- 172.21.15.37:0/874178545 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434014430 con 0x55bc00bbc4d0 2024-09-21T01:21:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.068+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa43c036040 con 0x55bc00bbc4d0 2024-09-21T01:21:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.068+0000 7fa429ffb640 1 -- 172.21.15.37:0/874178545 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4340145d0 con 0x55bc00bbc4d0 2024-09-21T01:21:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.075+0000 7fa429ffb640 1 -- 172.21.15.37:0/874178545 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4340147d0 con 0x55bc00bbc4d0 2024-09-21T01:21:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.075+0000 7fa44ffdc740 10 client.25804 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:06.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.076+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bc00cc1620 con 0x55bc00bbc4d0 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa429ffb640 1 -- 172.21.15.37:0/874178545 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43c036040 con 0x55bc00bbc4d0 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa429ffb640 1 -- 172.21.15.37:0/874178545 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa434013070 con 0x55bc00bbc4d0 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa44ffdc740 10 client.25804 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa44ffdc740 10 client.25804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa44ffdc740 20 client.25804 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b9bd80 0x55bc00face60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa44ffdc740 4 client.25804 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:21:06.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.079+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc00ef9640 con 0x55bc00b9bd80 2024-09-21T01:21:06.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.082+0000 7fa44259c640 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b9bd80 0x55bc00face60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.085+0000 7fa44259c640 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b9bd80 0x55bc00face60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5b2952b88184dc server_cookie=671ac14bfea775f9 in_seq=0 out_seq=0 2024-09-21T01:21:06.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.085+0000 7fa429ffb640 10 client.25804 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.088+0000 7fa429ffb640 1 -- 172.21.15.37:0/874178545 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc00ef9640 con 0x55bc00b9bd80 2024-09-21T01:21:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.088+0000 7fa429ffb640 10 client.25804 handle_command_reply: tid=0 2024-09-21T01:21:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.088+0000 7fa44ffdc740 1 client.25804 shutdown 2024-09-21T01:21:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.096+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 msgr2=0x55bc00f9f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.096+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9f820 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa43400bf60 tx=0x7fa43400bf90 comp rx=0 tx=0).stop 2024-09-21T01:21:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 shutdown_connections 2024-09-21T01:21:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b9bd80 0x55bc00face60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9f820 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/874178545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f9f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 >> 172.21.15.37:0/874178545 conn(0x55bc00bd1300 msgr2=0x55bc00f7eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.097+0000 7fa429ffb640 0 client.25804 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.100+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 shutdown_connections 2024-09-21T01:21:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.102+0000 7fa44ffdc740 1 -- 172.21.15.37:0/874178545 wait complete. 2024-09-21T01:21:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.102+0000 7fa44ffdc740 20 client.25804 trim_cache size 0 max 16384 2024-09-21T01:21:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.168+0000 7fa44ffdc740 1 Processor -- start 2024-09-21T01:21:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.168+0000 7fa44ffdc740 1 -- start start 2024-09-21T01:21:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.169+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f801e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.169+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.169+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f9e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.170+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b1700 con 0x55bc00bb42f0 2024-09-21T01:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.170+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b3240 con 0x55bc00bbc4d0 2024-09-21T01:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.170+0000 7fa44259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.170+0000 7fa44259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f801e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53086/0 (socket says 172.21.15.37:53086) 2024-09-21T01:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.170+0000 7fa44259c640 1 -- 172.21.15.37:0/1228867116 learned_addr learned my addr 172.21.15.37:0/1228867116 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.170+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1228867116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b1dd0 con 0x55bc00bdd1b0 2024-09-21T01:21:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.172+0000 7fa441d9b640 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.172+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f9e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.186+0000 7fa442d9d640 1 -- 172.21.15.37:0/1228867116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 msgr2=0x55bc00f9e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.186+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.186+0000 7fa442d9d640 1 -- 172.21.15.37:0/1228867116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 msgr2=0x55bc00f801e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.186+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f801e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.186+0000 7fa442d9d640 1 -- 172.21.15.37:0/1228867116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc00fa06c0 con 0x55bc00bdd1b0 2024-09-21T01:21:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.198+0000 7fa442d9d640 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f9e8a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0cbd20 tx=0x7fa43c009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45a7d4fc0481d2e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.201+0000 7fa42bfff640 1 -- 172.21.15.37:0/1228867116 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0ce5c0 con 0x55bc00bdd1b0 2024-09-21T01:21:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.201+0000 7fa42bfff640 1 -- 172.21.15.37:0/1228867116 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43c036070 con 0x55bc00bdd1b0 2024-09-21T01:21:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.201+0000 7fa42bfff640 1 -- 172.21.15.37:0/1228867116 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0cad20 con 0x55bc00bdd1b0 2024-09-21T01:21:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.205+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1228867116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 msgr2=0x55bc00f9e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.205+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f9e8a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0cbd20 tx=0x7fa43c009470 comp rx=0 tx=0).stop 2024-09-21T01:21:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1228867116 shutdown_connections 2024-09-21T01:21:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bdd1b0 0x55bc00f9e8a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bbc4d0 0x55bc00f9e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1228867116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00f801e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1228867116 >> 172.21.15.37:0/1228867116 conn(0x55bc00bd1300 msgr2=0x55bc00f8c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1228867116 shutdown_connections 2024-09-21T01:21:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.206+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1228867116 wait complete. 2024-09-21T01:21:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.207+0000 7fa44ffdc740 1 -- start start 2024-09-21T01:21:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.207+0000 7fa44ffdc740 1 Processor -- start 2024-09-21T01:21:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.208+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00fa4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.209+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00fa4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.209+0000 7fa44ffdc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.209+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b2b70 con 0x55bc00bb42f0 2024-09-21T01:21:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.209+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b24a0 con 0x55bc00bdd1b0 2024-09-21T01:21:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.209+0000 7fa44ffdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa444118fc0 con 0x55bc00bbc4d0 2024-09-21T01:21:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.210+0000 7fa44ffdc740 10 client.0 _ll_register_callbacks cb 0x7fa43400b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.210+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00fa4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.210+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.210+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:58806/0 (socket says 172.21.15.37:58806) 2024-09-21T01:21:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.210+0000 7fa442d9d640 1 -- 172.21.15.37:0/1832330349 learned_addr learned my addr 172.21.15.37:0/1832330349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.211+0000 7fa44259c640 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00fa4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.211+0000 7fa441d9b640 1 -- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 msgr2=0x55bc00fa5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.211+0000 7fa441d9b640 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.211+0000 7fa441d9b640 1 -- 172.21.15.37:0/1832330349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 msgr2=0x55bc00fa4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.211+0000 7fa441d9b640 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00fa4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.211+0000 7fa441d9b640 1 -- 172.21.15.37:0/1832330349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc00fa5dd0 con 0x55bc00bbc4d0 2024-09-21T01:21:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.214+0000 7fa441d9b640 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00fa4b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa434004810 tx=0x7fa434014660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c46d1a219bec0c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.215+0000 7fa429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.215+0000 7fa429ffb640 1 -- 172.21.15.37:0/1832330349 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43402e070 con 0x55bc00bbc4d0 2024-09-21T01:21:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.215+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa43c036070 con 0x55bc00bbc4d0 2024-09-21T01:21:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.215+0000 7fa429ffb640 1 -- 172.21.15.37:0/1832330349 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa434014b80 con 0x55bc00bbc4d0 2024-09-21T01:21:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.216+0000 7fa429ffb640 1 -- 172.21.15.37:0/1832330349 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa434039050 con 0x55bc00bbc4d0 2024-09-21T01:21:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.218+0000 7fa44ffdc740 10 client.25810 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.218+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bc00fa7110 con 0x55bc00bbc4d0 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.219+0000 7fa429ffb640 1 -- 172.21.15.37:0/1832330349 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43c036070 con 0x55bc00bbc4d0 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.219+0000 7fa429ffb640 1 -- 172.21.15.37:0/1832330349 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa43402a700 con 0x55bc00bbc4d0 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.220+0000 7fa44ffdc740 10 client.25810 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.220+0000 7fa44ffdc740 10 client.25810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.220+0000 7fa44ffdc740 20 client.25810 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.220+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b711c0 0x55bc01019b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.220+0000 7fa44ffdc740 4 client.25810 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:21:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.220+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc00ef50f0 con 0x55bc00b711c0 2024-09-21T01:21:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.224+0000 7fa44259c640 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b711c0 0x55bc01019b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.234+0000 7fa44259c640 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b711c0 0x55bc01019b60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=741d6f2420634bc1 server_cookie=cc941dfa6e2b3c3f in_seq=0 out_seq=0 2024-09-21T01:21:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:06.235+0000 7fa429ffb640 10 client.25810 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:07.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:06 smithi137 ceph-mon[34607]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 906 MiB/s wr, 2.33k op/s 2024-09-21T01:21:07.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:06 smithi144 ceph-mon[34818]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 906 MiB/s wr, 2.33k op/s 2024-09-21T01:21:07.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:06 smithi037 ceph-mon[31105]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 906 MiB/s wr, 2.33k op/s 2024-09-21T01:21:09.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:08 smithi137 ceph-mon[34607]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 766 MiB/s wr, 1.88k op/s 2024-09-21T01:21:09.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:08 smithi144 ceph-mon[34818]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 766 MiB/s wr, 1.88k op/s 2024-09-21T01:21:09.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:08 smithi037 ceph-mon[31105]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 766 MiB/s wr, 1.88k op/s 2024-09-21T01:21:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.565+0000 7fa429ffb640 1 -- 172.21.15.37:0/1832330349 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc00ef50f0 con 0x55bc00b711c0 2024-09-21T01:21:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.565+0000 7fa429ffb640 10 client.25810 handle_command_reply: tid=0 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.565+0000 7fa44ffdc740 1 client.25810 shutdown 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 msgr2=0x55bc00fa4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00fa4b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa434004810 tx=0x7fa434014660 comp rx=0 tx=0).stop 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 shutdown_connections 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bc00b711c0 0x55bc01019b60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bc00bdd1b0 0x55bc00fa5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc00bbc4d0 0x55bc00fa4b00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 --2- 172.21.15.37:0/1832330349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc00bb42f0 0x55bc00fa4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 >> 172.21.15.37:0/1832330349 conn(0x55bc00bd1300 msgr2=0x55bc00f84db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.566+0000 7fa429ffb640 0 client.25810 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.569+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 shutdown_connections 2024-09-21T01:21:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.570+0000 7fa44ffdc740 1 -- 172.21.15.37:0/1832330349 wait complete. 2024-09-21T01:21:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.570+0000 7fa44ffdc740 20 client.25810 trim_cache size 0 max 16384 2024-09-21T01:21:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:21:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:21:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:21:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:21:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b66e0 msgr2=0x7fa42c0b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b66e0 0x7fa42c0b8bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa438009990 tx=0x7fa438009110 comp rx=0 tx=0).stop 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 msgr2=0x7fa4441a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 0x7fa4441a9eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009bf0 tx=0x7fa43c003ba0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 shutdown_connections 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa42c0b66e0 0x7fa42c0b8bf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa44410f9d0 0x7fa4441a9eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa44410cdb0 0x7fa4441a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 --2- 172.21.15.37:0/1156107425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa44410a3c0 0x7fa4441a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.581+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 >> 172.21.15.37:0/1156107425 conn(0x7fa444070810 msgr2=0x7fa44410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:10.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.582+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 shutdown_connections 2024-09-21T01:21:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:10.582+0000 7fa448f90640 1 -- 172.21.15.37:0/1156107425 wait complete. 2024-09-21T01:21:11.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:10 smithi137 ceph-mon[34607]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 895 MiB/s wr, 2.15k op/s 2024-09-21T01:21:11.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:10 smithi144 ceph-mon[34818]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 895 MiB/s wr, 2.15k op/s 2024-09-21T01:21:11.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:10 smithi037 ceph-mon[31105]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 895 MiB/s wr, 2.15k op/s 2024-09-21T01:21:13.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:12 smithi137 ceph-mon[34607]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 906 MiB/s wr, 1.95k op/s 2024-09-21T01:21:13.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:12 smithi144 ceph-mon[34818]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 906 MiB/s wr, 1.95k op/s 2024-09-21T01:21:13.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:12 smithi037 ceph-mon[31105]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 906 MiB/s wr, 1.95k op/s 2024-09-21T01:21:15.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:14 smithi137 ceph-mon[34607]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 854 MiB/s wr, 1.89k op/s 2024-09-21T01:21:15.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:14 smithi144 ceph-mon[34818]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 854 MiB/s wr, 1.89k op/s 2024-09-21T01:21:15.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:14 smithi037 ceph-mon[31105]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 854 MiB/s wr, 1.89k op/s 2024-09-21T01:21:16.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:15 smithi137 ceph-mon[34607]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 916 MiB/s wr, 2.14k op/s 2024-09-21T01:21:16.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:15 smithi144 ceph-mon[34818]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 916 MiB/s wr, 2.14k op/s 2024-09-21T01:21:16.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:15 smithi037 ceph-mon[31105]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 916 MiB/s wr, 2.14k op/s 2024-09-21T01:21:18.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:18 smithi037 ceph-mon[31105]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 770 MiB/s wr, 1.92k op/s 2024-09-21T01:21:18.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:18 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:21:18.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:18 smithi137 ceph-mon[34607]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 770 MiB/s wr, 1.92k op/s 2024-09-21T01:21:18.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:18 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:21:18.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:18 smithi144 ceph-mon[34818]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 770 MiB/s wr, 1.92k op/s 2024-09-21T01:21:18.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:18 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:21:20.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:20 smithi137 ceph-mon[34607]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 910 MiB/s wr, 2.08k op/s 2024-09-21T01:21:20.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:20 smithi144 ceph-mon[34818]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 910 MiB/s wr, 2.08k op/s 2024-09-21T01:21:20.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:20 smithi037 ceph-mon[31105]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 910 MiB/s wr, 2.08k op/s 2024-09-21T01:21:22.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:22 smithi137 ceph-mon[34607]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 911 MiB/s wr, 1.98k op/s 2024-09-21T01:21:22.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:22 smithi144 ceph-mon[34818]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 911 MiB/s wr, 1.98k op/s 2024-09-21T01:21:22.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:22 smithi037 ceph-mon[31105]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 911 MiB/s wr, 1.98k op/s 2024-09-21T01:21:23.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:23 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:21:23.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:23 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:21:23.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:23 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:21:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:23 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:21:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:23 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:21:23.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:23 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:21:23.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:23 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:21:23.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:23 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:21:23.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:23 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:21:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.858+0000 7f507330b640 1 -- 172.21.15.37:0/1134734221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c103620 msgr2=0x7f506c103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.858+0000 7f507330b640 1 --2- 172.21.15.37:0/1134734221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c103620 0x7f506c103a30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5060009900 tx=0x7f506002a440 comp rx=0 tx=0).stop 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 -- 172.21.15.37:0/1134734221 shutdown_connections 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 --2- 172.21.15.37:0/1134734221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f506c103fc0 0x7f506c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 --2- 172.21.15.37:0/1134734221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c103620 0x7f506c103a30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 --2- 172.21.15.37:0/1134734221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f506c1025a0 0x7f506c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 -- 172.21.15.37:0/1134734221 >> 172.21.15.37:0/1134734221 conn(0x7f506c0fdee0 msgr2=0x7f506c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 -- 172.21.15.37:0/1134734221 shutdown_connections 2024-09-21T01:21:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.859+0000 7f507330b640 1 -- 172.21.15.37:0/1134734221 wait complete. 2024-09-21T01:21:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 Processor -- start 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 -- start start 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 0x7f506c10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f506c103620 0x7f506c10b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f506c103fc0 0x7f506c10bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10f450 con 0x7f506c1025a0 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10f2d0 con 0x7f506c103620 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.864+0000 7f507330b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10f5d0 con 0x7f506c103fc0 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.865+0000 7f50710a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 0x7f506c10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.865+0000 7f50710a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 0x7f506c10cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42308/0 (socket says 172.21.15.37:42308) 2024-09-21T01:21:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.865+0000 7f50710a7640 1 -- 172.21.15.37:0/184598834 learned_addr learned my addr 172.21.15.37:0/184598834 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50708a6640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f506c103620 0x7f506c10b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50710a7640 1 -- 172.21.15.37:0/184598834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f506c103fc0 msgr2=0x7f506c10bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50718a8640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f506c103fc0 0x7f506c10bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50710a7640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f506c103fc0 0x7f506c10bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50710a7640 1 -- 172.21.15.37:0/184598834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f506c103620 msgr2=0x7f506c10b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50710a7640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f506c103620 0x7f506c10b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.866+0000 7f50710a7640 1 -- 172.21.15.37:0/184598834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c19df60 con 0x7f506c1025a0 2024-09-21T01:21:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.867+0000 7f50710a7640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 0x7f506c10cd10 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f506400ba50 tx=0x7f506400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.869+0000 7f506a7fc640 1 -- 172.21.15.37:0/184598834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064019070 con 0x7f506c1025a0 2024-09-21T01:21:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.869+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c19e250 con 0x7f506c1025a0 2024-09-21T01:21:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.869+0000 7f506a7fc640 1 -- 172.21.15.37:0/184598834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f506400cc10 con 0x7f506c1025a0 2024-09-21T01:21:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.869+0000 7f506a7fc640 1 -- 172.21.15.37:0/184598834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640075d0 con 0x7f506c1025a0 2024-09-21T01:21:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.869+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c19e820 con 0x7f506c1025a0 2024-09-21T01:21:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.874+0000 7f507a275740 1 Processor -- start 2024-09-21T01:21:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.877+0000 7f506a7fc640 1 -- 172.21.15.37:0/184598834 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f506401c070 con 0x7f506c1025a0 2024-09-21T01:21:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.876+0000 7f507a275740 1 -- start start 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f507a275740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d83fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f507a275740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d46f2f0 0x55cc7d8404c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f507a275740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d4774d0 0x55cc7d841010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f507a275740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc7d7b26f0 con 0x55cc7d4981b0 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f507a275740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc7d7a1b20 con 0x55cc7d4774d0 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f507a275740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc7d7a5930 con 0x55cc7d46f2f0 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f506a7fc640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50540b66e0 0x7f50540b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f50718a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d83fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f50718a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d83fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42318/0 (socket says 172.21.15.37:42318) 2024-09-21T01:21:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.878+0000 7f50718a8640 1 -- 172.21.15.37:0/2617734298 learned_addr learned my addr 172.21.15.37:0/2617734298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.879+0000 7f50710a7640 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d46f2f0 0x55cc7d8404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.879+0000 7f506a7fc640 1 -- 172.21.15.37:0/184598834 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f50640e6830 con 0x7f506c1025a0 2024-09-21T01:21:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.879+0000 7f50718a8640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50540b66e0 0x7f50540b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.879+0000 7f50708a6640 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d4774d0 0x55cc7d841010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50710a7640 1 -- 172.21.15.37:0/2617734298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d4774d0 msgr2=0x55cc7d841010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50710a7640 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d4774d0 0x55cc7d841010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50710a7640 1 -- 172.21.15.37:0/2617734298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 msgr2=0x55cc7d83fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50710a7640 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d83fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50710a7640 1 -- 172.21.15.37:0/2617734298 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7d767530 con 0x55cc7d46f2f0 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50718a8640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50540b66e0 0x7f50540b8bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f505c00ef00 tx=0x7f505c00e400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.880+0000 7f50710a7640 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d46f2f0 0x55cc7d8404c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50640a8f50 tx=0x7f506400f980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b959aca1f7459824 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.882+0000 7f50537fe640 1 -- 172.21.15.37:0/2617734298 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640a80f0 con 0x55cc7d46f2f0 2024-09-21T01:21:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.882+0000 7f50537fe640 1 -- 172.21.15.37:0/2617734298 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50640ac490 con 0x55cc7d46f2f0 2024-09-21T01:21:23.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.882+0000 7f50537fe640 1 -- 172.21.15.37:0/2617734298 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640d0040 con 0x55cc7d46f2f0 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 -- 172.21.15.37:0/2617734298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d46f2f0 msgr2=0x55cc7d8404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d46f2f0 0x55cc7d8404c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50640a8f50 tx=0x7f506400f980 comp rx=0 tx=0).stop 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 -- 172.21.15.37:0/2617734298 shutdown_connections 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d4774d0 0x55cc7d841010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d46f2f0 0x55cc7d8404c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 --2- 172.21.15.37:0/2617734298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d83fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 -- 172.21.15.37:0/2617734298 >> 172.21.15.37:0/2617734298 conn(0x55cc7d48c300 msgr2=0x55cc7d83b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 -- 172.21.15.37:0/2617734298 shutdown_connections 2024-09-21T01:21:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.885+0000 7f507a275740 1 -- 172.21.15.37:0/2617734298 wait complete. 2024-09-21T01:21:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.886+0000 7f507a275740 1 -- start start 2024-09-21T01:21:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.887+0000 7f507a275740 1 Processor -- start 2024-09-21T01:21:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.888+0000 7f507a275740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d849690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.888+0000 7f507a275740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d849d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.888+0000 7f507a275740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.888+0000 7f507a275740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc7d6d9ab0 con 0x55cc7d4981b0 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.888+0000 7f507a275740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc7d747730 con 0x55cc7d46f2f0 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.889+0000 7f507a275740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc7d841b30 con 0x55cc7d4774d0 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.889+0000 7f50710a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d849690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.889+0000 7f50710a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d849690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:56116/0 (socket says 172.21.15.37:56116) 2024-09-21T01:21:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.889+0000 7f50710a7640 1 -- 172.21.15.37:0/4145633646 learned_addr learned my addr 172.21.15.37:0/4145633646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.889+0000 7f507a275740 10 client.0 _ll_register_callbacks cb 0x55cc7d79b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.889+0000 7f50708a6640 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d849d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.890+0000 7f50710a7640 1 -- 172.21.15.37:0/4145633646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 msgr2=0x55cc7d849d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.890+0000 7f50710a7640 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d849d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.890+0000 7f50710a7640 1 -- 172.21.15.37:0/4145633646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 msgr2=0x55cc7d84a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.890+0000 7f50710a7640 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.890+0000 7f50710a7640 1 -- 172.21.15.37:0/4145633646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7d503790 con 0x55cc7d46f2f0 2024-09-21T01:21:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.891+0000 7f50710a7640 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d849690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50640ac680 tx=0x7f50640a8e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78dc876bc90df27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.894+0000 7f5050ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:21:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.910+0000 7f5050ff9640 1 -- 172.21.15.37:0/4145633646 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640a80f0 con 0x55cc7d46f2f0 2024-09-21T01:21:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.910+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50640ac490 con 0x55cc7d46f2f0 2024-09-21T01:21:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.910+0000 7f5050ff9640 1 -- 172.21.15.37:0/4145633646 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f50640b5f10 con 0x55cc7d46f2f0 2024-09-21T01:21:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.911+0000 7f5050ff9640 1 -- 172.21.15.37:0/4145633646 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f50640b6110 con 0x55cc7d46f2f0 2024-09-21T01:21:23.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.916+0000 7f507a275740 10 client.25856 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:23.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.917+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cc7d57c620 con 0x55cc7d46f2f0 2024-09-21T01:21:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.917+0000 7f5050ff9640 1 -- 172.21.15.37:0/4145633646 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50640a82d0 con 0x55cc7d46f2f0 2024-09-21T01:21:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f5050ff9640 1 -- 172.21.15.37:0/4145633646 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f50640ab7b0 con 0x55cc7d46f2f0 2024-09-21T01:21:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f507a275740 10 client.25856 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f507a275740 10 client.25856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f507a275740 20 client.25856 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f507a275740 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d456d80 0x55cc7d856eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f507a275740 4 client.25856 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:21:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.918+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f50640ac490 con 0x55cc7d456d80 2024-09-21T01:21:23.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.920+0000 7f50708a6640 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d456d80 0x55cc7d856eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:23.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.926+0000 7f50708a6640 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d456d80 0x55cc7d856eb0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb652f78128d81cf server_cookie=9ee3e18c8a4c86b in_seq=0 out_seq=0 2024-09-21T01:21:23.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.926+0000 7f5050ff9640 10 client.25856 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.930+0000 7f5050ff9640 1 -- 172.21.15.37:0/4145633646 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f50640ac490 con 0x55cc7d456d80 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.930+0000 7f5050ff9640 10 client.25856 handle_command_reply: tid=0 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.930+0000 7f507a275740 1 client.25856 shutdown 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.932+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 msgr2=0x55cc7d849690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.932+0000 7f507a275740 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d849690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50640ac680 tx=0x7f50640a8e20 comp rx=0 tx=0).stop 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.933+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 shutdown_connections 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.933+0000 7f507a275740 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d456d80 0x55cc7d856eb0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.933+0000 7f507a275740 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.933+0000 7f507a275740 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d849d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.933+0000 7f507a275740 1 --2- 172.21.15.37:0/4145633646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d849690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.933+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 >> 172.21.15.37:0/4145633646 conn(0x55cc7d48c300 msgr2=0x55cc7d839ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.939+0000 7f5050ff9640 0 client.25856 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.940+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 shutdown_connections 2024-09-21T01:21:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.940+0000 7f507a275740 1 -- 172.21.15.37:0/4145633646 wait complete. 2024-09-21T01:21:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:23.940+0000 7f507a275740 20 client.25856 trim_cache size 0 max 16384 2024-09-21T01:21:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.009+0000 7f507a275740 1 Processor -- start 2024-09-21T01:21:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.009+0000 7f507a275740 1 -- start start 2024-09-21T01:21:24.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.010+0000 7f507a275740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d83ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.010+0000 7f507a275740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4774d0 0x55cc7d83b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.010+0000 7f507a275740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4981b0 0x55cc7d8365c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.011+0000 7f50710a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d83ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.011+0000 7f50710a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d83ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:56122/0 (socket says 172.21.15.37:56122) 2024-09-21T01:21:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.011+0000 7f50710a7640 1 -- 172.21.15.37:0/3123129468 learned_addr learned my addr 172.21.15.37:0/3123129468 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.011+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1ba030 con 0x55cc7d4774d0 2024-09-21T01:21:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.011+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1bbb70 con 0x55cc7d46f2f0 2024-09-21T01:21:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.011+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1ba700 con 0x55cc7d4981b0 2024-09-21T01:21:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.012+0000 7f50708a6640 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4774d0 0x55cc7d83b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.012+0000 7f50718a8640 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4981b0 0x55cc7d8365c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.020+0000 7f50708a6640 1 -- 172.21.15.37:0/3123129468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4981b0 msgr2=0x55cc7d8365c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.020+0000 7f50708a6640 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4981b0 0x55cc7d8365c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.020+0000 7f50708a6640 1 -- 172.21.15.37:0/3123129468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 msgr2=0x55cc7d83ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.020+0000 7f50708a6640 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d83ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.020+0000 7f50708a6640 1 -- 172.21.15.37:0/3123129468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7d83a510 con 0x55cc7d4774d0 2024-09-21T01:21:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.021+0000 7f50708a6640 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4774d0 0x55cc7d83b220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f506002a960 tx=0x7f5060000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f4926da9a1ab88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.026+0000 7f5052ffd640 1 -- 172.21.15.37:0/3123129468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060035040 con 0x55cc7d4774d0 2024-09-21T01:21:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.026+0000 7f5052ffd640 1 -- 172.21.15.37:0/3123129468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5060005390 con 0x55cc7d4774d0 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.026+0000 7f5052ffd640 1 -- 172.21.15.37:0/3123129468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060003ce0 con 0x55cc7d4774d0 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4774d0 msgr2=0x55cc7d83b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4774d0 0x55cc7d83b220 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f506002a960 tx=0x7f5060000bc0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 shutdown_connections 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4981b0 0x55cc7d8365c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4774d0 0x55cc7d83b220 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 --2- 172.21.15.37:0/3123129468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d83ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.028+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 >> 172.21.15.37:0/3123129468 conn(0x55cc7d48c300 msgr2=0x55cc7d856e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:24.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.029+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 shutdown_connections 2024-09-21T01:21:24.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.029+0000 7f507a275740 1 -- 172.21.15.37:0/3123129468 wait complete. 2024-09-21T01:21:24.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.029+0000 7f507a275740 1 -- start start 2024-09-21T01:21:24.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.030+0000 7f507a275740 1 Processor -- start 2024-09-21T01:21:24.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d84bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d84c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1bb4a0 con 0x55cc7d4981b0 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1badd0 con 0x55cc7d46f2f0 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f506c102a90 con 0x55cc7d4774d0 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f507a275740 10 client.0 _ll_register_callbacks cb 0x7f50640a9060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f50710a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d84bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.031+0000 7f50708a6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d84c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.032+0000 7f50708a6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d84c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39710/0 (socket says 172.21.15.37:39710) 2024-09-21T01:21:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.032+0000 7f50708a6640 1 -- 172.21.15.37:0/3560800091 learned_addr learned my addr 172.21.15.37:0/3560800091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.032+0000 7f50718a8640 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.033+0000 7f50708a6640 1 -- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 msgr2=0x55cc7d84bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.033+0000 7f50708a6640 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d84bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.033+0000 7f50708a6640 1 -- 172.21.15.37:0/3560800091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 msgr2=0x55cc7d84d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:24.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.033+0000 7f50708a6640 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:24.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.033+0000 7f50708a6640 1 -- 172.21.15.37:0/3560800091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7d84d7d0 con 0x55cc7d4774d0 2024-09-21T01:21:24.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.034+0000 7f50708a6640 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d84c640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50600096c0 tx=0x7f50600056a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3eba6db788449e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:24.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.034+0000 7f5050ff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.036+0000 7f5050ff9640 1 -- 172.21.15.37:0/3560800091 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506004f070 con 0x55cc7d4774d0 2024-09-21T01:21:24.043 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.043+0000 7f5050ff9640 1 -- 172.21.15.37:0/3560800091 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5060003a60 con 0x55cc7d4774d0 2024-09-21T01:21:24.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.044+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5060005390 con 0x55cc7d4774d0 2024-09-21T01:21:24.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.045+0000 7f5050ff9640 1 -- 172.21.15.37:0/3560800091 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5060035040 con 0x55cc7d4774d0 2024-09-21T01:21:24.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.048+0000 7f507a275740 10 client.25822 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:24.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.048+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cc7d850b70 con 0x55cc7d4774d0 2024-09-21T01:21:24.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.050+0000 7f5050ff9640 1 -- 172.21.15.37:0/3560800091 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5060005390 con 0x55cc7d4774d0 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.051+0000 7f5050ff9640 1 -- 172.21.15.37:0/3560800091 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f506003a040 con 0x55cc7d4774d0 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.055+0000 7f507a275740 10 client.25822 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.055+0000 7f507a275740 10 client.25822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.055+0000 7f507a275740 20 client.25822 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.055+0000 7f507a275740 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d42c1c0 0x55cc7d851480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.055+0000 7f507a275740 4 client.25822 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:21:24.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.055+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc7d7b4640 con 0x55cc7d42c1c0 2024-09-21T01:21:24.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.057+0000 7f50710a7640 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d42c1c0 0x55cc7d851480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.066+0000 7f50710a7640 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d42c1c0 0x55cc7d851480 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbeb5e5a0354c616 server_cookie=480b5dc724474105 in_seq=0 out_seq=0 2024-09-21T01:21:24.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:24.066+0000 7f5050ff9640 10 client.25822 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:24 smithi137 ceph-mon[34607]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 850 MiB/s wr, 1.69k op/s 2024-09-21T01:21:24.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:24 smithi144 ceph-mon[34818]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 850 MiB/s wr, 1.69k op/s 2024-09-21T01:21:25.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:24 smithi037 ceph-mon[31105]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 850 MiB/s wr, 1.69k op/s 2024-09-21T01:21:26.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:26 smithi137 ceph-mon[34607]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.69k op/s 2024-09-21T01:21:26.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:26 smithi144 ceph-mon[34818]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.69k op/s 2024-09-21T01:21:27.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:26 smithi037 ceph-mon[31105]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.69k op/s 2024-09-21T01:21:27.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.565+0000 7f5050ff9640 1 -- 172.21.15.37:0/3560800091 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc7d7b4640 con 0x55cc7d42c1c0 2024-09-21T01:21:27.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.565+0000 7f5050ff9640 10 client.25822 handle_command_reply: tid=0 2024-09-21T01:21:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.565+0000 7f507a275740 1 client.25822 shutdown 2024-09-21T01:21:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.566+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 msgr2=0x55cc7d84c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.566+0000 7f507a275740 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d84c640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50600096c0 tx=0x7f50600056a0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 shutdown_connections 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f507a275740 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55cc7d42c1c0 0x55cc7d851480 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f507a275740 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7d4981b0 0x55cc7d84d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f507a275740 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7d4774d0 0x55cc7d84c640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f507a275740 1 --2- 172.21.15.37:0/3560800091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc7d46f2f0 0x55cc7d84bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 >> 172.21.15.37:0/3560800091 conn(0x55cc7d48c300 msgr2=0x55cc7d83b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.567+0000 7f5050ff9640 0 client.25822 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.568+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 shutdown_connections 2024-09-21T01:21:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.570+0000 7f507a275740 1 -- 172.21.15.37:0/3560800091 wait complete. 2024-09-21T01:21:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.570+0000 7f507a275740 20 client.25822 trim_cache size 0 max 16384 2024-09-21T01:21:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:21:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:21:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:21:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:21:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.573+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50540b66e0 msgr2=0x7f50540b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.573+0000 7f507330b640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50540b66e0 0x7f50540b8bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f505c00ef00 tx=0x7f505c00e400 comp rx=0 tx=0).stop 2024-09-21T01:21:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.573+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 msgr2=0x7f506c10cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.573+0000 7f507330b640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 0x7f506c10cd10 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f506400ba50 tx=0x7f506400bf10 comp rx=0 tx=0).stop 2024-09-21T01:21:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.574+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 shutdown_connections 2024-09-21T01:21:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.574+0000 7f507330b640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f50540b66e0 0x7f50540b8bf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.574+0000 7f507330b640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f506c103fc0 0x7f506c10bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.574+0000 7f507330b640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f506c103620 0x7f506c10b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.574+0000 7f507330b640 1 --2- 172.21.15.37:0/184598834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f506c1025a0 0x7f506c10cd10 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.574+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 >> 172.21.15.37:0/184598834 conn(0x7f506c0fdee0 msgr2=0x7f506c106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.580+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 shutdown_connections 2024-09-21T01:21:27.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:27.582+0000 7f507330b640 1 -- 172.21.15.37:0/184598834 wait complete. 2024-09-21T01:21:28.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:28 smithi137 ceph-mon[34607]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 782 MiB/s wr, 1.44k op/s 2024-09-21T01:21:28.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:28 smithi144 ceph-mon[34818]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 782 MiB/s wr, 1.44k op/s 2024-09-21T01:21:29.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:28 smithi037 ceph-mon[31105]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 782 MiB/s wr, 1.44k op/s 2024-09-21T01:21:30.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:30 smithi137 ceph-mon[34607]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 925 MiB/s wr, 1.75k op/s 2024-09-21T01:21:30.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:30 smithi144 ceph-mon[34818]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 925 MiB/s wr, 1.75k op/s 2024-09-21T01:21:31.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:30 smithi037 ceph-mon[31105]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 925 MiB/s wr, 1.75k op/s 2024-09-21T01:21:32.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:32 smithi137 ceph-mon[34607]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 908 MiB/s wr, 1.72k op/s 2024-09-21T01:21:32.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:32 smithi144 ceph-mon[34818]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 908 MiB/s wr, 1.72k op/s 2024-09-21T01:21:32.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:21:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:32 smithi037 ceph-mon[31105]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 908 MiB/s wr, 1.72k op/s 2024-09-21T01:21:33.937 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:21:34.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:34 smithi137 ceph-mon[34607]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 798 MiB/s wr, 1.50k op/s 2024-09-21T01:21:34.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:34 smithi144 ceph-mon[34818]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 798 MiB/s wr, 1.50k op/s 2024-09-21T01:21:35.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:34 smithi037 ceph-mon[31105]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 798 MiB/s wr, 1.50k op/s 2024-09-21T01:21:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 -- 172.21.15.37:0/2028637638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 msgr2=0x7f719010e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 --2- 172.21.15.37:0/2028637638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 0x7f719010e000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7188009ca0 tx=0x7f718802a8f0 comp rx=0 tx=0).stop 2024-09-21T01:21:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 -- 172.21.15.37:0/2028637638 shutdown_connections 2024-09-21T01:21:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 --2- 172.21.15.37:0/2028637638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f719011cba0 0x7f719011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 --2- 172.21.15.37:0/2028637638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 0x7f719010e000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 --2- 172.21.15.37:0/2028637638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7190111cd0 0x7f719010d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.989+0000 7f7196573640 1 -- 172.21.15.37:0/2028637638 >> 172.21.15.37:0/2028637638 conn(0x7f719006e9f0 msgr2=0x7f719006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:35.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.991+0000 7f7196573640 1 -- 172.21.15.37:0/2028637638 shutdown_connections 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.991+0000 7f7196573640 1 -- 172.21.15.37:0/2028637638 wait complete. 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.992+0000 7f7196573640 1 Processor -- start 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.992+0000 7f7196573640 1 -- start start 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.993+0000 7f7196573640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 0x7f71901a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.993+0000 7f7196573640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 0x7f71901a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.993+0000 7f7196573640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f719011cba0 0x7f71901ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.993+0000 7f7196573640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7190122750 con 0x7f719011cba0 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.993+0000 7f7196573640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71901225d0 con 0x7f719010dbf0 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.993+0000 7f7196573640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71901228d0 con 0x7f7190111cd0 2024-09-21T01:21:35.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.994+0000 7f7195d72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f719011cba0 0x7f71901ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.994+0000 7f7194d70640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 0x7f71901a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.995+0000 7f7194d70640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 0x7f71901a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42390/0 (socket says 172.21.15.37:42390) 2024-09-21T01:21:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.995+0000 7f7194d70640 1 -- 172.21.15.37:0/3889404739 learned_addr learned my addr 172.21.15.37:0/3889404739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.996+0000 7f7194d70640 1 -- 172.21.15.37:0/3889404739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 msgr2=0x7f71901a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.996+0000 7f7194d70640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 0x7f71901a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.996+0000 7f7194d70640 1 -- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f719011cba0 msgr2=0x7f71901ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.996+0000 7f7194d70640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f719011cba0 0x7f71901ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.997+0000 7f7194d70640 1 -- 172.21.15.37:0/3889404739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71901af100 con 0x7f7190111cd0 2024-09-21T01:21:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.997+0000 7f7195d72640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f719011cba0 0x7f71901ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:21:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:35.998+0000 7f7194d70640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 0x7f71901a96e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7188009bf0 tx=0x7f7188030c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.001+0000 7f71867fc640 1 -- 172.21.15.37:0/3889404739 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188003b70 con 0x7f7190111cd0 2024-09-21T01:21:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.001+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71901af390 con 0x7f7190111cd0 2024-09-21T01:21:36.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.001+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71901b5b00 con 0x7f7190111cd0 2024-09-21T01:21:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.002+0000 7f71867fc640 1 -- 172.21.15.37:0/3889404739 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7188036040 con 0x7f7190111cd0 2024-09-21T01:21:36.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.002+0000 7f71867fc640 1 -- 172.21.15.37:0/3889404739 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718803b780 con 0x7f7190111cd0 2024-09-21T01:21:36.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 Processor -- start 2024-09-21T01:21:36.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 -- start start 2024-09-21T01:21:36.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f01b0 0x5646d58c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f8390 0x5646d58c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5646d5836e50 con 0x5646d54f01b0 2024-09-21T01:21:36.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5646d5826280 con 0x5646d54f8390 2024-09-21T01:21:36.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.012+0000 7f719dd49740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5646d582a090 con 0x5646d5519070 2024-09-21T01:21:36.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.020+0000 7f7195d72640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.020+0000 7f7195d72640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58c0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42392/0 (socket says 172.21.15.37:42392) 2024-09-21T01:21:36.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.020+0000 7f7195d72640 1 -- 172.21.15.37:0/3524388132 learned_addr learned my addr 172.21.15.37:0/3524388132 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:36.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.020+0000 7f71867fc640 1 -- 172.21.15.37:0/3889404739 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7188043030 con 0x7f7190111cd0 2024-09-21T01:21:36.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.021+0000 7f7195571640 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f01b0 0x5646d58c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.022+0000 7f71867fc640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f717c0b6690 0x7f717c0b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.022+0000 7f71867fc640 1 -- 172.21.15.37:0/3889404739 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7188107a00 con 0x7f7190111cd0 2024-09-21T01:21:36.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.023+0000 7f7195d72640 1 -- 172.21.15.37:0/3524388132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f8390 msgr2=0x5646d58c0e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:21:36.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.023+0000 7f7195d72640 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f8390 0x5646d58c0e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.023+0000 7f7195d72640 1 -- 172.21.15.37:0/3524388132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f01b0 msgr2=0x5646d58c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.023+0000 7f7195d72640 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f01b0 0x5646d58c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.023+0000 7f7195d72640 1 -- 172.21.15.37:0/3524388132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d5584650 con 0x5646d5519070 2024-09-21T01:21:36.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.024+0000 7f7195d72640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f717c0b6690 0x7f717c0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.026+0000 7f7195d72640 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58c0410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7180009de0 tx=0x7f718000e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59efb47b28a6c10d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.028+0000 7f717b7fe640 1 -- 172.21.15.37:0/3524388132 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180025070 con 0x5646d5519070 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.028+0000 7f717b7fe640 1 -- 172.21.15.37:0/3524388132 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7180014e10 con 0x5646d5519070 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 -- 172.21.15.37:0/3524388132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 msgr2=0x5646d58c0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58c0410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7180009de0 tx=0x7f718000e5a0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 -- 172.21.15.37:0/3524388132 shutdown_connections 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f8390 0x5646d58c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f01b0 0x5646d58c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 --2- 172.21.15.37:0/3524388132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58c0410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.030+0000 7f719dd49740 1 -- 172.21.15.37:0/3524388132 >> 172.21.15.37:0/3524388132 conn(0x5646d550d460 msgr2=0x5646d58be300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:36.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.031+0000 7f7195d72640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f717c0b6690 0x7f717c0b8ba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f718001e000 tx=0x7f718001f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.033+0000 7f719dd49740 1 -- 172.21.15.37:0/3524388132 shutdown_connections 2024-09-21T01:21:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.034+0000 7f719dd49740 1 -- 172.21.15.37:0/3524388132 wait complete. 2024-09-21T01:21:36.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.035+0000 7f719dd49740 1 -- start start 2024-09-21T01:21:36.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.035+0000 7f719dd49740 1 Processor -- start 2024-09-21T01:21:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.037+0000 7f719dd49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.037+0000 7f719dd49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f8390 0x5646d58cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.037+0000 7f719dd49740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.037+0000 7f719dd49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5646d5687700 con 0x5646d54f8390 2024-09-21T01:21:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.037+0000 7f719dd49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5646d57c1110 con 0x5646d54f01b0 2024-09-21T01:21:36.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.037+0000 7f719dd49740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5646d58dfc50 con 0x5646d5519070 2024-09-21T01:21:36.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.038+0000 7f719dd49740 10 client.0 _ll_register_callbacks cb 0x5646d57da990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.039+0000 7f7195d72640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.040+0000 7f7195d72640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42394/0 (socket says 172.21.15.37:42394) 2024-09-21T01:21:36.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.040+0000 7f7195d72640 1 -- 172.21.15.37:0/4145773319 learned_addr learned my addr 172.21.15.37:0/4145773319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:36.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.040+0000 7f7195571640 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.041+0000 7f7195d72640 1 -- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 msgr2=0x5646d58cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.041+0000 7f7195d72640 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.041+0000 7f7195d72640 1 -- 172.21.15.37:0/4145773319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f8390 msgr2=0x5646d58cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.041+0000 7f7195d72640 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f8390 0x5646d58cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.041+0000 7f7195d72640 1 -- 172.21.15.37:0/4145773319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d57eec40 con 0x5646d5519070 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.042+0000 7f7195d72640 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58cc570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7180004700 tx=0x7f7180009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=437ef9257c33812c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.042+0000 7f7178ff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.043+0000 7f7178ff9640 1 -- 172.21.15.37:0/4145773319 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718002e030 con 0x5646d5519070 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.043+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7180014e10 con 0x5646d5519070 2024-09-21T01:21:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.043+0000 7f7178ff9640 1 -- 172.21.15.37:0/4145773319 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7180005bd0 con 0x5646d5519070 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.044+0000 7f7178ff9640 1 -- 172.21.15.37:0/4145773319 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71800099d0 con 0x5646d5519070 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.045+0000 7f719dd49740 10 client.25831 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.045+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5646d58eb9d0 con 0x5646d5519070 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.047+0000 7f7178ff9640 1 -- 172.21.15.37:0/4145773319 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7180014e10 con 0x5646d5519070 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.047+0000 7f7178ff9640 1 -- 172.21.15.37:0/4145773319 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f718001c040 con 0x5646d5519070 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.048+0000 7f719dd49740 10 client.25831 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.048+0000 7f719dd49740 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.048+0000 7f719dd49740 20 client.25831 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.049+0000 7f719dd49740 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d54d79f0 0x5646d58ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.049+0000 7f719dd49740 4 client.25831 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:21:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.049+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646d5838da0 con 0x5646d54d79f0 2024-09-21T01:21:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.050+0000 7f7195571640 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d54d79f0 0x5646d58ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.061+0000 7f7195571640 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d54d79f0 0x5646d58ef140 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caf558ae37500cf8 server_cookie=95c4733cd1c3ebcd in_seq=0 out_seq=0 2024-09-21T01:21:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.061+0000 7f7178ff9640 10 client.25831 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.064+0000 7f7178ff9640 1 -- 172.21.15.37:0/4145773319 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646d5838da0 con 0x5646d54d79f0 2024-09-21T01:21:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.064+0000 7f7178ff9640 10 client.25831 handle_command_reply: tid=0 2024-09-21T01:21:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 client.25831 shutdown 2024-09-21T01:21:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 msgr2=0x5646d58cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58cc570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7180004700 tx=0x7f7180009230 comp rx=0 tx=0).stop 2024-09-21T01:21:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 shutdown_connections 2024-09-21T01:21:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d54d79f0 0x5646d58ef140 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d5519070 0x5646d58cc570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54f8390 0x5646d58cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.065+0000 7f719dd49740 1 --2- 172.21.15.37:0/4145773319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.066+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 >> 172.21.15.37:0/4145773319 conn(0x5646d550d460 msgr2=0x5646d58c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.066+0000 7f7178ff9640 0 client.25831 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.066+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 shutdown_connections 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.066+0000 7f719dd49740 1 -- 172.21.15.37:0/4145773319 wait complete. 2024-09-21T01:21:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.066+0000 7f719dd49740 20 client.25831 trim_cache size 0 max 16384 2024-09-21T01:21:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.115+0000 7f719dd49740 1 Processor -- start 2024-09-21T01:21:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.115+0000 7f719dd49740 1 -- start start 2024-09-21T01:21:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.116+0000 7f719dd49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.116+0000 7f719dd49740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 0x5646d58bd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.117+0000 7f719dd49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d5519070 0x5646d58bde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.117+0000 7f7195571640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.117+0000 7f7195571640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:40622/0 (socket says 172.21.15.37:40622) 2024-09-21T01:21:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.118+0000 7f7194d70640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 0x5646d58bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.118+0000 7f7194d70640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 0x5646d58bd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42396/0 (socket says 172.21.15.37:42396) 2024-09-21T01:21:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.118+0000 7f7194d70640 1 -- 172.21.15.37:0/394602920 learned_addr learned my addr 172.21.15.37:0/394602920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.118+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f717400e620 con 0x5646d5519070 2024-09-21T01:21:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.118+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7174010160 con 0x5646d54f01b0 2024-09-21T01:21:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.119+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f717400ecf0 con 0x5646d54f8390 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.120+0000 7f7195d72640 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d5519070 0x5646d58bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.120+0000 7f7194d70640 1 -- 172.21.15.37:0/394602920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 msgr2=0x5646d58cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.120+0000 7f7194d70640 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.120+0000 7f7194d70640 1 -- 172.21.15.37:0/394602920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d5519070 msgr2=0x5646d58bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.120+0000 7f7194d70640 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d5519070 0x5646d58bde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.120+0000 7f7194d70640 1 -- 172.21.15.37:0/394602920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d58ccd70 con 0x5646d54f8390 2024-09-21T01:21:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.121+0000 7f7195d72640 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d5519070 0x5646d58bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:21:36.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.126+0000 7f7194d70640 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 0x5646d58bd930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71880ca210 tx=0x7f7188000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8e3357b360f79a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:36.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.126+0000 7f717affd640 1 -- 172.21.15.37:0/394602920 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718804a040 con 0x5646d54f8390 2024-09-21T01:21:36.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.126+0000 7f717affd640 1 -- 172.21.15.37:0/394602920 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f718802d070 con 0x5646d54f8390 2024-09-21T01:21:36.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 msgr2=0x5646d58bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:36.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 0x5646d58bd930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71880ca210 tx=0x7f7188000f40 comp rx=0 tx=0).stop 2024-09-21T01:21:36.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 shutdown_connections 2024-09-21T01:21:36.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d5519070 0x5646d58bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f8390 0x5646d58bd930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 --2- 172.21.15.37:0/394602920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d54f01b0 0x5646d58cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 >> 172.21.15.37:0/394602920 conn(0x5646d550d460 msgr2=0x5646d58ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:36.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 shutdown_connections 2024-09-21T01:21:36.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.128+0000 7f719dd49740 1 -- 172.21.15.37:0/394602920 wait complete. 2024-09-21T01:21:36.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.129+0000 7f719dd49740 1 -- start start 2024-09-21T01:21:36.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.129+0000 7f719dd49740 1 Processor -- start 2024-09-21T01:21:36.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f01b0 0x5646d58e5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d5519070 0x5646d58dff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54acda0 0x5646d58e0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f717400fa90 con 0x5646d54acda0 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f717400f3c0 con 0x5646d5519070 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f717400c5e0 con 0x5646d54f01b0 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.130+0000 7f719dd49740 10 client.0 _ll_register_callbacks cb 0x7f7180009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.131+0000 7f7195571640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f01b0 0x5646d58e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.131+0000 7f7195571640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f01b0 0x5646d58e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42402/0 (socket says 172.21.15.37:42402) 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.131+0000 7f7195571640 1 -- 172.21.15.37:0/3535290396 learned_addr learned my addr 172.21.15.37:0/3535290396 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.131+0000 7f7195d72640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54acda0 0x5646d58e0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.133+0000 7f7194d70640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d5519070 0x5646d58dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.134+0000 7f7195d72640 1 -- 172.21.15.37:0/3535290396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f01b0 msgr2=0x5646d58e5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.134+0000 7f7195d72640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f01b0 0x5646d58e5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.134+0000 7f7195d72640 1 -- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d5519070 msgr2=0x5646d58dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.134+0000 7f7195d72640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d5519070 0x5646d58dff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.134+0000 7f7195d72640 1 -- 172.21.15.37:0/3535290396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d5957af0 con 0x5646d54acda0 2024-09-21T01:21:36.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.136+0000 7f7195d72640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54acda0 0x5646d58e0650 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7180009d00 tx=0x7f718001fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9312ada9924651e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.137+0000 7f7178ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:21:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.138+0000 7f7178ff9640 1 -- 172.21.15.37:0/3535290396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718002e030 con 0x5646d54acda0 2024-09-21T01:21:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.138+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5646d5834850 con 0x5646d54acda0 2024-09-21T01:21:36.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.138+0000 7f7178ff9640 1 -- 172.21.15.37:0/3535290396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f7180005de0 con 0x5646d54acda0 2024-09-21T01:21:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.139+0000 7f7178ff9640 1 -- 172.21.15.37:0/3535290396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71800067a0 con 0x5646d54acda0 2024-09-21T01:21:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.139+0000 7f719dd49740 10 client.16422 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.139+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5646d5958c80 con 0x5646d54acda0 2024-09-21T01:21:36.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f7178ff9640 1 -- 172.21.15.37:0/3535290396 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5646d5834850 con 0x5646d54acda0 2024-09-21T01:21:36.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f7178ff9640 1 -- 172.21.15.37:0/3535290396 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7180040070 con 0x5646d54acda0 2024-09-21T01:21:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f719dd49740 10 client.16422 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f719dd49740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f719dd49740 20 client.16422 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f719dd49740 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d5959350 0x5646d595b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f719dd49740 4 client.16422 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:21:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.141+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646d5831c80 con 0x5646d5959350 2024-09-21T01:21:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.142+0000 7f7195571640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d5959350 0x5646d595b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.147+0000 7f7195571640 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d5959350 0x5646d595b770 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7468428b0033652 server_cookie=bd48ab6166b73e08 in_seq=0 out_seq=0 2024-09-21T01:21:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.147+0000 7f7178ff9640 10 client.16422 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.150+0000 7f7178ff9640 1 -- 172.21.15.37:0/3535290396 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x5646d5831c80 con 0x5646d5959350 2024-09-21T01:21:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.150+0000 7f7178ff9640 10 client.16422 handle_command_reply: tid=0 2024-09-21T01:21:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.150+0000 7f719dd49740 1 client.16422 shutdown 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54acda0 msgr2=0x5646d58e0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54acda0 0x5646d58e0650 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7180009d00 tx=0x7f718001fcc0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 shutdown_connections 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5646d5959350 0x5646d595b770 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646d54acda0 0x5646d58e0650 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5646d5519070 0x5646d58dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 --2- 172.21.15.37:0/3535290396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d54f01b0 0x5646d58e5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f7178ff9640 0 client.16422 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.151+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 >> 172.21.15.37:0/3535290396 conn(0x5646d550d460 msgr2=0x5646d58c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.152+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 shutdown_connections 2024-09-21T01:21:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.153+0000 7f719dd49740 1 -- 172.21.15.37:0/3535290396 wait complete. 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.153+0000 7f719dd49740 20 client.16422 trim_cache size 0 max 16384 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:21:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:21:36.156 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:21:36.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:21:36.158 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.161+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f717c0b6690 msgr2=0x7f717c0b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.161+0000 7f7196573640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f717c0b6690 0x7f717c0b8ba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f718001e000 tx=0x7f718001f000 comp rx=0 tx=0).stop 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.161+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 msgr2=0x7f71901a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.161+0000 7f7196573640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 0x7f71901a96e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7188009bf0 tx=0x7f7188030c00 comp rx=0 tx=0).stop 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.162+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 shutdown_connections 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.162+0000 7f7196573640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f717c0b6690 0x7f717c0b8ba0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.162+0000 7f7196573640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f719011cba0 0x7f71901ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.162+0000 7f7196573640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7190111cd0 0x7f71901a96e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.162+0000 7f7196573640 1 --2- 172.21.15.37:0/3889404739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f719010dbf0 0x7f71901a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.162+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 >> 172.21.15.37:0/3889404739 conn(0x7f719006e9f0 msgr2=0x7f719010c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.163+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 shutdown_connections 2024-09-21T01:21:36.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:36.163+0000 7f7196573640 1 -- 172.21.15.37:0/3889404739 wait complete. 2024-09-21T01:21:36.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:36 smithi137 ceph-mon[34607]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 924 MiB/s wr, 1.75k op/s 2024-09-21T01:21:36.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:36 smithi144 ceph-mon[34818]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 924 MiB/s wr, 1.75k op/s 2024-09-21T01:21:37.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:36 smithi037 ceph-mon[31105]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 924 MiB/s wr, 1.75k op/s 2024-09-21T01:21:38.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:38 smithi137 ceph-mon[34607]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 807 MiB/s wr, 1.50k op/s 2024-09-21T01:21:38.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:38 smithi144 ceph-mon[34818]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 807 MiB/s wr, 1.50k op/s 2024-09-21T01:21:39.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:38 smithi037 ceph-mon[31105]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 807 MiB/s wr, 1.50k op/s 2024-09-21T01:21:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.829+0000 7ff7984f9640 1 -- 172.21.15.37:0/1131521562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff790109ce0 msgr2=0x7ff79010a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.829+0000 7ff7984f9640 1 --2- 172.21.15.37:0/1131521562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff790109ce0 0x7ff79010a150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff788009ca0 tx=0x7ff78802a8f0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.830+0000 7ff7984f9640 1 -- 172.21.15.37:0/1131521562 shutdown_connections 2024-09-21T01:21:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.830+0000 7ff7984f9640 1 --2- 172.21.15.37:0/1131521562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff79010b700 0x7ff7901120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.830+0000 7ff7984f9640 1 --2- 172.21.15.37:0/1131521562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010ad60 0x7ff79010b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.830+0000 7ff7984f9640 1 --2- 172.21.15.37:0/1131521562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff790109ce0 0x7ff79010a150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.830+0000 7ff7984f9640 1 -- 172.21.15.37:0/1131521562 >> 172.21.15.37:0/1131521562 conn(0x7ff790079060 msgr2=0x7ff79007b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.836+0000 7ff7984f9640 1 -- 172.21.15.37:0/1131521562 shutdown_connections 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.837+0000 7ff7984f9640 1 -- 172.21.15.37:0/1131521562 wait complete. 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.838+0000 7ff7984f9640 1 Processor -- start 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.838+0000 7ff7984f9640 1 -- start start 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff7984f9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff790109ce0 0x7ff790074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff7984f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff79010ad60 0x7ff790074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff7984f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 0x7ff790072e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff7984f9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff79006d2b0 con 0x7ff79010b700 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff7984f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff79006d130 con 0x7ff79010ad60 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff7984f9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff79006d430 con 0x7ff790109ce0 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff796a96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 0x7ff790072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff796a96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 0x7ff790072e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51480/0 (socket says 172.21.15.37:51480) 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.839+0000 7ff796a96640 1 -- 172.21.15.37:0/711612044 learned_addr learned my addr 172.21.15.37:0/711612044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.840+0000 7ff796295640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff790109ce0 0x7ff790074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.840+0000 7ff795a94640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff79010ad60 0x7ff790074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.843+0000 7ff796a96640 1 -- 172.21.15.37:0/711612044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff790109ce0 msgr2=0x7ff790074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.843+0000 7ff796a96640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff790109ce0 0x7ff790074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.843+0000 7ff796a96640 1 -- 172.21.15.37:0/711612044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff79010ad60 msgr2=0x7ff790074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.843+0000 7ff796a96640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff79010ad60 0x7ff790074830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.843+0000 7ff796a96640 1 -- 172.21.15.37:0/711612044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff790073380 con 0x7ff79010b700 2024-09-21T01:21:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.847+0000 7ff796a96640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 0x7ff790072e10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff780009fd0 tx=0x7ff78000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.848+0000 7ff7877fe640 1 -- 172.21.15.37:0/711612044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780011830 con 0x7ff79010b700 2024-09-21T01:21:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.848+0000 7ff7877fe640 1 -- 172.21.15.37:0/711612044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff780016070 con 0x7ff79010b700 2024-09-21T01:21:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.848+0000 7ff7877fe640 1 -- 172.21.15.37:0/711612044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780010de0 con 0x7ff79010b700 2024-09-21T01:21:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.848+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff790073670 con 0x7ff79010b700 2024-09-21T01:21:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.849+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff790073bf0 con 0x7ff79010b700 2024-09-21T01:21:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.864+0000 7ff7877fe640 1 -- 172.21.15.37:0/711612044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff78001b460 con 0x7ff79010b700 2024-09-21T01:21:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.866+0000 7ff7877fe640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff77c0b65c0 0x7ff77c0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.867+0000 7ff7877fe640 1 -- 172.21.15.37:0/711612044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff7800e5410 con 0x7ff79010b700 2024-09-21T01:21:40.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.867+0000 7ff796295640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff77c0b65c0 0x7ff77c0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.870+0000 7ff79f466740 1 Processor -- start 2024-09-21T01:21:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.870+0000 7ff79f466740 1 -- start start 2024-09-21T01:21:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.871+0000 7ff79f466740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9e0e1b0 0x5620da1c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.871+0000 7ff79f466740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9de52f0 0x5620da1c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.871+0000 7ff79f466740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 0x5620da1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.871+0000 7ff79f466740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620da1286f0 con 0x5620d9de52f0 2024-09-21T01:21:40.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.871+0000 7ff79f466740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5620da117b20 con 0x5620d9e0e1b0 2024-09-21T01:21:40.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.871+0000 7ff79f466740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5620da11b930 con 0x5620d9ded4d0 2024-09-21T01:21:40.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.877+0000 7ff796295640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9e0e1b0 0x5620da1c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.877+0000 7ff796a96640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 0x5620da1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.877+0000 7ff796a96640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 0x5620da1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42422/0 (socket says 172.21.15.37:42422) 2024-09-21T01:21:40.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.877+0000 7ff796a96640 1 -- 172.21.15.37:0/1228307417 learned_addr learned my addr 172.21.15.37:0/1228307417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:40.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.877+0000 7ff795a94640 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9de52f0 0x5620da1c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.878+0000 7ff796295640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff77c0b65c0 0x7ff77c0b8ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7880094e0 tx=0x7ff788031a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.878+0000 7ff796a96640 1 -- 172.21.15.37:0/1228307417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9e0e1b0 msgr2=0x5620da1c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.879+0000 7ff796a96640 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9e0e1b0 0x5620da1c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.879+0000 7ff796a96640 1 -- 172.21.15.37:0/1228307417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9de52f0 msgr2=0x5620da1c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:40.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.879+0000 7ff796a96640 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9de52f0 0x5620da1c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.879+0000 7ff796a96640 1 -- 172.21.15.37:0/1228307417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620da0dd530 con 0x5620d9ded4d0 2024-09-21T01:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.880+0000 7ff796a96640 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 0x5620da1c8020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff7800a99f0 tx=0x7ff7800b6880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea33a85a2224049 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.880+0000 7ff795a94640 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9de52f0 0x5620da1c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:21:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.882+0000 7ff784bfe640 1 -- 172.21.15.37:0/1228307417 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800aa180 con 0x5620d9ded4d0 2024-09-21T01:21:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.882+0000 7ff784bfe640 1 -- 172.21.15.37:0/1228307417 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7800ad2e0 con 0x5620d9ded4d0 2024-09-21T01:21:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.882+0000 7ff784bfe640 1 -- 172.21.15.37:0/1228307417 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800aa320 con 0x5620d9ded4d0 2024-09-21T01:21:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.886+0000 7ff79f466740 1 -- 172.21.15.37:0/1228307417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 msgr2=0x5620da1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.886+0000 7ff79f466740 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 0x5620da1c8020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff7800a99f0 tx=0x7ff7800b6880 comp rx=0 tx=0).stop 2024-09-21T01:21:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.887+0000 7ff79f466740 1 -- 172.21.15.37:0/1228307417 shutdown_connections 2024-09-21T01:21:40.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.887+0000 7ff79f466740 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9ded4d0 0x5620da1c8020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.887+0000 7ff79f466740 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9de52f0 0x5620da1c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.887+0000 7ff79f466740 1 --2- 172.21.15.37:0/1228307417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9e0e1b0 0x5620da1c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.887+0000 7ff79f466740 1 -- 172.21.15.37:0/1228307417 >> 172.21.15.37:0/1228307417 conn(0x5620d9e02300 msgr2=0x5620da1b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.892+0000 7ff79f466740 1 -- 172.21.15.37:0/1228307417 shutdown_connections 2024-09-21T01:21:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.892+0000 7ff79f466740 1 -- 172.21.15.37:0/1228307417 wait complete. 2024-09-21T01:21:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.893+0000 7ff79f466740 1 -- start start 2024-09-21T01:21:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.894+0000 7ff79f466740 1 Processor -- start 2024-09-21T01:21:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.895+0000 7ff79f466740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.896+0000 7ff79f466740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.896+0000 7ff79f466740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9e0e1b0 0x5620da1d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.897+0000 7ff796295640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.897+0000 7ff795a94640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.897+0000 7ff796295640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42424/0 (socket says 172.21.15.37:42424) 2024-09-21T01:21:40.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.898+0000 7ff796295640 1 -- 172.21.15.37:0/4291444407 learned_addr learned my addr 172.21.15.37:0/4291444407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.898+0000 7ff796a96640 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9e0e1b0 0x5620da1d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.898+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620da04fab0 con 0x5620d9e0e1b0 2024-09-21T01:21:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.898+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5620da0bd730 con 0x5620d9ded4d0 2024-09-21T01:21:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.899+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5620da1c8a50 con 0x5620d9de52f0 2024-09-21T01:21:40.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.899+0000 7ff79f466740 10 client.0 _ll_register_callbacks cb 0x5620da1116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.902+0000 7ff796a96640 1 -- 172.21.15.37:0/4291444407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 msgr2=0x5620da1d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.902+0000 7ff796a96640 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.902+0000 7ff796a96640 1 -- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 msgr2=0x5620da1d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.902+0000 7ff796a96640 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.902+0000 7ff796a96640 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d9e79790 con 0x5620d9e0e1b0 2024-09-21T01:21:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.904+0000 7ff796a96640 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9e0e1b0 0x5620da1d17f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff7800a99f0 tx=0x7ff780006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03dbef56a9449f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.904+0000 7ff779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:21:40.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.905+0000 7ff779ffb640 1 -- 172.21.15.37:0/4291444407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800b2070 con 0x5620d9e0e1b0 2024-09-21T01:21:40.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.906+0000 7ff779ffb640 1 -- 172.21.15.37:0/4291444407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff7800a9fe0 con 0x5620d9e0e1b0 2024-09-21T01:21:40.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.906+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620da12a640 con 0x5620d9e0e1b0 2024-09-21T01:21:40.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.907+0000 7ff779ffb640 1 -- 172.21.15.37:0/4291444407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff780097030 con 0x5620d9e0e1b0 2024-09-21T01:21:40.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.907+0000 7ff79f466740 10 client.16431 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:40.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.907+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5620d9ef2620 con 0x5620d9e0e1b0 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.909+0000 7ff779ffb640 1 -- 172.21.15.37:0/4291444407 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7800b73b0 con 0x5620d9e0e1b0 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.909+0000 7ff779ffb640 1 -- 172.21.15.37:0/4291444407 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff780011c10 con 0x5620d9e0e1b0 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.909+0000 7ff79f466740 10 client.16431 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.909+0000 7ff79f466740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.909+0000 7ff79f466740 20 client.16431 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.910+0000 7ff79f466740 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9dccd80 0x5620da1dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.910+0000 7ff79f466740 4 client.16431 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:21:40.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.910+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620da12a640 con 0x5620d9dccd80 2024-09-21T01:21:40.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.911+0000 7ff796295640 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9dccd80 0x5620da1dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:40 smithi144 ceph-mon[34818]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 935 MiB/s wr, 1.78k op/s 2024-09-21T01:21:40.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:40 smithi137 ceph-mon[34607]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 935 MiB/s wr, 1.78k op/s 2024-09-21T01:21:40.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.922+0000 7ff779ffb640 10 client.16431 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:40.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.922+0000 7ff796295640 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9dccd80 0x5620da1dd850 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8f02f8a5deb216 server_cookie=aa5619114bb9add3 in_seq=0 out_seq=0 2024-09-21T01:21:40.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.930+0000 7ff779ffb640 1 -- 172.21.15.37:0/4291444407 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620da12a640 con 0x5620d9dccd80 2024-09-21T01:21:40.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.930+0000 7ff779ffb640 10 client.16431 handle_command_reply: tid=0 2024-09-21T01:21:40.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.931+0000 7ff79f466740 1 client.16431 shutdown 2024-09-21T01:21:40.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.931+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9e0e1b0 msgr2=0x5620da1d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:40.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9e0e1b0 0x5620da1d17f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff7800a99f0 tx=0x7ff780006ae0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 shutdown_connections 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9dccd80 0x5620da1dd850 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9e0e1b0 0x5620da1d17f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff779ffb640 0 client.16431 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 --2- 172.21.15.37:0/4291444407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.935+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 >> 172.21.15.37:0/4291444407 conn(0x5620d9e02300 msgr2=0x5620da1afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.936+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 shutdown_connections 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.936+0000 7ff79f466740 1 -- 172.21.15.37:0/4291444407 wait complete. 2024-09-21T01:21:40.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.936+0000 7ff79f466740 20 client.16431 trim_cache size 0 max 16384 2024-09-21T01:21:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.980+0000 7ff79f466740 1 Processor -- start 2024-09-21T01:21:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.981+0000 7ff79f466740 1 -- start start 2024-09-21T01:21:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.981+0000 7ff79f466740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9dccd80 0x5620da1afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.981+0000 7ff79f466740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff79f466740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9ded4d0 0x5620da1d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff79f466740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400e5f0 con 0x5620d9ded4d0 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff79f466740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff774010130 con 0x5620d9dccd80 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff79f466740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400ecc0 con 0x5620d9de52f0 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff795a94640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff795a94640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:42440/0 (socket says 172.21.15.37:42440) 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff795a94640 1 -- 172.21.15.37:0/1120234346 learned_addr learned my addr 172.21.15.37:0/1120234346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.982+0000 7ff796295640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9dccd80 0x5620da1afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796a96640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9ded4d0 0x5620da1d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796295640 1 -- 172.21.15.37:0/1120234346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 msgr2=0x5620da1cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796295640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796295640 1 -- 172.21.15.37:0/1120234346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9ded4d0 msgr2=0x5620da1d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796295640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9ded4d0 0x5620da1d8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796295640 1 -- 172.21.15.37:0/1120234346 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620da1d14e0 con 0x5620d9dccd80 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.983+0000 7ff796a96640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9ded4d0 0x5620da1d8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:21:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.984+0000 7ff795a94640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:21:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.985+0000 7ff796295640 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9dccd80 0x5620da1afea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5620da1dde70 tx=0x7ff788044000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4778c706f6c36cef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.986+0000 7ff77bfff640 1 -- 172.21.15.37:0/1120234346 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788004240 con 0x5620d9dccd80 2024-09-21T01:21:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.986+0000 7ff77bfff640 1 -- 172.21.15.37:0/1120234346 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff788036040 con 0x5620d9dccd80 2024-09-21T01:21:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.986+0000 7ff77bfff640 1 -- 172.21.15.37:0/1120234346 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78802fda0 con 0x5620d9dccd80 2024-09-21T01:21:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.988+0000 7ff79f466740 1 -- 172.21.15.37:0/1120234346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9dccd80 msgr2=0x5620da1afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.988+0000 7ff79f466740 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9dccd80 0x5620da1afea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5620da1dde70 tx=0x7ff788044000 comp rx=0 tx=0).stop 2024-09-21T01:21:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.991+0000 7ff79f466740 1 -- 172.21.15.37:0/1120234346 shutdown_connections 2024-09-21T01:21:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.992+0000 7ff79f466740 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9ded4d0 0x5620da1d8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.992+0000 7ff79f466740 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.992+0000 7ff79f466740 1 --2- 172.21.15.37:0/1120234346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9dccd80 0x5620da1afea0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.992+0000 7ff79f466740 1 -- 172.21.15.37:0/1120234346 >> 172.21.15.37:0/1120234346 conn(0x5620d9e02300 msgr2=0x5620da1ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.993+0000 7ff79f466740 1 -- 172.21.15.37:0/1120234346 shutdown_connections 2024-09-21T01:21:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.994+0000 7ff79f466740 1 -- 172.21.15.37:0/1120234346 wait complete. 2024-09-21T01:21:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.995+0000 7ff79f466740 1 -- start start 2024-09-21T01:21:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.995+0000 7ff79f466740 1 Processor -- start 2024-09-21T01:21:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.996+0000 7ff79f466740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9dccd80 0x5620da1d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.996+0000 7ff79f466740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff79f466740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff796295640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9dccd80 0x5620da1d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff796295640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9dccd80 0x5620da1d7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51516/0 (socket says 172.21.15.37:51516) 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff796295640 1 -- 172.21.15.37:0/258563791 learned_addr learned my addr 172.21.15.37:0/258563791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400fa60 con 0x5620d9dccd80 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400f390 con 0x5620d9ded4d0 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff77400c5b0 con 0x5620d9de52f0 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff79f466740 10 client.0 _ll_register_callbacks cb 0x7ff78c00a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.997+0000 7ff795a94640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.998+0000 7ff796a96640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:41.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:40 smithi037 ceph-mon[31105]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 935 MiB/s wr, 1.78k op/s 2024-09-21T01:21:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.999+0000 7ff795a94640 1 -- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 msgr2=0x5620da1d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.999+0000 7ff795a94640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.999+0000 7ff795a94640 1 -- 172.21.15.37:0/258563791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9dccd80 msgr2=0x5620da1d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.999+0000 7ff795a94640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9dccd80 0x5620da1d7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:40.999+0000 7ff795a94640 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620da1d4750 con 0x5620d9de52f0 2024-09-21T01:21:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.000+0000 7ff795a94640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d8650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff78c015790 tx=0x7ff78c015880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6681adc37d68f667 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.000+0000 7ff779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.002+0000 7ff779ffb640 1 -- 172.21.15.37:0/258563791 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c022060 con 0x5620d9de52f0 2024-09-21T01:21:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.002+0000 7ff779ffb640 1 -- 172.21.15.37:0/258563791 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff78c013930 con 0x5620d9de52f0 2024-09-21T01:21:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.002+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff788036040 con 0x5620d9de52f0 2024-09-21T01:21:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.004+0000 7ff779ffb640 1 -- 172.21.15.37:0/258563791 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff78c013b30 con 0x5620d9de52f0 2024-09-21T01:21:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.005+0000 7ff79f466740 10 client.25852 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.005+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5620da248180 con 0x5620d9de52f0 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.006+0000 7ff779ffb640 1 -- 172.21.15.37:0/258563791 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff788036040 con 0x5620d9de52f0 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.006+0000 7ff779ffb640 1 -- 172.21.15.37:0/258563791 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff78c0263a0 con 0x5620d9de52f0 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.006+0000 7ff79f466740 10 client.25852 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.006+0000 7ff79f466740 10 client.25852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.006+0000 7ff79f466740 20 client.25852 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.007+0000 7ff79f466740 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9e0e1b0 0x5620da24ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.007+0000 7ff79f466740 4 client.25852 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:21:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.007+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620da1260f0 con 0x5620d9e0e1b0 2024-09-21T01:21:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.019+0000 7ff796295640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9e0e1b0 0x5620da24ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.020+0000 7ff796295640 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9e0e1b0 0x5620da24ab00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b56863badbc13d server_cookie=76ba6273b244589 in_seq=0 out_seq=0 2024-09-21T01:21:41.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:41.020+0000 7ff779ffb640 10 client.25852 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:41.286 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:21:41.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:21:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:21:42.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:42 smithi137 ceph-mon[34607]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 911 MiB/s wr, 1.81k op/s 2024-09-21T01:21:42.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:42 smithi144 ceph-mon[34818]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 911 MiB/s wr, 1.81k op/s 2024-09-21T01:21:43.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:42 smithi037 ceph-mon[31105]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 911 MiB/s wr, 1.81k op/s 2024-09-21T01:21:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.626+0000 7ff779ffb640 1 -- 172.21.15.37:0/258563791 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620da1260f0 con 0x5620d9e0e1b0 2024-09-21T01:21:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.626+0000 7ff779ffb640 10 client.25852 handle_command_reply: tid=0 2024-09-21T01:21:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.626+0000 7ff79f466740 1 client.25852 shutdown 2024-09-21T01:21:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 msgr2=0x5620da1d8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d8650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff78c015790 tx=0x7ff78c015880 comp rx=0 tx=0).stop 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 shutdown_connections 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5620d9e0e1b0 0x5620da24ab00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5620d9ded4d0 0x5620da1d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620d9de52f0 0x5620da1d8650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 --2- 172.21.15.37:0/258563791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620d9dccd80 0x5620da1d7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 >> 172.21.15.37:0/258563791 conn(0x5620d9e02300 msgr2=0x5620da1c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.627+0000 7ff779ffb640 0 client.25852 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.628+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 shutdown_connections 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.628+0000 7ff79f466740 1 -- 172.21.15.37:0/258563791 wait complete. 2024-09-21T01:21:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.628+0000 7ff79f466740 20 client.25852 trim_cache size 0 max 16384 2024-09-21T01:21:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:21:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:21:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:21:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:21:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.630+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff77c0b65c0 msgr2=0x7ff77c0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.630+0000 7ff7984f9640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff77c0b65c0 0x7ff77c0b8ad0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7880094e0 tx=0x7ff788031a90 comp rx=0 tx=0).stop 2024-09-21T01:21:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.630+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 msgr2=0x7ff790072e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.630+0000 7ff7984f9640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 0x7ff790072e10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff780009fd0 tx=0x7ff78000b8e0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.631+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 shutdown_connections 2024-09-21T01:21:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.631+0000 7ff7984f9640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff77c0b65c0 0x7ff77c0b8ad0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.631+0000 7ff7984f9640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff79010b700 0x7ff790072e10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.631+0000 7ff7984f9640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff79010ad60 0x7ff790074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.631+0000 7ff7984f9640 1 --2- 172.21.15.37:0/711612044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff790109ce0 0x7ff790074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.631+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 >> 172.21.15.37:0/711612044 conn(0x7ff790079060 msgr2=0x7ff79010e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.632+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 shutdown_connections 2024-09-21T01:21:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:43.632+0000 7ff7984f9640 1 -- 172.21.15.37:0/711612044 wait complete. 2024-09-21T01:21:45.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:44 smithi037 ceph-mon[31105]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 806 MiB/s wr, 1.77k op/s 2024-09-21T01:21:45.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:44 smithi137 ceph-mon[34607]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 806 MiB/s wr, 1.77k op/s 2024-09-21T01:21:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:44 smithi144 ceph-mon[34818]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 806 MiB/s wr, 1.77k op/s 2024-09-21T01:21:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.654+0000 7f18dd954640 1 -- 172.21.15.37:0/1295597550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 msgr2=0x7f18d807b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.654+0000 7f18dd954640 1 --2- 172.21.15.37:0/1295597550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807b6d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f18d000af00 tx=0x7f18d002e630 comp rx=0 tx=0).stop 2024-09-21T01:21:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.654+0000 7f18dd954640 1 -- 172.21.15.37:0/1295597550 shutdown_connections 2024-09-21T01:21:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.655+0000 7f18dd954640 1 --2- 172.21.15.37:0/1295597550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807b6d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:45.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.655+0000 7f18dd954640 1 --2- 172.21.15.37:0/1295597550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d810c6d0 0x7f18d810cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.655+0000 7f18dd954640 1 --2- 172.21.15.37:0/1295597550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d810a650 0x7f18d810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.655+0000 7f18dd954640 1 -- 172.21.15.37:0/1295597550 >> 172.21.15.37:0/1295597550 conn(0x7f18d806d950 msgr2=0x7f18d806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.655+0000 7f18dd954640 1 -- 172.21.15.37:0/1295597550 shutdown_connections 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.655+0000 7f18dd954640 1 -- 172.21.15.37:0/1295597550 wait complete. 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.656+0000 7f18dd954640 1 Processor -- start 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.656+0000 7f18dd954640 1 -- start start 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18dd954640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d810a650 0x7f18d807eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18dd954640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d810c6d0 0x7f18d807efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18dd954640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18dd954640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18d807cfb0 con 0x7f18d810d020 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18dd954640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18d807ce30 con 0x7f18d810a650 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18dd954640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18d807d130 con 0x7f18d810c6d0 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58878/0 (socket says 172.21.15.37:58878) 2024-09-21T01:21:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.657+0000 7f18d77fe640 1 -- 172.21.15.37:0/3488310519 learned_addr learned my addr 172.21.15.37:0/3488310519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.658+0000 7f18d77fe640 1 -- 172.21.15.37:0/3488310519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d810c6d0 msgr2=0x7f18d807efe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.658+0000 7f18d77fe640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d810c6d0 0x7f18d807efe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.658+0000 7f18d77fe640 1 -- 172.21.15.37:0/3488310519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d810a650 msgr2=0x7f18d807eaa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.658+0000 7f18d77fe640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d810a650 0x7f18d807eaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.658+0000 7f18d77fe640 1 -- 172.21.15.37:0/3488310519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d8138c90 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.661+0000 7f18d77fe640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807f520 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a330 tx=0x7f18d000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.665+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d000a910 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.665+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d00124e0 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.665+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d00356f0 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.666+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d8138f20 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.666+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d8139410 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.669+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d810aa60 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.675+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f18d000f040 con 0x7f18d810d020 2024-09-21T01:21:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.677+0000 7f18dc952640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18c40b6710 0x7f18c40b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.678+0000 7f18d6ffd640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18c40b6710 0x7f18c40b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.678+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f18d0108800 con 0x7f18d810d020 2024-09-21T01:21:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.679+0000 7f18d6ffd640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18c40b6710 0x7f18c40b8c20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f18c8005fd0 tx=0x7f18c8005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:45.690+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18d004b020 con 0x7f18d810d020 2024-09-21T01:21:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.231+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18d807fda0 con 0x7f18d810d020 2024-09-21T01:21:46.245 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:21:46.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.243+0000 7f18dc952640 1 -- 172.21.15.37:0/3488310519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11976 (secure 0 0 0) 0x7f18d807fda0 con 0x7f18d810d020 2024-09-21T01:21:46.246 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-21T01:19:26:088830+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:19:25.613490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:21:46.246 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-21T01:21:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.252+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18c40b6710 msgr2=0x7f18c40b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.252+0000 7f18dd954640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18c40b6710 0x7f18c40b8c20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f18c8005fd0 tx=0x7f18c8005f00 comp rx=0 tx=0).stop 2024-09-21T01:21:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.252+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 msgr2=0x7f18d807f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.252+0000 7f18dd954640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807f520 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f18d000a330 tx=0x7f18d000a360 comp rx=0 tx=0).stop 2024-09-21T01:21:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.253+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 shutdown_connections 2024-09-21T01:21:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.253+0000 7f18dd954640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f18c40b6710 0x7f18c40b8c20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.253+0000 7f18dd954640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d810d020 0x7f18d807f520 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.253+0000 7f18dd954640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d810c6d0 0x7f18d807efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.253+0000 7f18dd954640 1 --2- 172.21.15.37:0/3488310519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18d810a650 0x7f18d807eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:46.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.253+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 >> 172.21.15.37:0/3488310519 conn(0x7f18d806d950 msgr2=0x7f18d810e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:46.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.254+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 shutdown_connections 2024-09-21T01:21:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:46.257+0000 7f18dd954640 1 -- 172.21.15.37:0/3488310519 wait complete. 2024-09-21T01:21:47.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:46 smithi037 ceph-mon[31105]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 957 MiB/s wr, 2.20k op/s 2024-09-21T01:21:47.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:46 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3488310519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:21:47.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:46 smithi137 ceph-mon[34607]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 957 MiB/s wr, 2.20k op/s 2024-09-21T01:21:47.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:46 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3488310519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:21:47.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:46 smithi144 ceph-mon[34818]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 957 MiB/s wr, 2.20k op/s 2024-09-21T01:21:47.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:46 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3488310519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:21:49.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:48 smithi037 ceph-mon[31105]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 771 MiB/s wr, 1.87k op/s 2024-09-21T01:21:49.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:48 smithi137 ceph-mon[34607]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 771 MiB/s wr, 1.87k op/s 2024-09-21T01:21:49.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:48 smithi144 ceph-mon[34818]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 771 MiB/s wr, 1.87k op/s 2024-09-21T01:21:50.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:21:50.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:50 smithi037 ceph-mon[31105]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 887 MiB/s wr, 2.35k op/s 2024-09-21T01:21:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:21:51.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:50 smithi137 ceph-mon[34607]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 887 MiB/s wr, 2.35k op/s 2024-09-21T01:21:51.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:50 smithi144 ceph-mon[34818]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 887 MiB/s wr, 2.35k op/s 2024-09-21T01:21:53.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:52 smithi037 ceph-mon[31105]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 882 MiB/s wr, 2.55k op/s 2024-09-21T01:21:53.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:52 smithi137 ceph-mon[34607]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 882 MiB/s wr, 2.55k op/s 2024-09-21T01:21:53.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:52 smithi144 ceph-mon[34818]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 882 MiB/s wr, 2.55k op/s 2024-09-21T01:21:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.050+0000 7ff417ae1640 1 -- 172.21.15.37:0/4045983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410102a60 msgr2=0x7ff410102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.050+0000 7ff417ae1640 1 --2- 172.21.15.37:0/4045983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410102a60 0x7ff410102e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009900 tx=0x7ff40c02a440 comp rx=0 tx=0).stop 2024-09-21T01:21:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.051+0000 7ff417ae1640 1 -- 172.21.15.37:0/4045983486 shutdown_connections 2024-09-21T01:21:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.051+0000 7ff417ae1640 1 --2- 172.21.15.37:0/4045983486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410108cf0 0x7ff41010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.051+0000 7ff417ae1640 1 --2- 172.21.15.37:0/4045983486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4101083a0 0x7ff4101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.051+0000 7ff417ae1640 1 --2- 172.21.15.37:0/4045983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410102a60 0x7ff410102e70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.051+0000 7ff417ae1640 1 -- 172.21.15.37:0/4045983486 >> 172.21.15.37:0/4045983486 conn(0x7ff410079730 msgr2=0x7ff410079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.052+0000 7ff417ae1640 1 -- 172.21.15.37:0/4045983486 shutdown_connections 2024-09-21T01:21:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.052+0000 7ff417ae1640 1 -- 172.21.15.37:0/4045983486 wait complete. 2024-09-21T01:21:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.053+0000 7ff417ae1640 1 Processor -- start 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.053+0000 7ff417ae1640 1 -- start start 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff417ae1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 0x7ff41019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff417ae1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4101083a0 0x7ff4101997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff417ae1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410108cf0 0x7ff410199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff417ae1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff410112a90 con 0x7ff410102a60 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff417ae1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff410112910 con 0x7ff410108cf0 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff417ae1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff410112c10 con 0x7ff4101083a0 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff41587d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 0x7ff41019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff41587d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 0x7ff41019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58902/0 (socket says 172.21.15.37:58902) 2024-09-21T01:21:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff41587d640 1 -- 172.21.15.37:0/2272620083 learned_addr learned my addr 172.21.15.37:0/2272620083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff41607e640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410108cf0 0x7ff410199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.054+0000 7ff41507c640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4101083a0 0x7ff4101997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.055+0000 7ff41587d640 1 -- 172.21.15.37:0/2272620083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4101083a0 msgr2=0x7ff4101997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.055+0000 7ff41587d640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4101083a0 0x7ff4101997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.055+0000 7ff41587d640 1 -- 172.21.15.37:0/2272620083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410108cf0 msgr2=0x7ff410199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.055+0000 7ff41587d640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410108cf0 0x7ff410199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.055+0000 7ff41587d640 1 -- 172.21.15.37:0/2272620083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4101acda0 con 0x7ff410102a60 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.055+0000 7ff41587d640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 0x7ff41019bd40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff40c02a9b0 tx=0x7ff40c003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.056+0000 7ff406ffd640 1 -- 172.21.15.37:0/2272620083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c03f070 con 0x7ff410102a60 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.056+0000 7ff406ffd640 1 -- 172.21.15.37:0/2272620083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff40c03bd20 con 0x7ff410102a60 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.056+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4101acf70 con 0x7ff410102a60 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.056+0000 7ff406ffd640 1 -- 172.21.15.37:0/2272620083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c035030 con 0x7ff410102a60 2024-09-21T01:21:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.056+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4101ad360 con 0x7ff410102a60 2024-09-21T01:21:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.060+0000 7ff406ffd640 1 -- 172.21.15.37:0/2272620083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff40c042070 con 0x7ff410102a60 2024-09-21T01:21:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.061+0000 7ff406ffd640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff3fc0b6720 0x7ff3fc0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.062+0000 7ff406ffd640 1 -- 172.21.15.37:0/2272620083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff40c108c50 con 0x7ff410102a60 2024-09-21T01:21:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.063+0000 7ff41507c640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff3fc0b6720 0x7ff3fc0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.121+0000 7ff41507c640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff3fc0b6720 0x7ff3fc0b8c30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff41006c040 tx=0x7ff400008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.126+0000 7ff41e055740 1 Processor -- start 2024-09-21T01:21:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.127+0000 7ff41e055740 1 -- start start 2024-09-21T01:21:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.128+0000 7ff41e055740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 0x5622426f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.128+0000 7ff41e055740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x5622426f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.128+0000 7ff41e055740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426f3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.129+0000 7ff41e055740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562242668ea0 con 0x5622423221b0 2024-09-21T01:21:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.129+0000 7ff41e055740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622426582d0 con 0x56224232a390 2024-09-21T01:21:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.129+0000 7ff41e055740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56224265c0e0 con 0x56224234b070 2024-09-21T01:21:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.131+0000 7ff41587d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 0x5622426f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.131+0000 7ff41587d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 0x5622426f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:36760/0 (socket says 172.21.15.37:36760) 2024-09-21T01:21:54.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.131+0000 7ff41587d640 1 -- 172.21.15.37:0/2062705553 learned_addr learned my addr 172.21.15.37:0/2062705553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.134+0000 7ff41607e640 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.136+0000 7ff41587d640 1 -- 172.21.15.37:0/2062705553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 msgr2=0x5622426f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.136+0000 7ff41587d640 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.136+0000 7ff41587d640 1 -- 172.21.15.37:0/2062705553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 msgr2=0x5622426f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.136+0000 7ff41587d640 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x5622426f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.136+0000 7ff41587d640 1 -- 172.21.15.37:0/2062705553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622423b6650 con 0x56224234b070 2024-09-21T01:21:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.142+0000 7ff41587d640 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 0x5622426f26a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff40c106650 tx=0x7ff40c003f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff1e155623b3be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.144+0000 7ff3fbfff640 1 -- 172.21.15.37:0/2062705553 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c0d2020 con 0x56224234b070 2024-09-21T01:21:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.145+0000 7ff3fbfff640 1 -- 172.21.15.37:0/2062705553 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff40c0ce8b0 con 0x56224234b070 2024-09-21T01:21:54.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.145+0000 7ff3fbfff640 1 -- 172.21.15.37:0/2062705553 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c049040 con 0x56224234b070 2024-09-21T01:21:54.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 -- 172.21.15.37:0/2062705553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 msgr2=0x5622426f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 0x5622426f26a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff40c106650 tx=0x7ff40c003f50 comp rx=0 tx=0).stop 2024-09-21T01:21:54.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 -- 172.21.15.37:0/2062705553 shutdown_connections 2024-09-21T01:21:54.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x5622426f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 --2- 172.21.15.37:0/2062705553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224234b070 0x5622426f26a0 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff40c106650 tx=0x7ff40c003f50 comp rx=0 tx=0).stop 2024-09-21T01:21:54.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.148+0000 7ff41e055740 1 -- 172.21.15.37:0/2062705553 >> 172.21.15.37:0/2062705553 conn(0x56224233f460 msgr2=0x5622426f0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:54.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.154+0000 7ff41e055740 1 -- 172.21.15.37:0/2062705553 shutdown_connections 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.154+0000 7ff41e055740 1 -- 172.21.15.37:0/2062705553 wait complete. 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.155+0000 7ff41e055740 1 -- start start 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.155+0000 7ff41e055740 1 Processor -- start 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x5622426fde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426fe3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242709ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5622424b9700 con 0x5622423099f0 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5622425f3160 con 0x56224232a390 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562242700c40 con 0x5622423221b0 2024-09-21T01:21:54.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.156+0000 7ff41e055740 10 client.0 _ll_register_callbacks cb 0x56224260c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.161+0000 7ff41587d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x5622426fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.161+0000 7ff41587d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x5622426fde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:36774/0 (socket says 172.21.15.37:36774) 2024-09-21T01:21:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.162+0000 7ff41587d640 1 -- 172.21.15.37:0/3128536957 learned_addr learned my addr 172.21.15.37:0/3128536957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.162+0000 7ff41507c640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426fe3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.162+0000 7ff41607e640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242709ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.168+0000 7ff41587d640 1 -- 172.21.15.37:0/3128536957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 msgr2=0x5622426fe3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.168+0000 7ff41587d640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426fe3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.168+0000 7ff41587d640 1 -- 172.21.15.37:0/3128536957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 msgr2=0x562242709ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.168+0000 7ff41587d640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242709ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.169+0000 7ff41587d640 1 -- 172.21.15.37:0/3128536957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562242620c90 con 0x5622423221b0 2024-09-21T01:21:54.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.177+0000 7ff41587d640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x5622426fde70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff40c02a480 tx=0x7ff40c0cb240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8174b8462640ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:54.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.177+0000 7ff3f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.178+0000 7ff3f97fa640 1 -- 172.21.15.37:0/3128536957 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c049070 con 0x5622423221b0 2024-09-21T01:21:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.179+0000 7ff3f97fa640 1 -- 172.21.15.37:0/3128536957 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff40c07e1b0 con 0x5622423221b0 2024-09-21T01:21:54.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.180+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff40c0ce8b0 con 0x5622423221b0 2024-09-21T01:21:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.183+0000 7ff3f97fa640 1 -- 172.21.15.37:0/3128536957 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff40c0d2040 con 0x5622423221b0 2024-09-21T01:21:54.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.184+0000 7ff41e055740 10 client.25861 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:54.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.184+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56224270c9e0 con 0x5622423221b0 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff3f97fa640 1 -- 172.21.15.37:0/3128536957 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff40c0ce8b0 con 0x5622423221b0 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff3f97fa640 1 -- 172.21.15.37:0/3128536957 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff40c0f60d0 con 0x5622423221b0 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff41e055740 10 client.25861 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff41e055740 10 client.25861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff41e055740 20 client.25861 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff41e055740 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5622422deda0 0x56224270fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff41e055740 4 client.25861 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:21:54.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.191+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56224266adf0 con 0x5622422deda0 2024-09-21T01:21:54.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.194+0000 7ff41507c640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5622422deda0 0x56224270fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.203+0000 7ff41507c640 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5622422deda0 0x56224270fd40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1601ffaee26acdd0 server_cookie=3841ea22fdde541f in_seq=0 out_seq=0 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.203+0000 7ff3f97fa640 10 client.25861 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.205+0000 7ff3f97fa640 1 -- 172.21.15.37:0/3128536957 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56224266adf0 con 0x5622422deda0 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.205+0000 7ff3f97fa640 10 client.25861 handle_command_reply: tid=0 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.206+0000 7ff41e055740 1 client.25861 shutdown 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 msgr2=0x5622426fde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x5622426fde70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff40c02a480 tx=0x7ff40c0cb240 comp rx=0 tx=0).stop 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 shutdown_connections 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5622422deda0 0x56224270fd40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242709ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x5622426fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 --2- 172.21.15.37:0/3128536957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x5622426fde70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.207+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 >> 172.21.15.37:0/3128536957 conn(0x56224233f460 msgr2=0x5622426f5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:54.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.208+0000 7ff3f97fa640 0 client.25861 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:21:54.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.208+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 shutdown_connections 2024-09-21T01:21:54.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.208+0000 7ff41e055740 1 -- 172.21.15.37:0/3128536957 wait complete. 2024-09-21T01:21:54.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.209+0000 7ff41e055740 20 client.25861 trim_cache size 0 max 16384 2024-09-21T01:21:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.253+0000 7ff41e055740 1 Processor -- start 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 -- start start 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622423099f0 0x5622426f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x562242709d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 0x56224270a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4101b5c30 con 0x5622423221b0 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4101b7770 con 0x5622423099f0 2024-09-21T01:21:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.254+0000 7ff41e055740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4101b6300 con 0x56224232a390 2024-09-21T01:21:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.255+0000 7ff41607e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 0x56224270a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.256+0000 7ff41607e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 0x56224270a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:36776/0 (socket says 172.21.15.37:36776) 2024-09-21T01:21:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.256+0000 7ff41607e640 1 -- 172.21.15.37:0/174795022 learned_addr learned my addr 172.21.15.37:0/174795022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.256+0000 7ff41587d640 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622423099f0 0x5622426f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.257+0000 7ff41507c640 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x562242709d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.258+0000 7ff41607e640 1 -- 172.21.15.37:0/174795022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622423099f0 msgr2=0x5622426f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.258+0000 7ff41607e640 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622423099f0 0x5622426f5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.258+0000 7ff41607e640 1 -- 172.21.15.37:0/174795022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 msgr2=0x562242709d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.258+0000 7ff41607e640 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x562242709d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.258+0000 7ff41607e640 1 -- 172.21.15.37:0/174795022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622426f4bc0 con 0x56224232a390 2024-09-21T01:21:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.262+0000 7ff41607e640 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 0x56224270a280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff40800a670 tx=0x7ff4080097b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5715ccd1541dc8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.263+0000 7ff3fb7fe640 1 -- 172.21.15.37:0/174795022 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408007970 con 0x56224232a390 2024-09-21T01:21:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.263+0000 7ff3fb7fe640 1 -- 172.21.15.37:0/174795022 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff40801c070 con 0x56224232a390 2024-09-21T01:21:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.263+0000 7ff3fb7fe640 1 -- 172.21.15.37:0/174795022 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4080163c0 con 0x56224232a390 2024-09-21T01:21:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.266+0000 7ff41e055740 1 -- 172.21.15.37:0/174795022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 msgr2=0x56224270a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.266+0000 7ff41e055740 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 0x56224270a280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff40800a670 tx=0x7ff4080097b0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.267+0000 7ff41e055740 1 -- 172.21.15.37:0/174795022 shutdown_connections 2024-09-21T01:21:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.267+0000 7ff41e055740 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224232a390 0x56224270a280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.267+0000 7ff41e055740 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423221b0 0x562242709d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.267+0000 7ff41e055740 1 --2- 172.21.15.37:0/174795022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5622423099f0 0x5622426f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.267+0000 7ff41e055740 1 -- 172.21.15.37:0/174795022 >> 172.21.15.37:0/174795022 conn(0x56224233f460 msgr2=0x5622426f57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:54.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.272+0000 7ff41e055740 1 -- 172.21.15.37:0/174795022 shutdown_connections 2024-09-21T01:21:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.273+0000 7ff41e055740 1 -- 172.21.15.37:0/174795022 wait complete. 2024-09-21T01:21:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.273+0000 7ff41e055740 1 -- start start 2024-09-21T01:21:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.273+0000 7ff41e055740 1 Processor -- start 2024-09-21T01:21:54.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242705da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x562242706320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x562242773930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4101b70a0 con 0x5622423099f0 2024-09-21T01:21:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4101b69d0 con 0x56224232a390 2024-09-21T01:21:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4101b3bf0 con 0x5622423221b0 2024-09-21T01:21:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.275+0000 7ff41e055740 10 client.0 _ll_register_callbacks cb 0x7ff408009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.279+0000 7ff41587d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242705da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.279+0000 7ff41507c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x562242706320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.279+0000 7ff41507c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x562242706320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:36788/0 (socket says 172.21.15.37:36788) 2024-09-21T01:21:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.279+0000 7ff41507c640 1 -- 172.21.15.37:0/200851427 learned_addr learned my addr 172.21.15.37:0/200851427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.280+0000 7ff41607e640 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x562242773930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.280+0000 7ff41507c640 1 -- 172.21.15.37:0/200851427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 msgr2=0x562242773930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.280+0000 7ff41507c640 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x562242773930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.280+0000 7ff41507c640 1 -- 172.21.15.37:0/200851427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 msgr2=0x562242705da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.280+0000 7ff41507c640 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242705da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.280+0000 7ff41507c640 1 -- 172.21.15.37:0/200851427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562242773e70 con 0x5622423221b0 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.281+0000 7ff41507c640 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x562242706320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5622426f1320 tx=0x7ff40000ddb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e714b520654372 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.281+0000 7ff3f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.283+0000 7ff3f97fa640 1 -- 172.21.15.37:0/200851427 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40002e060 con 0x5622423221b0 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.283+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff40801c070 con 0x5622423221b0 2024-09-21T01:21:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.283+0000 7ff3f97fa640 1 -- 172.21.15.37:0/200851427 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff40000f040 con 0x5622423221b0 2024-09-21T01:21:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.286+0000 7ff3f97fa640 1 -- 172.21.15.37:0/200851427 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff400014b10 con 0x5622423221b0 2024-09-21T01:21:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.286+0000 7ff41e055740 10 client.25867 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.286+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56224279ccb0 con 0x5622423221b0 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.288+0000 7ff3f97fa640 1 -- 172.21.15.37:0/200851427 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff40801c070 con 0x5622423221b0 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.288+0000 7ff3f97fa640 1 -- 172.21.15.37:0/200851427 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff400033070 con 0x5622423221b0 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.288+0000 7ff41e055740 10 client.25867 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.288+0000 7ff41e055740 10 client.25867 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.288+0000 7ff41e055740 20 client.25867 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.289+0000 7ff41e055740 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x56224279d4e0 0x56224279f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.289+0000 7ff41e055740 4 client.25867 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:21:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.289+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622426668a0 con 0x56224279d4e0 2024-09-21T01:21:54.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.290+0000 7ff41587d640 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x56224279d4e0 0x56224279f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.294+0000 7ff41587d640 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x56224279d4e0 0x56224279f900 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4511774f671b3747 server_cookie=c36dd24db05fcbda in_seq=0 out_seq=0 2024-09-21T01:21:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.294+0000 7ff3f97fa640 10 client.25867 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:21:54.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.295+0000 7ff3f97fa640 1 -- 172.21.15.37:0/200851427 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622426668a0 con 0x56224279d4e0 2024-09-21T01:21:54.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.295+0000 7ff3f97fa640 10 client.25867 handle_command_reply: tid=0 2024-09-21T01:21:54.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.295+0000 7ff41e055740 1 client.25867 shutdown 2024-09-21T01:21:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.297+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 msgr2=0x562242706320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.297+0000 7ff41e055740 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x562242706320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5622426f1320 tx=0x7ff40000ddb0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 shutdown_connections 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff41e055740 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x56224279d4e0 0x56224279f900 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff41e055740 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56224232a390 0x562242773930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff41e055740 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622423221b0 0x562242706320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff41e055740 1 --2- 172.21.15.37:0/200851427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622423099f0 0x562242705da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 >> 172.21.15.37:0/200851427 conn(0x56224233f460 msgr2=0x5622426f57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.299+0000 7ff3f97fa640 0 client.25867 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:21:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.300+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 shutdown_connections 2024-09-21T01:21:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.303+0000 7ff41e055740 1 -- 172.21.15.37:0/200851427 wait complete. 2024-09-21T01:21:54.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.303+0000 7ff41e055740 20 client.25867 trim_cache size 0 max 16384 2024-09-21T01:21:54.308 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:21:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.309+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff3fc0b6720 msgr2=0x7ff3fc0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.309+0000 7ff417ae1640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff3fc0b6720 0x7ff3fc0b8c30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff41006c040 tx=0x7ff400008040 comp rx=0 tx=0).stop 2024-09-21T01:21:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.309+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 msgr2=0x7ff41019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:54.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.309+0000 7ff417ae1640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 0x7ff41019bd40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff40c02a9b0 tx=0x7ff40c003d60 comp rx=0 tx=0).stop 2024-09-21T01:21:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 shutdown_connections 2024-09-21T01:21:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff3fc0b6720 0x7ff3fc0b8c30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff410108cf0 0x7ff410199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4101083a0 0x7ff4101997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 --2- 172.21.15.37:0/2272620083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff410102a60 0x7ff41019bd40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 >> 172.21.15.37:0/2272620083 conn(0x7ff410079730 msgr2=0x7ff410100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:54.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.310+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 shutdown_connections 2024-09-21T01:21:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:21:54.313+0000 7ff417ae1640 1 -- 172.21.15.37:0/2272620083 wait complete. 2024-09-21T01:21:55.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:54 smithi037 ceph-mon[31105]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 793 MiB/s wr, 2.45k op/s 2024-09-21T01:21:55.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:54 smithi137 ceph-mon[34607]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 793 MiB/s wr, 2.45k op/s 2024-09-21T01:21:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:54 smithi144 ceph-mon[34818]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 793 MiB/s wr, 2.45k op/s 2024-09-21T01:21:56.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 -- 172.21.15.37:0/743864452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2240782a0 msgr2=0x7fd22407a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 --2- 172.21.15.37:0/743864452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2240782a0 0x7fd22407a6c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009be0 tx=0x7fd21c02a6f0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 -- 172.21.15.37:0/743864452 shutdown_connections 2024-09-21T01:21:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 --2- 172.21.15.37:0/743864452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd22407ac00 0x7fd22407d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 --2- 172.21.15.37:0/743864452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2240782a0 0x7fd22407a6c0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009be0 tx=0x7fd21c02a6f0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 --2- 172.21.15.37:0/743864452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2240754e0 0x7fd224075950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.918+0000 7fd22990b640 1 -- 172.21.15.37:0/743864452 >> 172.21.15.37:0/743864452 conn(0x7fd224070810 msgr2=0x7fd224072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:56.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.921+0000 7fd22990b640 1 -- 172.21.15.37:0/743864452 shutdown_connections 2024-09-21T01:21:56.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.925+0000 7fd22990b640 1 -- 172.21.15.37:0/743864452 wait complete. 2024-09-21T01:21:56.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.927+0000 7fd22990b640 1 Processor -- start 2024-09-21T01:21:56.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.927+0000 7fd22990b640 1 -- start start 2024-09-21T01:21:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.928+0000 7fd22990b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2240754e0 0x7fd224081150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.928+0000 7fd22990b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22407ac00 0x7fd2241b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.928+0000 7fd22990b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 0x7fd2241b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.928+0000 7fd22990b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd224081cc0 con 0x7fd22407ac00 2024-09-21T01:21:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.928+0000 7fd22990b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd224081b40 con 0x7fd2240754e0 2024-09-21T01:21:56.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.928+0000 7fd22990b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd224081e40 con 0x7fd2241b68f0 2024-09-21T01:21:56.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.933+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2240754e0 0x7fd224081150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.934+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 0x7fd2241b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.934+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 0x7fd2241b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41556/0 (socket says 172.21.15.37:41556) 2024-09-21T01:21:56.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.934+0000 7fd2237fe640 1 -- 172.21.15.37:0/359245047 learned_addr learned my addr 172.21.15.37:0/359245047 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:56.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.937+0000 7fd2227fc640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22407ac00 0x7fd2241b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.945+0000 7fd222ffd640 1 -- 172.21.15.37:0/359245047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 msgr2=0x7fd2241b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:56.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.945+0000 7fd222ffd640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 0x7fd2241b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.945+0000 7fd222ffd640 1 -- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22407ac00 msgr2=0x7fd2241b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.945+0000 7fd222ffd640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22407ac00 0x7fd2241b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.945+0000 7fd222ffd640 1 -- 172.21.15.37:0/359245047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241b75e0 con 0x7fd2240754e0 2024-09-21T01:21:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.946+0000 7fd222ffd640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2240754e0 0x7fd224081150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd21800b3f0 tx=0x7fd21800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.948+0000 7fd228909640 1 -- 172.21.15.37:0/359245047 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218015020 con 0x7fd2240754e0 2024-09-21T01:21:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.949+0000 7fd228909640 1 -- 172.21.15.37:0/359245047 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd218011ce0 con 0x7fd2240754e0 2024-09-21T01:21:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.949+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241b78d0 con 0x7fd2240754e0 2024-09-21T01:21:56.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.952+0000 7fd228909640 1 -- 172.21.15.37:0/359245047 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218015020 con 0x7fd2240754e0 2024-09-21T01:21:56.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.957+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2241b7ea0 con 0x7fd2240754e0 2024-09-21T01:21:56.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.959+0000 7fd2237fe640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 0x7fd2241b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:21:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.961+0000 7fd228909640 1 -- 172.21.15.37:0/359245047 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd218018020 con 0x7fd2240754e0 2024-09-21T01:21:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.963+0000 7fd228909640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd20c0b6950 0x7fd20c0b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.964+0000 7fd2227fc640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd20c0b6950 0x7fd20c0b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.971+0000 7fd228909640 1 -- 172.21.15.37:0/359245047 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd218011630 con 0x7fd2240754e0 2024-09-21T01:21:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 Processor -- start 2024-09-21T01:21:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 -- start start 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd2227fc640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd20c0b6950 0x7fd20c0b8e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd21c034040 tx=0x7fd21c000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00a96e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00a974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00a98010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555f00a096f0 con 0x555f006c62f0 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555f009f8b20 con 0x555f006ce4d0 2024-09-21T01:21:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.974+0000 7fd230874740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555f009fc930 con 0x555f006ef1b0 2024-09-21T01:21:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.975+0000 7fd2227fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00a974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.975+0000 7fd2227fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00a974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50770/0 (socket says 172.21.15.37:50770) 2024-09-21T01:21:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.975+0000 7fd2227fc640 1 -- 172.21.15.37:0/2222143910 learned_addr learned my addr 172.21.15.37:0/2222143910 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.977+0000 7fd2227fc640 1 -- 172.21.15.37:0/2222143910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 msgr2=0x555f00a96e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.977+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00a96e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.977+0000 7fd2227fc640 1 -- 172.21.15.37:0/2222143910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 msgr2=0x555f00a98010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:21:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.977+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00a98010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.977+0000 7fd2227fc640 1 -- 172.21.15.37:0/2222143910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f009be530 con 0x555f006c62f0 2024-09-21T01:21:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.978+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00a974c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009be0 tx=0x7fd21c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51053f3e9ae29d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.983+0000 7fd209ffb640 1 -- 172.21.15.37:0/2222143910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c036040 con 0x555f006c62f0 2024-09-21T01:21:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.983+0000 7fd209ffb640 1 -- 172.21.15.37:0/2222143910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c04f070 con 0x555f006c62f0 2024-09-21T01:21:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.983+0000 7fd209ffb640 1 -- 172.21.15.37:0/2222143910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c03ddd0 con 0x555f006c62f0 2024-09-21T01:21:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.986+0000 7fd230874740 1 -- 172.21.15.37:0/2222143910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 msgr2=0x555f00a974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.986+0000 7fd230874740 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00a974c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009be0 tx=0x7fd21c03d000 comp rx=0 tx=0).stop 2024-09-21T01:21:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.992+0000 7fd230874740 1 -- 172.21.15.37:0/2222143910 shutdown_connections 2024-09-21T01:21:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.992+0000 7fd230874740 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00a98010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.992+0000 7fd230874740 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00a974c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.992+0000 7fd230874740 1 --2- 172.21.15.37:0/2222143910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00a96e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:56.993+0000 7fd230874740 1 -- 172.21.15.37:0/2222143910 >> 172.21.15.37:0/2222143910 conn(0x555f006e3300 msgr2=0x555f00a928e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.006+0000 7fd230874740 1 -- 172.21.15.37:0/2222143910 shutdown_connections 2024-09-21T01:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.010+0000 7fd230874740 1 -- 172.21.15.37:0/2222143910 wait complete. 2024-09-21T01:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.010+0000 7fd230874740 1 -- start start 2024-09-21T01:21:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.011+0000 7fd230874740 1 Processor -- start 2024-09-21T01:21:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00aa0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00aa0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00aa1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555f00930ab0 con 0x555f006c62f0 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555f0099e730 con 0x555f006ce4d0 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555f00a98ad0 con 0x555f006ef1b0 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.016+0000 7fd230874740 10 client.0 _ll_register_callbacks cb 0x555f009f26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.017+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00aa0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.017+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00aa0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50782/0 (socket says 172.21.15.37:50782) 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.017+0000 7fd222ffd640 1 -- 172.21.15.37:0/3319255934 learned_addr learned my addr 172.21.15.37:0/3319255934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.018+0000 7fd2227fc640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00aa0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.019+0000 7fd2237fe640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00aa1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.024+0000 7fd222ffd640 1 -- 172.21.15.37:0/3319255934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 msgr2=0x555f00aa1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.024+0000 7fd222ffd640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00aa1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.024+0000 7fd222ffd640 1 -- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 msgr2=0x555f00aa0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.024+0000 7fd222ffd640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00aa0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.024+0000 7fd222ffd640 1 -- 172.21.15.37:0/3319255934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0075a790 con 0x555f006c62f0 2024-09-21T01:21:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.024+0000 7fd222ffd640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00aa0660 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd21800bfd0 tx=0x7fd2180092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eca6d287c60af09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.025+0000 7fd202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:21:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.027+0000 7fd202ffd640 1 -- 172.21.15.37:0/3319255934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218015070 con 0x555f006c62f0 2024-09-21T01:21:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.027+0000 7fd202ffd640 1 -- 172.21.15.37:0/3319255934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd2180aaf00 con 0x555f006c62f0 2024-09-21T01:21:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.030+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21c04f070 con 0x555f006c62f0 2024-09-21T01:21:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.033+0000 7fd202ffd640 1 -- 172.21.15.37:0/3319255934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2180cf0b0 con 0x555f006c62f0 2024-09-21T01:21:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.038+0000 7fd230874740 10 client.16461 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.038+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f007d3620 con 0x555f006c62f0 2024-09-21T01:21:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.043+0000 7fd202ffd640 1 -- 172.21.15.37:0/3319255934 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2180cf0b0 con 0x555f006c62f0 2024-09-21T01:21:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.044+0000 7fd202ffd640 1 -- 172.21.15.37:0/3319255934 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd218096020 con 0x555f006c62f0 2024-09-21T01:21:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.045+0000 7fd230874740 10 client.16461 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.045+0000 7fd230874740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.045+0000 7fd230874740 20 client.16461 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.045+0000 7fd230874740 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006add80 0x555f00abf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.045+0000 7fd230874740 4 client.16461 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:21:57.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.045+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f00a0b640 con 0x555f006add80 2024-09-21T01:21:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.051+0000 7fd2227fc640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006add80 0x555f00abf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.062+0000 7fd2227fc640 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006add80 0x555f00abf210 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d845a5ff281728b0 server_cookie=e51cf8930d96d0a4 in_seq=0 out_seq=0 2024-09-21T01:21:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.062+0000 7fd202ffd640 10 client.16461 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:57.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.067+0000 7fd202ffd640 1 -- 172.21.15.37:0/3319255934 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555f00a0b640 con 0x555f006add80 2024-09-21T01:21:57.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.067+0000 7fd202ffd640 10 client.16461 handle_command_reply: tid=0 2024-09-21T01:21:57.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.068+0000 7fd230874740 1 client.16461 shutdown 2024-09-21T01:21:57.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.070+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 msgr2=0x555f00aa0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:57.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.070+0000 7fd230874740 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00aa0660 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd21800bfd0 tx=0x7fd2180092c0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.076+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 shutdown_connections 2024-09-21T01:21:57.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.076+0000 7fd230874740 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006add80 0x555f00abf210 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.076+0000 7fd230874740 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ef1b0 0x555f00aa1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.076+0000 7fd230874740 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ce4d0 0x555f00aa0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.076+0000 7fd230874740 1 --2- 172.21.15.37:0/3319255934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006c62f0 0x555f00aa0660 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.076+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 >> 172.21.15.37:0/3319255934 conn(0x555f006e3300 msgr2=0x555f00a90ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:57.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.077+0000 7fd202ffd640 0 client.16461 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:57.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.080+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 shutdown_connections 2024-09-21T01:21:57.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.080+0000 7fd230874740 1 -- 172.21.15.37:0/3319255934 wait complete. 2024-09-21T01:21:57.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.082+0000 7fd230874740 20 client.16461 trim_cache size 0 max 16384 2024-09-21T01:21:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.144+0000 7fd230874740 1 Processor -- start 2024-09-21T01:21:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.144+0000 7fd230874740 1 -- start start 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd230874740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006c62f0 0x555f00a9ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd230874740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ce4d0 0x555f00a9f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd230874740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ef1b0 0x555f00a92dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd230874740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241c0bd0 con 0x555f006ce4d0 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd230874740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241c4730 con 0x555f006ef1b0 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd230874740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241c32c0 con 0x555f006c62f0 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.145+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006c62f0 0x555f00a9ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.146+0000 7fd222ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006c62f0 0x555f00a9ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41578/0 (socket says 172.21.15.37:41578) 2024-09-21T01:21:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.146+0000 7fd222ffd640 1 -- 172.21.15.37:0/2413269355 learned_addr learned my addr 172.21.15.37:0/2413269355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.149+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ce4d0 0x555f00a9f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.153+0000 7fd2227fc640 1 -- 172.21.15.37:0/2413269355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006c62f0 msgr2=0x555f00a9ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.153+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006c62f0 0x555f00a9ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.153+0000 7fd2227fc640 1 -- 172.21.15.37:0/2413269355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ef1b0 msgr2=0x555f00a92dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.153+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ef1b0 0x555f00a92dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.153+0000 7fd2227fc640 1 -- 172.21.15.37:0/2413269355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f00a8e080 con 0x555f006ce4d0 2024-09-21T01:21:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.157+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ce4d0 0x555f00a9f0f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009560 tx=0x7fd21c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173f59c0a33e0e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.160+0000 7fd2097fa640 1 -- 172.21.15.37:0/2413269355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c061070 con 0x555f006ce4d0 2024-09-21T01:21:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.161+0000 7fd2097fa640 1 -- 172.21.15.37:0/2413269355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c031890 con 0x555f006ce4d0 2024-09-21T01:21:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.163+0000 7fd230874740 1 -- 172.21.15.37:0/2413269355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ce4d0 msgr2=0x555f00a9f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:21:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.163+0000 7fd230874740 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ce4d0 0x555f00a9f0f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009560 tx=0x7fd21c03d000 comp rx=0 tx=0).stop 2024-09-21T01:21:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.164+0000 7fd230874740 1 -- 172.21.15.37:0/2413269355 shutdown_connections 2024-09-21T01:21:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.164+0000 7fd230874740 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006ef1b0 0x555f00a92dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.164+0000 7fd230874740 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ce4d0 0x555f00a9f0f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.164+0000 7fd230874740 1 --2- 172.21.15.37:0/2413269355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006c62f0 0x555f00a9ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.164+0000 7fd230874740 1 -- 172.21.15.37:0/2413269355 >> 172.21.15.37:0/2413269355 conn(0x555f006e3300 msgr2=0x555f00a92220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:21:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:56 smithi137 ceph-mon[34607]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 873 MiB/s wr, 2.98k op/s 2024-09-21T01:21:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.169+0000 7fd230874740 1 -- 172.21.15.37:0/2413269355 shutdown_connections 2024-09-21T01:21:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:56 smithi144 ceph-mon[34818]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 873 MiB/s wr, 2.98k op/s 2024-09-21T01:21:57.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.169+0000 7fd230874740 1 -- 172.21.15.37:0/2413269355 wait complete. 2024-09-21T01:21:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.169+0000 7fd230874740 1 -- start start 2024-09-21T01:21:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.170+0000 7fd230874740 1 Processor -- start 2024-09-21T01:21:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.171+0000 7fd230874740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006c62f0 0x555f00aa55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.171+0000 7fd230874740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 0x555f00aa5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.171+0000 7fd230874740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ef1b0 0x555f00aa6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd2227fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 0x555f00aa5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd2227fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 0x555f00aa5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41592/0 (socket says 172.21.15.37:41592) 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd230874740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241c4060 con 0x555f006ef1b0 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd230874740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241c3990 con 0x555f006c62f0 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd230874740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241beb50 con 0x555f006ce4d0 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd230874740 10 client.0 _ll_register_callbacks cb 0x7fd2180a80e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:21:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.172+0000 7fd2227fc640 1 -- 172.21.15.37:0/2660598592 learned_addr learned my addr 172.21.15.37:0/2660598592 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:21:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.175+0000 7fd2227fc640 1 -- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006c62f0 msgr2=0x555f00aa55f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:21:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.175+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006c62f0 0x555f00aa55f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.175+0000 7fd2227fc640 1 -- 172.21.15.37:0/2660598592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ef1b0 msgr2=0x555f00aa6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:21:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.175+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ef1b0 0x555f00aa6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:21:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.175+0000 7fd2227fc640 1 -- 172.21.15.37:0/2660598592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f00aa6f80 con 0x555f006ce4d0 2024-09-21T01:21:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.179+0000 7fd2227fc640 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 0x555f00aa5cb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd21c030890 tx=0x7fd21c009960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e284f15d826ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:21:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.180+0000 7fd202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:21:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.180+0000 7fd202ffd640 1 -- 172.21.15.37:0/2660598592 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c061070 con 0x555f006ce4d0 2024-09-21T01:21:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.180+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21c031890 con 0x555f006ce4d0 2024-09-21T01:21:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.180+0000 7fd202ffd640 1 -- 172.21.15.37:0/2660598592 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd21c03d560 con 0x555f006ce4d0 2024-09-21T01:21:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.183+0000 7fd202ffd640 1 -- 172.21.15.37:0/2660598592 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd21c05c070 con 0x555f006ce4d0 2024-09-21T01:21:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.183+0000 7fd230874740 10 client.25882 fetch_fsmap learned FSMap version 30 2024-09-21T01:21:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.183+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f00aa8270 con 0x555f006ce4d0 2024-09-21T01:21:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.188+0000 7fd202ffd640 1 -- 172.21.15.37:0/2660598592 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c031890 con 0x555f006ce4d0 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd202ffd640 1 -- 172.21.15.37:0/2660598592 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd21c065400 con 0x555f006ce4d0 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd230874740 10 client.25882 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd230874740 10 client.25882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd230874740 20 client.25882 populate_metadata read hostname 'smithi037' 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd230874740 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006831c0 0x555f00b2bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd230874740 4 client.25882 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:21:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.189+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f00a070f0 con 0x555f006831c0 2024-09-21T01:21:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.194+0000 7fd222ffd640 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006831c0 0x555f00b2bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:21:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.197+0000 7fd202ffd640 10 client.25882 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:21:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:21:57.197+0000 7fd222ffd640 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006831c0 0x555f00b2bc20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf06e4c9bf2ae2a server_cookie=dfac228b3d72d4bf in_seq=0 out_seq=0 2024-09-21T01:21:57.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:56 smithi037 ceph-mon[31105]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 873 MiB/s wr, 2.98k op/s 2024-09-21T01:21:58.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:21:59.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:21:58 smithi137 ceph-mon[34607]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 745 MiB/s wr, 2.85k op/s 2024-09-21T01:21:59.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:21:58 smithi144 ceph-mon[34818]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 745 MiB/s wr, 2.85k op/s 2024-09-21T01:21:59.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:21:58 smithi037 ceph-mon[31105]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 745 MiB/s wr, 2.85k op/s 2024-09-21T01:21:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:22:00.891 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:00 smithi037 ceph-mon[31105]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 884 MiB/s wr, 3.51k op/s 2024-09-21T01:22:01.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:00 smithi137 ceph-mon[34607]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 884 MiB/s wr, 3.51k op/s 2024-09-21T01:22:01.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:00 smithi144 ceph-mon[34818]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 884 MiB/s wr, 3.51k op/s 2024-09-21T01:22:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.398+0000 7fd202ffd640 1 -- 172.21.15.37:0/2660598592 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f00a070f0 con 0x555f006831c0 2024-09-21T01:22:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.398+0000 7fd202ffd640 10 client.25882 handle_command_reply: tid=0 2024-09-21T01:22:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.398+0000 7fd230874740 1 client.25882 shutdown 2024-09-21T01:22:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 msgr2=0x555f00aa5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 0x555f00aa5cb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd21c030890 tx=0x7fd21c009960 comp rx=0 tx=0).stop 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 shutdown_connections 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555f006831c0 0x555f00b2bc20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555f006ef1b0 0x555f00aa6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f006ce4d0 0x555f00aa5cb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 --2- 172.21.15.37:0/2660598592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555f006c62f0 0x555f00aa55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 >> 172.21.15.37:0/2660598592 conn(0x555f006e3300 msgr2=0x555f00a9e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.402+0000 7fd202ffd640 0 client.25882 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:01.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.403+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 shutdown_connections 2024-09-21T01:22:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.403+0000 7fd230874740 1 -- 172.21.15.37:0/2660598592 wait complete. 2024-09-21T01:22:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.403+0000 7fd230874740 20 client.25882 trim_cache size 0 max 16384 2024-09-21T01:22:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:22:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:22:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:22:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:22:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.409+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd20c0b6950 msgr2=0x7fd20c0b8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.409+0000 7fd22990b640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd20c0b6950 0x7fd20c0b8e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd21c034040 tx=0x7fd21c000f40 comp rx=0 tx=0).stop 2024-09-21T01:22:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.410+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2240754e0 msgr2=0x7fd224081150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.410+0000 7fd22990b640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2240754e0 0x7fd224081150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd21800b3f0 tx=0x7fd21800b8b0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.411+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 shutdown_connections 2024-09-21T01:22:01.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.411+0000 7fd22990b640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd20c0b6950 0x7fd20c0b8e60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.411+0000 7fd22990b640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2241b68f0 0x7fd2241b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.411+0000 7fd22990b640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd22407ac00 0x7fd2241b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.412+0000 7fd22990b640 1 --2- 172.21.15.37:0/359245047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2240754e0 0x7fd224081150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.412+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 >> 172.21.15.37:0/359245047 conn(0x7fd224070810 msgr2=0x7fd2240791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.429+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 shutdown_connections 2024-09-21T01:22:01.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:01.429+0000 7fd22990b640 1 -- 172.21.15.37:0/359245047 wait complete. 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 -- 172.21.15.37:0/629363782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010b650 msgr2=0x7f0ca010bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 --2- 172.21.15.37:0/629363782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010b650 0x7f0ca010bd30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b9f0 tx=0x7f0c9c02c0f0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 -- 172.21.15.37:0/629363782 shutdown_connections 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 --2- 172.21.15.37:0/629363782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca0110210 0x7f0ca007c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 --2- 172.21.15.37:0/629363782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca010f8c0 0x7f0ca010fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 --2- 172.21.15.37:0/629363782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010b650 0x7f0ca010bd30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.512+0000 7f0ca6887640 1 -- 172.21.15.37:0/629363782 >> 172.21.15.37:0/629363782 conn(0x7f0ca006e9f0 msgr2=0x7f0ca006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.519+0000 7f0ca6887640 1 -- 172.21.15.37:0/629363782 shutdown_connections 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.520+0000 7f0ca6887640 1 -- 172.21.15.37:0/629363782 wait complete. 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.521+0000 7f0ca6887640 1 Processor -- start 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.521+0000 7f0ca6887640 1 -- start start 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.521+0000 7f0ca6887640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca010b650 0x7f0ca00805d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.521+0000 7f0ca6887640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010f8c0 0x7f0ca0080b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.521+0000 7f0ca6887640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca0110210 0x7f0ca0081050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.522+0000 7f0ca6887640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca007eae0 con 0x7f0ca010f8c0 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.522+0000 7f0ca6887640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca007e960 con 0x7f0ca0110210 2024-09-21T01:22:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.522+0000 7f0ca6887640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca007ec60 con 0x7f0ca010b650 2024-09-21T01:22:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.526+0000 7f0ca5885640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca010b650 0x7f0ca00805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.528+0000 7f0ca5885640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca010b650 0x7f0ca00805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41600/0 (socket says 172.21.15.37:41600) 2024-09-21T01:22:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.528+0000 7f0ca5885640 1 -- 172.21.15.37:0/3723831255 learned_addr learned my addr 172.21.15.37:0/3723831255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:01.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.528+0000 7f0ca5084640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010f8c0 0x7f0ca0080b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.528+0000 7f0ca6086640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca0110210 0x7f0ca0081050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.528+0000 7f0ca5084640 1 -- 172.21.15.37:0/3723831255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca010b650 msgr2=0x7f0ca00805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.528+0000 7f0ca5084640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca010b650 0x7f0ca00805d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.529+0000 7f0ca5084640 1 -- 172.21.15.37:0/3723831255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca0110210 msgr2=0x7f0ca0081050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.529+0000 7f0ca5084640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca0110210 0x7f0ca0081050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.529+0000 7f0ca5084640 1 -- 172.21.15.37:0/3723831255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca0138c10 con 0x7f0ca010f8c0 2024-09-21T01:22:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.530+0000 7f0ca5084640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010f8c0 0x7f0ca0080b10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0c98005fd0 tx=0x7f0c9800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.534+0000 7f0c96ffd640 1 -- 172.21.15.37:0/3723831255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9801b070 con 0x7f0ca010f8c0 2024-09-21T01:22:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.534+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca0138f00 con 0x7f0ca010f8c0 2024-09-21T01:22:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.534+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca0139440 con 0x7f0ca010f8c0 2024-09-21T01:22:01.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.547+0000 7f0cae05d740 1 Processor -- start 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.547+0000 7f0c96ffd640 1 -- 172.21.15.37:0/3723831255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c9800ba20 con 0x7f0ca010f8c0 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.547+0000 7f0c96ffd640 1 -- 172.21.15.37:0/3723831255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98016b20 con 0x7f0ca010f8c0 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.548+0000 7f0cae05d740 1 -- start start 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.549+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe8e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.549+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe8eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.549+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578abac6390 0x5578abe8f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.549+0000 7f0cae05d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5578abe04ea0 con 0x5578ababe1b0 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.549+0000 7f0cae05d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5578abdf42d0 con 0x5578abae7070 2024-09-21T01:22:01.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.549+0000 7f0cae05d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5578abdf80e0 con 0x5578abac6390 2024-09-21T01:22:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.551+0000 7f0ca6086640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe8e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.551+0000 7f0ca5084640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578abac6390 0x5578abe8f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.551+0000 7f0ca6086640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe8e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:54942/0 (socket says 172.21.15.37:54942) 2024-09-21T01:22:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.551+0000 7f0ca6086640 1 -- 172.21.15.37:0/3835882763 learned_addr learned my addr 172.21.15.37:0/3835882763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:01.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.553+0000 7f0ca6086640 1 -- 172.21.15.37:0/3835882763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578abac6390 msgr2=0x5578abe8f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.553+0000 7f0ca6086640 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578abac6390 0x5578abe8f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.553+0000 7f0ca6086640 1 -- 172.21.15.37:0/3835882763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 msgr2=0x5578abe8eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.553+0000 7f0ca6086640 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe8eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.553+0000 7f0ca6086640 1 -- 172.21.15.37:0/3835882763 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578abb52650 con 0x5578abae7070 2024-09-21T01:22:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.555+0000 7f0ca6086640 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe8e860 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000ba10 tx=0x7f0c9000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389bd04b18a1540b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:01.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.555+0000 7f0c8bfff640 1 -- 172.21.15.37:0/3835882763 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000de50 con 0x5578abae7070 2024-09-21T01:22:01.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.556+0000 7f0c8bfff640 1 -- 172.21.15.37:0/3835882763 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c900178d0 con 0x5578abae7070 2024-09-21T01:22:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.557+0000 7f0cae05d740 1 -- 172.21.15.37:0/3835882763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 msgr2=0x5578abe8e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.557+0000 7f0cae05d740 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe8e860 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000ba10 tx=0x7f0c9000bed0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.559+0000 7f0cae05d740 1 -- 172.21.15.37:0/3835882763 shutdown_connections 2024-09-21T01:22:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.559+0000 7f0cae05d740 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578abac6390 0x5578abe8f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.559+0000 7f0cae05d740 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe8eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.559+0000 7f0cae05d740 1 --2- 172.21.15.37:0/3835882763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe8e860 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.559+0000 7f0cae05d740 1 -- 172.21.15.37:0/3835882763 >> 172.21.15.37:0/3835882763 conn(0x5578abadb460 msgr2=0x5578abe8c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.561+0000 7f0c96ffd640 1 -- 172.21.15.37:0/3723831255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0c9801e070 con 0x7f0ca010f8c0 2024-09-21T01:22:01.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.562+0000 7f0cae05d740 1 -- 172.21.15.37:0/3835882763 shutdown_connections 2024-09-21T01:22:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.563+0000 7f0cae05d740 1 -- 172.21.15.37:0/3835882763 wait complete. 2024-09-21T01:22:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.563+0000 7f0c96ffd640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0c8c0b65d0 0x7f0c8c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.563+0000 7f0cae05d740 1 -- start start 2024-09-21T01:22:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.563+0000 7f0cae05d740 1 Processor -- start 2024-09-21T01:22:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.564+0000 7f0c96ffd640 1 -- 172.21.15.37:0/3723831255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0c980e72d0 con 0x7f0ca010f8c0 2024-09-21T01:22:01.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.564+0000 7f0ca5885640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0c8c0b65d0 0x7f0c8c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578ababe1b0 0x5578abe99f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 0x5578abe9a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abe9a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5578abc55700 con 0x5578abae7070 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5578abd8f160 con 0x5578abac6390 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5578abe9d0e0 con 0x5578ababe1b0 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.565+0000 7f0cae05d740 10 client.0 _ll_register_callbacks cb 0x5578abda89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.566+0000 7f0ca5084640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 0x5578abe9a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.566+0000 7f0ca5084640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 0x5578abe9a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:54952/0 (socket says 172.21.15.37:54952) 2024-09-21T01:22:01.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.566+0000 7f0ca5084640 1 -- 172.21.15.37:0/1561930876 learned_addr learned my addr 172.21.15.37:0/1561930876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.566+0000 7f0ca5885640 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578ababe1b0 0x5578abe99f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.567+0000 7f0ca5084640 1 -- 172.21.15.37:0/1561930876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578ababe1b0 msgr2=0x5578abe99f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.567+0000 7f0ca5084640 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578ababe1b0 0x5578abe99f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.567+0000 7f0ca5084640 1 -- 172.21.15.37:0/1561930876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 msgr2=0x5578abe9a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.567+0000 7f0ca5084640 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abe9a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.567+0000 7f0ca5084640 1 -- 172.21.15.37:0/1561930876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578abdbcc90 con 0x5578abac6390 2024-09-21T01:22:01.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.570+0000 7f0ca5084640 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 0x5578abe9a480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c980a99f0 tx=0x7f0c980accc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c83a4243b2eec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:01.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.570+0000 7f0c897fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:22:01.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.571+0000 7f0ca5885640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0c8c0b65d0 0x7f0c8c0b8ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005fd0 tx=0x7f0c9c00b750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:01.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.571+0000 7f0c897fa640 1 -- 172.21.15.37:0/1561930876 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98025070 con 0x5578abac6390 2024-09-21T01:22:01.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.572+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c900178d0 con 0x5578abac6390 2024-09-21T01:22:01.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.572+0000 7f0c897fa640 1 -- 172.21.15.37:0/1561930876 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0c98094bb0 con 0x5578abac6390 2024-09-21T01:22:01.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.576+0000 7f0c897fa640 1 -- 172.21.15.37:0/1561930876 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0c980b6e40 con 0x5578abac6390 2024-09-21T01:22:01.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.581+0000 7f0cae05d740 10 client.25913 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:01.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.581+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5578abea8df0 con 0x5578abac6390 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0c897fa640 1 -- 172.21.15.37:0/1561930876 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c900178d0 con 0x5578abac6390 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0c897fa640 1 -- 172.21.15.37:0/1561930876 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0c9800b040 con 0x5578abac6390 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0cae05d740 10 client.25913 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0cae05d740 10 client.25913 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0cae05d740 20 client.25913 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abaa59f0 0x5578abeac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0cae05d740 4 client.25913 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.587+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578abe06df0 con 0x5578abaa59f0 2024-09-21T01:22:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.588+0000 7f0ca5885640 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abaa59f0 0x5578abeac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.589+0000 7f0ca5885640 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abaa59f0 0x5578abeac1e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2a0d69c985035f2e server_cookie=a0e9eb1ab6ef3768 in_seq=0 out_seq=0 2024-09-21T01:22:01.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.589+0000 7f0c897fa640 10 client.25913 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.593+0000 7f0c897fa640 1 -- 172.21.15.37:0/1561930876 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0c9c009540 con 0x5578abaa59f0 2024-09-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.593+0000 7f0c897fa640 10 client.25913 handle_command_reply: tid=0 2024-09-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.594+0000 7f0cae05d740 1 client.25913 shutdown 2024-09-21T01:22:01.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.596+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 msgr2=0x5578abe9a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.596+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 0x5578abe9a480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c980a99f0 tx=0x7f0c980accc0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 shutdown_connections 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abaa59f0 0x5578abeac1e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abe9a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abac6390 0x5578abe9a480 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c980a99f0 tx=0x7f0c980accc0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1561930876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578ababe1b0 0x5578abe99f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 >> 172.21.15.37:0/1561930876 conn(0x5578abadb460 msgr2=0x5578abe919f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.597+0000 7f0c897fa640 0 client.25913 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:22:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.601+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 shutdown_connections 2024-09-21T01:22:01.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.601+0000 7f0cae05d740 1 -- 172.21.15.37:0/1561930876 wait complete. 2024-09-21T01:22:01.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.602+0000 7f0cae05d740 20 client.25913 trim_cache size 0 max 16384 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.632+0000 7f0cae05d740 1 Processor -- start 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 -- start start 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe90250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe9bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe8bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8400e560 con 0x5578ababe1b0 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840100a0 con 0x5578abae7070 2024-09-21T01:22:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.633+0000 7f0cae05d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8400ec30 con 0x5578aba7ada0 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.634+0000 7f0ca5885640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe90250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.634+0000 7f0ca5885640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe90250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50876/0 (socket says 172.21.15.37:50876) 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.634+0000 7f0ca5885640 1 -- 172.21.15.37:0/489359953 learned_addr learned my addr 172.21.15.37:0/489359953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.634+0000 7f0ca6086640 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.635+0000 7f0ca5084640 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe9bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.635+0000 7f0ca5885640 1 -- 172.21.15.37:0/489359953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 msgr2=0x5578abe8bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.635+0000 7f0ca5885640 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe8bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.635+0000 7f0ca5885640 1 -- 172.21.15.37:0/489359953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 msgr2=0x5578abe9bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.635+0000 7f0ca5885640 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe9bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.635+0000 7f0ca5885640 1 -- 172.21.15.37:0/489359953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578abe90b50 con 0x5578ababe1b0 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.636+0000 7f0ca5885640 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe90250 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005eb0 tx=0x7f0c9c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3856db08bbdae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.636+0000 7f0c8b7fe640 1 -- 172.21.15.37:0/489359953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c039040 con 0x5578ababe1b0 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.636+0000 7f0c8b7fe640 1 -- 172.21.15.37:0/489359953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5578abe06df0 con 0x5578ababe1b0 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.636+0000 7f0c8b7fe640 1 -- 172.21.15.37:0/489359953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0046c0 con 0x5578ababe1b0 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.638+0000 7f0cae05d740 1 -- 172.21.15.37:0/489359953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 msgr2=0x5578abe90250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.638+0000 7f0cae05d740 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe90250 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005eb0 tx=0x7f0c9c042000 comp rx=0 tx=0).stop 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.639+0000 7f0cae05d740 1 -- 172.21.15.37:0/489359953 shutdown_connections 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.639+0000 7f0cae05d740 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe8bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.639+0000 7f0cae05d740 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578abae7070 0x5578abe9bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.639+0000 7f0cae05d740 1 --2- 172.21.15.37:0/489359953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578ababe1b0 0x5578abe90250 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.639+0000 7f0cae05d740 1 -- 172.21.15.37:0/489359953 >> 172.21.15.37:0/489359953 conn(0x5578abadb460 msgr2=0x5578abe9b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.642+0000 7f0cae05d740 1 -- 172.21.15.37:0/489359953 shutdown_connections 2024-09-21T01:22:01.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.642+0000 7f0cae05d740 1 -- 172.21.15.37:0/489359953 wait complete. 2024-09-21T01:22:01.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.643+0000 7f0cae05d740 1 -- start start 2024-09-21T01:22:01.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.644+0000 7f0cae05d740 1 Processor -- start 2024-09-21T01:22:01.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.645+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe9ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.645+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578ababe1b0 0x5578abe9f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.645+0000 7f0cae05d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abf0fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.646+0000 7f0cae05d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8400f9d0 con 0x5578abae7070 2024-09-21T01:22:01.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.646+0000 7f0cae05d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8400f300 con 0x5578ababe1b0 2024-09-21T01:22:01.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.646+0000 7f0cae05d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8400c520 con 0x5578aba7ada0 2024-09-21T01:22:01.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.646+0000 7f0cae05d740 10 client.0 _ll_register_callbacks cb 0x7f0c980a9a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.649+0000 7f0ca5084640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578ababe1b0 0x5578abe9f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.649+0000 7f0ca5885640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.651+0000 7f0ca6086640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abf0fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.651+0000 7f0ca6086640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abf0fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50890/0 (socket says 172.21.15.37:50890) 2024-09-21T01:22:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.651+0000 7f0ca6086640 1 -- 172.21.15.37:0/1383522296 learned_addr learned my addr 172.21.15.37:0/1383522296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.653+0000 7f0ca6086640 1 -- 172.21.15.37:0/1383522296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 msgr2=0x5578abe9ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.653+0000 7f0ca6086640 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe9ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.653+0000 7f0ca6086640 1 -- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578ababe1b0 msgr2=0x5578abe9f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.653+0000 7f0ca6086640 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578ababe1b0 0x5578abe9f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.653+0000 7f0ca6086640 1 -- 172.21.15.37:0/1383522296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578abf10370 con 0x5578abae7070 2024-09-21T01:22:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.656+0000 7f0ca6086640 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abf0fd00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000d710 tx=0x7f0c9000d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86e711a33d0c011 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.658+0000 7f0c897fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.659+0000 7f0c897fa640 1 -- 172.21.15.37:0/1383522296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90005040 con 0x5578abae7070 2024-09-21T01:22:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.659+0000 7f0c897fa640 1 -- 172.21.15.37:0/1383522296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0c900051e0 con 0x5578abae7070 2024-09-21T01:22:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.661+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578abe06df0 con 0x5578abae7070 2024-09-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.668+0000 7f0c897fa640 1 -- 172.21.15.37:0/1383522296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0c900053e0 con 0x5578abae7070 2024-09-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.668+0000 7f0cae05d740 10 client.16476 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.668+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5578abf17760 con 0x5578abae7070 2024-09-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0c897fa640 1 -- 172.21.15.37:0/1383522296 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5578abe06df0 con 0x5578abae7070 2024-09-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0c897fa640 1 -- 172.21.15.37:0/1383522296 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0c900225a0 con 0x5578abae7070 2024-09-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0cae05d740 10 client.16476 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0cae05d740 10 client.16476 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0cae05d740 20 client.16476 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abf17ba0 0x5578abf19fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0cae05d740 4 client.16476 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.670+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5578abe028a0 con 0x5578abf17ba0 2024-09-21T01:22:01.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.674+0000 7f0ca5885640 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abf17ba0 0x5578abf19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.680+0000 7f0ca5885640 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abf17ba0 0x5578abf19fc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9b48472bdf52818b server_cookie=ca4a2eae6f5a78d in_seq=0 out_seq=0 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.680+0000 7f0c897fa640 10 client.16476 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.681+0000 7f0c897fa640 1 -- 172.21.15.37:0/1383522296 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5578abe028a0 con 0x5578abf17ba0 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.681+0000 7f0c897fa640 10 client.16476 handle_command_reply: tid=0 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.681+0000 7f0cae05d740 1 client.16476 shutdown 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.681+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 msgr2=0x5578abf0fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.681+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abf0fd00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000d710 tx=0x7f0c9000d840 comp rx=0 tx=0).stop 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 shutdown_connections 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5578abf17ba0 0x5578abf19fc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578abae7070 0x5578abf0fd00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578ababe1b0 0x5578abe9f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0cae05d740 1 --2- 172.21.15.37:0/1383522296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578aba7ada0 0x5578abe9ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0c897fa640 0 client.16476 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.683+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 >> 172.21.15.37:0/1383522296 conn(0x5578abadb460 msgr2=0x5578abe8ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.684+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 shutdown_connections 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.684+0000 7f0cae05d740 1 -- 172.21.15.37:0/1383522296 wait complete. 2024-09-21T01:22:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.684+0000 7f0cae05d740 20 client.16476 trim_cache size 0 max 16384 2024-09-21T01:22:01.689 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:22:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.688+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0c8c0b65d0 msgr2=0x7f0c8c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.688+0000 7f0ca6887640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0c8c0b65d0 0x7f0c8c0b8ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005fd0 tx=0x7f0c9c00b750 comp rx=0 tx=0).stop 2024-09-21T01:22:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010f8c0 msgr2=0x7f0ca0080b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010f8c0 0x7f0ca0080b10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0c98005fd0 tx=0x7f0c9800c800 comp rx=0 tx=0).stop 2024-09-21T01:22:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 shutdown_connections 2024-09-21T01:22:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0c8c0b65d0 0x7f0c8c0b8ae0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca0110210 0x7f0ca0081050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca010f8c0 0x7f0ca0080b10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 --2- 172.21.15.37:0/3723831255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca010b650 0x7f0ca00805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 >> 172.21.15.37:0/3723831255 conn(0x7f0ca006e9f0 msgr2=0x7f0ca010c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.689+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 shutdown_connections 2024-09-21T01:22:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:01.691+0000 7f0ca6887640 1 -- 172.21.15.37:0/3723831255 wait complete. 2024-09-21T01:22:03.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:02 smithi137 ceph-mon[34607]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 865 MiB/s wr, 3.47k op/s 2024-09-21T01:22:03.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:02 smithi144 ceph-mon[34818]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 865 MiB/s wr, 3.47k op/s 2024-09-21T01:22:03.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:02 smithi037 ceph-mon[31105]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 865 MiB/s wr, 3.47k op/s 2024-09-21T01:22:04.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:22:05.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:04 smithi137 ceph-mon[34607]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 790 MiB/s wr, 2.97k op/s 2024-09-21T01:22:05.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:04 smithi144 ceph-mon[34818]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 790 MiB/s wr, 2.97k op/s 2024-09-21T01:22:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:22:05.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:04 smithi037 ceph-mon[31105]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 790 MiB/s wr, 2.97k op/s 2024-09-21T01:22:07.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:06 smithi137 ceph-mon[34607]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 887 MiB/s wr, 3.04k op/s 2024-09-21T01:22:07.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:06 smithi144 ceph-mon[34818]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 887 MiB/s wr, 3.04k op/s 2024-09-21T01:22:07.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:06 smithi037 ceph-mon[31105]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 887 MiB/s wr, 3.04k op/s 2024-09-21T01:22:07.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.202+0000 7f6ab7fff640 1 -- 172.21.15.37:0/517887737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8107a30 msgr2=0x7f6ab8107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.202+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/517887737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8107a30 0x7f6ab8107f10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009c10 tx=0x7f6ab002a720 comp rx=0 tx=0).stop 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.203+0000 7f6ab7fff640 1 -- 172.21.15.37:0/517887737 shutdown_connections 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.203+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/517887737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8107a30 0x7f6ab8107f10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.203+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/517887737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab8102f40 0x7f6ab8107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.203+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/517887737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab81025f0 0x7f6ab8102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.203+0000 7f6ab7fff640 1 -- 172.21.15.37:0/517887737 >> 172.21.15.37:0/517887737 conn(0x7f6ab80fe320 msgr2=0x7f6ab8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.204+0000 7f6ab7fff640 1 -- 172.21.15.37:0/517887737 shutdown_connections 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.204+0000 7f6ab7fff640 1 -- 172.21.15.37:0/517887737 wait complete. 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.206+0000 7f6ab7fff640 1 Processor -- start 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.206+0000 7f6ab7fff640 1 -- start start 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.206+0000 7f6ab7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab81025f0 0x7f6ab8116ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.207+0000 7f6ab7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8102f40 0x7f6ab810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.207+0000 7f6ab7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab8107a30 0x7f6ab8110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.207+0000 7f6ab7fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8119f30 con 0x7f6ab8102f40 2024-09-21T01:22:07.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.207+0000 7f6ab7fff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8119db0 con 0x7f6ab81025f0 2024-09-21T01:22:07.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.207+0000 7f6ab7fff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab811a0b0 con 0x7f6ab8107a30 2024-09-21T01:22:07.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.208+0000 7f6ab77fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab8107a30 0x7f6ab8110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.208+0000 7f6ab6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab81025f0 0x7f6ab8116ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.208+0000 7f6ab77fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab8107a30 0x7f6ab8110300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40884/0 (socket says 172.21.15.37:40884) 2024-09-21T01:22:07.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.208+0000 7f6ab77fe640 1 -- 172.21.15.37:0/1858713654 learned_addr learned my addr 172.21.15.37:0/1858713654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.211+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8102f40 0x7f6ab810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.211+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1858713654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab8107a30 msgr2=0x7f6ab8110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.211+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab8107a30 0x7f6ab8110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.211+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8102f40 msgr2=0x7f6ab810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.211+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8102f40 0x7f6ab810fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.211+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1858713654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab8110b20 con 0x7f6ab81025f0 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.212+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab81025f0 0x7f6ab8116ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00d6d0 tx=0x7f6aac00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.213+0000 7f6abc869640 1 -- 172.21.15.37:0/1858713654 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac017070 con 0x7f6ab81025f0 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.213+0000 7f6abc869640 1 -- 172.21.15.37:0/1858713654 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aac010460 con 0x7f6ab81025f0 2024-09-21T01:22:07.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.214+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab81157a0 con 0x7f6ab81025f0 2024-09-21T01:22:07.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.214+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab8115d60 con 0x7f6ab81025f0 2024-09-21T01:22:07.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.215+0000 7f6abc869640 1 -- 172.21.15.37:0/1858713654 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00f620 con 0x7f6ab81025f0 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.219+0000 7f6ac3ddf740 1 Processor -- start 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.219+0000 7f6ac3ddf740 1 -- start start 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.220+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e74d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.220+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 0x55d38e74dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.220+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e74e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.220+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d38e6c3ea0 con 0x55d38e3a6070 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.220+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d38e6b32d0 con 0x55d38e385390 2024-09-21T01:22:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.220+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d38e6b70e0 con 0x55d38e37d1b0 2024-09-21T01:22:07.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.221+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e74e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.222+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e74e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41750/0 (socket says 172.21.15.37:41750) 2024-09-21T01:22:07.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.222+0000 7f6ab67fc640 1 -- 172.21.15.37:0/2781438835 learned_addr learned my addr 172.21.15.37:0/2781438835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:07.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.222+0000 7f6ab77fe640 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e74d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.223+0000 7f6ab67fc640 1 -- 172.21.15.37:0/2781438835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 msgr2=0x55d38e74dda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:22:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.223+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 0x55d38e74dda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.223+0000 7f6ab67fc640 1 -- 172.21.15.37:0/2781438835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 msgr2=0x55d38e74d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.223+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e74d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.223+0000 7f6ab67fc640 1 -- 172.21.15.37:0/2781438835 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38e411650 con 0x55d38e385390 2024-09-21T01:22:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.227+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e74e2e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800b790 tx=0x7f6aa800bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3dbbd07ef65a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.229+0000 7f6abc869640 1 -- 172.21.15.37:0/1858713654 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6aac01a070 con 0x7f6ab81025f0 2024-09-21T01:22:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.229+0000 7f6a9dffb640 1 -- 172.21.15.37:0/2781438835 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800d950 con 0x55d38e385390 2024-09-21T01:22:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.230+0000 7f6a9dffb640 1 -- 172.21.15.37:0/2781438835 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa8018070 con 0x55d38e385390 2024-09-21T01:22:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.231+0000 7f6abc869640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6aa00b66a0 0x7f6aa00b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.231+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/2781438835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 msgr2=0x55d38e74e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.231+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e74e2e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800b790 tx=0x7f6aa800bc50 comp rx=0 tx=0).stop 2024-09-21T01:22:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.232+0000 7f6abc869640 1 -- 172.21.15.37:0/1858713654 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6aac0e6e40 con 0x7f6ab81025f0 2024-09-21T01:22:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.233+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/2781438835 shutdown_connections 2024-09-21T01:22:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.233+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e74e2e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.233+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 0x55d38e74dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.233+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/2781438835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e74d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.233+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/2781438835 >> 172.21.15.37:0/2781438835 conn(0x55d38e39a460 msgr2=0x55d38e74b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.233+0000 7f6ab77fe640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6aa00b66a0 0x7f6aa00b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.234+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/2781438835 shutdown_connections 2024-09-21T01:22:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.234+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/2781438835 wait complete. 2024-09-21T01:22:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.235+0000 7f6ac3ddf740 1 -- start start 2024-09-21T01:22:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.235+0000 7f6ac3ddf740 1 Processor -- start 2024-09-21T01:22:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e758e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e759380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e7598c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d38e514700 con 0x55d38e37d1b0 2024-09-21T01:22:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d38e64e160 con 0x55d38e3a6070 2024-09-21T01:22:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d38e75c0e0 con 0x55d38e385390 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.237+0000 7f6ac3ddf740 10 client.0 _ll_register_callbacks cb 0x55d38e6679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.239+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e759380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.240+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e759380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40894/0 (socket says 172.21.15.37:40894) 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.240+0000 7f6ab67fc640 1 -- 172.21.15.37:0/3906566750 learned_addr learned my addr 172.21.15.37:0/3906566750 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.242+0000 7f6ab67fc640 1 -- 172.21.15.37:0/3906566750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 msgr2=0x55d38e7598c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.242+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e7598c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.242+0000 7f6ab67fc640 1 -- 172.21.15.37:0/3906566750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 msgr2=0x55d38e758e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.242+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e758e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.242+0000 7f6ab67fc640 1 -- 172.21.15.37:0/3906566750 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d38e67bc90 con 0x55d38e385390 2024-09-21T01:22:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.247+0000 7f6ab77fe640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6aa00b66a0 0x7f6aa00b8bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009420 tx=0x7f6ab0032d10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.247+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e759380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8013c40 tx=0x7f6aa80136b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0827268c6449631 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.247+0000 7f6a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:22:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.251+0000 7f6a96ffd640 1 -- 172.21.15.37:0/3906566750 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800dd60 con 0x55d38e385390 2024-09-21T01:22:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.251+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa8018070 con 0x55d38e385390 2024-09-21T01:22:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.251+0000 7f6a96ffd640 1 -- 172.21.15.37:0/3906566750 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6aa8012640 con 0x55d38e385390 2024-09-21T01:22:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.253+0000 7f6a96ffd640 1 -- 172.21.15.37:0/3906566750 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6aa8012840 con 0x55d38e385390 2024-09-21T01:22:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.253+0000 7f6ac3ddf740 10 client.25903 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:07.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.253+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d38e767dc0 con 0x55d38e385390 2024-09-21T01:22:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.254+0000 7f6a96ffd640 1 -- 172.21.15.37:0/3906566750 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa8018070 con 0x55d38e385390 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.254+0000 7f6a96ffd640 1 -- 172.21.15.37:0/3906566750 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6aa8024810 con 0x55d38e385390 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.257+0000 7f6ac3ddf740 10 client.25903 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.257+0000 7f6ac3ddf740 10 client.25903 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.257+0000 7f6ac3ddf740 20 client.25903 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.257+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e3649f0 0x55d38e76b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.257+0000 7f6ac3ddf740 4 client.25903 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.257+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d38e6c5df0 con 0x55d38e3649f0 2024-09-21T01:22:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.258+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e3649f0 0x55d38e76b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.260+0000 7f6a96ffd640 10 client.25903 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:22:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.260+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e3649f0 0x55d38e76b290 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65b3ff2501996043 server_cookie=635eb5f6b07f6aed in_seq=0 out_seq=0 2024-09-21T01:22:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.265+0000 7f6a96ffd640 1 -- 172.21.15.37:0/3906566750 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d38e6c5df0 con 0x55d38e3649f0 2024-09-21T01:22:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.265+0000 7f6a96ffd640 10 client.25903 handle_command_reply: tid=0 2024-09-21T01:22:07.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.266+0000 7f6ac3ddf740 1 client.25903 shutdown 2024-09-21T01:22:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 msgr2=0x55d38e759380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e759380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8013c40 tx=0x7f6aa80136b0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 shutdown_connections 2024-09-21T01:22:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e3649f0 0x55d38e76b290 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e7598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e759380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/3906566750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e758e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 >> 172.21.15.37:0/3906566750 conn(0x55d38e39a460 msgr2=0x55d38e750a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.267+0000 7f6a96ffd640 0 client.25903 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:22:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.269+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 shutdown_connections 2024-09-21T01:22:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.269+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/3906566750 wait complete. 2024-09-21T01:22:07.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.269+0000 7f6ac3ddf740 20 client.25903 trim_cache size 0 max 16384 2024-09-21T01:22:07.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.300+0000 7f6ac3ddf740 1 Processor -- start 2024-09-21T01:22:07.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.301+0000 7f6ac3ddf740 1 -- start start 2024-09-21T01:22:07.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.302+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e74ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.302+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e74b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e756030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81ad1c0 con 0x55d38e37d1b0 2024-09-21T01:22:07.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ab6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e74ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ab6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e74ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37646/0 (socket says 172.21.15.37:37646) 2024-09-21T01:22:07.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1022361105 learned_addr learned my addr 172.21.15.37:0/1022361105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:07.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81aed00 con 0x55d38e3a6070 2024-09-21T01:22:07.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81ad890 con 0x55d38e385390 2024-09-21T01:22:07.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.303+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e74b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.304+0000 7f6ab77fe640 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e756030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.304+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1022361105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 msgr2=0x55d38e74b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.304+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e74b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.304+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1022361105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 msgr2=0x55d38e756030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.304+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e756030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.304+0000 7f6ab6ffd640 1 -- 172.21.15.37:0/1022361105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38e75b580 con 0x55d38e37d1b0 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.305+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e74ad20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0a9560 tx=0x7f6aac0e47d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f18cbed2d87e9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.305+0000 7f6a9d7fa640 1 -- 172.21.15.37:0/1022361105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac021040 con 0x55d38e37d1b0 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.306+0000 7f6a9d7fa640 1 -- 172.21.15.37:0/1022361105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aac0ad690 con 0x55d38e37d1b0 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.306+0000 7f6a9d7fa640 1 -- 172.21.15.37:0/1022361105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac010730 con 0x55d38e37d1b0 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.307+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 msgr2=0x55d38e74ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.307+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e74ad20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0a9560 tx=0x7f6aac0e47d0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.308+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 shutdown_connections 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.308+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e3a6070 0x55d38e756030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.308+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e385390 0x55d38e74b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.308+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1022361105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e37d1b0 0x55d38e74ad20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.308+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 >> 172.21.15.37:0/1022361105 conn(0x55d38e39a460 msgr2=0x55d38e75ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:07.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.311+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 shutdown_connections 2024-09-21T01:22:07.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.314+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1022361105 wait complete. 2024-09-21T01:22:07.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.315+0000 7f6ac3ddf740 1 -- start start 2024-09-21T01:22:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.316+0000 7f6ac3ddf740 1 Processor -- start 2024-09-21T01:22:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.317+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 0x55d38e76c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.317+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e76c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.317+0000 7f6ac3ddf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e76ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.317+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81ae630 con 0x55d38e3a6070 2024-09-21T01:22:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.318+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab81adf60 con 0x55d38e385390 2024-09-21T01:22:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.318+0000 7f6ac3ddf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab806bf20 con 0x55d38e37d1b0 2024-09-21T01:22:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.318+0000 7f6ac3ddf740 10 client.0 _ll_register_callbacks cb 0x7f6aa800b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.318+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e76c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.318+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e76c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41760/0 (socket says 172.21.15.37:41760) 2024-09-21T01:22:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.318+0000 7f6ab67fc640 1 -- 172.21.15.37:0/1357176499 learned_addr learned my addr 172.21.15.37:0/1357176499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.319+0000 7f6ab67fc640 1 -- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 msgr2=0x55d38e76c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.320+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 0x55d38e76c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.320+0000 7f6ab67fc640 1 -- 172.21.15.37:0/1357176499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 msgr2=0x55d38e76ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.320+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e76ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.320+0000 7f6ab67fc640 1 -- 172.21.15.37:0/1357176499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d38e7d4b70 con 0x55d38e385390 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.321+0000 7f6ab67fc640 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e76c940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8024dd0 tx=0x7f6aa800bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=466a51bfc291eeae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.321+0000 7f6a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.321+0000 7f6a96ffd640 1 -- 172.21.15.37:0/1357176499 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8033030 con 0x55d38e385390 2024-09-21T01:22:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.322+0000 7f6a96ffd640 1 -- 172.21.15.37:0/1357176499 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6aa80129e0 con 0x55d38e385390 2024-09-21T01:22:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.322+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aac0ad690 con 0x55d38e385390 2024-09-21T01:22:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.323+0000 7f6a96ffd640 1 -- 172.21.15.37:0/1357176499 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6aa8012be0 con 0x55d38e385390 2024-09-21T01:22:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.323+0000 7f6ac3ddf740 10 client.25928 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.323+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d38e7d5dd0 con 0x55d38e385390 2024-09-21T01:22:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.325+0000 7f6a96ffd640 1 -- 172.21.15.37:0/1357176499 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa8018040 con 0x55d38e385390 2024-09-21T01:22:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.325+0000 7f6a96ffd640 1 -- 172.21.15.37:0/1357176499 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6aa802f800 con 0x55d38e385390 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.325+0000 7f6ac3ddf740 10 client.25928 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.325+0000 7f6ac3ddf740 10 client.25928 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.326+0000 7f6ac3ddf740 20 client.25928 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.326+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e339da0 0x55d38e7d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.326+0000 7f6ac3ddf740 4 client.25928 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.326+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6aac0ad690 con 0x55d38e339da0 2024-09-21T01:22:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.327+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e339da0 0x55d38e7d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.329+0000 7f6ab6ffd640 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e339da0 0x55d38e7d84f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2688b08815d94a23 server_cookie=896369331593da36 in_seq=0 out_seq=0 2024-09-21T01:22:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.329+0000 7f6a96ffd640 10 client.25928 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:22:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.331+0000 7f6a96ffd640 1 -- 172.21.15.37:0/1357176499 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6aac0ad690 con 0x55d38e339da0 2024-09-21T01:22:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.331+0000 7f6a96ffd640 10 client.25928 handle_command_reply: tid=0 2024-09-21T01:22:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.331+0000 7f6ac3ddf740 1 client.25928 shutdown 2024-09-21T01:22:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.332+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 msgr2=0x55d38e76c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.332+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e76c940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8024dd0 tx=0x7f6aa800bf70 comp rx=0 tx=0).stop 2024-09-21T01:22:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.334+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 shutdown_connections 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.334+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55d38e339da0 0x55d38e7d84f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.334+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d38e3a6070 0x55d38e76ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.334+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d38e385390 0x55d38e76c940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.334+0000 7f6ac3ddf740 1 --2- 172.21.15.37:0/1357176499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d38e37d1b0 0x55d38e76c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.335+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 >> 172.21.15.37:0/1357176499 conn(0x55d38e39a460 msgr2=0x55d38e764da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.335+0000 7f6a96ffd640 0 client.25928 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.335+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 shutdown_connections 2024-09-21T01:22:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.336+0000 7f6ac3ddf740 1 -- 172.21.15.37:0/1357176499 wait complete. 2024-09-21T01:22:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.336+0000 7f6ac3ddf740 20 client.25928 trim_cache size 0 max 16384 2024-09-21T01:22:07.339 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:22:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.338+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6aa00b66a0 msgr2=0x7f6aa00b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.338+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6aa00b66a0 0x7f6aa00b8bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009420 tx=0x7f6ab0032d10 comp rx=0 tx=0).stop 2024-09-21T01:22:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.338+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab81025f0 msgr2=0x7f6ab8116ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.338+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab81025f0 0x7f6ab8116ad0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00d6d0 tx=0x7f6aac00db90 comp rx=0 tx=0).stop 2024-09-21T01:22:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.339+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 shutdown_connections 2024-09-21T01:22:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.339+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6aa00b66a0 0x7f6aa00b8bb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.339+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab8107a30 0x7f6ab8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.339+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ab8102f40 0x7f6ab810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.339+0000 7f6ab7fff640 1 --2- 172.21.15.37:0/1858713654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ab81025f0 0x7f6ab8116ad0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:07.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.339+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 >> 172.21.15.37:0/1858713654 conn(0x7f6ab80fe320 msgr2=0x7f6ab8105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.341+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 shutdown_connections 2024-09-21T01:22:07.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:07.341+0000 7f6ab7fff640 1 -- 172.21.15.37:0/1858713654 wait complete. 2024-09-21T01:22:09.115 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:08 smithi037 ceph-mon[31105]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 832 MiB/s wr, 2.61k op/s 2024-09-21T01:22:09.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:08 smithi137 ceph-mon[34607]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 832 MiB/s wr, 2.61k op/s 2024-09-21T01:22:09.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:08 smithi144 ceph-mon[34818]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 832 MiB/s wr, 2.61k op/s 2024-09-21T01:22:10.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:22:11.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:10 smithi137 ceph-mon[34607]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 916 MiB/s wr, 2.69k op/s 2024-09-21T01:22:11.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:10 smithi144 ceph-mon[34818]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 916 MiB/s wr, 2.69k op/s 2024-09-21T01:22:11.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:10 smithi037 ceph-mon[31105]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 916 MiB/s wr, 2.69k op/s 2024-09-21T01:22:11.609 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:22:13.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:12 smithi137 ceph-mon[34607]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 885 MiB/s wr, 2.10k op/s 2024-09-21T01:22:13.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:12 smithi144 ceph-mon[34818]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 885 MiB/s wr, 2.10k op/s 2024-09-21T01:22:13.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:12 smithi037 ceph-mon[31105]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 885 MiB/s wr, 2.10k op/s 2024-09-21T01:22:14.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.416+0000 7f2c6d287640 1 -- 172.21.15.37:0/715695494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c68105bc0 msgr2=0x7f2c68105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.416+0000 7f2c6d287640 1 --2- 172.21.15.37:0/715695494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c68105bc0 0x7f2c68105fd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009900 tx=0x7f2c5802a440 comp rx=0 tx=0).stop 2024-09-21T01:22:14.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.422+0000 7f2c6d287640 1 -- 172.21.15.37:0/715695494 shutdown_connections 2024-09-21T01:22:14.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.422+0000 7f2c6d287640 1 --2- 172.21.15.37:0/715695494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6810be50 0x7f2c68112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.422+0000 7f2c6d287640 1 --2- 172.21.15.37:0/715695494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c6810b500 0x7f2c6810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.422+0000 7f2c6d287640 1 --2- 172.21.15.37:0/715695494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c68105bc0 0x7f2c68105fd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.422+0000 7f2c6d287640 1 -- 172.21.15.37:0/715695494 >> 172.21.15.37:0/715695494 conn(0x7f2c68101630 msgr2=0x7f2c68103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.425+0000 7f2c6d287640 1 -- 172.21.15.37:0/715695494 shutdown_connections 2024-09-21T01:22:14.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.431+0000 7f2c6d287640 1 -- 172.21.15.37:0/715695494 wait complete. 2024-09-21T01:22:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.432+0000 7f2c6d287640 1 Processor -- start 2024-09-21T01:22:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.442+0000 7f2c6d287640 1 -- start start 2024-09-21T01:22:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.443+0000 7f2c6d287640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c68105bc0 0x7f2c6811bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.443+0000 7f2c6d287640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 0x7f2c6811c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.443+0000 7f2c6d287640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6810be50 0x7f2c68111d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.443+0000 7f2c6d287640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68079130 con 0x7f2c6810be50 2024-09-21T01:22:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.444+0000 7f2c6d287640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68078fb0 con 0x7f2c6810b500 2024-09-21T01:22:14.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.444+0000 7f2c6d287640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2c680792b0 con 0x7f2c68105bc0 2024-09-21T01:22:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.448+0000 7f2c677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 0x7f2c6811c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.448+0000 7f2c677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 0x7f2c6811c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41774/0 (socket says 172.21.15.37:41774) 2024-09-21T01:22:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.448+0000 7f2c677fe640 1 -- 172.21.15.37:0/3300586968 learned_addr learned my addr 172.21.15.37:0/3300586968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.449+0000 7f2c67fff640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c68105bc0 0x7f2c6811bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.449+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6810be50 0x7f2c68111d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.450+0000 7f2c677fe640 1 -- 172.21.15.37:0/3300586968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c68105bc0 msgr2=0x7f2c6811bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.450+0000 7f2c677fe640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c68105bc0 0x7f2c6811bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.450+0000 7f2c677fe640 1 -- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6810be50 msgr2=0x7f2c68111d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.450+0000 7f2c677fe640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6810be50 0x7f2c68111d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.450+0000 7f2c677fe640 1 -- 172.21.15.37:0/3300586968 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c681124f0 con 0x7f2c6810b500 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.451+0000 7f2c677fe640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 0x7f2c6811c280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00e9f0 tx=0x7f2c5c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.452+0000 7f2c657fa640 1 -- 172.21.15.37:0/3300586968 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00ccc0 con 0x7f2c6810b500 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.452+0000 7f2c657fa640 1 -- 172.21.15.37:0/3300586968 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c5c0108e0 con 0x7f2c6810b500 2024-09-21T01:22:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.452+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c681127e0 con 0x7f2c6810b500 2024-09-21T01:22:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.453+0000 7f2c657fa640 1 -- 172.21.15.37:0/3300586968 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c018880 con 0x7f2c6810b500 2024-09-21T01:22:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.453+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c68118d50 con 0x7f2c6810b500 2024-09-21T01:22:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.460+0000 7f2c657fa640 1 -- 172.21.15.37:0/3300586968 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2c5c018a20 con 0x7f2c6810b500 2024-09-21T01:22:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.462+0000 7f2c657fa640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2c500b65c0 0x7f2c500b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.463+0000 7f2c657fa640 1 -- 172.21.15.37:0/3300586968 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2c5c0e86c0 con 0x7f2c6810b500 2024-09-21T01:22:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.464+0000 7f2c67fff640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2c500b65c0 0x7f2c500b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.465+0000 7f2c67fff640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2c500b65c0 0x7f2c500b8ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009230 tx=0x7f2c58000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.467+0000 7f2c74a5d740 1 Processor -- start 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 -- start start 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 0x55f208c9e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208c9eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208c9f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f208c14ea0 con 0x55f2088f7070 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f208c042d0 con 0x55f2088d6390 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.470+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f208c080e0 con 0x55f2088ce1b0 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.471+0000 7f2c67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 0x55f208c9e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.471+0000 7f2c67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 0x55f208c9e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37688/0 (socket says 172.21.15.37:37688) 2024-09-21T01:22:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.471+0000 7f2c67fff640 1 -- 172.21.15.37:0/1431992897 learned_addr learned my addr 172.21.15.37:0/1431992897 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.474+0000 7f2c677fe640 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208c9eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.475+0000 7f2c67fff640 1 -- 172.21.15.37:0/1431992897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 msgr2=0x55f208c9eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.475+0000 7f2c67fff640 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208c9eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.475+0000 7f2c67fff640 1 -- 172.21.15.37:0/1431992897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 msgr2=0x55f208c9f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.475+0000 7f2c67fff640 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208c9f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.475+0000 7f2c67fff640 1 -- 172.21.15.37:0/1431992897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f208962650 con 0x55f2088f7070 2024-09-21T01:22:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.480+0000 7f2c67fff640 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 0x55f208c9e860 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2c58032000 tx=0x7f2c5803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac162aa51674613 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.481+0000 7f2c4e7fc640 1 -- 172.21.15.37:0/1431992897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5804e070 con 0x55f2088f7070 2024-09-21T01:22:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.482+0000 7f2c4e7fc640 1 -- 172.21.15.37:0/1431992897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c58031bc0 con 0x55f2088f7070 2024-09-21T01:22:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.482+0000 7f2c4e7fc640 1 -- 172.21.15.37:0/1431992897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5803d680 con 0x55f2088f7070 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1431992897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 msgr2=0x55f208c9e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 0x55f208c9e860 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2c58032000 tx=0x7f2c5803e000 comp rx=0 tx=0).stop 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1431992897 shutdown_connections 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208c9f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208c9eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1431992897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088f7070 0x55f208c9e860 secure :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2c58032000 tx=0x7f2c5803e000 comp rx=0 tx=0).stop 2024-09-21T01:22:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.484+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1431992897 >> 172.21.15.37:0/1431992897 conn(0x55f2088eb460 msgr2=0x55f208c9c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.489+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1431992897 shutdown_connections 2024-09-21T01:22:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.491+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1431992897 wait complete. 2024-09-21T01:22:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.492+0000 7f2c74a5d740 1 -- start start 2024-09-21T01:22:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.492+0000 7f2c74a5d740 1 Processor -- start 2024-09-21T01:22:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208caa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208cb62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f208a65700 con 0x55f2088b59f0 2024-09-21T01:22:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f208b9f160 con 0x55f2088d6390 2024-09-21T01:22:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f208cacfe0 con 0x55f2088ce1b0 2024-09-21T01:22:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.493+0000 7f2c74a5d740 10 client.0 _ll_register_callbacks cb 0x55f208bb89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.496+0000 7f2c67fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208caa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.496+0000 7f2c677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.496+0000 7f2c6ca86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208cb62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.496+0000 7f2c677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41788/0 (socket says 172.21.15.37:41788) 2024-09-21T01:22:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.496+0000 7f2c677fe640 1 -- 172.21.15.37:0/1685886545 learned_addr learned my addr 172.21.15.37:0/1685886545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.500+0000 7f2c6ca86640 1 -- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 msgr2=0x55f208caa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.500+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208caa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.500+0000 7f2c6ca86640 1 -- 172.21.15.37:0/1685886545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 msgr2=0x55f208caa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.501+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.501+0000 7f2c6ca86640 1 -- 172.21.15.37:0/1685886545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f208bccc90 con 0x55f2088b59f0 2024-09-21T01:22:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.507+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208cb62d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2c60010670 tx=0x7f2c60010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663ccdbeaadda5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.509+0000 7f2c477fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.510+0000 7f2c477fe640 1 -- 172.21.15.37:0/1685886545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60004d20 con 0x55f2088b59f0 2024-09-21T01:22:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.511+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c58031bc0 con 0x55f2088b59f0 2024-09-21T01:22:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.511+0000 7f2c477fe640 1 -- 172.21.15.37:0/1685886545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2c6000e8d0 con 0x55f2088b59f0 2024-09-21T01:22:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.512+0000 7f2c477fe640 1 -- 172.21.15.37:0/1685886545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2c6000ead0 con 0x55f2088b59f0 2024-09-21T01:22:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.512+0000 7f2c74a5d740 10 client.16500 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.512+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f208cb8ea0 con 0x55f2088b59f0 2024-09-21T01:22:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.515+0000 7f2c477fe640 1 -- 172.21.15.37:0/1685886545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c58031bc0 con 0x55f2088b59f0 2024-09-21T01:22:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.515+0000 7f2c477fe640 1 -- 172.21.15.37:0/1685886545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2c6000f040 con 0x55f2088b59f0 2024-09-21T01:22:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.517+0000 7f2c74a5d740 10 client.16500 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.517+0000 7f2c74a5d740 10 client.16500 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:22:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.517+0000 7f2c74a5d740 20 client.16500 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.517+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f20888ada0 0x55f208cbc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.517+0000 7f2c74a5d740 4 client.16500 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.517+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f208c16df0 con 0x55f20888ada0 2024-09-21T01:22:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.521+0000 7f2c67fff640 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f20888ada0 0x55f208cbc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.526+0000 7f2c67fff640 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f20888ada0 0x55f208cbc790 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=caa26bfd30390e79 server_cookie=f1016f72e675d997 in_seq=0 out_seq=0 2024-09-21T01:22:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.526+0000 7f2c477fe640 10 client.16500 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:22:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.527+0000 7f2c477fe640 1 -- 172.21.15.37:0/1685886545 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f208c16df0 con 0x55f20888ada0 2024-09-21T01:22:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.528+0000 7f2c477fe640 10 client.16500 handle_command_reply: tid=0 2024-09-21T01:22:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.528+0000 7f2c74a5d740 1 client.16500 shutdown 2024-09-21T01:22:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.531+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 msgr2=0x55f208cb62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.531+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208cb62d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2c60010670 tx=0x7f2c60010b30 comp rx=0 tx=0).stop 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 shutdown_connections 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f20888ada0 0x55f208cbc790 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208cb62d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/1685886545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208caa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 >> 172.21.15.37:0/1685886545 conn(0x55f2088eb460 msgr2=0x55f208ca1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c477fe640 0 client.16500 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.532+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 shutdown_connections 2024-09-21T01:22:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.533+0000 7f2c74a5d740 1 -- 172.21.15.37:0/1685886545 wait complete. 2024-09-21T01:22:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.535+0000 7f2c74a5d740 20 client.16500 trim_cache size 0 max 16384 2024-09-21T01:22:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.585+0000 7f2c74a5d740 1 Processor -- start 2024-09-21T01:22:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 -- start start 2024-09-21T01:22:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208c9c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208cb61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208cb6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681be170 con 0x55f2088b59f0 2024-09-21T01:22:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681bfcb0 con 0x55f2088d6390 2024-09-21T01:22:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.592+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681be840 con 0x55f2088ce1b0 2024-09-21T01:22:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.594+0000 7f2c6ca86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208cb6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.595+0000 7f2c6ca86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208cb6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41790/0 (socket says 172.21.15.37:41790) 2024-09-21T01:22:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.595+0000 7f2c6ca86640 1 -- 172.21.15.37:0/517478648 learned_addr learned my addr 172.21.15.37:0/517478648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.596+0000 7f2c677fe640 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208cb61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.598+0000 7f2c6ca86640 1 -- 172.21.15.37:0/517478648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 msgr2=0x55f208cb61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.598+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208cb61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.598+0000 7f2c6ca86640 1 -- 172.21.15.37:0/517478648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 msgr2=0x55f208c9c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.598+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208c9c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.598+0000 7f2c6ca86640 1 -- 172.21.15.37:0/517478648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f208ca0b50 con 0x55f2088d6390 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.601+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208cb6710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c60011fc0 tx=0x7f2c600096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c9cb97bb839d9e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.601+0000 7f2c677fe640 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208cb61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.602+0000 7f2c4dffb640 1 -- 172.21.15.37:0/517478648 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6002b070 con 0x55f2088d6390 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.603+0000 7f2c4dffb640 1 -- 172.21.15.37:0/517478648 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c60012c20 con 0x55f2088d6390 2024-09-21T01:22:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.603+0000 7f2c4dffb640 1 -- 172.21.15.37:0/517478648 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60030c20 con 0x55f2088d6390 2024-09-21T01:22:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.606+0000 7f2c74a5d740 1 -- 172.21.15.37:0/517478648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 msgr2=0x55f208cb6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.606+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208cb6710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c60011fc0 tx=0x7f2c600096c0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.610+0000 7f2c74a5d740 1 -- 172.21.15.37:0/517478648 shutdown_connections 2024-09-21T01:22:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.610+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208cb6710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.610+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088ce1b0 0x55f208cb61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.610+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/517478648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088b59f0 0x55f208c9c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.610+0000 7f2c74a5d740 1 -- 172.21.15.37:0/517478648 >> 172.21.15.37:0/517478648 conn(0x55f2088eb460 msgr2=0x55f208c9c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.614+0000 7f2c74a5d740 1 -- 172.21.15.37:0/517478648 shutdown_connections 2024-09-21T01:22:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.615+0000 7f2c74a5d740 1 -- 172.21.15.37:0/517478648 wait complete. 2024-09-21T01:22:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.616+0000 7f2c74a5d740 1 -- start start 2024-09-21T01:22:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.617+0000 7f2c74a5d740 1 Processor -- start 2024-09-21T01:22:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.617+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 0x55f208cae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.618+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088ce1b0 0x55f208cae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.618+0000 7f2c74a5d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.618+0000 7f2c74a5d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681bf5e0 con 0x55f2088ce1b0 2024-09-21T01:22:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.618+0000 7f2c67fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 0x55f208cae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.618+0000 7f2c67fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 0x55f208cae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40992/0 (socket says 172.21.15.37:40992) 2024-09-21T01:22:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.618+0000 7f2c67fff640 1 -- 172.21.15.37:0/2233124327 learned_addr learned my addr 172.21.15.37:0/2233124327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.619+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681bef10 con 0x55f2088d6390 2024-09-21T01:22:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.619+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681bc130 con 0x55f2088b59f0 2024-09-21T01:22:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.619+0000 7f2c74a5d740 10 client.0 _ll_register_callbacks cb 0x7f2c600095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c6ca86640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c677fe640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088ce1b0 0x55f208cae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c67fff640 1 -- 172.21.15.37:0/2233124327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 msgr2=0x55f208caed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c67fff640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c67fff640 1 -- 172.21.15.37:0/2233124327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088ce1b0 msgr2=0x55f208cae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c67fff640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088ce1b0 0x55f208cae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.625+0000 7f2c67fff640 1 -- 172.21.15.37:0/2233124327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f208d26260 con 0x55f2088b59f0 2024-09-21T01:22:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.626+0000 7f2c67fff640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 0x55f208cae2d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c58031810 tx=0x7f2c58009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b48772257eb71e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.627+0000 7f2c477fe640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:22:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.631+0000 7f2c477fe640 1 -- 172.21.15.37:0/2233124327 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5806a060 con 0x55f2088b59f0 2024-09-21T01:22:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.631+0000 7f2c477fe640 1 -- 172.21.15.37:0/2233124327 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2c5804a450 con 0x55f2088b59f0 2024-09-21T01:22:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.635+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c60012c20 con 0x55f2088b59f0 2024-09-21T01:22:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.641+0000 7f2c477fe640 1 -- 172.21.15.37:0/2233124327 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2c58041070 con 0x55f2088b59f0 2024-09-21T01:22:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.643+0000 7f2c74a5d740 10 client.25921 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.643+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f208d27430 con 0x55f2088b59f0 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.648+0000 7f2c477fe640 1 -- 172.21.15.37:0/2233124327 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c5804ab00 con 0x55f2088b59f0 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.648+0000 7f2c477fe640 1 -- 172.21.15.37:0/2233124327 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2c58064030 con 0x55f2088b59f0 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.650+0000 7f2c74a5d740 10 client.25921 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.650+0000 7f2c74a5d740 10 client.25921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.650+0000 7f2c74a5d740 20 client.25921 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.650+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f208d27660 0x55f208d29a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.650+0000 7f2c74a5d740 4 client.25921 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:22:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.650+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2c60012c20 con 0x55f208d27660 2024-09-21T01:22:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.654+0000 7f2c677fe640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f208d27660 0x55f208d29a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.658+0000 7f2c677fe640 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f208d27660 0x55f208d29a80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f85feafae0fc2e76 server_cookie=165adc3f74f88170 in_seq=0 out_seq=0 2024-09-21T01:22:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.659+0000 7f2c477fe640 10 client.25921 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:22:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.663+0000 7f2c477fe640 1 -- 172.21.15.37:0/2233124327 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2c60012c20 con 0x55f208d27660 2024-09-21T01:22:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.663+0000 7f2c477fe640 10 client.25921 handle_command_reply: tid=0 2024-09-21T01:22:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.663+0000 7f2c74a5d740 1 client.25921 shutdown 2024-09-21T01:22:14.669 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:22:14.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 msgr2=0x55f208cae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 0x55f208cae2d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c58031810 tx=0x7f2c58009260 comp rx=0 tx=0).stop 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 shutdown_connections 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55f208d27660 0x55f208d29a80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f2088d6390 0x55f208caed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f2088ce1b0 0x55f208cae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 --2- 172.21.15.37:0/2233124327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f2088b59f0 0x55f208cae2d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.664+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 >> 172.21.15.37:0/2233124327 conn(0x55f2088eb460 msgr2=0x55f208c9f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.665+0000 7f2c477fe640 0 client.25921 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.667+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 shutdown_connections 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.667+0000 7f2c74a5d740 1 -- 172.21.15.37:0/2233124327 wait complete. 2024-09-21T01:22:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.667+0000 7f2c74a5d740 20 client.25921 trim_cache size 0 max 16384 2024-09-21T01:22:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.670+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2c500b65c0 msgr2=0x7f2c500b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2c500b65c0 0x7f2c500b8ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009230 tx=0x7f2c58000bc0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 msgr2=0x7f2c6811c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 0x7f2c6811c280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00e9f0 tx=0x7f2c5c00eeb0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 shutdown_connections 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f2c500b65c0 0x7f2c500b8ad0 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009230 tx=0x7f2c58000bc0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6810be50 0x7f2c68111d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c6810b500 0x7f2c6811c280 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 --2- 172.21.15.37:0/3300586968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c68105bc0 0x7f2c6811bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 >> 172.21.15.37:0/3300586968 conn(0x7f2c68101630 msgr2=0x7f2c6810ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 shutdown_connections 2024-09-21T01:22:14.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:14.671+0000 7f2c6d287640 1 -- 172.21.15.37:0/3300586968 wait complete. 2024-09-21T01:22:14.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.893+0000 7f3427fff640 1 -- 172.21.15.37:0/1971560279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810a3c0 msgr2=0x7f342810c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.893+0000 7f3427fff640 1 --2- 172.21.15.37:0/1971560279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810a3c0 0x7f342810c7e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ca0 tx=0x7f342002a8d0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.901+0000 7f3427fff640 1 -- 172.21.15.37:0/1971560279 shutdown_connections 2024-09-21T01:22:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.901+0000 7f3427fff640 1 --2- 172.21.15.37:0/1971560279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810f830 0x7f342810fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.901+0000 7f3427fff640 1 --2- 172.21.15.37:0/1971560279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f342810cd20 0x7f342810f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.901+0000 7f3427fff640 1 --2- 172.21.15.37:0/1971560279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810a3c0 0x7f342810c7e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.901+0000 7f3427fff640 1 -- 172.21.15.37:0/1971560279 >> 172.21.15.37:0/1971560279 conn(0x7f3428070640 msgr2=0x7f3428072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.905+0000 7f3427fff640 1 -- 172.21.15.37:0/1971560279 shutdown_connections 2024-09-21T01:22:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.905+0000 7f3427fff640 1 -- 172.21.15.37:0/1971560279 wait complete. 2024-09-21T01:22:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.906+0000 7f3427fff640 1 Processor -- start 2024-09-21T01:22:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.907+0000 7f3427fff640 1 -- start start 2024-09-21T01:22:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.907+0000 7f3427fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 0x7f34281a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.907+0000 7f3427fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f342810cd20 0x7f34281a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3427fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810f830 0x7f34281a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3427fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f342811e070 con 0x7f342810cd20 2024-09-21T01:22:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3427fff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f342811def0 con 0x7f342810a3c0 2024-09-21T01:22:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3427fff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f342811e1f0 con 0x7f342810f830 2024-09-21T01:22:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3426ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 0x7f34281a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f34277fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810f830 0x7f34281a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3426ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 0x7f34281a8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:41802/0 (socket says 172.21.15.37:41802) 2024-09-21T01:22:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.908+0000 7f3426ffd640 1 -- 172.21.15.37:0/611327142 learned_addr learned my addr 172.21.15.37:0/611327142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.910+0000 7f3426ffd640 1 -- 172.21.15.37:0/611327142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810f830 msgr2=0x7f34281a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.910+0000 7f3426ffd640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810f830 0x7f34281a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.910+0000 7f3426ffd640 1 -- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f342810cd20 msgr2=0x7f34281a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.910+0000 7f3426ffd640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f342810cd20 0x7f34281a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.910+0000 7f3426ffd640 1 -- 172.21.15.37:0/611327142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34281aa7a0 con 0x7f342810a3c0 2024-09-21T01:22:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.911+0000 7f3426ffd640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 0x7f34281a8cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3420000f80 tx=0x7f3420031a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.911+0000 7f340ffff640 1 -- 172.21.15.37:0/611327142 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420004240 con 0x7f342810a3c0 2024-09-21T01:22:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.911+0000 7f340ffff640 1 -- 172.21.15.37:0/611327142 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3420036070 con 0x7f342810a3c0 2024-09-21T01:22:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.911+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34281aaa30 con 0x7f342810a3c0 2024-09-21T01:22:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.912+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34281b10e0 con 0x7f342810a3c0 2024-09-21T01:22:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.912+0000 7f340ffff640 1 -- 172.21.15.37:0/611327142 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342002fec0 con 0x7f342810a3c0 2024-09-21T01:22:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.925+0000 7f340ffff640 1 -- 172.21.15.37:0/611327142 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f342002f620 con 0x7f342810a3c0 2024-09-21T01:22:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.927+0000 7f34345da740 1 Processor -- start 2024-09-21T01:22:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.929+0000 7f340ffff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f34100b6830 0x7f34100b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.929+0000 7f340ffff640 1 -- 172.21.15.37:0/611327142 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3420108500 con 0x7f342810a3c0 2024-09-21T01:22:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.930+0000 7f34345da740 1 -- start start 2024-09-21T01:22:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.930+0000 7f34277fe640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f34100b6830 0x7f34100b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.931+0000 7f34345da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231431b0 0x55f6234eb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.931+0000 7f34345da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.931+0000 7f34345da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 0x55f6234ec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.931+0000 7f34345da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f62345d6f0 con 0x55f6231224d0 2024-09-21T01:22:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.931+0000 7f34345da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f62344cb20 con 0x55f6231431b0 2024-09-21T01:22:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.931+0000 7f34345da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f623450930 con 0x55f62311a2f0 2024-09-21T01:22:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.932+0000 7f34277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 0x55f6234ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.933+0000 7f34277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 0x55f6234ec200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37752/0 (socket says 172.21.15.37:37752) 2024-09-21T01:22:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.933+0000 7f34277fe640 1 -- 172.21.15.37:0/2032518244 learned_addr learned my addr 172.21.15.37:0/2032518244 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.933+0000 7f34267fc640 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.934+0000 7f34277fe640 1 -- 172.21.15.37:0/2032518244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 msgr2=0x55f6234eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.935+0000 7f34277fe640 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.935+0000 7f34277fe640 1 -- 172.21.15.37:0/2032518244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231431b0 msgr2=0x55f6234eb040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:22:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.935+0000 7f34277fe640 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231431b0 0x55f6234eb040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.935+0000 7f34277fe640 1 -- 172.21.15.37:0/2032518244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f623412530 con 0x55f6231224d0 2024-09-21T01:22:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.942+0000 7f34277fe640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f34100b6830 0x7f34100b8d40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f34180165a0 tx=0x7f341800bd80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.943+0000 7f34277fe640 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 0x55f6234ec200 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3418016e30 tx=0x7f341801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af908543b3fad149 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.944+0000 7f340d7fa640 1 -- 172.21.15.37:0/2032518244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418026070 con 0x55f6231224d0 2024-09-21T01:22:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.944+0000 7f340d7fa640 1 -- 172.21.15.37:0/2032518244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3418010040 con 0x55f6231224d0 2024-09-21T01:22:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.944+0000 7f340d7fa640 1 -- 172.21.15.37:0/2032518244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34180219d0 con 0x55f6231224d0 2024-09-21T01:22:14.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.945+0000 7f34345da740 1 -- 172.21.15.37:0/2032518244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 msgr2=0x55f6234ec200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.945+0000 7f34345da740 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 0x55f6234ec200 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3418016e30 tx=0x7f341801b000 comp rx=0 tx=0).stop 2024-09-21T01:22:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.946+0000 7f34345da740 1 -- 172.21.15.37:0/2032518244 shutdown_connections 2024-09-21T01:22:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.946+0000 7f34345da740 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f6231224d0 0x55f6234ec200 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.946+0000 7f34345da740 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.946+0000 7f34345da740 1 --2- 172.21.15.37:0/2032518244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231431b0 0x55f6234eb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.946+0000 7f34345da740 1 -- 172.21.15.37:0/2032518244 >> 172.21.15.37:0/2032518244 conn(0x55f623137300 msgr2=0x55f6234e6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.949+0000 7f34345da740 1 -- 172.21.15.37:0/2032518244 shutdown_connections 2024-09-21T01:22:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.951+0000 7f34345da740 1 -- 172.21.15.37:0/2032518244 wait complete. 2024-09-21T01:22:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.952+0000 7f34345da740 1 -- start start 2024-09-21T01:22:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.953+0000 7f34345da740 1 Processor -- start 2024-09-21T01:22:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.953+0000 7f34345da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 0x55f6234f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.953+0000 7f34345da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f34345da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f623101d80 0x55f6234f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f34345da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f623384ab0 con 0x55f62311a2f0 2024-09-21T01:22:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f34345da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f6233f2730 con 0x55f623101d80 2024-09-21T01:22:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f34345da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f6234eccc0 con 0x55f6231224d0 2024-09-21T01:22:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f34345da740 10 client.0 _ll_register_callbacks cb 0x55f6234466b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f3426ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 0x55f6234f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f3426ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 0x55f6234f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37766/0 (socket says 172.21.15.37:37766) 2024-09-21T01:22:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.954+0000 7f3426ffd640 1 -- 172.21.15.37:0/3966137192 learned_addr learned my addr 172.21.15.37:0/3966137192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:14.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.956+0000 7f34267fc640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.956+0000 7f34277fe640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f623101d80 0x55f6234f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.957+0000 7f3426ffd640 1 -- 172.21.15.37:0/3966137192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 msgr2=0x55f6234f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.957+0000 7f3426ffd640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.957+0000 7f3426ffd640 1 -- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f623101d80 msgr2=0x55f6234f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.957+0000 7f3426ffd640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f623101d80 0x55f6234f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.957+0000 7f3426ffd640 1 -- 172.21.15.37:0/3966137192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6231ae790 con 0x55f62311a2f0 2024-09-21T01:22:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.963+0000 7f3426ffd640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 0x55f6234f4910 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f34200cac20 tx=0x7f34200cdfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76ab3ebdeed33ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.963+0000 7f340aff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.971+0000 7f340aff5640 1 -- 172.21.15.37:0/3966137192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34201082e0 con 0x55f62311a2f0 2024-09-21T01:22:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.971+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3418010040 con 0x55f62311a2f0 2024-09-21T01:22:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.971+0000 7f340aff5640 1 -- 172.21.15.37:0/3966137192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3420004b40 con 0x55f62311a2f0 2024-09-21T01:22:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.973+0000 7f340aff5640 1 -- 172.21.15.37:0/3966137192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f34200ce160 con 0x55f62311a2f0 2024-09-21T01:22:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.973+0000 7f34345da740 10 client.16509 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.973+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f623227620 con 0x55f62311a2f0 2024-09-21T01:22:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.974+0000 7f340aff5640 1 -- 172.21.15.37:0/3966137192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3418010040 con 0x55f62311a2f0 2024-09-21T01:22:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.974+0000 7f340aff5640 1 -- 172.21.15.37:0/3966137192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f34200c9fa0 con 0x55f62311a2f0 2024-09-21T01:22:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.975+0000 7f34345da740 10 client.16509 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.975+0000 7f34345da740 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.975+0000 7f34345da740 20 client.16509 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.975+0000 7f34345da740 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6230d71c0 0x55f623502170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.975+0000 7f34345da740 4 client.16509 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.975+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f62345f640 con 0x55f6230d71c0 2024-09-21T01:22:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.977+0000 7f34267fc640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6230d71c0 0x55f623502170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.980+0000 7f340aff5640 10 client.16509 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.980+0000 7f34267fc640 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6230d71c0 0x55f623502170 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e411ec461919da50 server_cookie=8e6ff289757ad5e5 in_seq=0 out_seq=0 2024-09-21T01:22:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.987+0000 7f340aff5640 1 -- 172.21.15.37:0/3966137192 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f62345f640 con 0x55f6230d71c0 2024-09-21T01:22:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.987+0000 7f340aff5640 10 client.16509 handle_command_reply: tid=0 2024-09-21T01:22:14.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.988+0000 7f34345da740 1 client.16509 shutdown 2024-09-21T01:22:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.992+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 msgr2=0x55f6234f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.992+0000 7f34345da740 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 0x55f6234f4910 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f34200cac20 tx=0x7f34200cdfa0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.998+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 shutdown_connections 2024-09-21T01:22:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f6230d71c0 0x55f623502170 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f623101d80 0x55f6234f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 --2- 172.21.15.37:0/3966137192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f62311a2f0 0x55f6234f4910 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 >> 172.21.15.37:0/3966137192 conn(0x55f623137300 msgr2=0x55f6234e5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f340aff5640 0 client.16509 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 shutdown_connections 2024-09-21T01:22:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:14.999+0000 7f34345da740 1 -- 172.21.15.37:0/3966137192 wait complete. 2024-09-21T01:22:15.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:14 smithi037 ceph-mon[31105]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 814 MiB/s wr, 1.67k op/s 2024-09-21T01:22:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.000+0000 7f34345da740 20 client.16509 trim_cache size 0 max 16384 2024-09-21T01:22:15.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.081+0000 7f34345da740 1 Processor -- start 2024-09-21T01:22:15.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.081+0000 7f34345da740 1 -- start start 2024-09-21T01:22:15.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.085+0000 7f34345da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 0x55f6234f4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.085+0000 7f34345da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.085+0000 7f34345da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231224d0 0x55f6234f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.086+0000 7f34345da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b9ea0 con 0x55f623101d80 2024-09-21T01:22:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.086+0000 7f34345da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34281bb9e0 con 0x55f6231224d0 2024-09-21T01:22:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.086+0000 7f34267fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.086+0000 7f34267fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41040/0 (socket says 172.21.15.37:41040) 2024-09-21T01:22:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.086+0000 7f34267fc640 1 -- 172.21.15.37:0/1736118282 learned_addr learned my addr 172.21.15.37:0/1736118282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.086+0000 7f34345da740 1 -- 172.21.15.37:0/1736118282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34281ba570 con 0x55f62311a2f0 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.087+0000 7f34277fe640 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231224d0 0x55f6234f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.087+0000 7f34267fc640 1 -- 172.21.15.37:0/1736118282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231224d0 msgr2=0x55f6234f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.087+0000 7f34267fc640 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231224d0 0x55f6234f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.087+0000 7f34267fc640 1 -- 172.21.15.37:0/1736118282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 msgr2=0x55f6234f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.087+0000 7f34267fc640 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 0x55f6234f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.087+0000 7f34267fc640 1 -- 172.21.15.37:0/1736118282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6234ece30 con 0x55f62311a2f0 2024-09-21T01:22:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.088+0000 7f34267fc640 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234f2e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55f6235028c0 tx=0x7f341c00bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeee08515f12dcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:15.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.092+0000 7f340cff9640 1 -- 172.21.15.37:0/1736118282 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c020020 con 0x55f62311a2f0 2024-09-21T01:22:15.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.092+0000 7f340cff9640 1 -- 172.21.15.37:0/1736118282 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f341c016db0 con 0x55f62311a2f0 2024-09-21T01:22:15.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.092+0000 7f340cff9640 1 -- 172.21.15.37:0/1736118282 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c01ce00 con 0x55f62311a2f0 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.094+0000 7f34345da740 1 -- 172.21.15.37:0/1736118282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 msgr2=0x55f6234f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.094+0000 7f34345da740 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234f2e60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55f6235028c0 tx=0x7f341c00bc10 comp rx=0 tx=0).stop 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.094+0000 7f34345da740 1 -- 172.21.15.37:0/1736118282 shutdown_connections 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.094+0000 7f34345da740 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6231224d0 0x55f6234f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.094+0000 7f34345da740 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f62311a2f0 0x55f6234f2e60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.094+0000 7f34345da740 1 --2- 172.21.15.37:0/1736118282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 0x55f6234f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.095+0000 7f34345da740 1 -- 172.21.15.37:0/1736118282 >> 172.21.15.37:0/1736118282 conn(0x55f623137300 msgr2=0x55f6234e5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.099+0000 7f34345da740 1 -- 172.21.15.37:0/1736118282 shutdown_connections 2024-09-21T01:22:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.099+0000 7f34345da740 1 -- 172.21.15.37:0/1736118282 wait complete. 2024-09-21T01:22:15.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.100+0000 7f34345da740 1 -- start start 2024-09-21T01:22:15.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.100+0000 7f34345da740 1 Processor -- start 2024-09-21T01:22:15.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.101+0000 7f34345da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 0x55f6234fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.101+0000 7f34345da740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f62311a2f0 0x55f6234fb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34345da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234fb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34345da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34281bb310 con 0x55f623101d80 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34345da740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34281bac40 con 0x55f62311a2f0 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34345da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b7e60 con 0x55f6231224d0 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34277fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34277fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234fb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41056/0 (socket says 172.21.15.37:41056) 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34277fe640 1 -- 172.21.15.37:0/2040819615 learned_addr learned my addr 172.21.15.37:0/2040819615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.102+0000 7f34267fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f62311a2f0 0x55f6234fb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:15.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.103+0000 7f34345da740 10 client.0 _ll_register_callbacks cb 0x7f3420009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.103+0000 7f34277fe640 1 -- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f62311a2f0 msgr2=0x55f6234fb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.103+0000 7f34277fe640 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f62311a2f0 0x55f6234fb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.103+0000 7f34277fe640 1 -- 172.21.15.37:0/2040819615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 msgr2=0x55f6234fc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.103+0000 7f34277fe640 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 0x55f6234fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:15.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.103+0000 7f34277fe640 1 -- 172.21.15.37:0/2040819615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6234fbb50 con 0x55f6231224d0 2024-09-21T01:22:15.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.104+0000 7f34277fe640 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234fb610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3418016e30 tx=0x7f3418004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73eae799366c3e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.116+0000 7f340aff5640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:22:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.116+0000 7f340aff5640 1 -- 172.21.15.37:0/2040819615 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418032020 con 0x55f6231224d0 2024-09-21T01:22:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.116+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f341c016db0 con 0x55f6231224d0 2024-09-21T01:22:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.116+0000 7f340aff5640 1 -- 172.21.15.37:0/2040819615 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3418003690 con 0x55f6231224d0 2024-09-21T01:22:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.117+0000 7f340aff5640 1 -- 172.21.15.37:0/2040819615 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3418026040 con 0x55f6231224d0 2024-09-21T01:22:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.122+0000 7f34345da740 10 client.25939 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.122+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f6234fa910 con 0x55f6231224d0 2024-09-21T01:22:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.123+0000 7f340aff5640 1 -- 172.21.15.37:0/2040819615 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f341c016db0 con 0x55f6231224d0 2024-09-21T01:22:15.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f340aff5640 1 -- 172.21.15.37:0/2040819615 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f341802c040 con 0x55f6231224d0 2024-09-21T01:22:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f34345da740 10 client.25939 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f34345da740 10 client.25939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f34345da740 20 client.25939 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f34345da740 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f62356d0d0 0x55f62356f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f34345da740 4 client.25939 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:22:15.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.125+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f62345b0f0 con 0x55f62356d0d0 2024-09-21T01:22:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.126+0000 7f3426ffd640 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f62356d0d0 0x55f62356f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.130+0000 7f3426ffd640 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f62356d0d0 0x55f62356f510 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6497ad62b35a22 server_cookie=6246afd114687277 in_seq=0 out_seq=0 2024-09-21T01:22:15.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:15.130+0000 7f340aff5640 10 client.25939 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:15.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:14 smithi137 ceph-mon[34607]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 814 MiB/s wr, 1.67k op/s 2024-09-21T01:22:15.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:14 smithi144 ceph-mon[34818]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 814 MiB/s wr, 1.67k op/s 2024-09-21T01:22:17.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:16 smithi037 ceph-mon[31105]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 909 MiB/s wr, 1.94k op/s 2024-09-21T01:22:17.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:16 smithi137 ceph-mon[34607]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 909 MiB/s wr, 1.94k op/s 2024-09-21T01:22:17.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:16 smithi144 ceph-mon[34818]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 909 MiB/s wr, 1.94k op/s 2024-09-21T01:22:17.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:22:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.084+0000 7f340aff5640 1 -- 172.21.15.37:0/2040819615 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f62345b0f0 con 0x55f62356d0d0 2024-09-21T01:22:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.084+0000 7f340aff5640 10 client.25939 handle_command_reply: tid=0 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 client.25939 shutdown 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 msgr2=0x55f6234fb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234fb610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3418016e30 tx=0x7f3418004750 comp rx=0 tx=0).stop 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 shutdown_connections 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f62356d0d0 0x55f62356f510 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6231224d0 0x55f6234fb610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f62311a2f0 0x55f6234fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 --2- 172.21.15.37:0/2040819615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f623101d80 0x55f6234fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 >> 172.21.15.37:0/2040819615 conn(0x55f623137300 msgr2=0x55f6234e5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:18.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.085+0000 7f340aff5640 0 client.25939 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.087+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 shutdown_connections 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.087+0000 7f34345da740 1 -- 172.21.15.37:0/2040819615 wait complete. 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.087+0000 7f34345da740 20 client.25939 trim_cache size 0 max 16384 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:22:18.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:22:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.090+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f34100b6830 msgr2=0x7f34100b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:18.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.090+0000 7f3427fff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f34100b6830 0x7f34100b8d40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f34180165a0 tx=0x7f341800bd80 comp rx=0 tx=0).stop 2024-09-21T01:22:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.091+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 msgr2=0x7f34281a8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:18.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.091+0000 7f3427fff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 0x7f34281a8cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3420000f80 tx=0x7f3420031a80 comp rx=0 tx=0).stop 2024-09-21T01:22:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.094+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 shutdown_connections 2024-09-21T01:22:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.094+0000 7f3427fff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f34100b6830 0x7f34100b8d40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.094+0000 7f3427fff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f342810f830 0x7f34281a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.094+0000 7f3427fff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f342810cd20 0x7f34281a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.094+0000 7f3427fff640 1 --2- 172.21.15.37:0/611327142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f342810a3c0 0x7f34281a8cc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.094+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 >> 172.21.15.37:0/611327142 conn(0x7f3428070640 msgr2=0x7f342810b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.096+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 shutdown_connections 2024-09-21T01:22:18.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:18.096+0000 7f3427fff640 1 -- 172.21.15.37:0/611327142 wait complete. 2024-09-21T01:22:18.686 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:22:19.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:18 smithi037 ceph-mon[31105]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 838 MiB/s wr, 1.76k op/s 2024-09-21T01:22:19.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:18 smithi137 ceph-mon[34607]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 838 MiB/s wr, 1.76k op/s 2024-09-21T01:22:19.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:18 smithi144 ceph-mon[34818]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 838 MiB/s wr, 1.76k op/s 2024-09-21T01:22:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.837+0000 7f3f0c28f640 1 -- 172.21.15.37:0/702814360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0410a590 msgr2=0x7f3f0410a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.837+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/702814360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0410a590 0x7f3f0410a9a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009900 tx=0x7f3ef402a410 comp rx=0 tx=0).stop 2024-09-21T01:22:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 -- 172.21.15.37:0/702814360 shutdown_connections 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/702814360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f04116640 0x7f3f04118b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/702814360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0410aee0 0x7f3f04115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/702814360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0410a590 0x7f3f0410a9a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 -- 172.21.15.37:0/702814360 >> 172.21.15.37:0/702814360 conn(0x7f3f040712f0 msgr2=0x7f3f04073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 -- 172.21.15.37:0/702814360 shutdown_connections 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.838+0000 7f3f0c28f640 1 -- 172.21.15.37:0/702814360 wait complete. 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.840+0000 7f3f0c28f640 1 Processor -- start 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.843+0000 7f3f0c28f640 1 -- start start 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.844+0000 7f3f0c28f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0410a590 0x7f3f041a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.844+0000 7f3f0c28f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f0410aee0 0x7f3f041a3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.844+0000 7f3f0c28f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 0x7f3f041a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.844+0000 7f3f0c28f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0411c340 con 0x7f3f04116640 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.845+0000 7f3f0c28f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0411c1c0 con 0x7f3f0410aee0 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.845+0000 7f3f0c28f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0411c4c0 con 0x7f3f0410a590 2024-09-21T01:22:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.845+0000 7f3f0a82c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 0x7f3f041a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.845+0000 7f3f0a82c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 0x7f3f041a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54210/0 (socket says 172.21.15.37:54210) 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.845+0000 7f3f0a82c640 1 -- 172.21.15.37:0/1705527959 learned_addr learned my addr 172.21.15.37:0/1705527959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.846+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0410a590 0x7f3f041a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.846+0000 7f3f0982a640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f0410aee0 0x7f3f041a3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.847+0000 7f3f0a82c640 1 -- 172.21.15.37:0/1705527959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0410a590 msgr2=0x7f3f041a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.847+0000 7f3f0a82c640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0410a590 0x7f3f041a2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.847+0000 7f3f0a82c640 1 -- 172.21.15.37:0/1705527959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f0410aee0 msgr2=0x7f3f041a3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.847+0000 7f3f0a82c640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f0410aee0 0x7f3f041a3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.847+0000 7f3f0a82c640 1 -- 172.21.15.37:0/1705527959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f041a8c60 con 0x7f3f04116640 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.848+0000 7f3f0a82c640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 0x7f3f041a8530 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00eaa0 tx=0x7f3efc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.850+0000 7f3f037fe640 1 -- 172.21.15.37:0/1705527959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00cdb0 con 0x7f3f04116640 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.851+0000 7f3f037fe640 1 -- 172.21.15.37:0/1705527959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3efc005020 con 0x7f3f04116640 2024-09-21T01:22:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.851+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f041a8f50 con 0x7f3f04116640 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.851+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f041af6b0 con 0x7f3f04116640 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.853+0000 7f3f037fe640 1 -- 172.21.15.37:0/1705527959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0116d0 con 0x7f3f04116640 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.863+0000 7f3f12803740 1 Processor -- start 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.865+0000 7f3f037fe640 1 -- 172.21.15.37:0/1705527959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3efc004a00 con 0x7f3f04116640 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.868+0000 7f3f037fe640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3eec0b65f0 0x7f3eec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.869+0000 7f3f12803740 1 -- start start 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f12803740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc25a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f037fe640 1 -- 172.21.15.37:0/1705527959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3efc0e7470 con 0x7f3f04116640 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f12803740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc25a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f12803740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc25ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f12803740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616bc1d0ea0 con 0x5616bbe8a1b0 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f12803740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616bc1c02d0 con 0x5616bbeb3070 2024-09-21T01:22:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.870+0000 7f3f12803740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5616bc1c40e0 con 0x5616bbe92390 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.873+0000 7f3f0a02b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc25a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.873+0000 7f3f0a82c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc25ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.873+0000 7f3f0982a640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3eec0b65f0 0x7f3eec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.873+0000 7f3f0982a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc25a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.873+0000 7f3f0982a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc25a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54218/0 (socket says 172.21.15.37:54218) 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.873+0000 7f3f0982a640 1 -- 172.21.15.37:0/2752027077 learned_addr learned my addr 172.21.15.37:0/2752027077 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.877+0000 7f3f0a02b640 1 -- 172.21.15.37:0/2752027077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 msgr2=0x5616bc25ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.877+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc25ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.877+0000 7f3f0a02b640 1 -- 172.21.15.37:0/2752027077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 msgr2=0x5616bc25a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.877+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc25a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.877+0000 7f3f0982a640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3eec0b65f0 0x7f3eec0b8b00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80149c0 tx=0x7f3ef800cc30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.877+0000 7f3f0a02b640 1 -- 172.21.15.37:0/2752027077 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bbf1e650 con 0x5616bbeb3070 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.878+0000 7f3f0a82c640 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc25ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.879+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc25a2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ef402aa00 tx=0x7f3ef4004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7deaef1e1e4783b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.885+0000 7f3f00d9a640 1 -- 172.21.15.37:0/2752027077 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4035030 con 0x5616bbeb3070 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.885+0000 7f3f00d9a640 1 -- 172.21.15.37:0/2752027077 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef40054f0 con 0x5616bbeb3070 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.887+0000 7f3f12803740 1 -- 172.21.15.37:0/2752027077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 msgr2=0x5616bc25a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.887+0000 7f3f12803740 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc25a2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ef402aa00 tx=0x7f3ef4004180 comp rx=0 tx=0).stop 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.889+0000 7f3f12803740 1 -- 172.21.15.37:0/2752027077 shutdown_connections 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.889+0000 7f3f12803740 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc25ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.889+0000 7f3f12803740 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc25a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.889+0000 7f3f12803740 1 --2- 172.21.15.37:0/2752027077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc25a2c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.889+0000 7f3f12803740 1 -- 172.21.15.37:0/2752027077 >> 172.21.15.37:0/2752027077 conn(0x5616bbea7460 msgr2=0x5616bc2581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.891+0000 7f3f12803740 1 -- 172.21.15.37:0/2752027077 shutdown_connections 2024-09-21T01:22:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.892+0000 7f3f12803740 1 -- 172.21.15.37:0/2752027077 wait complete. 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.893+0000 7f3f12803740 1 -- start start 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.893+0000 7f3f12803740 1 Processor -- start 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbe8a1b0 0x5616bc2618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 0x5616bc261e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbeb3070 0x5616bc262390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616bc021700 con 0x5616bbe92390 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616bc15b160 con 0x5616bbe8a1b0 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5616bc271230 con 0x5616bbeb3070 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.894+0000 7f3f12803740 10 client.0 _ll_register_callbacks cb 0x5616bc1749e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.899+0000 7f3f0982a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 0x5616bc261e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.899+0000 7f3f0982a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 0x5616bc261e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54232/0 (socket says 172.21.15.37:54232) 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.899+0000 7f3f0982a640 1 -- 172.21.15.37:0/4068154309 learned_addr learned my addr 172.21.15.37:0/4068154309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.901+0000 7f3f0a82c640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbeb3070 0x5616bc262390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.902+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbe8a1b0 0x5616bc2618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.902+0000 7f3f0982a640 1 -- 172.21.15.37:0/4068154309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbeb3070 msgr2=0x5616bc262390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.902+0000 7f3f0982a640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbeb3070 0x5616bc262390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.902+0000 7f3f0982a640 1 -- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbe8a1b0 msgr2=0x5616bc2618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.902+0000 7f3f0982a640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbe8a1b0 0x5616bc2618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.902+0000 7f3f0982a640 1 -- 172.21.15.37:0/4068154309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616bc188c90 con 0x5616bbe92390 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.903+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbe8a1b0 0x5616bc2618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.903+0000 7f3f0982a640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 0x5616bc261e10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800f650 tx=0x7f3ef801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483d3a2cb678e70f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.903+0000 7f3ee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.904+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/4068154309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8014230 con 0x5616bbe92390 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.904+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef40054f0 con 0x5616bbe92390 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.904+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/4068154309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3ef8012450 con 0x5616bbe92390 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.906+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/4068154309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3ef8012650 con 0x5616bbe92390 2024-09-21T01:22:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.907+0000 7f3f12803740 10 client.16521 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.907+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616bc267290 con 0x5616bbe92390 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.910+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/4068154309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef40054f0 con 0x5616bbe92390 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.910+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/4068154309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3ef8030710 con 0x5616bbe92390 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.912+0000 7f3f12803740 10 client.16521 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.912+0000 7f3f12803740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.912+0000 7f3f12803740 20 client.16521 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.912+0000 7f3f12803740 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe719f0 0x5616bc26a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.912+0000 7f3f12803740 4 client.16521 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.912+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616bc1d2df0 con 0x5616bbe719f0 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.913+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe719f0 0x5616bc26a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.921+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe719f0 0x5616bc26a7c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48ac23d5181a2f1 server_cookie=167fadead6e7dfa9 in_seq=0 out_seq=0 2024-09-21T01:22:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.921+0000 7f3ee9ffb640 10 client.16521 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:21.060 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:22:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.925+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/4068154309 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616bc1d2df0 con 0x5616bbe719f0 2024-09-21T01:22:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.925+0000 7f3ee9ffb640 10 client.16521 handle_command_reply: tid=0 2024-09-21T01:22:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.926+0000 7f3f12803740 1 client.16521 shutdown 2024-09-21T01:22:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.928+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 msgr2=0x5616bc261e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.928+0000 7f3f12803740 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 0x5616bc261e10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800f650 tx=0x7f3ef801b000 comp rx=0 tx=0).stop 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 shutdown_connections 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe719f0 0x5616bc26a7c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbeb3070 0x5616bc262390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe92390 0x5616bc261e10 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 --2- 172.21.15.37:0/4068154309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbe8a1b0 0x5616bc2618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 >> 172.21.15.37:0/4068154309 conn(0x5616bbea7460 msgr2=0x5616bc25bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3ee9ffb640 0 client.16521 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.947+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 shutdown_connections 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.951+0000 7f3f12803740 1 -- 172.21.15.37:0/4068154309 wait complete. 2024-09-21T01:22:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.951+0000 7f3f12803740 20 client.16521 trim_cache size 0 max 16384 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.993+0000 7f3f12803740 1 Processor -- start 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.994+0000 7f3f12803740 1 -- start start 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.995+0000 7f3f12803740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc260150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.996+0000 7f3f12803740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc260690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.997+0000 7f3f0a02b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc260150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.997+0000 7f3f0a02b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc260150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54244/0 (socket says 172.21.15.37:54244) 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.997+0000 7f3f0a02b640 1 -- 172.21.15.37:0/266807237 learned_addr learned my addr 172.21.15.37:0/266807237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.998+0000 7f3f12803740 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc261680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.999+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef000e5f0 con 0x5616bbe8a1b0 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.999+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef0010130 con 0x5616bbeb3070 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.999+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef000ecc0 con 0x5616bbe92390 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:20.999+0000 7f3f0a82c640 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc261680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.000+0000 7f3f0a02b640 1 -- 172.21.15.37:0/266807237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 msgr2=0x5616bc260690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.000+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc260690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.000+0000 7f3f0a02b640 1 -- 172.21.15.37:0/266807237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 msgr2=0x5616bc261680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.000+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc261680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.000+0000 7f3f0a02b640 1 -- 172.21.15.37:0/266807237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bc2523b0 con 0x5616bbe8a1b0 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.002+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc260150 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009900 tx=0x7f3ef4004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3fb7cc197989c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.003+0000 7f3eebfff640 1 -- 172.21.15.37:0/266807237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4035040 con 0x5616bbe8a1b0 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.003+0000 7f3eebfff640 1 -- 172.21.15.37:0/266807237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef40048c0 con 0x5616bbe8a1b0 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.003+0000 7f3eebfff640 1 -- 172.21.15.37:0/266807237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40052e0 con 0x5616bbe8a1b0 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.005+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 msgr2=0x5616bc260150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.005+0000 7f3f12803740 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc260150 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009900 tx=0x7f3ef4004b00 comp rx=0 tx=0).stop 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.008+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 shutdown_connections 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.008+0000 7f3f12803740 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc261680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.008+0000 7f3f12803740 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc260690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.008+0000 7f3f12803740 1 --2- 172.21.15.37:0/266807237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc260150 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.008+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 >> 172.21.15.37:0/266807237 conn(0x5616bbea7460 msgr2=0x5616bc26ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.009+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 shutdown_connections 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.009+0000 7f3f12803740 1 -- 172.21.15.37:0/266807237 wait complete. 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.014+0000 7f3f12803740 1 -- start start 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.015+0000 7f3f12803740 1 Processor -- start 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.016+0000 7f3f12803740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc2ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.016+0000 7f3f12803740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc2ec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.017+0000 7f3f12803740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc276360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f0a02b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc2ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f0a02b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc2ebae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54248/0 (socket says 172.21.15.37:54248) 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f0a82c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc276360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f0982a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc2ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f0982a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc2ec0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44292/0 (socket says 172.21.15.37:44292) 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f0a02b640 1 -- 172.21.15.37:0/3648310754 learned_addr learned my addr 172.21.15.37:0/3648310754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.018+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef000fa60 con 0x5616bbe8a1b0 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.019+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef000f390 con 0x5616bbeb3070 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.019+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef000c5b0 con 0x5616bbe92390 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.020+0000 7f3f12803740 10 client.0 _ll_register_callbacks cb 0x7f3ef80146d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.022+0000 7f3f0982a640 1 -- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 msgr2=0x5616bc276360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.022+0000 7f3f0982a640 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc276360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.022+0000 7f3f0982a640 1 -- 172.21.15.37:0/3648310754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 msgr2=0x5616bc2ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.022+0000 7f3f0982a640 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc2ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.022+0000 7f3f0982a640 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616bc2769d0 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.024+0000 7f3f0982a640 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc2ec0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8030ae0 tx=0x7f3ef80057d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6e42e1221c3fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.025+0000 7f3ee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.026+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/3648310754 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef800cca0 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.026+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef40048c0 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.026+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/3648310754 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3ef8030400 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.028+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/3648310754 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3ef8014280 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.029+0000 7f3f12803740 10 client.25954 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.029+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616bc2f32e0 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.030+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/3648310754 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ef40048c0 con 0x5616bbe92390 2024-09-21T01:22:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.032+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/3648310754 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3ef80127f0 con 0x5616bbe92390 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.033+0000 7f3f12803740 10 client.25954 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.033+0000 7f3f12803740 10 client.25954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.033+0000 7f3f12803740 20 client.25954 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.033+0000 7f3f12803740 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe46da0 0x5616bc2f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.033+0000 7f3f12803740 4 client.25954 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.033+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616bc1ce8a0 con 0x5616bbe46da0 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.034+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe46da0 0x5616bc2f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.038+0000 7f3f0a02b640 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe46da0 0x5616bc2f5a70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7abedd1fa6551167 server_cookie=1639bb9d77b22c7a in_seq=0 out_seq=0 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.038+0000 7f3ee9ffb640 10 client.25954 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.040+0000 7f3ee9ffb640 1 -- 172.21.15.37:0/3648310754 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616bc1ce8a0 con 0x5616bbe46da0 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.040+0000 7f3ee9ffb640 10 client.25954 handle_command_reply: tid=0 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.041+0000 7f3f12803740 1 client.25954 shutdown 2024-09-21T01:22:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 msgr2=0x5616bc2ec0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc2ec0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8030ae0 tx=0x7f3ef80057d0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 shutdown_connections 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616bbe46da0 0x5616bc2f5a70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616bbeb3070 0x5616bc276360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616bbe92390 0x5616bc2ec0c0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8030ae0 tx=0x7f3ef80057d0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 --2- 172.21.15.37:0/3648310754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616bbe8a1b0 0x5616bc2ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.043+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 >> 172.21.15.37:0/3648310754 conn(0x5616bbea7460 msgr2=0x5616bc2579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.044+0000 7f3ee9ffb640 0 client.25954 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.044+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 shutdown_connections 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.044+0000 7f3f12803740 1 -- 172.21.15.37:0/3648310754 wait complete. 2024-09-21T01:22:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.044+0000 7f3f12803740 20 client.25954 trim_cache size 0 max 16384 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.049+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3eec0b65f0 msgr2=0x7f3eec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.049+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3eec0b65f0 0x7f3eec0b8b00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80149c0 tx=0x7f3ef800cc30 comp rx=0 tx=0).stop 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.049+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 msgr2=0x7f3f041a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.049+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 0x7f3f041a8530 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00eaa0 tx=0x7f3efc00ef60 comp rx=0 tx=0).stop 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.050+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 shutdown_connections 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.050+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3eec0b65f0 0x7f3eec0b8b00 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80149c0 tx=0x7f3ef800cc30 comp rx=0 tx=0).stop 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.050+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f04116640 0x7f3f041a8530 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.050+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f0410aee0 0x7f3f041a3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.050+0000 7f3f0c28f640 1 --2- 172.21.15.37:0/1705527959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0410a590 0x7f3f041a2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.050+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 >> 172.21.15.37:0/1705527959 conn(0x7f3f040712f0 msgr2=0x7f3f040735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.052+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 shutdown_connections 2024-09-21T01:22:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:21.052+0000 7f3f0c28f640 1 -- 172.21.15.37:0/1705527959 wait complete. 2024-09-21T01:22:21.095 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:20 smithi037 ceph-mon[31105]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.73k op/s 2024-09-21T01:22:21.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:20 smithi137 ceph-mon[34607]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.73k op/s 2024-09-21T01:22:21.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:20 smithi144 ceph-mon[34818]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.73k op/s 2024-09-21T01:22:23.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:22 smithi037 ceph-mon[31105]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 891 MiB/s wr, 1.63k op/s 2024-09-21T01:22:23.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:22 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:22:23.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:22 smithi137 ceph-mon[34607]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 891 MiB/s wr, 1.63k op/s 2024-09-21T01:22:23.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:22 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:22:23.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:22 smithi144 ceph-mon[34818]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 891 MiB/s wr, 1.63k op/s 2024-09-21T01:22:23.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:22 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:22:24.591 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:22:24.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:22:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:22:25.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:24 smithi037 ceph-mon[31105]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 826 MiB/s wr, 1.67k op/s 2024-09-21T01:22:25.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:24 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:24 smithi137 ceph-mon[34607]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 826 MiB/s wr, 1.67k op/s 2024-09-21T01:22:25.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:24 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:24 smithi144 ceph-mon[34818]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 826 MiB/s wr, 1.67k op/s 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:25.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:24 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:22:26.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:25 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi037 to 177.0M 2024-09-21T01:22:26.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:26 smithi037 ceph-mon[31105]: Unable to set osd_memory_target on smithi037 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T01:22:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:25 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi037 to 177.0M 2024-09-21T01:22:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:26 smithi137 ceph-mon[34607]: Unable to set osd_memory_target on smithi037 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T01:22:26.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:25 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi037 to 177.0M 2024-09-21T01:22:26.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:25 smithi144 ceph-mon[34818]: Unable to set osd_memory_target on smithi037 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T01:22:27.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:26 smithi037 ceph-mon[31105]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 1.87k op/s 2024-09-21T01:22:27.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:27 smithi137 ceph-mon[34607]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 1.87k op/s 2024-09-21T01:22:27.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:27 smithi144 ceph-mon[34818]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 1.87k op/s 2024-09-21T01:22:27.720 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:22:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:22:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "efb52bc3-bca1-4107-a2ee-fa49909bfab3", 2024-09-21T01:22:27.720 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:22:27.721 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 -- 172.21.15.37:0/2692724130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac1410c040 msgr2=0x7fac14112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 --2- 172.21.15.37:0/2692724130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac1410c040 0x7fac14112870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac04009860 tx=0x7fac0402a380 comp rx=0 tx=0).stop 2024-09-21T01:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 -- 172.21.15.37:0/2692724130 shutdown_connections 2024-09-21T01:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 --2- 172.21.15.37:0/2692724130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac1410c040 0x7fac14112870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 --2- 172.21.15.37:0/2692724130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac1410b6f0 0x7fac1410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 --2- 172.21.15.37:0/2692724130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14105db0 0x7fac141061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.926+0000 7fac1c04f640 1 -- 172.21.15.37:0/2692724130 >> 172.21.15.37:0/2692724130 conn(0x7fac141017c0 msgr2=0x7fac14103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.930+0000 7fac1c04f640 1 -- 172.21.15.37:0/2692724130 shutdown_connections 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.932+0000 7fac1c04f640 1 -- 172.21.15.37:0/2692724130 wait complete. 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.933+0000 7fac1c04f640 1 Processor -- start 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.933+0000 7fac1c04f640 1 -- start start 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.934+0000 7fac1c04f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac14105db0 0x7fac1410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.934+0000 7fac1c04f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1410b6f0 0x7fac14110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.934+0000 7fac1c04f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac1410c040 0x7fac141106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.934+0000 7fac1c04f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac1406d290 con 0x7fac1410b6f0 2024-09-21T01:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.934+0000 7fac1c04f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac1406d110 con 0x7fac14105db0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.934+0000 7fac1c04f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac1406d410 con 0x7fac1410c040 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.935+0000 7fac19deb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac14105db0 0x7fac1410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.935+0000 7fac19deb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac14105db0 0x7fac1410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60720/0 (socket says 172.21.15.37:60720) 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.935+0000 7fac19deb640 1 -- 172.21.15.37:0/3787574194 learned_addr learned my addr 172.21.15.37:0/3787574194 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.935+0000 7fac195ea640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1410b6f0 0x7fac14110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.936+0000 7fac195ea640 1 -- 172.21.15.37:0/3787574194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac1410c040 msgr2=0x7fac141106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.936+0000 7fac195ea640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac1410c040 0x7fac141106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.936+0000 7fac195ea640 1 -- 172.21.15.37:0/3787574194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac14105db0 msgr2=0x7fac1410fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.936+0000 7fac195ea640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac14105db0 0x7fac1410fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.936+0000 7fac195ea640 1 -- 172.21.15.37:0/3787574194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac14074b20 con 0x7fac1410b6f0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.936+0000 7fac195ea640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1410b6f0 0x7fac14110160 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac1406c6e0 tx=0x7fac1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.937+0000 7fac0affd640 1 -- 172.21.15.37:0/3787574194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10017070 con 0x7fac1410b6f0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.937+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac14074e10 con 0x7fac1410b6f0 2024-09-21T01:22:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.938+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac14075350 con 0x7fac1410b6f0 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.938+0000 7fac0affd640 1 -- 172.21.15.37:0/3787574194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac10009e50 con 0x7fac1410b6f0 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.938+0000 7fac0affd640 1 -- 172.21.15.37:0/3787574194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10004bc0 con 0x7fac1410b6f0 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.943+0000 7fac225c3740 1 Processor -- start 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.944+0000 7fac225c3740 1 -- start start 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.945+0000 7fac225c3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615cacc350 0x55615ce73430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.945+0000 7fac225c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caa3490 0x55615ce73970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.945+0000 7fac225c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caab670 0x55615ce73eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.946+0000 7fac225c3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55615cde9e60 con 0x55615caa3490 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.946+0000 7fac225c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55615cdd9290 con 0x55615caab670 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.946+0000 7fac225c3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55615cddd0a0 con 0x55615cacc350 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.948+0000 7fac195ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caab670 0x55615ce73eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.948+0000 7fac1a5ec640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615cacc350 0x55615ce73430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.948+0000 7fac195ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caab670 0x55615ce73eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60732/0 (socket says 172.21.15.37:60732) 2024-09-21T01:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.948+0000 7fac195ea640 1 -- 172.21.15.37:0/3496782424 learned_addr learned my addr 172.21.15.37:0/3496782424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.952+0000 7fac1a5ec640 1 -- 172.21.15.37:0/3496782424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caab670 msgr2=0x55615ce73eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.952+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caab670 0x55615ce73eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.952+0000 7fac1a5ec640 1 -- 172.21.15.37:0/3496782424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caa3490 msgr2=0x55615ce73970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.952+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caa3490 0x55615ce73970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.952+0000 7fac1a5ec640 1 -- 172.21.15.37:0/3496782424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615cb37930 con 0x55615cacc350 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.953+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615cacc350 0x55615ce73430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac04009780 tx=0x7fac04009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9d14e8db1d000f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.954+0000 7fac0affd640 1 -- 172.21.15.37:0/3787574194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fac100099a0 con 0x7fac1410b6f0 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.954+0000 7fabfffff640 1 -- 172.21.15.37:0/3496782424 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04037040 con 0x55615cacc350 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.955+0000 7fabfffff640 1 -- 172.21.15.37:0/3496782424 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac04040070 con 0x55615cacc350 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.955+0000 7fabfffff640 1 -- 172.21.15.37:0/3496782424 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04003850 con 0x55615cacc350 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.956+0000 7fac0affd640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fac000b6690 0x7fac000b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.956+0000 7fac0affd640 1 -- 172.21.15.37:0/3787574194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fac100ed810 con 0x7fac1410b6f0 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.956+0000 7fac19deb640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fac000b6690 0x7fac000b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.958+0000 7fac225c3740 1 -- 172.21.15.37:0/3496782424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615cacc350 msgr2=0x55615ce73430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.958+0000 7fac225c3740 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615cacc350 0x55615ce73430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac04009780 tx=0x7fac04009370 comp rx=0 tx=0).stop 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.958+0000 7fac19deb640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fac000b6690 0x7fac000b8ba0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55615ce720b0 tx=0x7fac0c009c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.959+0000 7fac225c3740 1 -- 172.21.15.37:0/3496782424 shutdown_connections 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.959+0000 7fac225c3740 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caab670 0x55615ce73eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.959+0000 7fac225c3740 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caa3490 0x55615ce73970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.959+0000 7fac225c3740 1 --2- 172.21.15.37:0/3496782424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615cacc350 0x55615ce73430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.959+0000 7fac225c3740 1 -- 172.21.15.37:0/3496782424 >> 172.21.15.37:0/3496782424 conn(0x55615cac0740 msgr2=0x55615ce71320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.960+0000 7fac225c3740 1 -- 172.21.15.37:0/3496782424 shutdown_connections 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.960+0000 7fac225c3740 1 -- 172.21.15.37:0/3496782424 wait complete. 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.961+0000 7fac225c3740 1 -- start start 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.961+0000 7fac225c3740 1 Processor -- start 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.963+0000 7fac225c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce7f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.963+0000 7fac225c3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce7f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.963+0000 7fac225c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 0x55615ce8af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.964+0000 7fac1a5ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 0x55615ce8af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.964+0000 7fac1a5ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 0x55615ce8af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43282/0 (socket says 172.21.15.37:43282) 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.964+0000 7fac1a5ec640 1 -- 172.21.15.37:0/293212945 learned_addr learned my addr 172.21.15.37:0/293212945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.964+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55615cc3a890 con 0x55615cacc350 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.964+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55615cd73d40 con 0x55615caa3490 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.964+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55615ce81bb0 con 0x55615caab670 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.965+0000 7fac195ea640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce7f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.965+0000 7fac19deb640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce7f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.967+0000 7fac19deb640 1 -- 172.21.15.37:0/293212945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 msgr2=0x55615ce7f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.967+0000 7fac19deb640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce7f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.967+0000 7fac19deb640 1 -- 172.21.15.37:0/293212945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 msgr2=0x55615ce8af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.967+0000 7fac19deb640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 0x55615ce8af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.967+0000 7fac19deb640 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55615ce8b4c0 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.967+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 0x55615ce8af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.969+0000 7fac225c3740 10 client.0 _ll_register_callbacks cb 0x55615cdd7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.969+0000 7fac19deb640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce7f020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac0c004a80 tx=0x7fac0c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78bcfcab9bee902a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.969+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac04040070 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.969+0000 7fabfd7fa640 10 client.25982 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.970+0000 7fabfd7fa640 1 -- 172.21.15.37:0/293212945 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c02b060 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.970+0000 7fabfd7fa640 1 -- 172.21.15.37:0/293212945 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fac0c015030 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.971+0000 7fabfd7fa640 1 -- 172.21.15.37:0/293212945 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fac0c01bca0 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.977+0000 7fac225c3740 10 client.25982 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.977+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55615ce8dc70 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.980+0000 7fabfd7fa640 1 -- 172.21.15.37:0/293212945 <== mon.2 v2:172.21.15.137:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fac0c00b040 con 0x55615caa3490 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.980+0000 7fac225c3740 10 client.25982 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.980+0000 7fac225c3740 10 client.25982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.981+0000 7fac225c3740 20 client.25982 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.981+0000 7fac225c3740 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615ca8acd0 0x55615ce910a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.981+0000 7fac225c3740 4 client.25982 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.981+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fac04040070 con 0x55615ca8acd0 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.982+0000 7fac195ea640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615ca8acd0 0x55615ce910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.984+0000 7fac195ea640 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615ca8acd0 0x55615ce910a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5516f495580330c server_cookie=7b8485db84cfcae4 in_seq=0 out_seq=0 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.984+0000 7fabfd7fa640 10 client.25982 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.988+0000 7fabfd7fa640 1 -- 172.21.15.37:0/293212945 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fac04040070 con 0x55615ca8acd0 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.988+0000 7fabfd7fa640 10 client.25982 handle_command_reply: tid=0 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.988+0000 7fac225c3740 1 client.25982 shutdown 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.992+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 msgr2=0x55615ce7f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.992+0000 7fac225c3740 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce7f020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fac0c004a80 tx=0x7fac0c004ab0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 shutdown_connections 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fac225c3740 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615ca8acd0 0x55615ce910a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fac225c3740 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615cacc350 0x55615ce8af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fabfd7fa640 0 client.25982 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fac225c3740 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce7f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fac225c3740 1 --2- 172.21.15.37:0/293212945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce7f020 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.993+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 >> 172.21.15.37:0/293212945 conn(0x55615cac0740 msgr2=0x55615ce765c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.994+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 shutdown_connections 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.994+0000 7fac225c3740 1 -- 172.21.15.37:0/293212945 wait complete. 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:26.994+0000 7fac225c3740 20 client.25982 trim_cache size 0 max 16384 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.036+0000 7fac225c3740 1 Processor -- start 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.036+0000 7fac225c3740 1 -- start start 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.037+0000 7fac225c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615ca8acd0 0x55615ce76c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.037+0000 7fac225c3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caa3490 0x55615ce8ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.037+0000 7fac225c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caab670 0x55615ce70c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac19deb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615ca8acd0 0x55615ce76c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac19deb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615ca8acd0 0x55615ce76c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60752/0 (socket says 172.21.15.37:60752) 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac19deb640 1 -- 172.21.15.37:0/1762432766 learned_addr learned my addr 172.21.15.37:0/1762432766 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800e550 con 0x55615caab670 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabf8010090 con 0x55615ca8acd0 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800ec20 con 0x55615caa3490 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.038+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caab670 0x55615ce70c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.039+0000 7fac195ea640 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caa3490 0x55615ce8ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.040+0000 7fac1a5ec640 1 -- 172.21.15.37:0/1762432766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caa3490 msgr2=0x55615ce8ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.040+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caa3490 0x55615ce8ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.040+0000 7fac1a5ec640 1 -- 172.21.15.37:0/1762432766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615ca8acd0 msgr2=0x55615ce76c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.040+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615ca8acd0 0x55615ce76c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.040+0000 7fac1a5ec640 1 -- 172.21.15.37:0/1762432766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615ce75720 con 0x55615caab670 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.042+0000 7fac1a5ec640 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caab670 0x55615ce70c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fac04006010 tx=0x7fac04030360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd8e8b24bc75bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.048+0000 7fabff7fe640 1 -- 172.21.15.37:0/1762432766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04048070 con 0x55615caab670 2024-09-21T01:22:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.048+0000 7fabff7fe640 1 -- 172.21.15.37:0/1762432766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac04040050 con 0x55615caab670 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.048+0000 7fabff7fe640 1 -- 172.21.15.37:0/1762432766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04037040 con 0x55615caab670 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.054+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caab670 msgr2=0x55615ce70c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.054+0000 7fac225c3740 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caab670 0x55615ce70c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fac04006010 tx=0x7fac04030360 comp rx=0 tx=0).stop 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.060+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 shutdown_connections 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.060+0000 7fac225c3740 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615caab670 0x55615ce70c80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.060+0000 7fac225c3740 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caa3490 0x55615ce8ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.060+0000 7fac225c3740 1 --2- 172.21.15.37:0/1762432766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615ca8acd0 0x55615ce76c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.060+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 >> 172.21.15.37:0/1762432766 conn(0x55615cac0740 msgr2=0x55615ce76530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.072+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 shutdown_connections 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.072+0000 7fac225c3740 1 -- 172.21.15.37:0/1762432766 wait complete. 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.074+0000 7fac225c3740 1 -- start start 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.074+0000 7fac225c3740 1 Processor -- start 2024-09-21T01:22:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.076+0000 7fac225c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 0x55615ce87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.076+0000 7fac225c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce83d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.077+0000 7fac225c3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce84420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.077+0000 7fac225c3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800f9c0 con 0x55615ca8acd0 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.077+0000 7fac225c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800f2f0 con 0x55615caa3490 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.077+0000 7fac225c3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabf800c510 con 0x55615caab670 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.077+0000 7fac225c3740 10 client.0 _ll_register_callbacks cb 0x7fac0c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.078+0000 7fac195ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce83d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.078+0000 7fac19deb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 0x55615ce87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.079+0000 7fac1a5ec640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce84420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.079+0000 7fac19deb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 0x55615ce87850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43292/0 (socket says 172.21.15.37:43292) 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.079+0000 7fac19deb640 1 -- 172.21.15.37:0/3053035854 learned_addr learned my addr 172.21.15.37:0/3053035854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.081+0000 7fac19deb640 1 -- 172.21.15.37:0/3053035854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 msgr2=0x55615ce84420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.081+0000 7fac19deb640 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce84420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.081+0000 7fac19deb640 1 -- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 msgr2=0x55615ce83d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.081+0000 7fac19deb640 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce83d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.081+0000 7fac19deb640 1 -- 172.21.15.37:0/3053035854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55615cefbab0 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.081+0000 7fac19deb640 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 0x55615ce87850 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009840 tx=0x7fac0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca8b7327e8627ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.082+0000 7fabfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.083+0000 7fabfd7fa640 1 -- 172.21.15.37:0/3053035854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c02b040 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.083+0000 7fabfd7fa640 1 -- 172.21.15.37:0/3053035854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fac0c004a40 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.085+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac04040050 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.096+0000 7fabfd7fa640 1 -- 172.21.15.37:0/3053035854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fac0c03f050 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.096+0000 7fac225c3740 10 client.16542 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.097+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55615cefcc40 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.103+0000 7fabfd7fa640 1 -- 172.21.15.37:0/3053035854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac0c0198c0 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.103+0000 7fabfd7fa640 1 -- 172.21.15.37:0/3053035854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fac0c00b040 con 0x55615ca8acd0 2024-09-21T01:22:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.106+0000 7fac225c3740 10 client.16542 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.106+0000 7fac225c3740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.106+0000 7fac225c3740 20 client.16542 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.106+0000 7fac225c3740 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615cacc350 0x55615ceff400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.106+0000 7fac225c3740 4 client.16542 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.106+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fac04040050 con 0x55615cacc350 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.108+0000 7fac195ea640 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615cacc350 0x55615ceff400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.114+0000 7fac195ea640 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615cacc350 0x55615ceff400 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f40b15e839e700 server_cookie=8c4d43d3980d3118 in_seq=0 out_seq=0 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.115+0000 7fabfd7fa640 10 client.16542 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.490+0000 7fabfd7fa640 1 -- 172.21.15.37:0/3053035854 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fac04040050 con 0x55615cacc350 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.490+0000 7fabfd7fa640 10 client.16542 handle_command_reply: tid=0 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.490+0000 7fac225c3740 1 client.16542 shutdown 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.491+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 msgr2=0x55615ce87850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.491+0000 7fac225c3740 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 0x55615ce87850 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009840 tx=0x7fac0c016000 comp rx=0 tx=0).stop 2024-09-21T01:22:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 shutdown_connections 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55615cacc350 0x55615ceff400 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fabfd7fa640 0 client.16542 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55615caab670 0x55615ce84420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55615caa3490 0x55615ce83d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 --2- 172.21.15.37:0/3053035854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55615ca8acd0 0x55615ce87850 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 >> 172.21.15.37:0/3053035854 conn(0x55615cac0740 msgr2=0x55615ce70c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 shutdown_connections 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.492+0000 7fac225c3740 1 -- 172.21.15.37:0/3053035854 wait complete. 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.493+0000 7fac225c3740 20 client.16542 trim_cache size 0 max 16384 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fac000b6690 msgr2=0x7fac000b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fac000b6690 0x7fac000b8ba0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55615ce720b0 tx=0x7fac0c009c40 comp rx=0 tx=0).stop 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1410b6f0 msgr2=0x7fac14110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1410b6f0 0x7fac14110160 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac1406c6e0 tx=0x7fac1000dbb0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 shutdown_connections 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fac000b6690 0x7fac000b8ba0 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55615ce720b0 tx=0x7fac0c009c40 comp rx=0 tx=0).stop 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac1410c040 0x7fac141106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1410b6f0 0x7fac14110160 secure :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fac1406c6e0 tx=0x7fac1000dbb0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 --2- 172.21.15.37:0/3787574194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac14105db0 0x7fac1410fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.497+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 >> 172.21.15.37:0/3787574194 conn(0x7fac141017c0 msgr2=0x7fac14108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.498+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 shutdown_connections 2024-09-21T01:22:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:27.498+0000 7fac1c04f640 1 -- 172.21.15.37:0/3787574194 wait complete. 2024-09-21T01:22:28.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:22:28.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:22:28.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:22:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:22:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:22:28.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:22:28.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:22:28.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:22:28.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:22:29.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:29 smithi037 ceph-mon[31105]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 821 MiB/s wr, 1.61k op/s 2024-09-21T01:22:29.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:29 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:22:29.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:29 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:29.253 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:29 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:22:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:29 smithi137 ceph-mon[34607]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 821 MiB/s wr, 1.61k op/s 2024-09-21T01:22:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:29 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:22:29.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:29 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:29.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:29 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:22:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:29 smithi144 ceph-mon[34818]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 821 MiB/s wr, 1.61k op/s 2024-09-21T01:22:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:29 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:22:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:29 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:29 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:22:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:30 smithi137 ceph-mon[34607]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 902 MiB/s wr, 1.80k op/s 2024-09-21T01:22:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:30 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:22:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:30 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:30 smithi144 ceph-mon[34818]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 902 MiB/s wr, 1.80k op/s 2024-09-21T01:22:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:30 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:22:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:30 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:30.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:30 smithi037 ceph-mon[31105]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 902 MiB/s wr, 1.80k op/s 2024-09-21T01:22:30.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:30 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:22:30.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:30 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:30.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:22:31.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:31 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/1544019670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea0103fc0 msgr2=0x7f0ea010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/1544019670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea0103fc0 0x7f0ea010a960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009910 tx=0x7f0e9802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/1544019670 shutdown_connections 2024-09-21T01:22:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/1544019670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea0103fc0 0x7f0ea010a960 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/1544019670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea0103620 0x7f0ea0103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/1544019670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea01025a0 0x7f0ea0102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/1544019670 >> 172.21.15.37:0/1544019670 conn(0x7f0ea00fdee0 msgr2=0x7f0ea0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/1544019670 shutdown_connections 2024-09-21T01:22:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.398+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/1544019670 wait complete. 2024-09-21T01:22:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.399+0000 7f0ea4c7e640 1 Processor -- start 2024-09-21T01:22:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.399+0000 7f0ea4c7e640 1 -- start start 2024-09-21T01:22:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.400+0000 7f0ea4c7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 0x7f0ea019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.400+0000 7f0ea4c7e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea0103620 0x7f0ea019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.400+0000 7f0ea4c7e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea0103fc0 0x7f0ea019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.400+0000 7f0ea4c7e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea010e250 con 0x7f0ea01025a0 2024-09-21T01:22:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.400+0000 7f0ea4c7e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea010e0d0 con 0x7f0ea0103fc0 2024-09-21T01:22:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.400+0000 7f0ea4c7e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea010e3d0 con 0x7f0ea0103620 2024-09-21T01:22:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 0x7f0ea019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 0x7f0ea019c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43308/0 (socket says 172.21.15.37:43308) 2024-09-21T01:22:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 -- 172.21.15.37:0/865327885 learned_addr learned my addr 172.21.15.37:0/865327885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9ed9d640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea0103fc0 0x7f0ea019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 -- 172.21.15.37:0/865327885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea0103620 msgr2=0x7f0ea019c870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea0103620 0x7f0ea019c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 -- 172.21.15.37:0/865327885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea0103fc0 msgr2=0x7f0ea019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea0103fc0 0x7f0ea019d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.401+0000 7f0e9e59c640 1 -- 172.21.15.37:0/865327885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea019dbd0 con 0x7f0ea01025a0 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.402+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 0x7f0ea019c200 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000cce0 tx=0x7f0e9000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.402+0000 7f0e8f7fe640 1 -- 172.21.15.37:0/865327885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90004b20 con 0x7f0ea01025a0 2024-09-21T01:22:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.402+0000 7f0e8f7fe640 1 -- 172.21.15.37:0/865327885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e90004cc0 con 0x7f0ea01025a0 2024-09-21T01:22:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.402+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea019dec0 con 0x7f0ea01025a0 2024-09-21T01:22:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.402+0000 7f0e8f7fe640 1 -- 172.21.15.37:0/865327885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000f6b0 con 0x7f0ea01025a0 2024-09-21T01:22:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.402+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea01a45b0 con 0x7f0ea01025a0 2024-09-21T01:22:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.410+0000 7f0e8f7fe640 1 -- 172.21.15.37:0/865327885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0e9000f850 con 0x7f0ea01025a0 2024-09-21T01:22:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.411+0000 7f0e8f7fe640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e880b6590 0x7f0e880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.412+0000 7f0e8f7fe640 1 -- 172.21.15.37:0/865327885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0e900e8270 con 0x7f0ea01025a0 2024-09-21T01:22:31.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:31 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:31.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:31 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:22:31.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.412+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e880b6590 0x7f0e880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.423+0000 7f0eabbe3740 1 Processor -- start 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 -- start start 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e880b6590 0x7f0e880b8aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0e940096b0 tx=0x7f0e94006c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794daf81b0 0x55794de9fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794dacf2f0 0x55794dea04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794dea1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55794de126f0 con 0x55794daf81b0 2024-09-21T01:22:31.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55794de01b20 con 0x55794dad74d0 2024-09-21T01:22:31.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.424+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55794de05930 con 0x55794dacf2f0 2024-09-21T01:22:31.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.425+0000 7f0e9e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794daf81b0 0x55794de9fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.425+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794dea1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.425+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794dea1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60778/0 (socket says 172.21.15.37:60778) 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.425+0000 7f0e9ed9d640 1 -- 172.21.15.37:0/797201740 learned_addr learned my addr 172.21.15.37:0/797201740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.425+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794dacf2f0 0x55794dea04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.426+0000 7f0e9ed9d640 1 -- 172.21.15.37:0/797201740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794dacf2f0 msgr2=0x55794dea04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.426+0000 7f0e9ed9d640 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794dacf2f0 0x55794dea04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.426+0000 7f0e9ed9d640 1 -- 172.21.15.37:0/797201740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794daf81b0 msgr2=0x55794de9fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.426+0000 7f0e9ed9d640 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794daf81b0 0x55794de9fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.426+0000 7f0e9ed9d640 1 -- 172.21.15.37:0/797201740 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794ddc7530 con 0x55794dad74d0 2024-09-21T01:22:31.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.426+0000 7f0e9ed9d640 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794dea1010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e980098e0 tx=0x7f0e98031eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9725715fda12ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:31.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.427+0000 7f0e8cff9640 1 -- 172.21.15.37:0/797201740 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98041030 con 0x55794dad74d0 2024-09-21T01:22:31.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.427+0000 7f0e8cff9640 1 -- 172.21.15.37:0/797201740 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e98004450 con 0x55794dad74d0 2024-09-21T01:22:31.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.428+0000 7f0eabbe3740 1 -- 172.21.15.37:0/797201740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 msgr2=0x55794dea1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:31.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.429+0000 7f0e8cff9640 1 -- 172.21.15.37:0/797201740 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e98036040 con 0x55794dad74d0 2024-09-21T01:22:31.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.429+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794dea1010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e980098e0 tx=0x7f0e98031eb0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.430+0000 7f0eabbe3740 1 -- 172.21.15.37:0/797201740 shutdown_connections 2024-09-21T01:22:31.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.430+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794dea1010 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.430+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794dacf2f0 0x55794dea04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.430+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/797201740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794daf81b0 0x55794de9fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.430+0000 7f0eabbe3740 1 -- 172.21.15.37:0/797201740 >> 172.21.15.37:0/797201740 conn(0x55794daec300 msgr2=0x55794de9b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:31.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.431+0000 7f0eabbe3740 1 -- 172.21.15.37:0/797201740 shutdown_connections 2024-09-21T01:22:31.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.432+0000 7f0eabbe3740 1 -- 172.21.15.37:0/797201740 wait complete. 2024-09-21T01:22:31.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.433+0000 7f0eabbe3740 1 -- start start 2024-09-21T01:22:31.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.433+0000 7f0eabbe3740 1 Processor -- start 2024-09-21T01:22:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dacf2f0 0x55794dea9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 0x55794dea9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55794dd39ab0 con 0x55794dad74d0 2024-09-21T01:22:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55794dda7730 con 0x55794dacf2f0 2024-09-21T01:22:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55794dea1b70 con 0x55794daf81b0 2024-09-21T01:22:31.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0eabbe3740 10 client.0 _ll_register_callbacks cb 0x55794ddfb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0e9dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 0x55794dea9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0e9dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 0x55794dea9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43338/0 (socket says 172.21.15.37:43338) 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2353492752 learned_addr learned my addr 172.21.15.37:0/2353492752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.436+0000 7f0e9ed9d640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dacf2f0 0x55794dea9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2353492752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 msgr2=0x55794deaa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dacf2f0 msgr2=0x55794dea9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dacf2f0 0x55794dea9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2353492752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794db63790 con 0x55794dad74d0 2024-09-21T01:22:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.437+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 0x55794dea9c50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400b6e0 tx=0x7f0e940047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab36d8ca8ecd06d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.438+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2353492752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9401e7e0 con 0x55794dad74d0 2024-09-21T01:22:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.439+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2353492752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0e9401e5e0 con 0x55794dad74d0 2024-09-21T01:22:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.439+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e98004450 con 0x55794dad74d0 2024-09-21T01:22:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.439+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2353492752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0e9401e7e0 con 0x55794dad74d0 2024-09-21T01:22:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.439+0000 7f0eabbe3740 10 client.16554 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.439+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55794dbdc620 con 0x55794dad74d0 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.439+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2353492752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e98004450 con 0x55794dad74d0 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2353492752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0e94012070 con 0x55794dad74d0 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0eabbe3740 10 client.16554 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0eabbe3740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0eabbe3740 20 client.16554 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794dab6d80 0x55794debf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0eabbe3740 4 client.16554 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.440+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55794de14640 con 0x55794dab6d80 2024-09-21T01:22:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.441+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794dab6d80 0x55794debf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.444+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794dab6d80 0x55794debf5e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d18a41d851cf5b6 server_cookie=5fc73c0aa3526506 in_seq=0 out_seq=0 2024-09-21T01:22:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.444+0000 7f0e85ffb640 10 client.16554 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.448+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2353492752 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55794de14640 con 0x55794dab6d80 2024-09-21T01:22:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0e85ffb640 10 client.16554 handle_command_reply: tid=0 2024-09-21T01:22:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 client.16554 shutdown 2024-09-21T01:22:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 msgr2=0x55794dea9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 0x55794dea9c50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400b6e0 tx=0x7f0e940047d0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 shutdown_connections 2024-09-21T01:22:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794dab6d80 0x55794debf5e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dad74d0 0x55794dea9c50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2353492752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dacf2f0 0x55794dea9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 >> 172.21.15.37:0/2353492752 conn(0x55794daec300 msgr2=0x55794de99ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0e85ffb640 0 client.16554 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 shutdown_connections 2024-09-21T01:22:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2353492752 wait complete. 2024-09-21T01:22:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.449+0000 7f0eabbe3740 20 client.16554 trim_cache size 0 max 16384 2024-09-21T01:22:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.517+0000 7f0eabbe3740 1 Processor -- start 2024-09-21T01:22:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.517+0000 7f0eabbe3740 1 -- start start 2024-09-21T01:22:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.517+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794dea0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.517+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794de9c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.518+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794de9c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.518+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01a9020 con 0x55794dacf2f0 2024-09-21T01:22:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.518+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01aab60 con 0x55794dad74d0 2024-09-21T01:22:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.518+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01a96f0 con 0x55794daf81b0 2024-09-21T01:22:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.520+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794de9c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.520+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794de9c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51636/0 (socket says 172.21.15.37:51636) 2024-09-21T01:22:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.520+0000 7f0e9ed9d640 1 -- 172.21.15.37:0/1915167718 learned_addr learned my addr 172.21.15.37:0/1915167718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.521+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794de9c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.522+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/1915167718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 msgr2=0x55794de9c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.522+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794de9c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.522+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/1915167718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 msgr2=0x55794dea0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.522+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794dea0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.522+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/1915167718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794debbe60 con 0x55794dad74d0 2024-09-21T01:22:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.527+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794de9c230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e94011df0 tx=0x7f0e94006c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87cd64f45c0a615f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.536+0000 7f0e87fff640 1 -- 172.21.15.37:0/1915167718 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94037070 con 0x55794dad74d0 2024-09-21T01:22:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.536+0000 7f0e87fff640 1 -- 172.21.15.37:0/1915167718 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e94024070 con 0x55794dad74d0 2024-09-21T01:22:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.536+0000 7f0e87fff640 1 -- 172.21.15.37:0/1915167718 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9401e7e0 con 0x55794dad74d0 2024-09-21T01:22:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.538+0000 7f0eabbe3740 1 -- 172.21.15.37:0/1915167718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 msgr2=0x55794de9c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.538+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794de9c230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e94011df0 tx=0x7f0e94006c90 comp rx=0 tx=0).stop 2024-09-21T01:22:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.540+0000 7f0eabbe3740 1 -- 172.21.15.37:0/1915167718 shutdown_connections 2024-09-21T01:22:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.540+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794de9c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.540+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794de9c230 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.540+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/1915167718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794dea0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.540+0000 7f0eabbe3740 1 -- 172.21.15.37:0/1915167718 >> 172.21.15.37:0/1915167718 conn(0x55794daec300 msgr2=0x55794de9b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:31.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.547+0000 7f0eabbe3740 1 -- 172.21.15.37:0/1915167718 shutdown_connections 2024-09-21T01:22:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.554+0000 7f0eabbe3740 1 -- 172.21.15.37:0/1915167718 wait complete. 2024-09-21T01:22:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.555+0000 7f0eabbe3740 1 -- start start 2024-09-21T01:22:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.555+0000 7f0eabbe3740 1 Processor -- start 2024-09-21T01:22:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794deae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794deaec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01aa490 con 0x55794dacf2f0 2024-09-21T01:22:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01a9dc0 con 0x55794dad74d0 2024-09-21T01:22:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea01a6fa0 con 0x55794daf81b0 2024-09-21T01:22:31.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.556+0000 7f0eabbe3740 10 client.0 _ll_register_callbacks cb 0x7f0e94013490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.560+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.560+0000 7f0e9dd9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794deaec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.562+0000 7f0e9dd9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794deaec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60802/0 (socket says 172.21.15.37:60802) 2024-09-21T01:22:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.562+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2899318911 learned_addr learned my addr 172.21.15.37:0/2899318911 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.563+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794deae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.563+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2899318911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 msgr2=0x55794deaf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.564+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.564+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2899318911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 msgr2=0x55794deae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.564+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794deae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.564+0000 7f0e9dd9b640 1 -- 172.21.15.37:0/2899318911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794deafed0 con 0x55794dad74d0 2024-09-21T01:22:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.564+0000 7f0e9dd9b640 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794deaec70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400c010 tx=0x7f0e940117e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dfad82c67239f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.565+0000 7f0e85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:22:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.565+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2899318911 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94040060 con 0x55794dad74d0 2024-09-21T01:22:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.565+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e94024070 con 0x55794dad74d0 2024-09-21T01:22:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.565+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2899318911 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0e94028a00 con 0x55794dad74d0 2024-09-21T01:22:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.566+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2899318911 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0e94037050 con 0x55794dad74d0 2024-09-21T01:22:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.566+0000 7f0eabbe3740 10 client.26003 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.566+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55794deb11c0 con 0x55794dad74d0 2024-09-21T01:22:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.580+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2899318911 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e94024070 con 0x55794dad74d0 2024-09-21T01:22:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2899318911 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0e94045070 con 0x55794dad74d0 2024-09-21T01:22:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0eabbe3740 10 client.26003 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0eabbe3740 10 client.26003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0eabbe3740 20 client.26003 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794da8c1c0 0x55794df2c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0eabbe3740 4 client.26003 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:22:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.582+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55794de100f0 con 0x55794da8c1c0 2024-09-21T01:22:31.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.585+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794da8c1c0 0x55794df2c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.605+0000 7f0e9e59c640 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794da8c1c0 0x55794df2c350 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6274346dec6cdd62 server_cookie=a1e4803839ac6b70 in_seq=0 out_seq=0 2024-09-21T01:22:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:31.606+0000 7f0e85ffb640 10 client.26003 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:31.928 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:22:32.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:32 smithi137 ceph-mon[34607]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 846 MiB/s wr, 1.88k op/s 2024-09-21T01:22:32.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:32 smithi144 ceph-mon[34818]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 846 MiB/s wr, 1.88k op/s 2024-09-21T01:22:32.511 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:32 smithi037 ceph-mon[31105]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 846 MiB/s wr, 1.88k op/s 2024-09-21T01:22:33.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.513+0000 7f9eccefd640 1 -- 172.21.15.37:0/49223323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec8111f40 msgr2=0x7f9ec810a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.513+0000 7f9eccefd640 1 --2- 172.21.15.37:0/49223323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec8111f40 0x7f9ec810a3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009900 tx=0x7f9ec002a400 comp rx=0 tx=0).stop 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.517+0000 7f9eccefd640 1 -- 172.21.15.37:0/49223323 shutdown_connections 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.517+0000 7f9eccefd640 1 --2- 172.21.15.37:0/49223323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec811cc30 0x7f9ec811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.517+0000 7f9eccefd640 1 --2- 172.21.15.37:0/49223323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec810a9e0 0x7f9ec810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.517+0000 7f9eccefd640 1 --2- 172.21.15.37:0/49223323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec8111f40 0x7f9ec810a3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.517+0000 7f9eccefd640 1 -- 172.21.15.37:0/49223323 >> 172.21.15.37:0/49223323 conn(0x7f9ec8070ec0 msgr2=0x7f9ec80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.523+0000 7f9eccefd640 1 -- 172.21.15.37:0/49223323 shutdown_connections 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.523+0000 7f9eccefd640 1 -- 172.21.15.37:0/49223323 wait complete. 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.526+0000 7f9eccefd640 1 Processor -- start 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.527+0000 7f9eccefd640 1 -- start start 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.528+0000 7f9eccefd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec810a9e0 0x7f9ec81a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.528+0000 7f9eccefd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec8111f40 0x7f9ec81a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.528+0000 7f9eccefd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 0x7f9ec81aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.529+0000 7f9eccefd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8122900 con 0x7f9ec8111f40 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.529+0000 7f9eccefd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8122780 con 0x7f9ec811cc30 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.529+0000 7f9eccefd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8122a80 con 0x7f9ec810a9e0 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.530+0000 7f9ec6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 0x7f9ec81aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.530+0000 7f9ec6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 0x7f9ec81aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60816/0 (socket says 172.21.15.37:60816) 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.530+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2794505995 learned_addr learned my addr 172.21.15.37:0/2794505995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.530+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec8111f40 0x7f9ec81a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.532+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2794505995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec810a9e0 msgr2=0x7f9ec81a92d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.532+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec810a9e0 0x7f9ec81a92d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.532+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec8111f40 msgr2=0x7f9ec81a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.532+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec8111f40 0x7f9ec81a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.532+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2794505995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec81af240 con 0x7f9ec811cc30 2024-09-21T01:22:33.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.533+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 0x7f9ec81aeb10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800eb10 tx=0x7f9eb800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.533+0000 7f9ebf7fe640 1 -- 172.21.15.37:0/2794505995 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8004b20 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.533+0000 7f9ebf7fe640 1 -- 172.21.15.37:0/2794505995 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb8004cc0 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.534+0000 7f9ebf7fe640 1 -- 172.21.15.37:0/2794505995 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8010720 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.534+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec81af530 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.534+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec81b5c90 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.546+0000 7f9ed3471740 1 Processor -- start 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.549+0000 7f9ebf7fe640 1 -- 172.21.15.37:0/2794505995 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9eb8005020 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.552+0000 7f9ebf7fe640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9eb40b6640 0x7f9eb40b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.553+0000 7f9ebf7fe640 1 -- 172.21.15.37:0/2794505995 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9eb80e7b10 con 0x7f9ec811cc30 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.554+0000 7f9ed3471740 1 -- start start 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef3688c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364bc1b0 0x55ef3688cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3688d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ed3471740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef36802e50 con 0x55ef364c4390 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ed3471740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ef367f2280 con 0x55ef364e5070 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ed3471740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ef367f6090 con 0x55ef364bc1b0 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.555+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9eb40b6640 0x7f9eb40b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.558+0000 7f9ec659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef3688c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.558+0000 7f9ec659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef3688c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60820/0 (socket says 172.21.15.37:60820) 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.558+0000 7f9ec659c640 1 -- 172.21.15.37:0/2123294051 learned_addr learned my addr 172.21.15.37:0/2123294051 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.558+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3688d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.558+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364bc1b0 0x55ef3688cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.561+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2123294051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364bc1b0 msgr2=0x55ef3688cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.561+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364bc1b0 0x55ef3688cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.561+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2123294051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 msgr2=0x55ef3688c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.561+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef3688c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.561+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/2123294051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef36550650 con 0x55ef364c4390 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.563+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3688d0d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80e55d0 tx=0x7f9eb80a9c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfad11ba381d0556 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.563+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9eb40b6640 0x7f9eb40b8b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9ec811c300 tx=0x7f9eb0015850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.564+0000 7f9ebcff9640 1 -- 172.21.15.37:0/2123294051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80ad770 con 0x55ef364c4390 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.565+0000 7f9ebcff9640 1 -- 172.21.15.37:0/2123294051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb80ae360 con 0x55ef364c4390 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.565+0000 7f9ebcff9640 1 -- 172.21.15.37:0/2123294051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80b21c0 con 0x55ef364c4390 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.568+0000 7f9ed3471740 1 -- 172.21.15.37:0/2123294051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 msgr2=0x55ef3688d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.568+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3688d0d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80e55d0 tx=0x7f9eb80a9c20 comp rx=0 tx=0).stop 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.569+0000 7f9ed3471740 1 -- 172.21.15.37:0/2123294051 shutdown_connections 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.569+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3688d0d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.569+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364bc1b0 0x55ef3688cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.569+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2123294051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef3688c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.569+0000 7f9ed3471740 1 -- 172.21.15.37:0/2123294051 >> 172.21.15.37:0/2123294051 conn(0x55ef364d9460 msgr2=0x55ef3688a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.580+0000 7f9ed3471740 1 -- 172.21.15.37:0/2123294051 shutdown_connections 2024-09-21T01:22:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.581+0000 7f9ed3471740 1 -- 172.21.15.37:0/2123294051 wait complete. 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.582+0000 7f9ed3471740 1 -- start start 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.582+0000 7f9ed3471740 1 Processor -- start 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36897d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 0x55ef368982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef368a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef36653700 con 0x55ef364bc1b0 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ef3678d110 con 0x55ef364e5070 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ef3689ae30 con 0x55ef364c4390 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.583+0000 7f9ed3471740 10 client.0 _ll_register_callbacks cb 0x55ef367a6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.584+0000 7f9ec5d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 0x55ef368982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.584+0000 7f9ec5d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 0x55ef368982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:51696/0 (socket says 172.21.15.37:51696) 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.584+0000 7f9ec5d9b640 1 -- 172.21.15.37:0/2119610128 learned_addr learned my addr 172.21.15.37:0/2119610128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef368a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec5d9b640 1 -- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 msgr2=0x55ef368a4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef368a4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec5d9b640 1 -- 172.21.15.37:0/2119610128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 msgr2=0x55ef36897d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36897d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec5d9b640 1 -- 172.21.15.37:0/2119610128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef367bac40 con 0x55ef364c4390 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.586+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef368a4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.592+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 0x55ef368982a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009740 tx=0x7f9eb0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad4de31ef3c9019 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.592+0000 7f9eadffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.592+0000 7f9eadffb640 1 -- 172.21.15.37:0/2119610128 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0004220 con 0x55ef364c4390 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.593+0000 7f9eadffb640 1 -- 172.21.15.37:0/2119610128 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9eb00043c0 con 0x55ef364c4390 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.593+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb80ae360 con 0x55ef364c4390 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.593+0000 7f9eadffb640 1 -- 172.21.15.37:0/2119610128 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9eb000f720 con 0x55ef364c4390 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.593+0000 7f9ed3471740 10 client.25987 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.593+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef368a6c00 con 0x55ef364c4390 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9eadffb640 1 -- 172.21.15.37:0/2119610128 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb80ae360 con 0x55ef364c4390 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9eadffb640 1 -- 172.21.15.37:0/2119610128 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb001f070 con 0x55ef364c4390 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9ed3471740 10 client.25987 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9ed3471740 10 client.25987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9ed3471740 20 client.25987 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364a39f0 0x55ef368aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9ed3471740 4 client.25987 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.594+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef36804da0 con 0x55ef364a39f0 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.597+0000 7f9ec659c640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364a39f0 0x55ef368aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.607+0000 7f9ec659c640 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364a39f0 0x55ef368aa150 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53eac04ae243535b server_cookie=e9c505d964f5bf4c in_seq=0 out_seq=0 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.607+0000 7f9eadffb640 10 client.25987 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.613+0000 7f9eadffb640 1 -- 172.21.15.37:0/2119610128 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef36804da0 con 0x55ef364a39f0 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.613+0000 7f9eadffb640 10 client.25987 handle_command_reply: tid=0 2024-09-21T01:22:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.613+0000 7f9ed3471740 1 client.25987 shutdown 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.618+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 msgr2=0x55ef368982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.618+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 0x55ef368982a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009740 tx=0x7f9eb0004730 comp rx=0 tx=0).stop 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 shutdown_connections 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364a39f0 0x55ef368aa150 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364e5070 0x55ef368a4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364c4390 0x55ef368982a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 --2- 172.21.15.37:0/2119610128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36897d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 >> 172.21.15.37:0/2119610128 conn(0x55ef364d9460 msgr2=0x55ef3688f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9eadffb640 0 client.25987 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.628+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 shutdown_connections 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.630+0000 7f9ed3471740 1 -- 172.21.15.37:0/2119610128 wait complete. 2024-09-21T01:22:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.631+0000 7f9ed3471740 20 client.25987 trim_cache size 0 max 16384 2024-09-21T01:22:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.684+0000 7f9ed3471740 1 Processor -- start 2024-09-21T01:22:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.684+0000 7f9ed3471740 1 -- start start 2024-09-21T01:22:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.685+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3688dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.685+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36894f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.685+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 0x55ef36895490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.685+0000 7f9ed3471740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81be320 con 0x55ef364bc1b0 2024-09-21T01:22:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.686+0000 7f9ed3471740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81bfe60 con 0x55ef364c4390 2024-09-21T01:22:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.686+0000 7f9ed3471740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81be9f0 con 0x55ef364d9460 2024-09-21T01:22:33.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.687+0000 7f9ec6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 0x55ef36895490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.687+0000 7f9ec6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 0x55ef36895490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60832/0 (socket says 172.21.15.37:60832) 2024-09-21T01:22:33.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.687+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/3067636702 learned_addr learned my addr 172.21.15.37:0/3067636702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/3067636702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 msgr2=0x55ef3688dd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3688dd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/3067636702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 msgr2=0x55ef36894f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36894f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36894f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/3067636702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef3688aeb0 con 0x55ef364c4390 2024-09-21T01:22:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.691+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36894f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:22:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.697+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 0x55ef36895490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80aaed0 tx=0x7f9eb80ad6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907d5c81ea95a355 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.700+0000 7f9eaffff640 1 -- 172.21.15.37:0/3067636702 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80b2740 con 0x55ef364c4390 2024-09-21T01:22:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.700+0000 7f9eaffff640 1 -- 172.21.15.37:0/3067636702 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb80b7680 con 0x55ef364c4390 2024-09-21T01:22:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.702+0000 7f9ed3471740 1 -- 172.21.15.37:0/3067636702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 msgr2=0x55ef36895490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.702+0000 7f9ed3471740 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 0x55ef36895490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80aaed0 tx=0x7f9eb80ad6b0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 -- 172.21.15.37:0/3067636702 shutdown_connections 2024-09-21T01:22:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364c4390 0x55ef36895490 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364bc1b0 0x55ef36894f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 --2- 172.21.15.37:0/3067636702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3688dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 -- 172.21.15.37:0/3067636702 >> 172.21.15.37:0/3067636702 conn(0x55ef36898420 msgr2=0x55ef3688d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 -- 172.21.15.37:0/3067636702 shutdown_connections 2024-09-21T01:22:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.704+0000 7f9ed3471740 1 -- 172.21.15.37:0/3067636702 wait complete. 2024-09-21T01:22:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.705+0000 7f9ed3471740 1 -- start start 2024-09-21T01:22:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.705+0000 7f9ed3471740 1 Processor -- start 2024-09-21T01:22:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.706+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364bc1b0 0x55ef3689e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.706+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3689e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.707+0000 7f9ed3471740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3689ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.707+0000 7f9ed3471740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81bf790 con 0x55ef364c4390 2024-09-21T01:22:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.707+0000 7f9ed3471740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81bf0c0 con 0x55ef364bc1b0 2024-09-21T01:22:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.707+0000 7f9ed3471740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81bc2e0 con 0x55ef364d9460 2024-09-21T01:22:33.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.708+0000 7f9ed3471740 10 client.0 _ll_register_callbacks cb 0x7f9eb0009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.711+0000 7f9ec659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364bc1b0 0x55ef3689e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.711+0000 7f9ec659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364bc1b0 0x55ef3689e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60848/0 (socket says 172.21.15.37:60848) 2024-09-21T01:22:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.711+0000 7f9ec659c640 1 -- 172.21.15.37:0/650219139 learned_addr learned my addr 172.21.15.37:0/650219139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.711+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3689ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.712+0000 7f9ec5d9b640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3689e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.714+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364bc1b0 msgr2=0x55ef3689e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.714+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364bc1b0 0x55ef3689e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.714+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/650219139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 msgr2=0x55ef3689e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.714+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3689e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.714+0000 7f9ec6d9d640 1 -- 172.21.15.37:0/650219139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef36913ce0 con 0x55ef364d9460 2024-09-21T01:22:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.716+0000 7f9ec6d9d640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3689ec80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80aa230 tx=0x7f9eb80aa380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c324c3a838c2df38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.717+0000 7f9eadffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:22:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.717+0000 7f9eadffb640 1 -- 172.21.15.37:0/650219139 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80d1270 con 0x55ef364d9460 2024-09-21T01:22:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.718+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef36800850 con 0x55ef364d9460 2024-09-21T01:22:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.718+0000 7f9eadffb640 1 -- 172.21.15.37:0/650219139 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9eb80acec0 con 0x55ef364d9460 2024-09-21T01:22:33.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.719+0000 7f9eadffb640 1 -- 172.21.15.37:0/650219139 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9eb80b2740 con 0x55ef364d9460 2024-09-21T01:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.721+0000 7f9ed3471740 10 client.25990 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.721+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef36914f70 con 0x55ef364d9460 2024-09-21T01:22:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9eadffb640 1 -- 172.21.15.37:0/650219139 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ef36800850 con 0x55ef364d9460 2024-09-21T01:22:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9eadffb640 1 -- 172.21.15.37:0/650219139 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb80ac930 con 0x55ef364d9460 2024-09-21T01:22:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9ed3471740 10 client.25990 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9ed3471740 10 client.25990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9ed3471740 20 client.25990 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9ed3471740 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364e5070 0x55ef36917590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.723+0000 7f9ed3471740 4 client.25990 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:22:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.724+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef367fdc80 con 0x55ef364e5070 2024-09-21T01:22:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.725+0000 7f9ec659c640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364e5070 0x55ef36917590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.728+0000 7f9ec659c640 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364e5070 0x55ef36917590 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31a4386e625991a9 server_cookie=cb0005c4b0f89904 in_seq=0 out_seq=0 2024-09-21T01:22:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.728+0000 7f9eadffb640 10 client.25990 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.735+0000 7f9eadffb640 1 -- 172.21.15.37:0/650219139 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55ef367fdc80 con 0x55ef364e5070 2024-09-21T01:22:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.735+0000 7f9eadffb640 10 client.25990 handle_command_reply: tid=0 2024-09-21T01:22:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.735+0000 7f9ed3471740 1 client.25990 shutdown 2024-09-21T01:22:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.735+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 msgr2=0x55ef3689ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.735+0000 7f9ed3471740 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3689ec80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80aa230 tx=0x7f9eb80aa380 comp rx=0 tx=0).stop 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 shutdown_connections 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55ef364e5070 0x55ef36917590 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef364d9460 0x55ef3689ec80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef364c4390 0x55ef3689e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 --2- 172.21.15.37:0/650219139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef364bc1b0 0x55ef3689e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 >> 172.21.15.37:0/650219139 conn(0x55ef36898420 msgr2=0x55ef3688e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9eadffb640 0 client.25990 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.738+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 shutdown_connections 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.739+0000 7f9ed3471740 1 -- 172.21.15.37:0/650219139 wait complete. 2024-09-21T01:22:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.739+0000 7f9ed3471740 20 client.25990 trim_cache size 0 max 16384 2024-09-21T01:22:33.742 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:22:33.742 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:22:33.742 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:22:33.742 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "efb52bc3-bca1-4107-a2ee-fa49909bfab3", 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:22:33.743 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:22:33.744 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:22:33.745 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:22:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:22:33.747 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.745+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9eb40b6640 msgr2=0x7f9eb40b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.745+0000 7f9eccefd640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9eb40b6640 0x7f9eb40b8b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9ec811c300 tx=0x7f9eb0015850 comp rx=0 tx=0).stop 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.745+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 msgr2=0x7f9ec81aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.745+0000 7f9eccefd640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 0x7f9ec81aeb10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800eb10 tx=0x7f9eb800c2d0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.746+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 shutdown_connections 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.746+0000 7f9eccefd640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f9eb40b6640 0x7f9eb40b8b50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.746+0000 7f9eccefd640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ec811cc30 0x7f9ec81aeb10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.746+0000 7f9eccefd640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec8111f40 0x7f9ec81a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.746+0000 7f9eccefd640 1 --2- 172.21.15.37:0/2794505995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec810a9e0 0x7f9ec81a92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.746+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 >> 172.21.15.37:0/2794505995 conn(0x7f9ec8070ec0 msgr2=0x7f9ec811e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.752+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 shutdown_connections 2024-09-21T01:22:33.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:22:33.752+0000 7f9eccefd640 1 -- 172.21.15.37:0/2794505995 wait complete. 2024-09-21T01:22:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0e85ffb640 1 -- 172.21.15.37:0/2899318911 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55794de100f0 con 0x55794da8c1c0 2024-09-21T01:22:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0e85ffb640 10 client.26003 handle_command_reply: tid=0 2024-09-21T01:22:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0eabbe3740 1 client.26003 shutdown 2024-09-21T01:22:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 msgr2=0x55794deaec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794deaec70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400c010 tx=0x7f0e940117e0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 shutdown_connections 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.959+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55794da8c1c0 0x55794df2c350 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55794daf81b0 0x55794deaf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55794dad74d0 0x55794deaec70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0eabbe3740 1 --2- 172.21.15.37:0/2899318911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55794dacf2f0 0x55794deae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 >> 172.21.15.37:0/2899318911 conn(0x55794daec300 msgr2=0x55794dea0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0e85ffb640 0 client.26003 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 shutdown_connections 2024-09-21T01:22:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.960+0000 7f0eabbe3740 1 -- 172.21.15.37:0/2899318911 wait complete. 2024-09-21T01:22:33.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.962+0000 7f0eabbe3740 20 client.26003 trim_cache size 0 max 16384 2024-09-21T01:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:22:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:22:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.966+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e880b6590 msgr2=0x7f0e880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.966+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e880b6590 0x7f0e880b8aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0e940096b0 tx=0x7f0e94006c20 comp rx=0 tx=0).stop 2024-09-21T01:22:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.966+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 msgr2=0x7f0ea019c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.966+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 0x7f0ea019c200 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000cce0 tx=0x7f0e9000a620 comp rx=0 tx=0).stop 2024-09-21T01:22:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.967+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 shutdown_connections 2024-09-21T01:22:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.967+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0e880b6590 0x7f0e880b8aa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.967+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ea0103fc0 0x7f0ea019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.967+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea0103620 0x7f0ea019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.968+0000 7f0ea4c7e640 1 --2- 172.21.15.37:0/865327885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ea01025a0 0x7f0ea019c200 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.968+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 >> 172.21.15.37:0/865327885 conn(0x7f0ea00fdee0 msgr2=0x7f0ea006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.969+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 shutdown_connections 2024-09-21T01:22:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:33.969+0000 7f0ea4c7e640 1 -- 172.21.15.37:0/865327885 wait complete. 2024-09-21T01:22:34.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:34 smithi137 ceph-mon[34607]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 1.89k op/s 2024-09-21T01:22:34.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:34 smithi144 ceph-mon[34818]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 1.89k op/s 2024-09-21T01:22:34.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:34 smithi037 ceph-mon[31105]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 1.89k op/s 2024-09-21T01:22:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:36 smithi137 ceph-mon[34607]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 915 MiB/s wr, 1.95k op/s 2024-09-21T01:22:36.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:36 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:22:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:36 smithi144 ceph-mon[34818]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 915 MiB/s wr, 1.95k op/s 2024-09-21T01:22:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:36 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:22:36.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:36 smithi037 ceph-mon[31105]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 915 MiB/s wr, 1.95k op/s 2024-09-21T01:22:36.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:36 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:22:37.403 INFO:tasks.cephfs.filesystem:scrub status for tag:efb52bc3-bca1-4107-a2ee-fa49909bfab3 - {'path': '/', 'tag': 'efb52bc3-bca1-4107-a2ee-fa49909bfab3', 'options': 'recursive,force'} 2024-09-21T01:22:37.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:37 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:22:37.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:37 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:22:37.760 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:37 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:22:38.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:38 smithi137 ceph-mon[34607]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 845 MiB/s wr, 1.78k op/s 2024-09-21T01:22:38.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:38 smithi144 ceph-mon[34818]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 845 MiB/s wr, 1.78k op/s 2024-09-21T01:22:38.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:38 smithi037 ceph-mon[31105]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 845 MiB/s wr, 1.78k op/s 2024-09-21T01:22:40.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:40 smithi144 ceph-mon[34818]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 928 MiB/s wr, 2.08k op/s 2024-09-21T01:22:40.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:40 smithi137 ceph-mon[34607]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 928 MiB/s wr, 2.08k op/s 2024-09-21T01:22:40.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:40 smithi037 ceph-mon[31105]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 928 MiB/s wr, 2.08k op/s 2024-09-21T01:22:42.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:42 smithi137 ceph-mon[34607]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 869 MiB/s wr, 1.93k op/s 2024-09-21T01:22:42.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:42 smithi144 ceph-mon[34818]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 869 MiB/s wr, 1.93k op/s 2024-09-21T01:22:42.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:42 smithi037 ceph-mon[31105]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 869 MiB/s wr, 1.93k op/s 2024-09-21T01:22:44.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:44 smithi144 ceph-mon[34818]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 897 MiB/s wr, 1.79k op/s 2024-09-21T01:22:44.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:44 smithi137 ceph-mon[34607]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 897 MiB/s wr, 1.79k op/s 2024-09-21T01:22:44.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:44 smithi037 ceph-mon[31105]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 897 MiB/s wr, 1.79k op/s 2024-09-21T01:22:46.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:46 smithi137 ceph-mon[34607]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 935 MiB/s wr, 1.66k op/s 2024-09-21T01:22:46.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:46 smithi144 ceph-mon[34818]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 935 MiB/s wr, 1.66k op/s 2024-09-21T01:22:46.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:46 smithi037 ceph-mon[31105]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 935 MiB/s wr, 1.66k op/s 2024-09-21T01:22:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.320+0000 7fb050dcf640 1 -- 172.21.15.37:0/2745194324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10bc00 msgr2=0x7fb04c112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.320+0000 7fb050dcf640 1 --2- 172.21.15.37:0/2745194324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10bc00 0x7fb04c112620 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb044005fd0 tx=0x7fb04402e9a0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.321+0000 7fb050dcf640 1 -- 172.21.15.37:0/2745194324 shutdown_connections 2024-09-21T01:22:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.321+0000 7fb050dcf640 1 --2- 172.21.15.37:0/2745194324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10bc00 0x7fb04c112620 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.321+0000 7fb050dcf640 1 --2- 172.21.15.37:0/2745194324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c10aff0 0x7fb04c10b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.321+0000 7fb050dcf640 1 --2- 172.21.15.37:0/2745194324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04c10a5a0 0x7fb04c10a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.321+0000 7fb050dcf640 1 -- 172.21.15.37:0/2745194324 >> 172.21.15.37:0/2745194324 conn(0x7fb04c070c70 msgr2=0x7fb04c073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.336+0000 7fb050dcf640 1 -- 172.21.15.37:0/2745194324 shutdown_connections 2024-09-21T01:22:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.336+0000 7fb050dcf640 1 -- 172.21.15.37:0/2745194324 wait complete. 2024-09-21T01:22:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.339+0000 7fb050dcf640 1 Processor -- start 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 -- start start 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c10a5a0 0x7fb04c1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 0x7fb04c1a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04c10bc00 0x7fb04c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c115a10 con 0x7fb04c10aff0 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c115890 con 0x7fb04c10a5a0 2024-09-21T01:22:47.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.342+0000 7fb050dcf640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c115b90 con 0x7fb04c10bc00 2024-09-21T01:22:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.344+0000 7fb049d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 0x7fb04c1a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.344+0000 7fb049d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 0x7fb04c1a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56374/0 (socket says 172.21.15.37:56374) 2024-09-21T01:22:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.344+0000 7fb049d9b640 1 -- 172.21.15.37:0/3021897062 learned_addr learned my addr 172.21.15.37:0/3021897062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:47.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.345+0000 7fb04a59c640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c10a5a0 0x7fb04c1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.346+0000 7fb049d9b640 1 -- 172.21.15.37:0/3021897062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04c10bc00 msgr2=0x7fb04c1a18a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:22:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.346+0000 7fb04ad9d640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04c10bc00 0x7fb04c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.346+0000 7fb049d9b640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04c10bc00 0x7fb04c1a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.347+0000 7fb049d9b640 1 -- 172.21.15.37:0/3021897062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c10a5a0 msgr2=0x7fb04c1a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:47.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.347+0000 7fb049d9b640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c10a5a0 0x7fb04c1a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.347+0000 7fb049d9b640 1 -- 172.21.15.37:0/3021897062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c1a20c0 con 0x7fb04c10aff0 2024-09-21T01:22:47.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.351+0000 7fb049d9b640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 0x7fb04c1a0cf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b450 tx=0x7fb03c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:47.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.353+0000 7fb03b7fe640 1 -- 172.21.15.37:0/3021897062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c015020 con 0x7fb04c10aff0 2024-09-21T01:22:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.354+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c1a23b0 con 0x7fb04c10aff0 2024-09-21T01:22:47.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.355+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c1a2af0 con 0x7fb04c10aff0 2024-09-21T01:22:47.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.358+0000 7fb03b7fe640 1 -- 172.21.15.37:0/3021897062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb03c011d40 con 0x7fb04c10aff0 2024-09-21T01:22:47.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.360+0000 7fb03b7fe640 1 -- 172.21.15.37:0/3021897062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00f340 con 0x7fb04c10aff0 2024-09-21T01:22:47.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.366+0000 7fb03b7fe640 1 -- 172.21.15.37:0/3021897062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb03c018020 con 0x7fb04c10aff0 2024-09-21T01:22:47.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.368+0000 7fb03b7fe640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb0340b6530 0x7fb0340b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.369+0000 7fb03b7fe640 1 -- 172.21.15.37:0/3021897062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb03c0e6d10 con 0x7fb04c10aff0 2024-09-21T01:22:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.369+0000 7fb057e1d740 1 Processor -- start 2024-09-21T01:22:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.371+0000 7fb04a59c640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb0340b6530 0x7fb0340b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.372+0000 7fb04a59c640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb0340b6530 0x7fb0340b8a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb04000a7d0 tx=0x7fb040008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 -- start start 2024-09-21T01:22:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 0x5603a82a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ed72f0 0x5603a82a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 0x5603a82a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5603a821a6f0 con 0x5603a7f001b0 2024-09-21T01:22:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5603a8209b20 con 0x5603a7edf4d0 2024-09-21T01:22:47.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.380+0000 7fb057e1d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5603a820d930 con 0x5603a7ed72f0 2024-09-21T01:22:47.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.383+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 0x5603a82a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.383+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 0x5603a82a7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56390/0 (socket says 172.21.15.37:56390) 2024-09-21T01:22:47.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.383+0000 7fb04a59c640 1 -- 172.21.15.37:0/2248607968 learned_addr learned my addr 172.21.15.37:0/2248607968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.384+0000 7fb04a59c640 1 -- 172.21.15.37:0/2248607968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ed72f0 msgr2=0x5603a82a84c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:22:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.384+0000 7fb04a59c640 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ed72f0 0x5603a82a84c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.384+0000 7fb04a59c640 1 -- 172.21.15.37:0/2248607968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 msgr2=0x5603a82a9010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:22:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.384+0000 7fb04a59c640 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 0x5603a82a9010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.384+0000 7fb04a59c640 1 -- 172.21.15.37:0/2248607968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603a81cf530 con 0x5603a7f001b0 2024-09-21T01:22:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.384+0000 7fb04a59c640 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 0x5603a82a7e50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb04000caf0 tx=0x7fb04000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6d67c3f1baa2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.387+0000 7fb038ff9640 1 -- 172.21.15.37:0/2248607968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040019040 con 0x5603a7f001b0 2024-09-21T01:22:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.387+0000 7fb038ff9640 1 -- 172.21.15.37:0/2248607968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb040013e30 con 0x5603a7f001b0 2024-09-21T01:22:47.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.388+0000 7fb057e1d740 1 -- 172.21.15.37:0/2248607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 msgr2=0x5603a82a7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:47.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.388+0000 7fb057e1d740 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 0x5603a82a7e50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb04000caf0 tx=0x7fb04000f000 comp rx=0 tx=0).stop 2024-09-21T01:22:47.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.389+0000 7fb057e1d740 1 -- 172.21.15.37:0/2248607968 shutdown_connections 2024-09-21T01:22:47.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.389+0000 7fb057e1d740 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 0x5603a82a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.389+0000 7fb057e1d740 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ed72f0 0x5603a82a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.389+0000 7fb057e1d740 1 --2- 172.21.15.37:0/2248607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7f001b0 0x5603a82a7e50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.389+0000 7fb057e1d740 1 -- 172.21.15.37:0/2248607968 >> 172.21.15.37:0/2248607968 conn(0x5603a7ef4300 msgr2=0x5603a82a38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.393+0000 7fb057e1d740 1 -- 172.21.15.37:0/2248607968 shutdown_connections 2024-09-21T01:22:47.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.393+0000 7fb057e1d740 1 -- 172.21.15.37:0/2248607968 wait complete. 2024-09-21T01:22:47.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.394+0000 7fb057e1d740 1 -- start start 2024-09-21T01:22:47.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.394+0000 7fb057e1d740 1 Processor -- start 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ed72f0 0x5603a82b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7edf4d0 0x5603a82b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5603a8141ab0 con 0x5603a7edf4d0 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5603a81af730 con 0x5603a7ed72f0 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5603a82a9b80 con 0x5603a7ebed80 2024-09-21T01:22:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.395+0000 7fb057e1d740 10 client.0 _ll_register_callbacks cb 0x5603a82036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.396+0000 7fb04ad9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.396+0000 7fb04ad9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44270/0 (socket says 172.21.15.37:44270) 2024-09-21T01:22:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.396+0000 7fb04ad9d640 1 -- 172.21.15.37:0/4046166293 learned_addr learned my addr 172.21.15.37:0/4046166293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.396+0000 7fb04a59c640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ed72f0 0x5603a82b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.396+0000 7fb049d9b640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7edf4d0 0x5603a82b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.398+0000 7fb04a59c640 1 -- 172.21.15.37:0/4046166293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 msgr2=0x5603a82b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.398+0000 7fb04a59c640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.398+0000 7fb04a59c640 1 -- 172.21.15.37:0/4046166293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7edf4d0 msgr2=0x5603a82b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.398+0000 7fb04a59c640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7edf4d0 0x5603a82b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.398+0000 7fb04a59c640 1 -- 172.21.15.37:0/4046166293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603a7f6b790 con 0x5603a7ed72f0 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.398+0000 7fb04ad9d640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.399+0000 7fb04a59c640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ed72f0 0x5603a82b1550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c520 tx=0x7fb040014bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53c8e16e0399ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.399+0000 7fb031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:22:47.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.404+0000 7fb031ffb640 1 -- 172.21.15.37:0/4046166293 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04002c020 con 0x5603a7ed72f0 2024-09-21T01:22:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.404+0000 7fb031ffb640 1 -- 172.21.15.37:0/4046166293 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb040014df0 con 0x5603a7ed72f0 2024-09-21T01:22:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.405+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04001de50 con 0x5603a7ed72f0 2024-09-21T01:22:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.428+0000 7fb031ffb640 1 -- 172.21.15.37:0/4046166293 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb04001d3f0 con 0x5603a7ed72f0 2024-09-21T01:22:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.430+0000 7fb057e1d740 10 client.26021 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.430+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5603a7fe4620 con 0x5603a7ed72f0 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb031ffb640 1 -- 172.21.15.37:0/4046166293 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb04001de50 con 0x5603a7ed72f0 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb031ffb640 1 -- 172.21.15.37:0/4046166293 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb04001c030 con 0x5603a7ed72f0 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb057e1d740 10 client.26021 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb057e1d740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb057e1d740 20 client.26021 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb057e1d740 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a7e941c0 0x5603a82bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb057e1d740 4 client.26021 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:22:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.435+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603a821c640 con 0x5603a7e941c0 2024-09-21T01:22:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.439+0000 7fb049d9b640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a7e941c0 0x5603a82bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.443+0000 7fb049d9b640 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a7e941c0 0x5603a82bf0c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acda4af6ab788d3f server_cookie=5f7048278b62bc0f in_seq=0 out_seq=0 2024-09-21T01:22:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.443+0000 7fb031ffb640 10 client.26021 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.451+0000 7fb031ffb640 1 -- 172.21.15.37:0/4046166293 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603a821c640 con 0x5603a7e941c0 2024-09-21T01:22:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.451+0000 7fb031ffb640 10 client.26021 handle_command_reply: tid=0 2024-09-21T01:22:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.460+0000 7fb057e1d740 1 client.26021 shutdown 2024-09-21T01:22:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.461+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ed72f0 msgr2=0x5603a82b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.461+0000 7fb057e1d740 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ed72f0 0x5603a82b1550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c520 tx=0x7fb040014bc0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 shutdown_connections 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb057e1d740 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a7e941c0 0x5603a82bf0c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb057e1d740 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb057e1d740 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7edf4d0 0x5603a82b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb057e1d740 1 --2- 172.21.15.37:0/4046166293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ed72f0 0x5603a82b1550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb031ffb640 0 client.26021 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.462+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 >> 172.21.15.37:0/4046166293 conn(0x5603a7ef4300 msgr2=0x5603a82a1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.463+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 shutdown_connections 2024-09-21T01:22:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.464+0000 7fb057e1d740 1 -- 172.21.15.37:0/4046166293 wait complete. 2024-09-21T01:22:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.464+0000 7fb057e1d740 20 client.26021 trim_cache size 0 max 16384 2024-09-21T01:22:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.518+0000 7fb057e1d740 1 Processor -- start 2024-09-21T01:22:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.518+0000 7fb057e1d740 1 -- start start 2024-09-21T01:22:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.518+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 0x5603a82b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.519+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.519+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7edf4d0 0x5603a82a8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.519+0000 7fb057e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c00e630 con 0x5603a7ed72f0 2024-09-21T01:22:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.519+0000 7fb057e1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c010170 con 0x5603a7ebed80 2024-09-21T01:22:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.520+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 0x5603a82b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.520+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 0x5603a82b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:54390/0 (socket says 172.21.15.37:54390) 2024-09-21T01:22:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.520+0000 7fb04a59c640 1 -- 172.21.15.37:0/1090002252 learned_addr learned my addr 172.21.15.37:0/1090002252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.520+0000 7fb057e1d740 1 -- 172.21.15.37:0/1090002252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c00ed00 con 0x5603a7edf4d0 2024-09-21T01:22:47.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.522+0000 7fb04ad9d640 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7edf4d0 0x5603a82a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb04a59c640 1 -- 172.21.15.37:0/1090002252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7edf4d0 msgr2=0x5603a82a8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb04a59c640 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7edf4d0 0x5603a82a8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb049d9b640 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb04a59c640 1 -- 172.21.15.37:0/1090002252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 msgr2=0x5603a82a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb04a59c640 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82a7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb04a59c640 1 -- 172.21.15.37:0/1090002252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603a82a4010 con 0x5603a7ebed80 2024-09-21T01:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.523+0000 7fb049d9b640 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.524+0000 7fb04a59c640 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 0x5603a82b0110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb040008010 tx=0x7fb040004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a2f6c8836550f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.529+0000 7fb033fff640 1 -- 172.21.15.37:0/1090002252 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04002c070 con 0x5603a7ebed80 2024-09-21T01:22:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.530+0000 7fb033fff640 1 -- 172.21.15.37:0/1090002252 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb04001de50 con 0x5603a7ebed80 2024-09-21T01:22:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.530+0000 7fb033fff640 1 -- 172.21.15.37:0/1090002252 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040013cc0 con 0x5603a7ebed80 2024-09-21T01:22:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.536+0000 7fb057e1d740 1 -- 172.21.15.37:0/1090002252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 msgr2=0x5603a82b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.536+0000 7fb057e1d740 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 0x5603a82b0110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb040008010 tx=0x7fb040004710 comp rx=0 tx=0).stop 2024-09-21T01:22:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.539+0000 7fb057e1d740 1 -- 172.21.15.37:0/1090002252 shutdown_connections 2024-09-21T01:22:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.539+0000 7fb057e1d740 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7edf4d0 0x5603a82a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.539+0000 7fb057e1d740 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.539+0000 7fb057e1d740 1 --2- 172.21.15.37:0/1090002252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7ebed80 0x5603a82b0110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.539+0000 7fb057e1d740 1 -- 172.21.15.37:0/1090002252 >> 172.21.15.37:0/1090002252 conn(0x5603a7ef4300 msgr2=0x5603a829e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:47.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.543+0000 7fb057e1d740 1 -- 172.21.15.37:0/1090002252 shutdown_connections 2024-09-21T01:22:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.543+0000 7fb057e1d740 1 -- 172.21.15.37:0/1090002252 wait complete. 2024-09-21T01:22:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.543+0000 7fb057e1d740 1 -- start start 2024-09-21T01:22:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 Processor -- start 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 0x5603a82b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c00faa0 con 0x5603a7ed72f0 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c00f3d0 con 0x5603a7edf4d0 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb02c00c5f0 con 0x5603a7ebed80 2024-09-21T01:22:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.544+0000 7fb057e1d740 10 client.0 _ll_register_callbacks cb 0x7fb04000c9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:22:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.545+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.545+0000 7fb04a59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:44294/0 (socket says 172.21.15.37:44294) 2024-09-21T01:22:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.545+0000 7fb04a59c640 1 -- 172.21.15.37:0/81057188 learned_addr learned my addr 172.21.15.37:0/81057188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:22:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.545+0000 7fb049d9b640 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.546+0000 7fb049d9b640 1 -- 172.21.15.37:0/81057188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 msgr2=0x5603a82b8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.546+0000 7fb049d9b640 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.546+0000 7fb049d9b640 1 -- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 msgr2=0x5603a82b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:22:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.546+0000 7fb049d9b640 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 0x5603a82b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.546+0000 7fb049d9b640 1 -- 172.21.15.37:0/81057188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603a82b8310 con 0x5603a7ed72f0 2024-09-21T01:22:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.547+0000 7fb049d9b640 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82b7810 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb03c006e80 tx=0x7fb03c0d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1be6c4a7294b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:22:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.547+0000 7fb031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:22:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.548+0000 7fb031ffb640 1 -- 172.21.15.37:0/81057188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c098070 con 0x5603a7ed72f0 2024-09-21T01:22:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.548+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04001de50 con 0x5603a7ed72f0 2024-09-21T01:22:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.548+0000 7fb031ffb640 1 -- 172.21.15.37:0/81057188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb03c0d43d0 con 0x5603a7ed72f0 2024-09-21T01:22:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.549+0000 7fb031ffb640 1 -- 172.21.15.37:0/81057188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb03c098210 con 0x5603a7ed72f0 2024-09-21T01:22:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.550+0000 7fb057e1d740 10 client.16584 fetch_fsmap learned FSMap version 30 2024-09-21T01:22:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.550+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5603a8328830 con 0x5603a7ed72f0 2024-09-21T01:22:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.551+0000 7fb031ffb640 1 -- 172.21.15.37:0/81057188 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb04001de50 con 0x5603a7ed72f0 2024-09-21T01:22:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.553+0000 7fb031ffb640 1 -- 172.21.15.37:0/81057188 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb03c017b40 con 0x5603a7ed72f0 2024-09-21T01:22:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.554+0000 7fb057e1d740 10 client.16584 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:22:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.554+0000 7fb057e1d740 10 client.16584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:22:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.554+0000 7fb057e1d740 20 client.16584 populate_metadata read hostname 'smithi037' 2024-09-21T01:22:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.554+0000 7fb057e1d740 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a8329140 0x5603a832b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:22:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.554+0000 7fb057e1d740 4 client.16584 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:22:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.554+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603a82180f0 con 0x5603a8329140 2024-09-21T01:22:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.556+0000 7fb04a59c640 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a8329140 0x5603a832b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:22:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.562+0000 7fb04a59c640 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a8329140 0x5603a832b580 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ae93b2fc0c0207 server_cookie=34cc8d206f59265a in_seq=0 out_seq=0 2024-09-21T01:22:47.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:47.562+0000 7fb031ffb640 10 client.16584 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:48.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:48 smithi137 ceph-mon[34607]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 854 MiB/s wr, 1.52k op/s 2024-09-21T01:22:48.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:48 smithi144 ceph-mon[34818]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 854 MiB/s wr, 1.52k op/s 2024-09-21T01:22:48.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:48 smithi037 ceph-mon[31105]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 854 MiB/s wr, 1.52k op/s 2024-09-21T01:22:50.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:50 smithi037 ceph-mon[31105]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 941 MiB/s wr, 1.61k op/s 2024-09-21T01:22:50.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:50 smithi137 ceph-mon[34607]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 941 MiB/s wr, 1.61k op/s 2024-09-21T01:22:50.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:50 smithi144 ceph-mon[34818]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 941 MiB/s wr, 1.61k op/s 2024-09-21T01:22:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.849+0000 7fb031ffb640 1 -- 172.21.15.37:0/81057188 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603a82180f0 con 0x5603a8329140 2024-09-21T01:22:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.849+0000 7fb031ffb640 10 client.16584 handle_command_reply: tid=0 2024-09-21T01:22:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.850+0000 7fb057e1d740 1 client.16584 shutdown 2024-09-21T01:22:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.854+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 msgr2=0x5603a82b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.854+0000 7fb057e1d740 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82b7810 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb03c006e80 tx=0x7fb03c0d0040 comp rx=0 tx=0).stop 2024-09-21T01:22:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.855+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 shutdown_connections 2024-09-21T01:22:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.855+0000 7fb057e1d740 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5603a8329140 0x5603a832b580 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.855+0000 7fb057e1d740 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5603a7edf4d0 0x5603a82b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.855+0000 7fb057e1d740 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603a7ed72f0 0x5603a82b7810 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.855+0000 7fb057e1d740 1 --2- 172.21.15.37:0/81057188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603a7ebed80 0x5603a82b8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.855+0000 7fb031ffb640 0 client.16584 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.856+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 >> 172.21.15.37:0/81057188 conn(0x5603a7ef4300 msgr2=0x5603a82a7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.856+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 shutdown_connections 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.856+0000 7fb057e1d740 1 -- 172.21.15.37:0/81057188 wait complete. 2024-09-21T01:22:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.857+0000 7fb057e1d740 20 client.16584 trim_cache size 0 max 16384 2024-09-21T01:22:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:22:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:22:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:22:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:22:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.859+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb0340b6530 msgr2=0x7fb0340b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.859+0000 7fb050dcf640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb0340b6530 0x7fb0340b8a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb04000a7d0 tx=0x7fb040008040 comp rx=0 tx=0).stop 2024-09-21T01:22:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.859+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 msgr2=0x7fb04c1a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:22:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.859+0000 7fb050dcf640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 0x7fb04c1a0cf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b450 tx=0x7fb03c00b910 comp rx=0 tx=0).stop 2024-09-21T01:22:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.860+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 shutdown_connections 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.860+0000 7fb050dcf640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb0340b6530 0x7fb0340b8a40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.860+0000 7fb050dcf640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04c10bc00 0x7fb04c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.860+0000 7fb050dcf640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb04c10aff0 0x7fb04c1a0cf0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.860+0000 7fb050dcf640 1 --2- 172.21.15.37:0/3021897062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb04c10a5a0 0x7fb04c1a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.860+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 >> 172.21.15.37:0/3021897062 conn(0x7fb04c070c70 msgr2=0x7fb04c10e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.861+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 shutdown_connections 2024-09-21T01:22:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:22:51.861+0000 7fb050dcf640 1 -- 172.21.15.37:0/3021897062 wait complete. 2024-09-21T01:22:52.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:52 smithi037 ceph-mon[31105]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 877 MiB/s wr, 1.36k op/s 2024-09-21T01:22:52.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:52 smithi137 ceph-mon[34607]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 877 MiB/s wr, 1.36k op/s 2024-09-21T01:22:52.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:52 smithi144 ceph-mon[34818]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 877 MiB/s wr, 1.36k op/s 2024-09-21T01:22:54.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:54 smithi037 ceph-mon[31105]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 887 MiB/s wr, 1.29k op/s 2024-09-21T01:22:54.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:54 smithi137 ceph-mon[34607]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 887 MiB/s wr, 1.29k op/s 2024-09-21T01:22:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:54 smithi144 ceph-mon[34818]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 887 MiB/s wr, 1.29k op/s 2024-09-21T01:22:56.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:56 smithi037 ceph-mon[31105]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.34k op/s 2024-09-21T01:22:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:56 smithi137 ceph-mon[34607]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.34k op/s 2024-09-21T01:22:56.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:56 smithi144 ceph-mon[34818]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 915 MiB/s wr, 1.34k op/s 2024-09-21T01:22:58.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:22:58 smithi037 ceph-mon[31105]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 836 MiB/s wr, 1.23k op/s 2024-09-21T01:22:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:22:58 smithi137 ceph-mon[34607]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 836 MiB/s wr, 1.23k op/s 2024-09-21T01:22:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:22:58 smithi144 ceph-mon[34818]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 836 MiB/s wr, 1.23k op/s 2024-09-21T01:23:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:00 smithi137 ceph-mon[34607]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 930 MiB/s wr, 1.36k op/s 2024-09-21T01:23:00.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:00 smithi144 ceph-mon[34818]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 930 MiB/s wr, 1.36k op/s 2024-09-21T01:23:00.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:00 smithi037 ceph-mon[31105]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 930 MiB/s wr, 1.36k op/s 2024-09-21T01:23:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:02 smithi137 ceph-mon[34607]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 855 MiB/s wr, 1.25k op/s 2024-09-21T01:23:02.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:02 smithi144 ceph-mon[34818]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 855 MiB/s wr, 1.25k op/s 2024-09-21T01:23:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:02 smithi037 ceph-mon[31105]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 855 MiB/s wr, 1.25k op/s 2024-09-21T01:23:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:04 smithi137 ceph-mon[34607]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 876 MiB/s wr, 1.28k op/s 2024-09-21T01:23:04.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:04 smithi144 ceph-mon[34818]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 876 MiB/s wr, 1.28k op/s 2024-09-21T01:23:05.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:04 smithi037 ceph-mon[31105]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 876 MiB/s wr, 1.28k op/s 2024-09-21T01:23:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 -- 172.21.15.37:0/1157914004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9410f9d0 msgr2=0x7f0b9411ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/1157914004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9410f9d0 0x7f0b9411ab90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009860 tx=0x7f0b8802a360 comp rx=0 tx=0).stop 2024-09-21T01:23:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 -- 172.21.15.37:0/1157914004 shutdown_connections 2024-09-21T01:23:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/1157914004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9410f9d0 0x7f0b9411ab90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/1157914004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b9410cdb0 0x7f0b9410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/1157914004 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b9410a3c0 0x7f0b9410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.155+0000 7f0b9bd98640 1 -- 172.21.15.37:0/1157914004 >> 172.21.15.37:0/1157914004 conn(0x7f0b94070810 msgr2=0x7f0b94072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.156+0000 7f0b9bd98640 1 -- 172.21.15.37:0/1157914004 shutdown_connections 2024-09-21T01:23:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.157+0000 7f0b9bd98640 1 -- 172.21.15.37:0/1157914004 wait complete. 2024-09-21T01:23:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.158+0000 7f0b9bd98640 1 Processor -- start 2024-09-21T01:23:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.158+0000 7f0b9bd98640 1 -- start start 2024-09-21T01:23:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b9bd98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b9410a3c0 0x7f0b941175d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b9bd98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b9410cdb0 0x7f0b94117c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b9bd98640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 0x7f0b94118c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b9bd98640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9411e120 con 0x7f0b9410a3c0 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b9bd98640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9411dfa0 con 0x7f0b9410cdb0 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b9bd98640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9411e2a0 con 0x7f0b941187c0 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.159+0000 7f0b99333640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b9410cdb0 0x7f0b94117c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.160+0000 7f0b9a335640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 0x7f0b94118c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.160+0000 7f0b9a335640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 0x7f0b94118c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:34792/0 (socket says 172.21.15.37:34792) 2024-09-21T01:23:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.160+0000 7f0b9a335640 1 -- 172.21.15.37:0/3291940103 learned_addr learned my addr 172.21.15.37:0/3291940103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.160+0000 7f0b99b34640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b9410a3c0 0x7f0b941175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.162+0000 7f0b9a335640 1 -- 172.21.15.37:0/3291940103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b9410cdb0 msgr2=0x7f0b94117c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.162+0000 7f0b9a335640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b9410cdb0 0x7f0b94117c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.162+0000 7f0b9a335640 1 -- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b9410a3c0 msgr2=0x7f0b941175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.162+0000 7f0b9a335640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b9410a3c0 0x7f0b941175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.162+0000 7f0b9a335640 1 -- 172.21.15.37:0/3291940103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b941194a0 con 0x7f0b941187c0 2024-09-21T01:23:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.163+0000 7f0b9a335640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 0x7f0b94118c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b8802a8d0 tx=0x7f0b880042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.166+0000 7f0b92ffd640 1 -- 172.21.15.37:0/3291940103 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88037040 con 0x7f0b941187c0 2024-09-21T01:23:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.167+0000 7f0b92ffd640 1 -- 172.21.15.37:0/3291940103 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b88040070 con 0x7f0b941187c0 2024-09-21T01:23:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.167+0000 7f0b92ffd640 1 -- 172.21.15.37:0/3291940103 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88032a70 con 0x7f0b941187c0 2024-09-21T01:23:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.167+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b941197e0 con 0x7f0b941187c0 2024-09-21T01:23:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.167+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b94119c80 con 0x7f0b941187c0 2024-09-21T01:23:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.173+0000 7f0b92ffd640 1 -- 172.21.15.37:0/3291940103 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0b88032c10 con 0x7f0b941187c0 2024-09-21T01:23:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.174+0000 7f0ba2de1740 1 Processor -- start 2024-09-21T01:23:05.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.174+0000 7f0ba2de1740 1 -- start start 2024-09-21T01:23:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.179+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.179+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.179+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.179+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5582c05256f0 con 0x5582c01e22f0 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.179+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5582c0514b20 con 0x5582c020b1b0 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.179+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582c0518930 con 0x5582c01ea4d0 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.180+0000 7f0b99333640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.180+0000 7f0b99333640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39958/0 (socket says 172.21.15.37:39958) 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.180+0000 7f0b99333640 1 -- 172.21.15.37:0/2769403461 learned_addr learned my addr 172.21.15.37:0/2769403461 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.180+0000 7f0b99333640 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.180+0000 7f0b99b34640 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.181+0000 7f0b99333640 1 -- 172.21.15.37:0/2769403461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 msgr2=0x5582c05b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.181+0000 7f0b99333640 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.181+0000 7f0b99333640 1 -- 172.21.15.37:0/2769403461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 msgr2=0x5582c05b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.181+0000 7f0b99333640 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.181+0000 7f0b99333640 1 -- 172.21.15.37:0/2769403461 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c04da530 con 0x5582c020b1b0 2024-09-21T01:23:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.182+0000 7f0b92ffd640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b7c0b6690 0x7f0b7c0b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.182+0000 7f0b99333640 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05b2e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b840149f0 tx=0x7f0b8400c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ccfac89b96c926 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.183+0000 7f0b92ffd640 1 -- 172.21.15.37:0/3291940103 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0b88107150 con 0x7f0b941187c0 2024-09-21T01:23:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.186+0000 7f0b99b34640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b7c0b6690 0x7f0b7c0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.187+0000 7f0b99b34640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b7c0b6690 0x7f0b7c0b8ba0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c005c40 tx=0x7f0b8c00a6d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.200+0000 7f0b7bfff640 1 -- 172.21.15.37:0/2769403461 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840142d0 con 0x5582c020b1b0 2024-09-21T01:23:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.200+0000 7f0b7bfff640 1 -- 172.21.15.37:0/2769403461 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b8400fc10 con 0x5582c020b1b0 2024-09-21T01:23:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 -- 172.21.15.37:0/2769403461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 msgr2=0x5582c05b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05b2e50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b840149f0 tx=0x7f0b8400c4f0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 -- 172.21.15.37:0/2769403461 shutdown_connections 2024-09-21T01:23:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/2769403461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05b2e50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.202+0000 7f0ba2de1740 1 -- 172.21.15.37:0/2769403461 >> 172.21.15.37:0/2769403461 conn(0x5582c01ff300 msgr2=0x5582c05ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.218+0000 7f0ba2de1740 1 -- 172.21.15.37:0/2769403461 shutdown_connections 2024-09-21T01:23:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.219+0000 7f0ba2de1740 1 -- 172.21.15.37:0/2769403461 wait complete. 2024-09-21T01:23:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.220+0000 7f0ba2de1740 1 -- start start 2024-09-21T01:23:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.220+0000 7f0ba2de1740 1 Processor -- start 2024-09-21T01:23:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05bc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5582c044cab0 con 0x5582c01e22f0 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5582c04ba730 con 0x5582c020b1b0 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582c05b4b80 con 0x5582c01ea4d0 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.221+0000 7f0ba2de1740 10 client.0 _ll_register_callbacks cb 0x5582c050e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.222+0000 7f0b99b34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.222+0000 7f0b99b34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05bc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59776/0 (socket says 172.21.15.37:59776) 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.222+0000 7f0b99333640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.222+0000 7f0b99b34640 1 -- 172.21.15.37:0/220901567 learned_addr learned my addr 172.21.15.37:0/220901567 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.223+0000 7f0b99333640 1 -- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 msgr2=0x5582c05bdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.223+0000 7f0b99333640 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.223+0000 7f0b99333640 1 -- 172.21.15.37:0/220901567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 msgr2=0x5582c05bc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.223+0000 7f0b99333640 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05bc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.223+0000 7f0b99333640 1 -- 172.21.15.37:0/220901567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c0276790 con 0x5582c01ea4d0 2024-09-21T01:23:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.224+0000 7f0b99333640 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05bcfc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b840149f0 tx=0x7f0b84005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88f924c195d5fc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.225+0000 7f0b797fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.225+0000 7f0b797fa640 1 -- 172.21.15.37:0/220901567 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840142d0 con 0x5582c01ea4d0 2024-09-21T01:23:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.225+0000 7f0b797fa640 1 -- 172.21.15.37:0/220901567 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0b8400f730 con 0x5582c01ea4d0 2024-09-21T01:23:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.225+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582c0527640 con 0x5582c01ea4d0 2024-09-21T01:23:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.227+0000 7f0b797fa640 1 -- 172.21.15.37:0/220901567 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0b8400cc80 con 0x5582c01ea4d0 2024-09-21T01:23:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.228+0000 7f0ba2de1740 10 client.26011 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.228+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5582c02ef620 con 0x5582c01ea4d0 2024-09-21T01:23:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.228+0000 7f0b797fa640 1 -- 172.21.15.37:0/220901567 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5582c0527640 con 0x5582c01ea4d0 2024-09-21T01:23:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0b797fa640 1 -- 172.21.15.37:0/220901567 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0b84027020 con 0x5582c01ea4d0 2024-09-21T01:23:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0ba2de1740 10 client.26011 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0ba2de1740 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0ba2de1740 20 client.26011 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c01c9d80 0x5582c05ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0ba2de1740 4 client.26011 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.229+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582c05230f0 con 0x5582c01c9d80 2024-09-21T01:23:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.230+0000 7f0b99b34640 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c01c9d80 0x5582c05ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.232+0000 7f0b99b34640 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c01c9d80 0x5582c05ca480 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e92126b35a668a02 server_cookie=8b0dd0f8c3efeb82 in_seq=0 out_seq=0 2024-09-21T01:23:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.232+0000 7f0b797fa640 10 client.26011 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.238+0000 7f0b797fa640 1 -- 172.21.15.37:0/220901567 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582c05230f0 con 0x5582c01c9d80 2024-09-21T01:23:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.238+0000 7f0b797fa640 10 client.26011 handle_command_reply: tid=0 2024-09-21T01:23:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.238+0000 7f0ba2de1740 1 client.26011 shutdown 2024-09-21T01:23:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.251+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 msgr2=0x5582c05bcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.251+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05bcfc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b840149f0 tx=0x7f0b84005700 comp rx=0 tx=0).stop 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 shutdown_connections 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c01c9d80 0x5582c05ca480 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c020b1b0 0x5582c05bdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01ea4d0 0x5582c05bcfc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/220901567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01e22f0 0x5582c05bc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 >> 172.21.15.37:0/220901567 conn(0x5582c01ff300 msgr2=0x5582c05acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0b797fa640 0 client.26011 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.252+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 shutdown_connections 2024-09-21T01:23:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.254+0000 7f0ba2de1740 1 -- 172.21.15.37:0/220901567 wait complete. 2024-09-21T01:23:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.255+0000 7f0ba2de1740 20 client.26011 trim_cache size 0 max 16384 2024-09-21T01:23:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.301+0000 7f0ba2de1740 1 Processor -- start 2024-09-21T01:23:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.301+0000 7f0ba2de1740 1 -- start start 2024-09-21T01:23:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.302+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 0x5582c05bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.302+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01e22f0 0x5582c05b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01ea4d0 0x5582c05acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8000e630 con 0x5582c01ff300 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0b99333640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01e22f0 0x5582c05b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0b99333640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01e22f0 0x5582c05b7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:34820/0 (socket says 172.21.15.37:34820) 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0b99333640 1 -- 172.21.15.37:0/322916038 learned_addr learned my addr 172.21.15.37:0/322916038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80010170 con 0x5582c01ea4d0 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.303+0000 7f0b9a335640 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01ea4d0 0x5582c05acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.304+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8000ed00 con 0x5582c01e22f0 2024-09-21T01:23:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.306+0000 7f0b9a335640 1 -- 172.21.15.37:0/322916038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01e22f0 msgr2=0x5582c05b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.306+0000 7f0b9a335640 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01e22f0 0x5582c05b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.306+0000 7f0b9a335640 1 -- 172.21.15.37:0/322916038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 msgr2=0x5582c05bdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.306+0000 7f0b9a335640 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 0x5582c05bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.306+0000 7f0b9a335640 1 -- 172.21.15.37:0/322916038 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c05ba930 con 0x5582c01ea4d0 2024-09-21T01:23:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.307+0000 7f0b9a335640 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01ea4d0 0x5582c05acea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b88104c20 tx=0x7f0b880ca850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6989ff281faafcc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.308+0000 7f0b7b7fe640 1 -- 172.21.15.37:0/322916038 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b880cdb50 con 0x5582c01ea4d0 2024-09-21T01:23:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.308+0000 7f0b7b7fe640 1 -- 172.21.15.37:0/322916038 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b880cdd10 con 0x5582c01ea4d0 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01ea4d0 msgr2=0x5582c05acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01ea4d0 0x5582c05acea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b88104c20 tx=0x7f0b880ca850 comp rx=0 tx=0).stop 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 shutdown_connections 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01ea4d0 0x5582c05acea0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c01e22f0 0x5582c05b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/322916038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 0x5582c05bdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.309+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 >> 172.21.15.37:0/322916038 conn(0x5582c05b3720 msgr2=0x5582c05ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.314+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 shutdown_connections 2024-09-21T01:23:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.314+0000 7f0ba2de1740 1 -- 172.21.15.37:0/322916038 wait complete. 2024-09-21T01:23:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.314+0000 7f0ba2de1740 1 -- start start 2024-09-21T01:23:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.314+0000 7f0ba2de1740 1 Processor -- start 2024-09-21T01:23:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 0x5582c05c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 0x5582c05c1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c020b1b0 0x5582c05c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8000faa0 con 0x5582c01ff300 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8000f3d0 con 0x5582c01e22f0 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8000c5f0 con 0x5582c020b1b0 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.315+0000 7f0ba2de1740 10 client.0 _ll_register_callbacks cb 0x7f0b8c00a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.316+0000 7f0b99b34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 0x5582c05c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.316+0000 7f0b99b34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 0x5582c05c0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39972/0 (socket says 172.21.15.37:39972) 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.316+0000 7f0b99b34640 1 -- 172.21.15.37:0/385104531 learned_addr learned my addr 172.21.15.37:0/385104531 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.316+0000 7f0b9a335640 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c020b1b0 0x5582c05c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.318+0000 7f0b99b34640 1 -- 172.21.15.37:0/385104531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c020b1b0 msgr2=0x5582c05c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.318+0000 7f0b99b34640 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c020b1b0 0x5582c05c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.318+0000 7f0b99b34640 1 -- 172.21.15.37:0/385104531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 msgr2=0x5582c05c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.318+0000 7f0b99b34640 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 0x5582c05c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.318+0000 7f0b99b34640 1 -- 172.21.15.37:0/385104531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c05c2620 con 0x5582c01e22f0 2024-09-21T01:23:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.319+0000 7f0b99b34640 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 0x5582c05c0c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c01e8c0 tx=0x7f0b8c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788a7736b3095eca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.320+0000 7f0b797fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:23:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.320+0000 7f0b797fa640 1 -- 172.21.15.37:0/385104531 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0296d0 con 0x5582c01e22f0 2024-09-21T01:23:05.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.320+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582c0520520 con 0x5582c01e22f0 2024-09-21T01:23:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.320+0000 7f0b797fa640 1 -- 172.21.15.37:0/385104531 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0b8c029870 con 0x5582c01e22f0 2024-09-21T01:23:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.324+0000 7f0b797fa640 1 -- 172.21.15.37:0/385104531 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0b8c029a70 con 0x5582c01e22f0 2024-09-21T01:23:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.324+0000 7f0ba2de1740 10 client.26036 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.324+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5582c05c3aa0 con 0x5582c01e22f0 2024-09-21T01:23:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.327+0000 7f0b797fa640 1 -- 172.21.15.37:0/385104531 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5582c0520520 con 0x5582c01e22f0 2024-09-21T01:23:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.327+0000 7f0b797fa640 1 -- 172.21.15.37:0/385104531 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0b8c02f3e0 con 0x5582c01e22f0 2024-09-21T01:23:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.330+0000 7f0ba2de1740 10 client.26036 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.330+0000 7f0ba2de1740 10 client.26036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.330+0000 7f0ba2de1740 20 client.26036 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.330+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c019f1c0 0x5582c05c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.330+0000 7f0ba2de1740 4 client.26036 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:23:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.330+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582c0496800 con 0x5582c019f1c0 2024-09-21T01:23:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.333+0000 7f0b99333640 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c019f1c0 0x5582c05c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.336+0000 7f0b99333640 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c019f1c0 0x5582c05c44b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=729051bbf78c921a server_cookie=74555bdd4eb0a61a in_seq=0 out_seq=0 2024-09-21T01:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:05.338+0000 7f0b797fa640 10 client.26036 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:06 smithi137 ceph-mon[34607]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 919 MiB/s wr, 1.34k op/s 2024-09-21T01:23:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:06 smithi144 ceph-mon[34818]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 919 MiB/s wr, 1.34k op/s 2024-09-21T01:23:07.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:06 smithi037 ceph-mon[31105]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 919 MiB/s wr, 1.34k op/s 2024-09-21T01:23:07.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:23:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.704+0000 7f0b797fa640 1 -- 172.21.15.37:0/385104531 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582c0496800 con 0x5582c019f1c0 2024-09-21T01:23:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.704+0000 7f0b797fa640 10 client.26036 handle_command_reply: tid=0 2024-09-21T01:23:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.704+0000 7f0ba2de1740 1 client.26036 shutdown 2024-09-21T01:23:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.704+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 msgr2=0x5582c05c0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.704+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 0x5582c05c0c90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c01e8c0 tx=0x7f0b8c004ab0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 shutdown_connections 2024-09-21T01:23:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5582c019f1c0 0x5582c05c44b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5582c020b1b0 0x5582c05c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582c01ff300 0x5582c05c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 --2- 172.21.15.37:0/385104531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5582c01e22f0 0x5582c05c0c90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 >> 172.21.15.37:0/385104531 conn(0x5582c05b3720 msgr2=0x5582c05b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0b797fa640 0 client.26036 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 shutdown_connections 2024-09-21T01:23:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 1 -- 172.21.15.37:0/385104531 wait complete. 2024-09-21T01:23:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.705+0000 7f0ba2de1740 20 client.26036 trim_cache size 0 max 16384 2024-09-21T01:23:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:23:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:23:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:23:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:23:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.707+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b7c0b6690 msgr2=0x7f0b7c0b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.707+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b7c0b6690 0x7f0b7c0b8ba0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c005c40 tx=0x7f0b8c00a6d0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.707+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 msgr2=0x7f0b94118c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.707+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 0x7f0b94118c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b8802a8d0 tx=0x7f0b880042e0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.708+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 shutdown_connections 2024-09-21T01:23:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.708+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0b7c0b6690 0x7f0b7c0b8ba0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.708+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b941187c0 0x7f0b94118c80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.708+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b9410cdb0 0x7f0b94117c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.708+0000 7f0b9bd98640 1 --2- 172.21.15.37:0/3291940103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b9410a3c0 0x7f0b941175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.708+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 >> 172.21.15.37:0/3291940103 conn(0x7f0b94070810 msgr2=0x7f0b9410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.710+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 shutdown_connections 2024-09-21T01:23:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:08.710+0000 7f0b9bd98640 1 -- 172.21.15.37:0/3291940103 wait complete. 2024-09-21T01:23:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:08 smithi137 ceph-mon[34607]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 844 MiB/s wr, 1.22k op/s 2024-09-21T01:23:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:08 smithi144 ceph-mon[34818]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 844 MiB/s wr, 1.22k op/s 2024-09-21T01:23:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:08 smithi037 ceph-mon[31105]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 844 MiB/s wr, 1.22k op/s 2024-09-21T01:23:10.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.349+0000 7fde4f443640 1 -- 172.21.15.37:0/2012485050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48114280 msgr2=0x7fde48116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.349+0000 7fde4f443640 1 --2- 172.21.15.37:0/2012485050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48114280 0x7fde48116750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde40009900 tx=0x7fde4002a440 comp rx=0 tx=0).stop 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 -- 172.21.15.37:0/2012485050 shutdown_connections 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 --2- 172.21.15.37:0/2012485050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48114280 0x7fde48116750 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 --2- 172.21.15.37:0/2012485050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48075dd0 0x7fde480761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 --2- 172.21.15.37:0/2012485050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48077380 0x7fde480757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 -- 172.21.15.37:0/2012485050 >> 172.21.15.37:0/2012485050 conn(0x7fde480ff400 msgr2=0x7fde48101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 -- 172.21.15.37:0/2012485050 shutdown_connections 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.352+0000 7fde4f443640 1 -- 172.21.15.37:0/2012485050 wait complete. 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.354+0000 7fde4f443640 1 Processor -- start 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.354+0000 7fde4f443640 1 -- start start 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.355+0000 7fde4f443640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48075dd0 0x7fde48113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.355+0000 7fde4f443640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48077380 0x7fde4810cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.355+0000 7fde4f443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 0x7fde4810d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.355+0000 7fde4f443640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde48119f90 con 0x7fde48114280 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.355+0000 7fde4f443640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde48119e10 con 0x7fde48075dd0 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.355+0000 7fde4f443640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde4811a110 con 0x7fde48077380 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.356+0000 7fde4ec42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 0x7fde4810d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.356+0000 7fde4ec42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 0x7fde4810d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49482/0 (socket says 172.21.15.37:49482) 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.356+0000 7fde4ec42640 1 -- 172.21.15.37:0/229194306 learned_addr learned my addr 172.21.15.37:0/229194306 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.357+0000 7fde4ec42640 1 -- 172.21.15.37:0/229194306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48077380 msgr2=0x7fde4810cbe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.357+0000 7fde4ec42640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48077380 0x7fde4810cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.357+0000 7fde4ec42640 1 -- 172.21.15.37:0/229194306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48075dd0 msgr2=0x7fde48113910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.357+0000 7fde4ec42640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48075dd0 0x7fde48113910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.357+0000 7fde4ec42640 1 -- 172.21.15.37:0/229194306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4810d8a0 con 0x7fde48114280 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.357+0000 7fde4ec42640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 0x7fde4810d120 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fde40006010 tx=0x7fde40005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.360+0000 7fde477fe640 1 -- 172.21.15.37:0/229194306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40041070 con 0x7fde48114280 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.360+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde48112580 con 0x7fde48114280 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.360+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde48112ac0 con 0x7fde48114280 2024-09-21T01:23:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.362+0000 7fde477fe640 1 -- 172.21.15.37:0/229194306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde400041b0 con 0x7fde48114280 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.362+0000 7fde477fe640 1 -- 172.21.15.37:0/229194306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4003ddd0 con 0x7fde48114280 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.366+0000 7fde56c19740 1 Processor -- start 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.367+0000 7fde56c19740 1 -- start start 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.367+0000 7fde56c19740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.367+0000 7fde56c19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.367+0000 7fde56c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.372+0000 7fde56c19740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c10823ce50 con 0x55c107f1f070 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.372+0000 7fde56c19740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c10822c280 con 0x55c107efe390 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.372+0000 7fde56c19740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c108230090 con 0x55c107ef61b0 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.373+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.373+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49490/0 (socket says 172.21.15.37:49490) 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.373+0000 7fde4dc40640 1 -- 172.21.15.37:0/1253219101 learned_addr learned my addr 172.21.15.37:0/1253219101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.373+0000 7fde4dc40640 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.377+0000 7fde477fe640 1 -- 172.21.15.37:0/229194306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fde40044070 con 0x7fde48114280 2024-09-21T01:23:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde477fe640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde380b6710 0x7fde380b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde4dc40640 1 -- 172.21.15.37:0/1253219101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 msgr2=0x55c1082c6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde4dc40640 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c6d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde4dc40640 1 -- 172.21.15.37:0/1253219101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 msgr2=0x55c1082c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde4dc40640 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde4dc40640 1 -- 172.21.15.37:0/1253219101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c107f8a650 con 0x55c107f1f070 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.379+0000 7fde477fe640 1 -- 172.21.15.37:0/229194306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fde40107e60 con 0x7fde48114280 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.383+0000 7fde4ec42640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde380b6710 0x7fde380b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.384+0000 7fde4dc40640 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082c6810 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fde340058c0 tx=0x7fde34009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312646bdcb4462a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.385+0000 7fde4ec42640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde380b6710 0x7fde380b8c20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde400cb2b0 tx=0x7fde4002a440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.387+0000 7fde44ff9640 1 -- 172.21.15.37:0/1253219101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34005020 con 0x55c107f1f070 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.387+0000 7fde44ff9640 1 -- 172.21.15.37:0/1253219101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde340047a0 con 0x55c107f1f070 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.388+0000 7fde44ff9640 1 -- 172.21.15.37:0/1253219101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3400c930 con 0x55c107f1f070 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.389+0000 7fde56c19740 1 -- 172.21.15.37:0/1253219101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 msgr2=0x55c1082c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.389+0000 7fde56c19740 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082c6810 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fde340058c0 tx=0x7fde34009650 comp rx=0 tx=0).stop 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.390+0000 7fde56c19740 1 -- 172.21.15.37:0/1253219101 shutdown_connections 2024-09-21T01:23:10.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.390+0000 7fde56c19740 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.390+0000 7fde56c19740 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.390+0000 7fde56c19740 1 --2- 172.21.15.37:0/1253219101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082c6810 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.390+0000 7fde56c19740 1 -- 172.21.15.37:0/1253219101 >> 172.21.15.37:0/1253219101 conn(0x55c107f13460 msgr2=0x55c1082c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.393+0000 7fde56c19740 1 -- 172.21.15.37:0/1253219101 shutdown_connections 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.393+0000 7fde56c19740 1 -- 172.21.15.37:0/1253219101 wait complete. 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.393+0000 7fde56c19740 1 -- start start 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.394+0000 7fde56c19740 1 Processor -- start 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.394+0000 7fde56c19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.394+0000 7fde56c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.394+0000 7fde56c19740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.395+0000 7fde56c19740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c10808d700 con 0x55c107f1f070 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.395+0000 7fde56c19740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c1081c7110 con 0x55c107efe390 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.395+0000 7fde56c19740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c1082d4fe0 con 0x55c107ef61b0 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.395+0000 7fde56c19740 10 client.0 _ll_register_callbacks cb 0x55c1081e0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:10.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.395+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082de3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49496/0 (socket says 172.21.15.37:49496) 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 -- 172.21.15.37:0/2701523822 learned_addr learned my addr 172.21.15.37:0/2701523822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 -- 172.21.15.37:0/2701523822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 msgr2=0x55c1082d1f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d1f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 -- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 msgr2=0x55c1082d2440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.396+0000 7fde4dc40640 1 -- 172.21.15.37:0/2701523822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1081f4c40 con 0x55c107f1f070 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.398+0000 7fde4dc40640 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082de3b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fde34013fd0 tx=0x7fde340095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d562ec784d9d6fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.398+0000 7fde31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.399+0000 7fde31ffb640 1 -- 172.21.15.37:0/2701523822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34004950 con 0x55c107f1f070 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.399+0000 7fde31ffb640 1 -- 172.21.15.37:0/2701523822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fde34004af0 con 0x55c107f1f070 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.399+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde340047a0 con 0x55c107f1f070 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.400+0000 7fde31ffb640 1 -- 172.21.15.37:0/2701523822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fde34004cf0 con 0x55c107f1f070 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.401+0000 7fde56c19740 10 client.16605 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.401+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1082e0da0 con 0x55c107f1f070 2024-09-21T01:23:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.402+0000 7fde31ffb640 1 -- 172.21.15.37:0/2701523822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde340047a0 con 0x55c107f1f070 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.402+0000 7fde31ffb640 1 -- 172.21.15.37:0/2701523822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fde3400c9d0 con 0x55c107f1f070 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.403+0000 7fde56c19740 10 client.16605 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.403+0000 7fde56c19740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.404+0000 7fde56c19740 20 client.16605 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.404+0000 7fde56c19740 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107edd9f0 0x55c1082e4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.404+0000 7fde56c19740 4 client.16605 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.404+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c10823eda0 con 0x55c107edd9f0 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.404+0000 7fde4e441640 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107edd9f0 0x55c1082e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.482+0000 7fde31ffb640 10 client.16605 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.482+0000 7fde4e441640 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107edd9f0 0x55c1082e4100 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1742510928a3a2c2 server_cookie=2be0500377c99bd1 in_seq=0 out_seq=0 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.486+0000 7fde31ffb640 1 -- 172.21.15.37:0/2701523822 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c10823eda0 con 0x55c107edd9f0 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.486+0000 7fde31ffb640 10 client.16605 handle_command_reply: tid=0 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.486+0000 7fde56c19740 1 client.16605 shutdown 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.487+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 msgr2=0x55c1082de3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.487+0000 7fde56c19740 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082de3b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fde34013fd0 tx=0x7fde340095e0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.487+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 shutdown_connections 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107edd9f0 0x55c1082e4100 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f1f070 0x55c1082de3b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 --2- 172.21.15.37:0/2701523822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde31ffb640 0 client.16605 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 >> 172.21.15.37:0/2701523822 conn(0x55c107f13460 msgr2=0x55c1082c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 shutdown_connections 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.488+0000 7fde56c19740 1 -- 172.21.15.37:0/2701523822 wait complete. 2024-09-21T01:23:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.489+0000 7fde56c19740 20 client.16605 trim_cache size 0 max 16384 2024-09-21T01:23:10.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.538+0000 7fde56c19740 1 Processor -- start 2024-09-21T01:23:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.539+0000 7fde56c19740 1 -- start start 2024-09-21T01:23:10.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.540+0000 7fde56c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107f13460 0x55c1082d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.541+0000 7fde56c19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.541+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107f13460 0x55c1082d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.542+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107f13460 0x55c1082d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:38748/0 (socket says 172.21.15.37:38748) 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.542+0000 7fde4dc40640 1 -- 172.21.15.37:0/2923569393 learned_addr learned my addr 172.21.15.37:0/2923569393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.542+0000 7fde56c19740 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107efe390 0x55c1082de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.542+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c00e600 con 0x55c107efe390 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.542+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c010140 con 0x55c107f13460 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.542+0000 7fde4e441640 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.543+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c00ecd0 con 0x55c107ef61b0 2024-09-21T01:23:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.544+0000 7fde4dc40640 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107efe390 0x55c1082de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.545+0000 7fde4e441640 1 -- 172.21.15.37:0/2923569393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107f13460 msgr2=0x55c1082d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.545+0000 7fde4e441640 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107f13460 0x55c1082d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.545+0000 7fde4e441640 1 -- 172.21.15.37:0/2923569393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107efe390 msgr2=0x55c1082de2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.545+0000 7fde4e441640 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107efe390 0x55c1082de2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.545+0000 7fde4e441640 1 -- 172.21.15.37:0/2923569393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1082c52c0 con 0x55c107ef61b0 2024-09-21T01:23:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.547+0000 7fde4e441640 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c7f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55c10808d700 tx=0x7fde3c009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e825946055cdc402 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.549+0000 7fde33fff640 1 -- 172.21.15.37:0/2923569393 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c017360 con 0x55c107ef61b0 2024-09-21T01:23:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.549+0000 7fde33fff640 1 -- 172.21.15.37:0/2923569393 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde3c01b070 con 0x55c107ef61b0 2024-09-21T01:23:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.551+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 msgr2=0x55c1082c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.551+0000 7fde56c19740 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c7f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55c10808d700 tx=0x7fde3c009230 comp rx=0 tx=0).stop 2024-09-21T01:23:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.553+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 shutdown_connections 2024-09-21T01:23:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.553+0000 7fde56c19740 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107efe390 0x55c1082de2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.553+0000 7fde56c19740 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082c7f50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.553+0000 7fde56c19740 1 --2- 172.21.15.37:0/2923569393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107f13460 0x55c1082d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.553+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 >> 172.21.15.37:0/2923569393 conn(0x55c1082d2fa0 msgr2=0x55c1082c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.557+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 shutdown_connections 2024-09-21T01:23:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.559+0000 7fde56c19740 1 -- 172.21.15.37:0/2923569393 wait complete. 2024-09-21T01:23:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.560+0000 7fde56c19740 1 -- start start 2024-09-21T01:23:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.560+0000 7fde56c19740 1 Processor -- start 2024-09-21T01:23:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.561+0000 7fde56c19740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.561+0000 7fde56c19740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.562+0000 7fde56c19740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f13460 0x55c10834d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.564+0000 7fde4e441640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.564+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.564+0000 7fde4dc40640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:58466/0 (socket says 172.21.15.37:58466) 2024-09-21T01:23:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.564+0000 7fde4e441640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:38758/0 (socket says 172.21.15.37:38758) 2024-09-21T01:23:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.568+0000 7fde4dc40640 1 -- 172.21.15.37:0/2213932920 learned_addr learned my addr 172.21.15.37:0/2213932920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.568+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c00fa70 con 0x55c107f13460 2024-09-21T01:23:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.568+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c00f3a0 con 0x55c107efe390 2024-09-21T01:23:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.568+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c00c5c0 con 0x55c107ef61b0 2024-09-21T01:23:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.568+0000 7fde56c19740 10 client.0 _ll_register_callbacks cb 0x7fde34009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.570+0000 7fde4e441640 1 -- 172.21.15.37:0/2213932920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 msgr2=0x55c1082d6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.570+0000 7fde4e441640 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.570+0000 7fde4e441640 1 -- 172.21.15.37:0/2213932920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f13460 msgr2=0x55c10834d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.570+0000 7fde4e441640 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f13460 0x55c10834d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.570+0000 7fde4e441640 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c10834dec0 con 0x55c107efe390 2024-09-21T01:23:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.571+0000 7fde4e441640 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d6fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55c1081b2ce0 tx=0x7fde3c00c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f0054d00199f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:10.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.575+0000 7fde31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:23:10.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.575+0000 7fde31ffb640 1 -- 172.21.15.37:0/2213932920 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c02e060 con 0x55c107efe390 2024-09-21T01:23:10.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.575+0000 7fde31ffb640 1 -- 172.21.15.37:0/2213932920 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fde3c00cd30 con 0x55c107efe390 2024-09-21T01:23:10.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.576+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c10823a850 con 0x55c107efe390 2024-09-21T01:23:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.587+0000 7fde31ffb640 1 -- 172.21.15.37:0/2213932920 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fde3c020460 con 0x55c107efe390 2024-09-21T01:23:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.590+0000 7fde56c19740 10 client.26048 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.590+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c10834f1e0 con 0x55c107efe390 2024-09-21T01:23:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.595+0000 7fde31ffb640 1 -- 172.21.15.37:0/2213932920 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c10823a850 con 0x55c107efe390 2024-09-21T01:23:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.595+0000 7fde31ffb640 1 -- 172.21.15.37:0/2213932920 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fde3c029690 con 0x55c107efe390 2024-09-21T01:23:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.595+0000 7fde56c19740 10 client.26048 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.595+0000 7fde56c19740 10 client.26048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.595+0000 7fde56c19740 20 client.26048 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.595+0000 7fde56c19740 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107f1f070 0x55c1083517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.596+0000 7fde56c19740 4 client.26048 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:23:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.596+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c108237c80 con 0x55c107f1f070 2024-09-21T01:23:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.596+0000 7fde4dc40640 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107f1f070 0x55c1083517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.600+0000 7fde4dc40640 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107f1f070 0x55c1083517c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5945786d5ab63a52 server_cookie=6b458bc318a0e5a5 in_seq=0 out_seq=0 2024-09-21T01:23:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.600+0000 7fde31ffb640 10 client.26048 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.603+0000 7fde31ffb640 1 -- 172.21.15.37:0/2213932920 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55c108237c80 con 0x55c107f1f070 2024-09-21T01:23:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.603+0000 7fde31ffb640 10 client.26048 handle_command_reply: tid=0 2024-09-21T01:23:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.603+0000 7fde56c19740 1 client.26048 shutdown 2024-09-21T01:23:10.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:10 smithi037 ceph-mon[31105]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 944 MiB/s wr, 1.37k op/s 2024-09-21T01:23:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.605+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 msgr2=0x55c1082d6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.605+0000 7fde56c19740 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d6fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55c1081b2ce0 tx=0x7fde3c00c470 comp rx=0 tx=0).stop 2024-09-21T01:23:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.607+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 shutdown_connections 2024-09-21T01:23:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.607+0000 7fde56c19740 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c107f1f070 0x55c1083517c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.608+0000 7fde56c19740 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c107f13460 0x55c10834d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.608+0000 7fde56c19740 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c107efe390 0x55c1082d6fc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.608+0000 7fde56c19740 1 --2- 172.21.15.37:0/2213932920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c107ef61b0 0x55c1082d6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.608+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 >> 172.21.15.37:0/2213932920 conn(0x55c1082d2fa0 msgr2=0x55c1082d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.608+0000 7fde31ffb640 0 client.26048 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.609+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 shutdown_connections 2024-09-21T01:23:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.609+0000 7fde56c19740 1 -- 172.21.15.37:0/2213932920 wait complete. 2024-09-21T01:23:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.610+0000 7fde56c19740 20 client.26048 trim_cache size 0 max 16384 2024-09-21T01:23:10.612 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:23:10.612 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:23:10.613 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:23:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:23:10.615 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:23:10.616 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.615+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde380b6710 msgr2=0x7fde380b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.615+0000 7fde4f443640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde380b6710 0x7fde380b8c20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde400cb2b0 tx=0x7fde4002a440 comp rx=0 tx=0).stop 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.615+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 msgr2=0x7fde4810d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 0x7fde4810d120 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fde40006010 tx=0x7fde40005560 comp rx=0 tx=0).stop 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 shutdown_connections 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde380b6710 0x7fde380b8c20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde48114280 0x7fde4810d120 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde48077380 0x7fde4810cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 --2- 172.21.15.37:0/229194306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde48075dd0 0x7fde48113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 >> 172.21.15.37:0/229194306 conn(0x7fde480ff400 msgr2=0x7fde481033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 shutdown_connections 2024-09-21T01:23:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:10.616+0000 7fde4f443640 1 -- 172.21.15.37:0/229194306 wait complete. 2024-09-21T01:23:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:10 smithi137 ceph-mon[34607]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 944 MiB/s wr, 1.37k op/s 2024-09-21T01:23:10.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:10 smithi144 ceph-mon[34818]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 944 MiB/s wr, 1.37k op/s 2024-09-21T01:23:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:12 smithi137 ceph-mon[34607]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 864 MiB/s wr, 1.34k op/s 2024-09-21T01:23:12.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:12 smithi144 ceph-mon[34818]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 864 MiB/s wr, 1.34k op/s 2024-09-21T01:23:13.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:12 smithi037 ceph-mon[31105]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 864 MiB/s wr, 1.34k op/s 2024-09-21T01:23:14.443 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:23:14.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:23:14.718 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:14 smithi037 ceph-mon[31105]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 883 MiB/s wr, 1.57k op/s 2024-09-21T01:23:14.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:14 smithi137 ceph-mon[34607]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 883 MiB/s wr, 1.57k op/s 2024-09-21T01:23:14.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:14 smithi144 ceph-mon[34818]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 883 MiB/s wr, 1.57k op/s 2024-09-21T01:23:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:16.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:16 smithi037 ceph-mon[31105]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 915 MiB/s wr, 1.97k op/s 2024-09-21T01:23:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:16 smithi137 ceph-mon[34607]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 915 MiB/s wr, 1.97k op/s 2024-09-21T01:23:16.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:16 smithi144 ceph-mon[34818]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 915 MiB/s wr, 1.97k op/s 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 -- 172.21.15.37:0/1901415723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 msgr2=0x7f812810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 --2- 172.21.15.37:0/1901415723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f812810e000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f811c009900 tx=0x7f811c02a420 comp rx=0 tx=0).stop 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 -- 172.21.15.37:0/1901415723 shutdown_connections 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 --2- 172.21.15.37:0/1901415723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f812811cba0 0x7f812811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 --2- 172.21.15.37:0/1901415723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f812810e000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 --2- 172.21.15.37:0/1901415723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8128111cd0 0x7f812810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.799+0000 7f812c9e3640 1 -- 172.21.15.37:0/1901415723 >> 172.21.15.37:0/1901415723 conn(0x7f812806e9f0 msgr2=0x7f812806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.801+0000 7f812c9e3640 1 -- 172.21.15.37:0/1901415723 shutdown_connections 2024-09-21T01:23:17.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.801+0000 7f812c9e3640 1 -- 172.21.15.37:0/1901415723 wait complete. 2024-09-21T01:23:17.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.803+0000 7f812c9e3640 1 Processor -- start 2024-09-21T01:23:17.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.804+0000 7f812c9e3640 1 -- start start 2024-09-21T01:23:17.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f812c9e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f81281a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:17.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f812c9e3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128111cd0 0x7f81281a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:17.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f8126d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f81281a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:17.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f8126d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f81281a8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:49460/0 (socket says 172.21.15.37:49460) 2024-09-21T01:23:17.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f8126d9d640 1 -- 172.21.15.37:0/3991389190 learned_addr learned my addr 172.21.15.37:0/3991389190 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:17.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f812811cba0 0x7f81281ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:17.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.805+0000 7f812659c640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128111cd0 0x7f81281a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:17.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.806+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81281226d0 con 0x7f812811cba0 2024-09-21T01:23:17.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.806+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8128122550 con 0x7f812810dbf0 2024-09-21T01:23:17.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.806+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8128122850 con 0x7f8128111cd0 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.810+0000 7f812759e640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f812811cba0 0x7f81281ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.810+0000 7f812659c640 1 -- 172.21.15.37:0/3991389190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 msgr2=0x7f81281a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.810+0000 7f812659c640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f81281a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.810+0000 7f812659c640 1 -- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f812811cba0 msgr2=0x7f81281ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.810+0000 7f812659c640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f812811cba0 0x7f81281ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.810+0000 7f812659c640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81281aee60 con 0x7f8128111cd0 2024-09-21T01:23:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.811+0000 7f812659c640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128111cd0 0x7f81281a9490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f811c02aa10 tx=0x7f811c032670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.815+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c03f070 con 0x7f8128111cd0 2024-09-21T01:23:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.815+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f811c004440 con 0x7f8128111cd0 2024-09-21T01:23:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.815+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c035070 con 0x7f8128111cd0 2024-09-21T01:23:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.815+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81281af0f0 con 0x7f8128111cd0 2024-09-21T01:23:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.815+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81281b58b0 con 0x7f8128111cd0 2024-09-21T01:23:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.819+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81281aa020 con 0x7f8128111cd0 2024-09-21T01:23:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.823+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f811c042070 con 0x7f8128111cd0 2024-09-21T01:23:17.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.825+0000 7f810ffff640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f81100b6720 0x7f81100b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:17.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.830+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f811c107fd0 con 0x7f8128111cd0 2024-09-21T01:23:17.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.830+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f811c049020 con 0x7f8128111cd0 2024-09-21T01:23:17.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.830+0000 7f8126d9d640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f81100b6720 0x7f81100b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:17.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:17.835+0000 7f8126d9d640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f81100b6720 0x7f81100b8c30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f811800bc80 tx=0x7f811800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.477+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f812811d0d0 con 0x7f8128111cd0 2024-09-21T01:23:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.484+0000 7f810ffff640 1 -- 172.21.15.37:0/3991389190 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11976 (secure 0 0 0) 0x7f811c0ce820 con 0x7f8128111cd0 2024-09-21T01:23:18.486 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:23:18.487 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-21T01:19:26:088830+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:19:25.613490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:23:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-21T01:23:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.490+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f81100b6720 msgr2=0x7f81100b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.490+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f81100b6720 0x7f81100b8c30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f811800bc80 tx=0x7f811800b410 comp rx=0 tx=0).stop 2024-09-21T01:23:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.490+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128111cd0 msgr2=0x7f81281a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:18.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.490+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128111cd0 0x7f81281a9490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f811c02aa10 tx=0x7f811c032670 comp rx=0 tx=0).stop 2024-09-21T01:23:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.491+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 shutdown_connections 2024-09-21T01:23:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.491+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f81100b6720 0x7f81100b8c30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.491+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f812811cba0 0x7f81281ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.491+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128111cd0 0x7f81281a9490 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.491+0000 7f812c9e3640 1 --2- 172.21.15.37:0/3991389190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f812810dbf0 0x7f81281a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.491+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 >> 172.21.15.37:0/3991389190 conn(0x7f812806e9f0 msgr2=0x7f812810cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.492+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 shutdown_connections 2024-09-21T01:23:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:18.492+0000 7f812c9e3640 1 -- 172.21.15.37:0/3991389190 wait complete. 2024-09-21T01:23:18.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:18 smithi144 ceph-mon[34818]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 827 MiB/s wr, 2.04k op/s 2024-09-21T01:23:18.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:18 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3991389190' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:23:18.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:18 smithi137 ceph-mon[34607]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 827 MiB/s wr, 2.04k op/s 2024-09-21T01:23:18.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:18 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3991389190' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:23:19.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:18 smithi037 ceph-mon[31105]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 827 MiB/s wr, 2.04k op/s 2024-09-21T01:23:19.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:18 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3991389190' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:23:20.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:23:20.910 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:20 smithi037 ceph-mon[31105]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 915 MiB/s wr, 2.30k op/s 2024-09-21T01:23:20.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:20 smithi144 ceph-mon[34818]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 915 MiB/s wr, 2.30k op/s 2024-09-21T01:23:20.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:20 smithi137 ceph-mon[34607]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 915 MiB/s wr, 2.30k op/s 2024-09-21T01:23:21.641 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.936+0000 7fc7bbb82640 1 -- 172.21.15.37:0/3425145409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b406b710 msgr2=0x7fc7b41040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.936+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/3425145409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b406b710 0x7fc7b41040d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc7b001a910 tx=0x7fc7b003b420 comp rx=0 tx=0).stop 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.937+0000 7fc7bbb82640 1 -- 172.21.15.37:0/3425145409 shutdown_connections 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.937+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/3425145409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b41071d0 0x7fc7b41076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.937+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/3425145409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7b4104610 0x7fc7b4106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.937+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/3425145409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b406b710 0x7fc7b41040d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.937+0000 7fc7bbb82640 1 -- 172.21.15.37:0/3425145409 >> 172.21.15.37:0/3425145409 conn(0x7fc7b40fdee0 msgr2=0x7fc7b4100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.938+0000 7fc7bbb82640 1 -- 172.21.15.37:0/3425145409 shutdown_connections 2024-09-21T01:23:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.939+0000 7fc7bbb82640 1 -- 172.21.15.37:0/3425145409 wait complete. 2024-09-21T01:23:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.940+0000 7fc7bbb82640 1 Processor -- start 2024-09-21T01:23:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.947+0000 7fc7bbb82640 1 -- start start 2024-09-21T01:23:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.948+0000 7fc7bbb82640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b406b710 0x7fc7b4074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.948+0000 7fc7bbb82640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7b4104610 0x7fc7b4074990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.948+0000 7fc7bbb82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 0x7fc7b41a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.948+0000 7fc7bbb82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b410b190 con 0x7fc7b41071d0 2024-09-21T01:23:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.948+0000 7fc7bbb82640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b410b010 con 0x7fc7b4104610 2024-09-21T01:23:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.948+0000 7fc7bbb82640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b410b310 con 0x7fc7b406b710 2024-09-21T01:23:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.949+0000 7fc7b991e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b406b710 0x7fc7b4074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.950+0000 7fc7ba11f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 0x7fc7b41a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.950+0000 7fc7ba11f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 0x7fc7b41a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59510/0 (socket says 172.21.15.37:59510) 2024-09-21T01:23:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.950+0000 7fc7ba11f640 1 -- 172.21.15.37:0/2288074890 learned_addr learned my addr 172.21.15.37:0/2288074890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.951+0000 7fc7ba11f640 1 -- 172.21.15.37:0/2288074890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b406b710 msgr2=0x7fc7b4074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.951+0000 7fc7ba11f640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b406b710 0x7fc7b4074340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.951+0000 7fc7ba11f640 1 -- 172.21.15.37:0/2288074890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7b4104610 msgr2=0x7fc7b4074990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:23:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.951+0000 7fc7ba11f640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7b4104610 0x7fc7b4074990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.952+0000 7fc7ba11f640 1 -- 172.21.15.37:0/2288074890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b41a80f0 con 0x7fc7b41071d0 2024-09-21T01:23:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.953+0000 7fc7ba11f640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 0x7fc7b41a78d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b970 tx=0x7fc7ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.953+0000 7fc7aaffd640 1 -- 172.21.15.37:0/2288074890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac019070 con 0x7fc7b41071d0 2024-09-21T01:23:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.954+0000 7fc7aaffd640 1 -- 172.21.15.37:0/2288074890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7ac014440 con 0x7fc7b41071d0 2024-09-21T01:23:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.956+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b41a83e0 con 0x7fc7b41071d0 2024-09-21T01:23:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.956+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b41a89b0 con 0x7fc7b41071d0 2024-09-21T01:23:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.964+0000 7fc7c2bcd740 1 Processor -- start 2024-09-21T01:23:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.972+0000 7fc7aaffd640 1 -- 172.21.15.37:0/2288074890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0075d0 con 0x7fc7b41071d0 2024-09-21T01:23:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.972+0000 7fc7aaffd640 1 -- 172.21.15.37:0/2288074890 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc7ac01c070 con 0x7fc7b41071d0 2024-09-21T01:23:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.973+0000 7fc7c2bcd740 1 -- start start 2024-09-21T01:23:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.977+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c64781de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.977+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 0x55c64781e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.977+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c64781f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.977+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6477906f0 con 0x55c64744d2f0 2024-09-21T01:23:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.977+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c64777fb20 con 0x55c6474761b0 2024-09-21T01:23:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.977+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c647783930 con 0x55c6474554d0 2024-09-21T01:23:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.979+0000 7fc7aaffd640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc7a00b65f0 0x7fc7a00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.980+0000 7fc7aaffd640 1 -- 172.21.15.37:0/2288074890 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc7ac00cc20 con 0x7fc7b41071d0 2024-09-21T01:23:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.982+0000 7fc7ba11f640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc7a00b65f0 0x7fc7a00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.984+0000 7fc7ba11f640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc7a00b65f0 0x7fc7a00b8b00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0ace30 tx=0x7fc7ac00e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.986+0000 7fc7b991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 0x55c64781e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.986+0000 7fc7b991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 0x55c64781e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59524/0 (socket says 172.21.15.37:59524) 2024-09-21T01:23:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.986+0000 7fc7b991e640 1 -- 172.21.15.37:0/3925341242 learned_addr learned my addr 172.21.15.37:0/3925341242 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.986+0000 7fc7b911d640 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c64781f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.986+0000 7fc7b911d640 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c64781de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.990+0000 7fc7b991e640 1 -- 172.21.15.37:0/3925341242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 msgr2=0x55c64781f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.990+0000 7fc7b991e640 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c64781f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.990+0000 7fc7b991e640 1 -- 172.21.15.37:0/3925341242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 msgr2=0x55c64781de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.990+0000 7fc7b991e640 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c64781de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.990+0000 7fc7b991e640 1 -- 172.21.15.37:0/3925341242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c647745530 con 0x55c64744d2f0 2024-09-21T01:23:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.995+0000 7fc7b991e640 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 0x55c64781e4c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0006010 tx=0x7fc7b00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd784e3dd4d32776 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.997+0000 7fc79ffff640 1 -- 172.21.15.37:0/3925341242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0046040 con 0x55c64744d2f0 2024-09-21T01:23:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.999+0000 7fc79ffff640 1 -- 172.21.15.37:0/3925341242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7b0004a40 con 0x55c64744d2f0 2024-09-21T01:23:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:21.999+0000 7fc79ffff640 1 -- 172.21.15.37:0/3925341242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0005580 con 0x55c64744d2f0 2024-09-21T01:23:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3925341242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 msgr2=0x55c64781e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 0x55c64781e4c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0006010 tx=0x7fc7b00047e0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3925341242 shutdown_connections 2024-09-21T01:23:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c64781f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c64744d2f0 0x55c64781e4c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3925341242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c64781de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.001+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3925341242 >> 172.21.15.37:0/3925341242 conn(0x55c64746a300 msgr2=0x55c6478198e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.006+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3925341242 shutdown_connections 2024-09-21T01:23:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.006+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3925341242 wait complete. 2024-09-21T01:23:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.007+0000 7fc7c2bcd740 1 -- start start 2024-09-21T01:23:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.008+0000 7fc7c2bcd740 1 Processor -- start 2024-09-21T01:23:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c64744d2f0 0x55c647827570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c647827c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c6478287a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6476b7ab0 con 0x55c6474761b0 2024-09-21T01:23:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c647725730 con 0x55c64744d2f0 2024-09-21T01:23:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c64781fad0 con 0x55c6474554d0 2024-09-21T01:23:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.009+0000 7fc7c2bcd740 10 client.0 _ll_register_callbacks cb 0x55c6477796b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.010+0000 7fc7b911d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c6478287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.010+0000 7fc7b911d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c6478287a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59526/0 (socket says 172.21.15.37:59526) 2024-09-21T01:23:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.010+0000 7fc7b911d640 1 -- 172.21.15.37:0/3859407662 learned_addr learned my addr 172.21.15.37:0/3859407662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.011+0000 7fc7b911d640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c64744d2f0 0x55c647827570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.012+0000 7fc7b991e640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c647827c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.012+0000 7fc7b911d640 1 -- 172.21.15.37:0/3859407662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 msgr2=0x55c647827c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.012+0000 7fc7b911d640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c647827c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.013+0000 7fc7b911d640 1 -- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c64744d2f0 msgr2=0x55c647827570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.013+0000 7fc7b911d640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c64744d2f0 0x55c647827570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.013+0000 7fc7b911d640 1 -- 172.21.15.37:0/3859407662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6474e1790 con 0x55c6474761b0 2024-09-21T01:23:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.014+0000 7fc7b911d640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c6478287a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4013a90 tx=0x7fc7a400d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e377434047e6ebf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.014+0000 7fc79d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.016+0000 7fc79d7fa640 1 -- 172.21.15.37:0/3859407662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4013310 con 0x55c6474761b0 2024-09-21T01:23:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.016+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b0004a40 con 0x55c6474761b0 2024-09-21T01:23:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.016+0000 7fc79d7fa640 1 -- 172.21.15.37:0/3859407662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc7a40119a0 con 0x55c6474761b0 2024-09-21T01:23:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.017+0000 7fc79d7fa640 1 -- 172.21.15.37:0/3859407662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7a4011ba0 con 0x55c6474761b0 2024-09-21T01:23:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.017+0000 7fc7c2bcd740 10 client.16626 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.017+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c64755a620 con 0x55c6474761b0 2024-09-21T01:23:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.018+0000 7fc79d7fa640 1 -- 172.21.15.37:0/3859407662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7b0004a40 con 0x55c6474761b0 2024-09-21T01:23:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc79d7fa640 1 -- 172.21.15.37:0/3859407662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc7a402a400 con 0x55c6474761b0 2024-09-21T01:23:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc7c2bcd740 10 client.16626 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc7c2bcd740 10 client.16626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc7c2bcd740 20 client.16626 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c647434d80 0x55c647835120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc7c2bcd740 4 client.16626 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.019+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c647792640 con 0x55c647434d80 2024-09-21T01:23:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.024+0000 7fc7b991e640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c647434d80 0x55c647835120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.033+0000 7fc79d7fa640 10 client.16626 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.033+0000 7fc7b991e640 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c647434d80 0x55c647835120 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa9ce262b95ca5c server_cookie=a02f45717e359729 in_seq=0 out_seq=0 2024-09-21T01:23:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.036+0000 7fc79d7fa640 1 -- 172.21.15.37:0/3859407662 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c647792640 con 0x55c647434d80 2024-09-21T01:23:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.036+0000 7fc79d7fa640 10 client.16626 handle_command_reply: tid=0 2024-09-21T01:23:22.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.036+0000 7fc7c2bcd740 1 client.16626 shutdown 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 msgr2=0x55c6478287a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c6478287a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4013a90 tx=0x7fc7a400d9a0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 shutdown_connections 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c647434d80 0x55c647835120 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c6478287a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c6474554d0 0x55c647827c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/3859407662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c64744d2f0 0x55c647827570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 >> 172.21.15.37:0/3859407662 conn(0x55c64746a300 msgr2=0x55c647817ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc79d7fa640 0 client.16626 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.037+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 shutdown_connections 2024-09-21T01:23:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.038+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/3859407662 wait complete. 2024-09-21T01:23:22.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.038+0000 7fc7c2bcd740 20 client.16626 trim_cache size 0 max 16384 2024-09-21T01:23:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.072+0000 7fc7c2bcd740 1 Processor -- start 2024-09-21T01:23:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.072+0000 7fc7c2bcd740 1 -- start start 2024-09-21T01:23:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.072+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c647826770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.072+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 0x55c6478145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.072+0000 7fc7b991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 0x55c6478145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.073+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c647818610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.073+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41b1630 con 0x55c6474554d0 2024-09-21T01:23:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.073+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41b3170 con 0x55c6474761b0 2024-09-21T01:23:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.073+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41b1d00 con 0x55c64744d2f0 2024-09-21T01:23:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.073+0000 7fc7b991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 0x55c6478145c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59540/0 (socket says 172.21.15.37:59540) 2024-09-21T01:23:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.073+0000 7fc7b991e640 1 -- 172.21.15.37:0/4091103686 learned_addr learned my addr 172.21.15.37:0/4091103686 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b911d640 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c647826770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b991e640 1 -- 172.21.15.37:0/4091103686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 msgr2=0x55c647826770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b991e640 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c647826770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b991e640 1 -- 172.21.15.37:0/4091103686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 msgr2=0x55c647818610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b991e640 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c647818610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b991e640 1 -- 172.21.15.37:0/4091103686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6478278e0 con 0x55c6474554d0 2024-09-21T01:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.075+0000 7fc7b991e640 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 0x55c6478145c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0004850 tx=0x7fc7b001a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ab621bbec02315 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.076+0000 7fc79f7fe640 1 -- 172.21.15.37:0/4091103686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0046030 con 0x55c6474554d0 2024-09-21T01:23:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.076+0000 7fc79f7fe640 1 -- 172.21.15.37:0/4091103686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7b0004a40 con 0x55c6474554d0 2024-09-21T01:23:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.076+0000 7fc79f7fe640 1 -- 172.21.15.37:0/4091103686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0005650 con 0x55c6474554d0 2024-09-21T01:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.078+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/4091103686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 msgr2=0x55c6478145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.078+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 0x55c6478145c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0004850 tx=0x7fc7b001a890 comp rx=0 tx=0).stop 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/4091103686 shutdown_connections 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474761b0 0x55c647818610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474554d0 0x55c6478145c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/4091103686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c647826770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/4091103686 >> 172.21.15.37:0/4091103686 conn(0x55c64746a300 msgr2=0x55c647817ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/4091103686 shutdown_connections 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.079+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/4091103686 wait complete. 2024-09-21T01:23:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.080+0000 7fc7c2bcd740 1 -- start start 2024-09-21T01:23:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.080+0000 7fc7c2bcd740 1 Processor -- start 2024-09-21T01:23:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.081+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c64782c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.081+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474554d0 0x55c64782ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.081+0000 7fc7c2bcd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c64782d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41b2aa0 con 0x55c6474761b0 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41b23d0 con 0x55c6474554d0 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7c2bcd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b41af5f0 con 0x55c64744d2f0 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7c2bcd740 10 client.0 _ll_register_callbacks cb 0x7fc7a400dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c64782d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c64782d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59550/0 (socket says 172.21.15.37:59550) 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 -- 172.21.15.37:0/1082505265 learned_addr learned my addr 172.21.15.37:0/1082505265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b991e640 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474554d0 0x55c64782ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 -- 172.21.15.37:0/1082505265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 msgr2=0x55c64782c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c64782c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 -- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474554d0 msgr2=0x55c64782ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.082+0000 7fc7b911d640 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474554d0 0x55c64782ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.083+0000 7fc7b911d640 1 -- 172.21.15.37:0/1082505265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c64782dd60 con 0x55c6474761b0 2024-09-21T01:23:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.083+0000 7fc7b911d640 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c64782d600 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4005ce0 tx=0x7fc7a4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e50262106c850a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.083+0000 7fc79d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.083+0000 7fc79d7fa640 1 -- 172.21.15.37:0/1082505265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a402a9f0 con 0x55c6474761b0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.084+0000 7fc79d7fa640 1 -- 172.21.15.37:0/1082505265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc7a402ab90 con 0x55c6474761b0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.084+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b0004a40 con 0x55c6474761b0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.084+0000 7fc79d7fa640 1 -- 172.21.15.37:0/1082505265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7a4013310 con 0x55c6474761b0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.084+0000 7fc7c2bcd740 10 client.16632 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.084+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c64782f0e0 con 0x55c6474761b0 2024-09-21T01:23:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc79d7fa640 1 -- 172.21.15.37:0/1082505265 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7b0004a40 con 0x55c6474761b0 2024-09-21T01:23:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc79d7fa640 1 -- 172.21.15.37:0/1082505265 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc7a40035f0 con 0x55c6474761b0 2024-09-21T01:23:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc7c2bcd740 10 client.16632 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc7c2bcd740 10 client.16632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc7c2bcd740 20 client.16632 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c64740a1c0 0x55c6478a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc7c2bcd740 4 client.16632 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:23:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.085+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c64778e0f0 con 0x55c64740a1c0 2024-09-21T01:23:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.086+0000 7fc7b991e640 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c64740a1c0 0x55c6478a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.089+0000 7fc7b991e640 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c64740a1c0 0x55c6478a1f20 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7c7ebbc6d7449a server_cookie=97643d0b0e38ad03 in_seq=0 out_seq=0 2024-09-21T01:23:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:22.089+0000 7fc79d7fa640 10 client.16632 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:22.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:22 smithi137 ceph-mon[34607]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 2.15k op/s 2024-09-21T01:23:22.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:22 smithi144 ceph-mon[34818]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 2.15k op/s 2024-09-21T01:23:23.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:22 smithi037 ceph-mon[31105]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 794 MiB/s wr, 2.15k op/s 2024-09-21T01:23:23.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 -- 172.21.15.37:0/2030100350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c078370 msgr2=0x7f201c113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2030100350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c078370 0x7f201c113f40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2018009900 tx=0x7f201802a410 comp rx=0 tx=0).stop 2024-09-21T01:23:23.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 -- 172.21.15.37:0/2030100350 shutdown_connections 2024-09-21T01:23:23.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2030100350 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c114480 0x7f201c1168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2030100350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c078370 0x7f201c113f40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2030100350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c077a20 0x7f201c077e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.527+0000 7f2022f1a640 1 -- 172.21.15.37:0/2030100350 >> 172.21.15.37:0/2030100350 conn(0x7f201c101610 msgr2=0x7f201c103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.529+0000 7f2022f1a640 1 -- 172.21.15.37:0/2030100350 shutdown_connections 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.531+0000 7f2022f1a640 1 -- 172.21.15.37:0/2030100350 wait complete. 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.532+0000 7f2022f1a640 1 Processor -- start 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.532+0000 7f2022f1a640 1 -- start start 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.533+0000 7f2022f1a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c077a20 0x7f201c074e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.533+0000 7f2022f1a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c078370 0x7f201c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.533+0000 7f2022f1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c114480 0x7f201c06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.534+0000 7f2022f1a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f201c119f10 con 0x7f201c114480 2024-09-21T01:23:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.534+0000 7f2022f1a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f201c119d90 con 0x7f201c078370 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.534+0000 7f2022f1a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f201c11a090 con 0x7f201c077a20 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.535+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c114480 0x7f201c06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.535+0000 7f2021717640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c078370 0x7f201c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.536+0000 7f2021717640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c078370 0x7f201c06e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:49540/0 (socket says 172.21.15.37:49540) 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.536+0000 7f2021717640 1 -- 172.21.15.37:0/2464171499 learned_addr learned my addr 172.21.15.37:0/2464171499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.538+0000 7f2022719640 1 -- 172.21.15.37:0/2464171499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c077a20 msgr2=0x7f201c074e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.538+0000 7f2022719640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c077a20 0x7f201c074e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.539+0000 7f2022719640 1 -- 172.21.15.37:0/2464171499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c078370 msgr2=0x7f201c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.539+0000 7f2022719640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c078370 0x7f201c06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.539+0000 7f2022719640 1 -- 172.21.15.37:0/2464171499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c06eed0 con 0x7f201c114480 2024-09-21T01:23:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.540+0000 7f2022719640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c114480 0x7f201c06e6b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c710 tx=0x7f200c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.540+0000 7f2012ffd640 1 -- 172.21.15.37:0/2464171499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c004220 con 0x7f201c114480 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.541+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c073b90 con 0x7f201c114480 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.541+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c0740a0 con 0x7f201c114480 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.541+0000 7f2012ffd640 1 -- 172.21.15.37:0/2464171499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f200c00ce20 con 0x7f201c114480 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.541+0000 7f2012ffd640 1 -- 172.21.15.37:0/2464171499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c003d50 con 0x7f201c114480 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.546+0000 7f202a6f0740 1 Processor -- start 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.551+0000 7f202a6f0740 1 -- start start 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.552+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128de860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.552+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128deda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.552+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.552+0000 7f202a6f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556712854ea0 con 0x556712537070 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.552+0000 7f202a6f0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5567128442d0 con 0x55671250e1b0 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.552+0000 7f202a6f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5567128480e0 con 0x556712516390 2024-09-21T01:23:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.553+0000 7f2021717640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.553+0000 7f2021717640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128df2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:33490/0 (socket says 172.21.15.37:33490) 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.553+0000 7f2021717640 1 -- 172.21.15.37:0/3845328959 learned_addr learned my addr 172.21.15.37:0/3845328959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.553+0000 7f2012ffd640 1 -- 172.21.15.37:0/2464171499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f200c0035f0 con 0x7f201c114480 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.554+0000 7f2021717640 1 -- 172.21.15.37:0/3845328959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 msgr2=0x5567128deda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.554+0000 7f2021717640 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128deda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.554+0000 7f2021717640 1 -- 172.21.15.37:0/3845328959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 msgr2=0x5567128de860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.554+0000 7f2021717640 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.554+0000 7f2021717640 1 -- 172.21.15.37:0/3845328959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567125a2650 con 0x556712516390 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.556+0000 7f2021717640 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128df2e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2018009850 tx=0x7f20180042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee7243e765cade24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.556+0000 7f2007fff640 1 -- 172.21.15.37:0/3845328959 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018035070 con 0x556712516390 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.556+0000 7f2007fff640 1 -- 172.21.15.37:0/3845328959 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2018041030 con 0x556712516390 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.556+0000 7f2007fff640 1 -- 172.21.15.37:0/3845328959 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018003850 con 0x556712516390 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.558+0000 7f202a6f0740 1 -- 172.21.15.37:0/3845328959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 msgr2=0x5567128df2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.558+0000 7f202a6f0740 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128df2e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2018009850 tx=0x7f20180042f0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.559+0000 7f2012ffd640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20080b6650 0x7f20080b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.559+0000 7f202a6f0740 1 -- 172.21.15.37:0/3845328959 shutdown_connections 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.559+0000 7f202a6f0740 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128df2e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.559+0000 7f202a6f0740 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.559+0000 7f202a6f0740 1 --2- 172.21.15.37:0/3845328959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.559+0000 7f202a6f0740 1 -- 172.21.15.37:0/3845328959 >> 172.21.15.37:0/3845328959 conn(0x55671252b460 msgr2=0x5567128dc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.560+0000 7f202a6f0740 1 -- 172.21.15.37:0/3845328959 shutdown_connections 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.562+0000 7f2012ffd640 1 -- 172.21.15.37:0/2464171499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f200c0e6cc0 con 0x7f201c114480 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.563+0000 7f202a6f0740 1 -- 172.21.15.37:0/3845328959 wait complete. 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.563+0000 7f202a6f0740 1 -- start start 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 Processor -- start 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x556712907370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5567126a5700 con 0x556712537070 2024-09-21T01:23:23.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5567127df160 con 0x55671250e1b0 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.564+0000 7f202a6f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5567128fdff0 con 0x556712516390 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.565+0000 7f202a6f0740 10 client.0 _ll_register_callbacks cb 0x5567127f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.566+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x556712907370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.566+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x556712907370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59576/0 (socket says 172.21.15.37:59576) 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.566+0000 7f2022719640 1 -- 172.21.15.37:0/2221004208 learned_addr learned my addr 172.21.15.37:0/2221004208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.567+0000 7f2022719640 1 -- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 msgr2=0x5567128ea480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.567+0000 7f2022719640 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.567+0000 7f2022719640 1 -- 172.21.15.37:0/2221004208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 msgr2=0x5567128e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.567+0000 7f2022719640 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.567+0000 7f2022719640 1 -- 172.21.15.37:0/2221004208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671280cc90 con 0x556712537070 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.568+0000 7f2022719640 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x556712907370 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f200c0acb10 tx=0x7f200c0ac640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ae7ac7ad4751e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.569+0000 7f20057fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.569+0000 7f2021717640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20080b6650 0x7f20080b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.569+0000 7f20057fa640 1 -- 172.21.15.37:0/2221004208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c01d040 con 0x556712537070 2024-09-21T01:23:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.570+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2018041030 con 0x556712537070 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.570+0000 7f20057fa640 1 -- 172.21.15.37:0/2221004208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f200c0ac070 con 0x556712537070 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.571+0000 7f20057fa640 1 -- 172.21.15.37:0/2221004208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f200c0b18f0 con 0x556712537070 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.572+0000 7f2021717640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20080b6650 0x7f20080b8b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2018005ab0 tx=0x7f2018048040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.573+0000 7f202a6f0740 10 client.16641 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.573+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556712909d80 con 0x556712537070 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.576+0000 7f20057fa640 1 -- 172.21.15.37:0/2221004208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2018041030 con 0x556712537070 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.578+0000 7f20057fa640 1 -- 172.21.15.37:0/2221004208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f200c0abae0 con 0x556712537070 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.579+0000 7f202a6f0740 10 client.16641 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.579+0000 7f202a6f0740 10 client.16641 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.579+0000 7f202a6f0740 20 client.16641 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.579+0000 7f202a6f0740 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5567124f59f0 0x55671290d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.579+0000 7f202a6f0740 4 client.16641 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.579+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556712856df0 con 0x5567124f59f0 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.582+0000 7f2021f18640 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5567124f59f0 0x55671290d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.585+0000 7f2021f18640 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5567124f59f0 0x55671290d690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=98b73ddf69a3a94c server_cookie=ce0b0290b182131b in_seq=0 out_seq=0 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.585+0000 7f20057fa640 10 client.16641 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.587+0000 7f20057fa640 1 -- 172.21.15.37:0/2221004208 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556712856df0 con 0x5567124f59f0 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.587+0000 7f20057fa640 10 client.16641 handle_command_reply: tid=0 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.587+0000 7f202a6f0740 1 client.16641 shutdown 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 msgr2=0x556712907370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x556712907370 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f200c0acb10 tx=0x7f200c0ac640 comp rx=0 tx=0).stop 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 shutdown_connections 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x5567124f59f0 0x55671290d690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x556712907370 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 --2- 172.21.15.37:0/2221004208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.591+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 >> 172.21.15.37:0/2221004208 conn(0x55671252b460 msgr2=0x5567128e19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.595+0000 7f20057fa640 0 client.16641 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:23:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.595+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 shutdown_connections 2024-09-21T01:23:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.596+0000 7f202a6f0740 1 -- 172.21.15.37:0/2221004208 wait complete. 2024-09-21T01:23:23.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.597+0000 7f202a6f0740 20 client.16641 trim_cache size 0 max 16384 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.640+0000 7f202a6f0740 1 Processor -- start 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.641+0000 7f202a6f0740 1 -- start start 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.641+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.642+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.642+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128d76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.642+0000 7f202a6f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f200000e3d0 con 0x556712537070 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.643+0000 7f202a6f0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f200000ff10 con 0x55671250e1b0 2024-09-21T01:23:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.644+0000 7f202a6f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f200000eaa0 con 0x556712516390 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.644+0000 7f2021717640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.644+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128d76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.644+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128d76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59580/0 (socket says 172.21.15.37:59580) 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.644+0000 7f2022719640 1 -- 172.21.15.37:0/4017310658 learned_addr learned my addr 172.21.15.37:0/4017310658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.644+0000 7f2021f18640 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.646+0000 7f2021f18640 1 -- 172.21.15.37:0/4017310658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 msgr2=0x5567128ea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.646+0000 7f2021f18640 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.646+0000 7f2021f18640 1 -- 172.21.15.37:0/4017310658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 msgr2=0x5567128d76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.646+0000 7f2021f18640 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128d76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.646+0000 7f2021f18640 1 -- 172.21.15.37:0/4017310658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567128dd510 con 0x55671250e1b0 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.647+0000 7f2021f18640 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e56f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55671290de00 tx=0x7f2014004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29dea7f10a50a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.648+0000 7f20077fe640 1 -- 172.21.15.37:0/4017310658 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201401c070 con 0x55671250e1b0 2024-09-21T01:23:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.648+0000 7f20077fe640 1 -- 172.21.15.37:0/4017310658 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2014004d20 con 0x55671250e1b0 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 -- 172.21.15.37:0/4017310658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 msgr2=0x5567128e56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e56f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55671290de00 tx=0x7f2014004a40 comp rx=0 tx=0).stop 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 -- 172.21.15.37:0/4017310658 shutdown_connections 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556712537070 0x5567128d76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712516390 0x5567128ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 --2- 172.21.15.37:0/4017310658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128e56f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.649+0000 7f202a6f0740 1 -- 172.21.15.37:0/4017310658 >> 172.21.15.37:0/4017310658 conn(0x55671252b460 msgr2=0x5567128e9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.653+0000 7f202a6f0740 1 -- 172.21.15.37:0/4017310658 shutdown_connections 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.653+0000 7f202a6f0740 1 -- 172.21.15.37:0/4017310658 wait complete. 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.654+0000 7f202a6f0740 1 -- start start 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.655+0000 7f202a6f0740 1 Processor -- start 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.656+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.656+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712537070 0x5567128ff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.657+0000 7f202a6f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567124cada0 0x5567129031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.657+0000 7f202a6f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f200000f840 con 0x5567124cada0 2024-09-21T01:23:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.657+0000 7f202a6f0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f200000f170 con 0x55671250e1b0 2024-09-21T01:23:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.657+0000 7f202a6f0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f200000c460 con 0x556712537070 2024-09-21T01:23:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.657+0000 7f202a6f0740 10 client.0 _ll_register_callbacks cb 0x7f200c00a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:23.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.665+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567124cada0 0x5567129031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.665+0000 7f2022719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567124cada0 0x5567129031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59596/0 (socket says 172.21.15.37:59596) 2024-09-21T01:23:23.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.665+0000 7f2022719640 1 -- 172.21.15.37:0/1731717262 learned_addr learned my addr 172.21.15.37:0/1731717262 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:23.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.665+0000 7f2021717640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712537070 0x5567128ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.665+0000 7f2021f18640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.666+0000 7f2021717640 1 -- 172.21.15.37:0/1731717262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 msgr2=0x5567128fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.666+0000 7f2021717640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128fed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.666+0000 7f2021717640 1 -- 172.21.15.37:0/1731717262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567124cada0 msgr2=0x5567129031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.666+0000 7f2021717640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567124cada0 0x5567129031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.666+0000 7f2021717640 1 -- 172.21.15.37:0/1731717262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567128e4b70 con 0x556712537070 2024-09-21T01:23:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.667+0000 7f2021717640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712537070 0x5567128ff310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2018000c00 tx=0x7f201802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f21e7d6b97225dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.671+0000 7f20057fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.671+0000 7f20057fa640 1 -- 172.21.15.37:0/1731717262 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018058070 con 0x556712537070 2024-09-21T01:23:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.671+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2014004d20 con 0x556712537070 2024-09-21T01:23:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.671+0000 7f20057fa640 1 -- 172.21.15.37:0/1731717262 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f20180051a0 con 0x556712537070 2024-09-21T01:23:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.674+0000 7f20057fa640 1 -- 172.21.15.37:0/1731717262 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2018064050 con 0x556712537070 2024-09-21T01:23:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.674+0000 7f202a6f0740 10 client.26047 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.674+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5567129779b0 con 0x556712537070 2024-09-21T01:23:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.675+0000 7f20057fa640 1 -- 172.21.15.37:0/1731717262 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2014004d20 con 0x556712537070 2024-09-21T01:23:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.675+0000 7f20057fa640 1 -- 172.21.15.37:0/1731717262 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2018046470 con 0x556712537070 2024-09-21T01:23:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.677+0000 7f202a6f0740 10 client.26047 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.677+0000 7f202a6f0740 10 client.26047 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:23:23.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.677+0000 7f202a6f0740 20 client.26047 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:23.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.677+0000 7f202a6f0740 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x556712978080 0x55671297a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:23.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.677+0000 7f202a6f0740 4 client.26047 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:23:23.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.677+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5567128528a0 con 0x556712978080 2024-09-21T01:23:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.683+0000 7f2021f18640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x556712978080 0x55671297a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.701+0000 7f20057fa640 10 client.26047 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:23:23.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.701+0000 7f2021f18640 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x556712978080 0x55671297a4a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=389ea2058ac46377 server_cookie=51a00ea1ffc27b27 in_seq=0 out_seq=0 2024-09-21T01:23:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.702+0000 7f20057fa640 1 -- 172.21.15.37:0/1731717262 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5567128528a0 con 0x556712978080 2024-09-21T01:23:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.702+0000 7f20057fa640 10 client.26047 handle_command_reply: tid=0 2024-09-21T01:23:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.703+0000 7f202a6f0740 1 client.26047 shutdown 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712537070 msgr2=0x5567128ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712537070 0x5567128ff310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2018000c00 tx=0x7f201802a410 comp rx=0 tx=0).stop 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 shutdown_connections 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x556712978080 0x55671297a4a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567124cada0 0x5567129031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556712537070 0x5567128ff310 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 --2- 172.21.15.37:0/1731717262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55671250e1b0 0x5567128fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 >> 172.21.15.37:0/1731717262 conn(0x55671252b460 msgr2=0x5567128e1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.704+0000 7f20057fa640 0 client.26047 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:23:23.710 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:23:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.705+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 shutdown_connections 2024-09-21T01:23:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.706+0000 7f202a6f0740 1 -- 172.21.15.37:0/1731717262 wait complete. 2024-09-21T01:23:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.707+0000 7f202a6f0740 20 client.26047 trim_cache size 0 max 16384 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.709+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20080b6650 msgr2=0x7f20080b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.709+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20080b6650 0x7f20080b8b60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2018005ab0 tx=0x7f2018048040 comp rx=0 tx=0).stop 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.709+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c114480 msgr2=0x7f201c06e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.709+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c114480 0x7f201c06e6b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c710 tx=0x7f200c00cbd0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 shutdown_connections 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20080b6650 0x7f20080b8b60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f201c114480 0x7f201c06e6b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f201c078370 0x7f201c06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 --2- 172.21.15.37:0/2464171499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c077a20 0x7f201c074e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 >> 172.21.15.37:0/2464171499 conn(0x7f201c101610 msgr2=0x7f201c103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 shutdown_connections 2024-09-21T01:23:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:23.710+0000 7f2022f1a640 1 -- 172.21.15.37:0/2464171499 wait complete. 2024-09-21T01:23:25.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:24 smithi037 ceph-mon[31105]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 866 MiB/s wr, 2.13k op/s 2024-09-21T01:23:25.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:24 smithi137 ceph-mon[34607]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 866 MiB/s wr, 2.13k op/s 2024-09-21T01:23:25.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:24 smithi144 ceph-mon[34818]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 866 MiB/s wr, 2.13k op/s 2024-09-21T01:23:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.443+0000 7fc79d7fa640 1 -- 172.21.15.37:0/1082505265 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c64778e0f0 con 0x55c64740a1c0 2024-09-21T01:23:25.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.443+0000 7fc79d7fa640 10 client.16632 handle_command_reply: tid=0 2024-09-21T01:23:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.444+0000 7fc7c2bcd740 1 client.16632 shutdown 2024-09-21T01:23:25.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.446+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 msgr2=0x55c64782d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:25.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.446+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c64782d600 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4005ce0 tx=0x7fc7a4005b50 comp rx=0 tx=0).stop 2024-09-21T01:23:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 shutdown_connections 2024-09-21T01:23:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55c64740a1c0 0x55c6478a1f20 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6474761b0 0x55c64782d600 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6474554d0 0x55c64782ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc7c2bcd740 1 --2- 172.21.15.37:0/1082505265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c64744d2f0 0x55c64782c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 >> 172.21.15.37:0/1082505265 conn(0x55c64746a300 msgr2=0x55c6478145c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.449+0000 7fc79d7fa640 0 client.16632 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.450+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 shutdown_connections 2024-09-21T01:23:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.450+0000 7fc7c2bcd740 1 -- 172.21.15.37:0/1082505265 wait complete. 2024-09-21T01:23:25.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.453+0000 7fc7c2bcd740 20 client.16632 trim_cache size 0 max 16384 2024-09-21T01:23:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:23:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:23:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:23:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:23:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.457+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc7a00b65f0 msgr2=0x7fc7a00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:25.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.457+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc7a00b65f0 0x7fc7a00b8b00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0ace30 tx=0x7fc7ac00e040 comp rx=0 tx=0).stop 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.457+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 msgr2=0x7fc7b41a78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.457+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 0x7fc7b41a78d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b970 tx=0x7fc7ac00be30 comp rx=0 tx=0).stop 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.458+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 shutdown_connections 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.458+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc7a00b65f0 0x7fc7a00b8b00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.458+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b41071d0 0x7fc7b41a78d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.458+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7b4104610 0x7fc7b4074990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.458+0000 7fc7bbb82640 1 --2- 172.21.15.37:0/2288074890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b406b710 0x7fc7b4074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:25.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.458+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 >> 172.21.15.37:0/2288074890 conn(0x7fc7b40fdee0 msgr2=0x7fc7b4100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:25.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.461+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 shutdown_connections 2024-09-21T01:23:25.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:25.465+0000 7fc7bbb82640 1 -- 172.21.15.37:0/2288074890 wait complete. 2024-09-21T01:23:26.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:23:27.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:26 smithi037 ceph-mon[31105]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 2.05k op/s 2024-09-21T01:23:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:26 smithi137 ceph-mon[34607]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 2.05k op/s 2024-09-21T01:23:27.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:26 smithi144 ceph-mon[34818]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 2.05k op/s 2024-09-21T01:23:27.193 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:28.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:27 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:23:28.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:27 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:23:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:27 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:23:28.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 787 MiB/s wr, 1.61k op/s 2024-09-21T01:23:28.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:28.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 787 MiB/s wr, 1.61k op/s 2024-09-21T01:23:29.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 787 MiB/s wr, 1.61k op/s 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.173 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:23:29.499 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:23:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.165+0000 7f1a43408640 1 -- 172.21.15.37:0/3111047959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c111cd0 msgr2=0x7f1a3c10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.165+0000 7f1a43408640 1 --2- 172.21.15.37:0/3111047959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c111cd0 0x7f1a3c10d6b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009ca0 tx=0x7f1a3402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.167+0000 7f1a43408640 1 -- 172.21.15.37:0/3111047959 shutdown_connections 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.167+0000 7f1a43408640 1 --2- 172.21.15.37:0/3111047959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c11cba0 0x7f1a3c11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.167+0000 7f1a43408640 1 --2- 172.21.15.37:0/3111047959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c10dbf0 0x7f1a3c10e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.167+0000 7f1a43408640 1 --2- 172.21.15.37:0/3111047959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c111cd0 0x7f1a3c10d6b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.167+0000 7f1a43408640 1 -- 172.21.15.37:0/3111047959 >> 172.21.15.37:0/3111047959 conn(0x7f1a3c06e9f0 msgr2=0x7f1a3c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.175+0000 7f1a43408640 1 -- 172.21.15.37:0/3111047959 shutdown_connections 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.175+0000 7f1a43408640 1 -- 172.21.15.37:0/3111047959 wait complete. 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 Processor -- start 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 -- start start 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c10dbf0 0x7f1a3c1a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c11cba0 0x7f1a3c1a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 0x7f1a3c1ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c122740 con 0x7f1a3c1ae530 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1225c0 con 0x7f1a3c10dbf0 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.177+0000 7f1a43408640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c1228c0 con 0x7f1a3c11cba0 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.180+0000 7f1a42c07640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 0x7f1a3c1ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.180+0000 7f1a42c07640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 0x7f1a3c1ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39894/0 (socket says 172.21.15.37:39894) 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.180+0000 7f1a42c07640 1 -- 172.21.15.37:0/2437733828 learned_addr learned my addr 172.21.15.37:0/2437733828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.180+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c11cba0 0x7f1a3c1a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.180+0000 7f1a42c07640 1 -- 172.21.15.37:0/2437733828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c11cba0 msgr2=0x7f1a3c1a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.181+0000 7f1a42c07640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c11cba0 0x7f1a3c1a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.181+0000 7f1a42c07640 1 -- 172.21.15.37:0/2437733828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c10dbf0 msgr2=0x7f1a3c1a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.181+0000 7f1a42c07640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c10dbf0 0x7f1a3c1a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.181+0000 7f1a42c07640 1 -- 172.21.15.37:0/2437733828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3c1af180 con 0x7f1a3c1ae530 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.181+0000 7f1a42c07640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 0x7f1a3c1ae960 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00d750 tx=0x7f1a2c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.183+0000 7f1a337fe640 1 -- 172.21.15.37:0/2437733828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c017070 con 0x7f1a3c1ae530 2024-09-21T01:23:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.184+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3c112380 con 0x7f1a3c1ae530 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.184+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3c1128c0 con 0x7f1a3c1ae530 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.184+0000 7f1a337fe640 1 -- 172.21.15.37:0/2437733828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a2c0054d0 con 0x7f1a3c1ae530 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.184+0000 7f1a337fe640 1 -- 172.21.15.37:0/2437733828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c004c60 con 0x7f1a3c1ae530 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.188+0000 7f1a4abde740 1 Processor -- start 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 -- start start 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bac03070 0x55e0bafaa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafaa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0babe2390 0x55e0bafaaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e0baf20ea0 con 0x55e0bac03070 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e0baf102d0 con 0x55e0babe2390 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.189+0000 7f1a4abde740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0baf140e0 con 0x55e0babda1b0 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.192+0000 7f1a42406640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafaa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.192+0000 7f1a42406640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafaa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:50946/0 (socket says 172.21.15.37:50946) 2024-09-21T01:23:29.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.192+0000 7f1a42406640 1 -- 172.21.15.37:0/3330081744 learned_addr learned my addr 172.21.15.37:0/3330081744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.193+0000 7f1a41c05640 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0babe2390 0x55e0bafaaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.193+0000 7f1a41c05640 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bac03070 0x55e0bafaa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.195+0000 7f1a337fe640 1 -- 172.21.15.37:0/2437733828 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1a2c009bd0 con 0x7f1a3c1ae530 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.197+0000 7f1a42406640 1 -- 172.21.15.37:0/3330081744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0babe2390 msgr2=0x55e0bafaaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.197+0000 7f1a42406640 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0babe2390 0x55e0bafaaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.197+0000 7f1a42406640 1 -- 172.21.15.37:0/3330081744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bac03070 msgr2=0x55e0bafaa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.197+0000 7f1a42406640 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bac03070 0x55e0bafaa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.197+0000 7f1a42406640 1 -- 172.21.15.37:0/3330081744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bac6e650 con 0x55e0babda1b0 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.202+0000 7f1a42406640 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafaa9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009490 tx=0x7f1a34004aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d608d4dc639dd76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.204+0000 7f1a337fe640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1a280b6710 0x7f1a280b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.204+0000 7f1a337fe640 1 -- 172.21.15.37:0/2437733828 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1a2c0e6a60 con 0x7f1a3c1ae530 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.205+0000 7f1a30ff9640 1 -- 172.21.15.37:0/3330081744 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34003970 con 0x55e0babda1b0 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.205+0000 7f1a30ff9640 1 -- 172.21.15.37:0/3330081744 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a3403f070 con 0x55e0babda1b0 2024-09-21T01:23:29.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.207+0000 7f1a4abde740 1 -- 172.21.15.37:0/3330081744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 msgr2=0x55e0bafaa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.207+0000 7f1a4abde740 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafaa9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009490 tx=0x7f1a34004aa0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.210+0000 7f1a4abde740 1 -- 172.21.15.37:0/3330081744 shutdown_connections 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.210+0000 7f1a4abde740 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0babe2390 0x55e0bafaaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.210+0000 7f1a4abde740 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafaa9a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.210+0000 7f1a4abde740 1 --2- 172.21.15.37:0/3330081744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bac03070 0x55e0bafaa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.210+0000 7f1a4abde740 1 -- 172.21.15.37:0/3330081744 >> 172.21.15.37:0/3330081744 conn(0x55e0babf7460 msgr2=0x55e0bafa8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.210+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1a280b6710 0x7f1a280b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.211+0000 7f1a4abde740 1 -- 172.21.15.37:0/3330081744 shutdown_connections 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.212+0000 7f1a4abde740 1 -- 172.21.15.37:0/3330081744 wait complete. 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.212+0000 7f1a4abde740 1 -- start start 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.213+0000 7f1a4abde740 1 Processor -- start 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafb5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 0x55e0bafb60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafc2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e0bad71700 con 0x55e0babe2390 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e0baeab160 con 0x55e0bac03070 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0bafb8c30 con 0x55e0babda1b0 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.216+0000 7f1a4abde740 10 client.0 _ll_register_callbacks cb 0x55e0baec49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.217+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1a280b6710 0x7f1a280b8c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a380058c0 tx=0x7f1a38005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.217+0000 7f1a41c05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 0x55e0bafb60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.217+0000 7f1a41c05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 0x55e0bafb60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39900/0 (socket says 172.21.15.37:39900) 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.217+0000 7f1a41c05640 1 -- 172.21.15.37:0/141896237 learned_addr learned my addr 172.21.15.37:0/141896237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a42c07640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafc2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a42406640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafb5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a41c05640 1 -- 172.21.15.37:0/141896237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 msgr2=0x55e0bafb5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a41c05640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafb5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a41c05640 1 -- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 msgr2=0x55e0bafc2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a41c05640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafc2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.218+0000 7f1a41c05640 1 -- 172.21.15.37:0/141896237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0baed8c90 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.220+0000 7f1a41c05640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 0x55e0bafb60c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1a38004630 tx=0x7f1a38005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37a218600789bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.220+0000 7f1a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.221+0000 7f1a25ffb640 1 -- 172.21.15.37:0/141896237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380129e0 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.221+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0baf22df0 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.221+0000 7f1a25ffb640 1 -- 172.21.15.37:0/141896237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1a38012b80 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.222+0000 7f1a25ffb640 1 -- 172.21.15.37:0/141896237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a38012d80 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.223+0000 7f1a4abde740 10 client.16659 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.223+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0bafc4b70 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.224+0000 7f1a25ffb640 1 -- 172.21.15.37:0/141896237 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e0baf22df0 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.225+0000 7f1a25ffb640 1 -- 172.21.15.37:0/141896237 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1a380293e0 con 0x55e0babe2390 2024-09-21T01:23:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.225+0000 7f1a4abde740 10 client.16659 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.225+0000 7f1a4abde740 10 client.16659 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.225+0000 7f1a4abde740 20 client.16659 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.226+0000 7f1a4abde740 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0babc19f0 0x55e0bafc85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.226+0000 7f1a4abde740 4 client.16659 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.226+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0baf1e8a0 con 0x55e0babc19f0 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.231+0000 7f1a42406640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0babc19f0 0x55e0bafc85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.243+0000 7f1a25ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.243+0000 7f1a42406640 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0babc19f0 0x55e0bafc85a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f423539ea60413e0 server_cookie=a4ea723ea43db7eb in_seq=0 out_seq=0 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.246+0000 7f1a25ffb640 1 -- 172.21.15.37:0/141896237 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0baf1e8a0 con 0x55e0babc19f0 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.246+0000 7f1a25ffb640 10 client.16659 handle_command_reply: tid=0 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.246+0000 7f1a4abde740 1 client.16659 shutdown 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 msgr2=0x55e0bafb60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 0x55e0bafb60c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1a38004630 tx=0x7f1a38005f30 comp rx=0 tx=0).stop 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 shutdown_connections 2024-09-21T01:23:29.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0babc19f0 0x55e0bafc85a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafc2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babe2390 0x55e0bafb60c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 --2- 172.21.15.37:0/141896237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babda1b0 0x55e0bafb5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 >> 172.21.15.37:0/141896237 conn(0x55e0babf7460 msgr2=0x55e0bafad640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a25ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 shutdown_connections 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 1 -- 172.21.15.37:0/141896237 wait complete. 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.254+0000 7f1a4abde740 20 client.16659 trim_cache size 0 max 16384 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.305+0000 7f1a4abde740 1 Processor -- start 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.306+0000 7f1a4abde740 1 -- start start 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babda1b0 0x55e0bafb6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafc1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a4abde740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2000e5b0 con 0x55e0babda1b0 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a4abde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200100f0 con 0x55e0bac03070 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a4abde740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2000ec80 con 0x55e0babe2390 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.307+0000 7f1a42c07640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42c07640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:56416/0 (socket says 172.21.15.37:56416) 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42c07640 1 -- 172.21.15.37:0/2835955257 learned_addr learned my addr 172.21.15.37:0/2835955257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42406640 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babda1b0 0x55e0bafb6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafc1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42406640 1 -- 172.21.15.37:0/2835955257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 msgr2=0x55e0bafc1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42406640 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafc1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42406640 1 -- 172.21.15.37:0/2835955257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 msgr2=0x55e0bafb2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42406640 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.308+0000 7f1a42406640 1 -- 172.21.15.37:0/2835955257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bafac750 con 0x55e0babda1b0 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.309+0000 7f1a42406640 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babda1b0 0x55e0bafb6040 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009bf0 tx=0x7f1a34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1fcd5a874862d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:29.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.314+0000 7f1a27fff640 1 -- 172.21.15.37:0/2835955257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34051020 con 0x55e0babda1b0 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.314+0000 7f1a27fff640 1 -- 172.21.15.37:0/2835955257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a3403f040 con 0x55e0babda1b0 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.316+0000 7f1a4abde740 1 -- 172.21.15.37:0/2835955257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babda1b0 msgr2=0x55e0bafb6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.316+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babda1b0 0x55e0bafb6040 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009bf0 tx=0x7f1a34009b20 comp rx=0 tx=0).stop 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.318+0000 7f1a4abde740 1 -- 172.21.15.37:0/2835955257 shutdown_connections 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.318+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.318+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafc1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.318+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2835955257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0babda1b0 0x55e0bafb6040 secure :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009bf0 tx=0x7f1a34009b20 comp rx=0 tx=0).stop 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.318+0000 7f1a4abde740 1 -- 172.21.15.37:0/2835955257 >> 172.21.15.37:0/2835955257 conn(0x55e0babf7460 msgr2=0x55e0bafb5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.324+0000 7f1a4abde740 1 -- 172.21.15.37:0/2835955257 shutdown_connections 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.325+0000 7f1a4abde740 1 -- 172.21.15.37:0/2835955257 wait complete. 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.325+0000 7f1a4abde740 1 -- start start 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.326+0000 7f1a4abde740 1 Processor -- start 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafbe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bab96da0 0x55e0bafba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2000fa20 con 0x55e0bab96da0 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2000f350 con 0x55e0bac03070 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2000c570 con 0x55e0babe2390 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.327+0000 7f1a4abde740 10 client.0 _ll_register_callbacks cb 0x7f1a380041e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.328+0000 7f1a41c05640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.328+0000 7f1a41c05640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:56430/0 (socket says 172.21.15.37:56430) 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.328+0000 7f1a41c05640 1 -- 172.21.15.37:0/2076697685 learned_addr learned my addr 172.21.15.37:0/2076697685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.328+0000 7f1a42406640 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafbe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.333+0000 7f1a41c05640 1 -- 172.21.15.37:0/2076697685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 msgr2=0x55e0bafbe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.333+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafbe720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.333+0000 7f1a41c05640 1 -- 172.21.15.37:0/2076697685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bab96da0 msgr2=0x55e0bafba110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:29.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.333+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bab96da0 0x55e0bafba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.333+0000 7f1a41c05640 1 -- 172.21.15.37:0/2076697685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bafba880 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.334+0000 7f1a41c05640 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb9bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a38012a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c57b565932e0036 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.334+0000 7f1a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.334+0000 7f1a25ffb640 1 -- 172.21.15.37:0/2076697685 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38029e80 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.334+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a3403f040 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.334+0000 7f1a25ffb640 1 -- 172.21.15.37:0/2076697685 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1a38005030 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.335+0000 7f1a25ffb640 1 -- 172.21.15.37:0/2076697685 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1a38005230 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.340+0000 7f1a4abde740 10 client.26087 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.340+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0bb032e80 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.340+0000 7f1a25ffb640 1 -- 172.21.15.37:0/2076697685 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a3403f040 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a25ffb640 1 -- 172.21.15.37:0/2076697685 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1a3803d020 con 0x55e0bac03070 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a4abde740 10 client.26087 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a4abde740 10 client.26087 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:23:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a4abde740 20 client.26087 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0bb033600 0x55e0bb035a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a4abde740 4 client.26087 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0baf1bcd0 con 0x55e0bb033600 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.342+0000 7f1a42406640 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0bb033600 0x55e0bb035a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.343+0000 7f1a42406640 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0bb033600 0x55e0bb035a20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a19461dc22fa9086 server_cookie=a9a583ee3c5da800 in_seq=0 out_seq=0 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.343+0000 7f1a25ffb640 10 client.26087 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.343+0000 7f1a25ffb640 1 -- 172.21.15.37:0/2076697685 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0baf1bcd0 con 0x55e0bb033600 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.343+0000 7f1a25ffb640 10 client.26087 handle_command_reply: tid=0 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.343+0000 7f1a4abde740 1 client.26087 shutdown 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.344+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 msgr2=0x55e0bafb9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.344+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb9bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a38012a90 comp rx=0 tx=0).stop 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 shutdown_connections 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x55e0bb033600 0x55e0bb035a20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0bab96da0 0x55e0bafba110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0bac03070 0x55e0bafb9bd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a4abde740 1 --2- 172.21.15.37:0/2076697685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0babe2390 0x55e0bafbe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 >> 172.21.15.37:0/2076697685 conn(0x55e0babf7460 msgr2=0x55e0bafb7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.348+0000 7f1a25ffb640 0 client.26087 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.349+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 shutdown_connections 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.349+0000 7f1a4abde740 1 -- 172.21.15.37:0/2076697685 wait complete. 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.349+0000 7f1a4abde740 20 client.26087 trim_cache size 0 max 16384 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.361+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1a280b6710 msgr2=0x7f1a280b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.361+0000 7f1a43408640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1a280b6710 0x7f1a280b8c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a380058c0 tx=0x7f1a38005850 comp rx=0 tx=0).stop 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.361+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 msgr2=0x7f1a3c1ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.361+0000 7f1a43408640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 0x7f1a3c1ae960 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00d750 tx=0x7f1a2c00dc10 comp rx=0 tx=0).stop 2024-09-21T01:23:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.363+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 shutdown_connections 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.363+0000 7f1a43408640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1a280b6710 0x7f1a280b8c20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.363+0000 7f1a43408640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a3c1ae530 0x7f1a3c1ae960 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.363+0000 7f1a43408640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c11cba0 0x7f1a3c1a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.363+0000 7f1a43408640 1 --2- 172.21.15.37:0/2437733828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a3c10dbf0 0x7f1a3c1a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.363+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 >> 172.21.15.37:0/2437733828 conn(0x7f1a3c06e9f0 msgr2=0x7f1a3c10ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.364+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 shutdown_connections 2024-09-21T01:23:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:29.364+0000 7f1a43408640 1 -- 172.21.15.37:0/2437733828 wait complete. 2024-09-21T01:23:30.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: Unable to set osd_memory_target on smithi144 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: Unable to set osd_memory_target on smithi137 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:29 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: Unable to set osd_memory_target on smithi144 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: Unable to set osd_memory_target on smithi137 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T01:23:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:23:30.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:23:30.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:29 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: Unable to set osd_memory_target on smithi144 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: Adjusting osd_memory_target on smithi137 to 176.0M 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: Unable to set osd_memory_target on smithi137 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:23:30.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:29 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:23:31.046 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:30 smithi037 ceph-mon[31105]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 924 MiB/s wr, 1.96k op/s 2024-09-21T01:23:31.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:30 smithi137 ceph-mon[34607]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 924 MiB/s wr, 1.96k op/s 2024-09-21T01:23:31.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:30 smithi144 ceph-mon[34818]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 924 MiB/s wr, 1.96k op/s 2024-09-21T01:23:32.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:23:33.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:32 smithi137 ceph-mon[34607]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 808 MiB/s wr, 1.81k op/s 2024-09-21T01:23:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:32 smithi144 ceph-mon[34818]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 808 MiB/s wr, 1.81k op/s 2024-09-21T01:23:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:32 smithi037 ceph-mon[31105]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 808 MiB/s wr, 1.81k op/s 2024-09-21T01:23:35.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:34 smithi137 ceph-mon[34607]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 908 MiB/s wr, 2.25k op/s 2024-09-21T01:23:35.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:34 smithi144 ceph-mon[34818]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 908 MiB/s wr, 2.25k op/s 2024-09-21T01:23:35.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:34 smithi037 ceph-mon[31105]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 908 MiB/s wr, 2.25k op/s 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.569+0000 7f528d99b640 1 -- 172.21.15.37:0/2353204313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528811cc30 msgr2=0x7f528811f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.569+0000 7f528d99b640 1 --2- 172.21.15.37:0/2353204313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528811cc30 0x7f528811f140 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5280009be0 tx=0x7f528002a6f0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.572+0000 7f528d99b640 1 -- 172.21.15.37:0/2353204313 shutdown_connections 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.572+0000 7f528d99b640 1 --2- 172.21.15.37:0/2353204313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528811cc30 0x7f528811f140 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.572+0000 7f528d99b640 1 --2- 172.21.15.37:0/2353204313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f528810a9e0 0x7f528810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.572+0000 7f528d99b640 1 --2- 172.21.15.37:0/2353204313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5288111f40 0x7f528810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.572+0000 7f528d99b640 1 -- 172.21.15.37:0/2353204313 >> 172.21.15.37:0/2353204313 conn(0x7f5288070ec0 msgr2=0x7f52880712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.576+0000 7f528d99b640 1 -- 172.21.15.37:0/2353204313 shutdown_connections 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.577+0000 7f528d99b640 1 -- 172.21.15.37:0/2353204313 wait complete. 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.579+0000 7f528d99b640 1 Processor -- start 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.579+0000 7f528d99b640 1 -- start start 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.580+0000 7f528d99b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 0x7f528811bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.580+0000 7f528d99b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5288111f40 0x7f528811c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.580+0000 7f528d99b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f528811cc30 0x7f5288116360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.580+0000 7f528d99b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5288112830 con 0x7f528810a9e0 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.580+0000 7f528d99b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52881126b0 con 0x7f528811cc30 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.580+0000 7f528d99b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52881129b0 con 0x7f5288111f40 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.582+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 0x7f528811bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.582+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 0x7f528811bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50414/0 (socket says 172.21.15.37:50414) 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.582+0000 7f5286ffd640 1 -- 172.21.15.37:0/3396191463 learned_addr learned my addr 172.21.15.37:0/3396191463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.582+0000 7f52877fe640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f528811cc30 0x7f5288116360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.583+0000 7f5286ffd640 1 -- 172.21.15.37:0/3396191463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5288111f40 msgr2=0x7f528811c500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.583+0000 7f5286ffd640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5288111f40 0x7f528811c500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.583+0000 7f5286ffd640 1 -- 172.21.15.37:0/3396191463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f528811cc30 msgr2=0x7f5288116360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.583+0000 7f5286ffd640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f528811cc30 0x7f5288116360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.583+0000 7f5286ffd640 1 -- 172.21.15.37:0/3396191463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5288116b80 con 0x7f528810a9e0 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.584+0000 7f5286ffd640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 0x7f528811bf80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c890 tx=0x7f527c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.588+0000 7f528c999640 1 -- 172.21.15.37:0/3396191463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c004220 con 0x7f528810a9e0 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.588+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5288116e70 con 0x7f528810a9e0 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.588+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52881be370 con 0x7f528810a9e0 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.588+0000 7f528c999640 1 -- 172.21.15.37:0/3396191463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f527c0043c0 con 0x7f528810a9e0 2024-09-21T01:23:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.589+0000 7f528c999640 1 -- 172.21.15.37:0/3396191463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c004a00 con 0x7f528810a9e0 2024-09-21T01:23:35.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.597+0000 7f528c999640 1 -- 172.21.15.37:0/3396191463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f527c0079b0 con 0x7f528810a9e0 2024-09-21T01:23:35.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.599+0000 7f528c999640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52700b6690 0x7f52700b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.600+0000 7f528c999640 1 -- 172.21.15.37:0/3396191463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f527c0e6e30 con 0x7f528810a9e0 2024-09-21T01:23:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.603+0000 7f52867fc640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52700b6690 0x7f52700b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.605+0000 7f52867fc640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52700b6690 0x7f52700b8ba0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5288071310 tx=0x7f5278009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.612+0000 7f5293f0f740 1 Processor -- start 2024-09-21T01:23:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 -- start start 2024-09-21T01:23:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befe4070 0x5563bf38b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf38bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befc3390 0x5563bf38c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5563bf301ea0 con 0x5563befe4070 2024-09-21T01:23:35.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5563bf2f12d0 con 0x5563befbb1b0 2024-09-21T01:23:35.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.615+0000 7f5293f0f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5563bf2f50e0 con 0x5563befc3390 2024-09-21T01:23:35.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.618+0000 7f52877fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befc3390 0x5563bf38c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.618+0000 7f52867fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf38bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.618+0000 7f52867fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf38bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46062/0 (socket says 172.21.15.37:46062) 2024-09-21T01:23:35.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.618+0000 7f52867fc640 1 -- 172.21.15.37:0/2097977407 learned_addr learned my addr 172.21.15.37:0/2097977407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.622+0000 7f5286ffd640 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befe4070 0x5563bf38b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.623+0000 7f52867fc640 1 -- 172.21.15.37:0/2097977407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befc3390 msgr2=0x5563bf38c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.623+0000 7f52867fc640 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befc3390 0x5563bf38c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.623+0000 7f52867fc640 1 -- 172.21.15.37:0/2097977407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befe4070 msgr2=0x5563bf38b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.623+0000 7f52867fc640 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befe4070 0x5563bf38b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.623+0000 7f52867fc640 1 -- 172.21.15.37:0/2097977407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bf04f650 con 0x5563befbb1b0 2024-09-21T01:23:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.627+0000 7f52867fc640 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf38bbe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f527800ed00 tx=0x7f5278011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=350fc14ce67900fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:35.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.628+0000 7f526dffb640 1 -- 172.21.15.37:0/2097977407 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278020070 con 0x5563befbb1b0 2024-09-21T01:23:35.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.628+0000 7f526dffb640 1 -- 172.21.15.37:0/2097977407 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5278010e40 con 0x5563befbb1b0 2024-09-21T01:23:35.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.628+0000 7f526dffb640 1 -- 172.21.15.37:0/2097977407 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527801c770 con 0x5563befbb1b0 2024-09-21T01:23:35.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.630+0000 7f5293f0f740 1 -- 172.21.15.37:0/2097977407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 msgr2=0x5563bf38bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.630+0000 7f5293f0f740 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf38bbe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f527800ed00 tx=0x7f5278011000 comp rx=0 tx=0).stop 2024-09-21T01:23:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.634+0000 7f5293f0f740 1 -- 172.21.15.37:0/2097977407 shutdown_connections 2024-09-21T01:23:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.634+0000 7f5293f0f740 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befc3390 0x5563bf38c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.634+0000 7f5293f0f740 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf38bbe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.634+0000 7f5293f0f740 1 --2- 172.21.15.37:0/2097977407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befe4070 0x5563bf38b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.634+0000 7f5293f0f740 1 -- 172.21.15.37:0/2097977407 >> 172.21.15.37:0/2097977407 conn(0x5563befd8460 msgr2=0x5563bf389590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:35.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.636+0000 7f5293f0f740 1 -- 172.21.15.37:0/2097977407 shutdown_connections 2024-09-21T01:23:35.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.639+0000 7f5293f0f740 1 -- 172.21.15.37:0/2097977407 wait complete. 2024-09-21T01:23:35.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.640+0000 7f5293f0f740 1 -- start start 2024-09-21T01:23:35.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.640+0000 7f5293f0f740 1 Processor -- start 2024-09-21T01:23:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.646+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf396d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.646+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf397240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.646+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf397780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.646+0000 7f5293f0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5563bf152700 con 0x5563befc3390 2024-09-21T01:23:35.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.646+0000 7f5293f0f740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5563bf28c160 con 0x5563befbb1b0 2024-09-21T01:23:35.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.646+0000 7f5293f0f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5563bf399ed0 con 0x5563befe4070 2024-09-21T01:23:35.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.647+0000 7f5293f0f740 10 client.0 _ll_register_callbacks cb 0x5563bf2a59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf397240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf396d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf397240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50422/0 (socket says 172.21.15.37:50422) 2024-09-21T01:23:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf396d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46074/0 (socket says 172.21.15.37:46074) 2024-09-21T01:23:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 -- 172.21.15.37:0/86980456 learned_addr learned my addr 172.21.15.37:0/86980456 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:35.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52877fe640 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf397780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 -- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 msgr2=0x5563bf397780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf397780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 -- 172.21.15.37:0/86980456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 msgr2=0x5563bf396d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf396d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.650+0000 7f52867fc640 1 -- 172.21.15.37:0/86980456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bf2b9c90 con 0x5563befc3390 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.651+0000 7f52867fc640 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf397240 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f527800efe0 tx=0x7f527800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5dbaa6559be6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:35.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.651+0000 7f5266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.652+0000 7f5266ffd640 1 -- 172.21.15.37:0/86980456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278032020 con 0x5563befc3390 2024-09-21T01:23:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.652+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5563bf303df0 con 0x5563befc3390 2024-09-21T01:23:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.652+0000 7f5266ffd640 1 -- 172.21.15.37:0/86980456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5278004c90 con 0x5563befc3390 2024-09-21T01:23:35.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.653+0000 7f5266ffd640 1 -- 172.21.15.37:0/86980456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5278020040 con 0x5563befc3390 2024-09-21T01:23:35.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.653+0000 7f5293f0f740 10 client.16674 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:35.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.653+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5563bf3a5c00 con 0x5563befc3390 2024-09-21T01:23:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.655+0000 7f5266ffd640 1 -- 172.21.15.37:0/86980456 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5278025910 con 0x5563befc3390 2024-09-21T01:23:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5266ffd640 1 -- 172.21.15.37:0/86980456 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f527802d070 con 0x5563befc3390 2024-09-21T01:23:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5293f0f740 10 client.16674 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:35.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5293f0f740 10 client.16674 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:23:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5293f0f740 20 client.16674 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5293f0f740 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563befa29f0 0x5563bf3a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5293f0f740 4 client.16674 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.656+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563bf303df0 con 0x5563befa29f0 2024-09-21T01:23:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.658+0000 7f5286ffd640 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563befa29f0 0x5563bf3a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.662+0000 7f5286ffd640 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563befa29f0 0x5563bf3a93e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63a428acce45b5d0 server_cookie=dba01c2a6ab5974 in_seq=0 out_seq=0 2024-09-21T01:23:35.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.663+0000 7f5266ffd640 10 client.16674 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:23:35.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.665+0000 7f5266ffd640 1 -- 172.21.15.37:0/86980456 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563bf303df0 con 0x5563befa29f0 2024-09-21T01:23:35.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.665+0000 7f5266ffd640 10 client.16674 handle_command_reply: tid=0 2024-09-21T01:23:35.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.665+0000 7f5293f0f740 1 client.16674 shutdown 2024-09-21T01:23:35.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.665+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 msgr2=0x5563bf397240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf397240 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f527800efe0 tx=0x7f527800ea00 comp rx=0 tx=0).stop 2024-09-21T01:23:35.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 shutdown_connections 2024-09-21T01:23:35.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563befa29f0 0x5563bf3a93e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf397780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf397240 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 --2- 172.21.15.37:0/86980456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf396d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 >> 172.21.15.37:0/86980456 conn(0x5563befd8460 msgr2=0x5563bf38e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5266ffd640 0 client.16674 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 shutdown_connections 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.666+0000 7f5293f0f740 1 -- 172.21.15.37:0/86980456 wait complete. 2024-09-21T01:23:35.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.667+0000 7f5293f0f740 20 client.16674 trim_cache size 0 max 16384 2024-09-21T01:23:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.701+0000 7f5293f0f740 1 Processor -- start 2024-09-21T01:23:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.702+0000 7f5293f0f740 1 -- start start 2024-09-21T01:23:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.703+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf393ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.703+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf394430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.703+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf398220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.704+0000 7f5293f0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f527400e620 con 0x5563befc3390 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.704+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf393ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.704+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf393ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46080/0 (socket says 172.21.15.37:46080) 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.704+0000 7f5286ffd640 1 -- 172.21.15.37:0/3559844399 learned_addr learned my addr 172.21.15.37:0/3559844399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.705+0000 7f52867fc640 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf394430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.705+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5274010160 con 0x5563befbb1b0 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.705+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f527400ecf0 con 0x5563befe4070 2024-09-21T01:23:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.705+0000 7f52877fe640 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf398220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.706+0000 7f52867fc640 1 -- 172.21.15.37:0/3559844399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 msgr2=0x5563bf398220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.706+0000 7f52867fc640 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf398220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.706+0000 7f52867fc640 1 -- 172.21.15.37:0/3559844399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 msgr2=0x5563bf393ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.706+0000 7f52867fc640 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf393ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.706+0000 7f52867fc640 1 -- 172.21.15.37:0/3559844399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bf38df30 con 0x5563befc3390 2024-09-21T01:23:35.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.708+0000 7f52867fc640 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf394430 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5278000c00 tx=0x7f52780094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b77aff3cfa42d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:35.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.708+0000 7f526d7fa640 1 -- 172.21.15.37:0/3559844399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278014040 con 0x5563befc3390 2024-09-21T01:23:35.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.708+0000 7f526d7fa640 1 -- 172.21.15.37:0/3559844399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5278025460 con 0x5563befc3390 2024-09-21T01:23:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.710+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 msgr2=0x5563bf394430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.710+0000 7f5293f0f740 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf394430 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5278000c00 tx=0x7f52780094d0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.710+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 shutdown_connections 2024-09-21T01:23:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.711+0000 7f5293f0f740 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf398220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.711+0000 7f5293f0f740 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563befc3390 0x5563bf394430 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.711+0000 7f5293f0f740 1 --2- 172.21.15.37:0/3559844399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf393ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.711+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 >> 172.21.15.37:0/3559844399 conn(0x5563befd8460 msgr2=0x5563bf395580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:35.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.711+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 shutdown_connections 2024-09-21T01:23:35.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.712+0000 7f5293f0f740 1 -- 172.21.15.37:0/3559844399 wait complete. 2024-09-21T01:23:35.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.713+0000 7f5293f0f740 1 -- start start 2024-09-21T01:23:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.714+0000 7f5293f0f740 1 Processor -- start 2024-09-21T01:23:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.715+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf39a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.715+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf39a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.715+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf39a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.715+0000 7f5286ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf39a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46082/0 (socket says 172.21.15.37:46082) 2024-09-21T01:23:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.715+0000 7f5293f0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563bef77da0 0x5563bf39ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.716+0000 7f52867fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf39a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.716+0000 7f52867fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf39a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45606/0 (socket says 172.21.15.37:45606) 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.716+0000 7f52877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563bef77da0 0x5563bf39ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.716+0000 7f52877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563bef77da0 0x5563bf39ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50444/0 (socket says 172.21.15.37:50444) 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.716+0000 7f5286ffd640 1 -- 172.21.15.37:0/1740054366 learned_addr learned my addr 172.21.15.37:0/1740054366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.717+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f527400fa90 con 0x5563bef77da0 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.717+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f527400f3c0 con 0x5563befbb1b0 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.717+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f527400c5e0 con 0x5563befe4070 2024-09-21T01:23:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.717+0000 7f5293f0f740 10 client.0 _ll_register_callbacks cb 0x7f527800ec00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.718+0000 7f52867fc640 1 -- 172.21.15.37:0/1740054366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 msgr2=0x5563bf39a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.718+0000 7f52867fc640 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf39a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.718+0000 7f52867fc640 1 -- 172.21.15.37:0/1740054366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563bef77da0 msgr2=0x5563bf39ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.718+0000 7f52867fc640 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563bef77da0 0x5563bf39ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.718+0000 7f52867fc640 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bf411dd0 con 0x5563befe4070 2024-09-21T01:23:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.722+0000 7f52867fc640 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf39a730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f527800eb40 tx=0x7f5278004cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a4e3f59052d4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.722+0000 7f5266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.723+0000 7f5266ffd640 1 -- 172.21.15.37:0/1740054366 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278014040 con 0x5563befe4070 2024-09-21T01:23:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.723+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5563bf2ff8a0 con 0x5563befe4070 2024-09-21T01:23:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.723+0000 7f5266ffd640 1 -- 172.21.15.37:0/1740054366 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f527801c950 con 0x5563befe4070 2024-09-21T01:23:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.724+0000 7f5266ffd640 1 -- 172.21.15.37:0/1740054366 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5278005610 con 0x5563befe4070 2024-09-21T01:23:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.725+0000 7f5293f0f740 10 client.26080 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.725+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5563bf4130a0 con 0x5563befe4070 2024-09-21T01:23:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.725+0000 7f5266ffd640 1 -- 172.21.15.37:0/1740054366 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5278025460 con 0x5563befe4070 2024-09-21T01:23:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.726+0000 7f5266ffd640 1 -- 172.21.15.37:0/1740054366 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5278053050 con 0x5563befe4070 2024-09-21T01:23:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.728+0000 7f5293f0f740 10 client.26080 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.728+0000 7f5293f0f740 10 client.26080 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:23:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.732+0000 7f5293f0f740 20 client.26080 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.732+0000 7f5293f0f740 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563bf4136a0 0x5563bf415ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:35.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.732+0000 7f5293f0f740 4 client.26080 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:23:35.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.732+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563bf2ff8a0 con 0x5563bf4136a0 2024-09-21T01:23:35.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.736+0000 7f5286ffd640 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563bf4136a0 0x5563bf415ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.748+0000 7f5266ffd640 10 client.26080 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:23:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.748+0000 7f5286ffd640 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563bf4136a0 0x5563bf415ac0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=147e1b6f747e5367 server_cookie=d95a6fd11b5ff680 in_seq=0 out_seq=0 2024-09-21T01:23:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.749+0000 7f5266ffd640 1 -- 172.21.15.37:0/1740054366 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563bf2ff8a0 con 0x5563bf4136a0 2024-09-21T01:23:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.749+0000 7f5266ffd640 10 client.26080 handle_command_reply: tid=0 2024-09-21T01:23:35.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.749+0000 7f5293f0f740 1 client.26080 shutdown 2024-09-21T01:23:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.752+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 msgr2=0x5563bf39a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.752+0000 7f5293f0f740 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf39a730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f527800eb40 tx=0x7f5278004cc0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 shutdown_connections 2024-09-21T01:23:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x5563bf4136a0 0x5563bf415ac0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563bef77da0 0x5563bf39ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5563befe4070 0x5563bf39a730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 --2- 172.21.15.37:0/1740054366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563befbb1b0 0x5563bf39a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 >> 172.21.15.37:0/1740054366 conn(0x5563befd8460 msgr2=0x5563bf38c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5266ffd640 0 client.26080 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:23:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 shutdown_connections 2024-09-21T01:23:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.753+0000 7f5293f0f740 1 -- 172.21.15.37:0/1740054366 wait complete. 2024-09-21T01:23:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.757+0000 7f5293f0f740 20 client.26080 trim_cache size 0 max 16384 2024-09-21T01:23:35.760 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52700b6690 msgr2=0x7f52700b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52700b6690 0x7f52700b8ba0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5288071310 tx=0x7f5278009260 comp rx=0 tx=0).stop 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 msgr2=0x7f528811bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 0x7f528811bf80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c890 tx=0x7f527c00cd50 comp rx=0 tx=0).stop 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 shutdown_connections 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f52700b6690 0x7f52700b8ba0 secure :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5288071310 tx=0x7f5278009260 comp rx=0 tx=0).stop 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f528811cc30 0x7f5288116360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5288111f40 0x7f528811c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 --2- 172.21.15.37:0/3396191463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528810a9e0 0x7f528811bf80 secure :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c890 tx=0x7f527c00cd50 comp rx=0 tx=0).stop 2024-09-21T01:23:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.759+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 >> 172.21.15.37:0/3396191463 conn(0x7f5288070ec0 msgr2=0x7f528810ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.760+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 shutdown_connections 2024-09-21T01:23:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:35.760+0000 7f528d99b640 1 -- 172.21.15.37:0/3396191463 wait complete. 2024-09-21T01:23:37.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:36 smithi137 ceph-mon[34607]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 900 MiB/s wr, 2.62k op/s 2024-09-21T01:23:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:36 smithi144 ceph-mon[34818]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 900 MiB/s wr, 2.62k op/s 2024-09-21T01:23:37.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:36 smithi037 ceph-mon[31105]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 900 MiB/s wr, 2.62k op/s 2024-09-21T01:23:38.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 -- 172.21.15.37:0/1047202547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10f830 msgr2=0x7f192c10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 --2- 172.21.15.37:0/1047202547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10f830 0x7f192c10fd30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f191c01a910 tx=0x7f191c03b430 comp rx=0 tx=0).stop 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 -- 172.21.15.37:0/1047202547 shutdown_connections 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 --2- 172.21.15.37:0/1047202547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10f830 0x7f192c10fd30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 --2- 172.21.15.37:0/1047202547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c10f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 --2- 172.21.15.37:0/1047202547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192c10a3c0 0x7f192c10c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.896+0000 7f1932157640 1 -- 172.21.15.37:0/1047202547 >> 172.21.15.37:0/1047202547 conn(0x7f192c070670 msgr2=0x7f192c072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.897+0000 7f1932157640 1 -- 172.21.15.37:0/1047202547 shutdown_connections 2024-09-21T01:23:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.897+0000 7f1932157640 1 -- 172.21.15.37:0/1047202547 wait complete. 2024-09-21T01:23:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.898+0000 7f1932157640 1 Processor -- start 2024-09-21T01:23:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 -- start start 2024-09-21T01:23:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10a3c0 0x7f192c1a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c1a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192c10f830 0x7f192c1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f192c113740 con 0x7f192c10a3c0 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1135c0 con 0x7f192c10f830 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.899+0000 7f1932157640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1138c0 con 0x7f192c10cd20 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.900+0000 7f192affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c1a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.900+0000 7f192affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c1a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45630/0 (socket says 172.21.15.37:45630) 2024-09-21T01:23:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.900+0000 7f192affd640 1 -- 172.21.15.37:0/753594793 learned_addr learned my addr 172.21.15.37:0/753594793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.900+0000 7f192b7fe640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10a3c0 0x7f192c1a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.900+0000 7f192bfff640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192c10f830 0x7f192c1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.901+0000 7f192affd640 1 -- 172.21.15.37:0/753594793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192c10f830 msgr2=0x7f192c1a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.901+0000 7f192affd640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192c10f830 0x7f192c1a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.901+0000 7f192affd640 1 -- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10a3c0 msgr2=0x7f192c1a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.901+0000 7f192affd640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10a3c0 0x7f192c1a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.901+0000 7f192affd640 1 -- 172.21.15.37:0/753594793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c1a1d90 con 0x7f192c10cd20 2024-09-21T01:23:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.901+0000 7f192b7fe640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10a3c0 0x7f192c1a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:23:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.902+0000 7f192affd640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c1a09c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f192400ebc0 tx=0x7f192400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.907+0000 7f1928ff9640 1 -- 172.21.15.37:0/753594793 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924010630 con 0x7f192c10cd20 2024-09-21T01:23:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.907+0000 7f1928ff9640 1 -- 172.21.15.37:0/753594793 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1924010c80 con 0x7f192c10cd20 2024-09-21T01:23:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.907+0000 7f1928ff9640 1 -- 172.21.15.37:0/753594793 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924018b00 con 0x7f192c10cd20 2024-09-21T01:23:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.907+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192c1a2080 con 0x7f192c10cd20 2024-09-21T01:23:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.907+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192c1a8770 con 0x7f192c10cd20 2024-09-21T01:23:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.922+0000 7f19390c7740 1 Processor -- start 2024-09-21T01:23:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.937+0000 7f1928ff9640 1 -- 172.21.15.37:0/753594793 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1924018ca0 con 0x7f192c10cd20 2024-09-21T01:23:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.940+0000 7f1928ff9640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f19140b6720 0x7f19140b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.942+0000 7f1928ff9640 1 -- 172.21.15.37:0/753594793 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f19240e7840 con 0x7f192c10cd20 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.943+0000 7f19390c7740 1 -- start start 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.943+0000 7f19390c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b517d1b0 0x5649b5525040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.944+0000 7f19390c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b55256b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.944+0000 7f19390c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b5526200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.944+0000 7f19390c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5649b54976f0 con 0x5649b517d1b0 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.944+0000 7f19390c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5649b5486b20 con 0x5649b51542f0 2024-09-21T01:23:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.944+0000 7f19390c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5649b548a930 con 0x5649b515c4d0 2024-09-21T01:23:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.946+0000 7f192b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b517d1b0 0x5649b5525040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.946+0000 7f192b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b517d1b0 0x5649b5525040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50476/0 (socket says 172.21.15.37:50476) 2024-09-21T01:23:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.946+0000 7f192b7fe640 1 -- 172.21.15.37:0/2160230211 learned_addr learned my addr 172.21.15.37:0/2160230211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.947+0000 7f192bfff640 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b5526200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.947+0000 7f192bfff640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f19140b6720 0x7f19140b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.948+0000 7f192bfff640 1 -- 172.21.15.37:0/2160230211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 msgr2=0x5649b55256b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.948+0000 7f192bfff640 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b55256b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.948+0000 7f192bfff640 1 -- 172.21.15.37:0/2160230211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b517d1b0 msgr2=0x5649b5525040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.948+0000 7f192bfff640 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b517d1b0 0x5649b5525040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.948+0000 7f192bfff640 1 -- 172.21.15.37:0/2160230211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b544c530 con 0x5649b515c4d0 2024-09-21T01:23:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.951+0000 7f192bfff640 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b5526200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f191c006010 tx=0x7f191c004fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87330634311b1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.954+0000 7f1911ffb640 1 -- 172.21.15.37:0/2160230211 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c05f070 con 0x5649b515c4d0 2024-09-21T01:23:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.954+0000 7f1911ffb640 1 -- 172.21.15.37:0/2160230211 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c040510 con 0x5649b515c4d0 2024-09-21T01:23:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.954+0000 7f1911ffb640 1 -- 172.21.15.37:0/2160230211 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c046040 con 0x5649b515c4d0 2024-09-21T01:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.956+0000 7f19390c7740 1 -- 172.21.15.37:0/2160230211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 msgr2=0x5649b5526200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.956+0000 7f19390c7740 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b5526200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f191c006010 tx=0x7f191c004fa0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.963+0000 7f19390c7740 1 -- 172.21.15.37:0/2160230211 shutdown_connections 2024-09-21T01:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.963+0000 7f19390c7740 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b5526200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.963+0000 7f19390c7740 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b55256b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.963+0000 7f19390c7740 1 --2- 172.21.15.37:0/2160230211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b517d1b0 0x5649b5525040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.963+0000 7f19390c7740 1 -- 172.21.15.37:0/2160230211 >> 172.21.15.37:0/2160230211 conn(0x5649b5171300 msgr2=0x5649b5520ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.964+0000 7f19390c7740 1 -- 172.21.15.37:0/2160230211 shutdown_connections 2024-09-21T01:23:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.964+0000 7f19390c7740 1 -- 172.21.15.37:0/2160230211 wait complete. 2024-09-21T01:23:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.965+0000 7f19390c7740 1 -- start start 2024-09-21T01:23:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.965+0000 7f19390c7740 1 Processor -- start 2024-09-21T01:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b552e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b552ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b517d1b0 0x5649b552fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5649b53beab0 con 0x5649b51542f0 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5649b542c730 con 0x5649b517d1b0 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5649b5526d20 con 0x5649b515c4d0 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.966+0000 7f19390c7740 10 client.0 _ll_register_callbacks cb 0x5649b54806b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.968+0000 7f192bfff640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f19140b6720 0x7f19140b8c30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5649b55269f0 tx=0x7f191c04f7a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.968+0000 7f192affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b552ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.968+0000 7f192affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b552ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45646/0 (socket says 172.21.15.37:45646) 2024-09-21T01:23:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.968+0000 7f192affd640 1 -- 172.21.15.37:0/138443291 learned_addr learned my addr 172.21.15.37:0/138443291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.969+0000 7f192bfff640 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b517d1b0 0x5649b552fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.970+0000 7f192affd640 1 -- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b517d1b0 msgr2=0x5649b552fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.970+0000 7f192affd640 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b517d1b0 0x5649b552fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.970+0000 7f192affd640 1 -- 172.21.15.37:0/138443291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 msgr2=0x5649b552e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.970+0000 7f192affd640 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b552e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.970+0000 7f192affd640 1 -- 172.21.15.37:0/138443291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b51e8790 con 0x5649b515c4d0 2024-09-21T01:23:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.976+0000 7f192affd640 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b552ef40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f19240aacb0 tx=0x7f1924010ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ff1a22a41f8d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.976+0000 7f190f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.978+0000 7f190f7f6640 1 -- 172.21.15.37:0/138443291 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19240ad810 con 0x5649b515c4d0 2024-09-21T01:23:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.978+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191c040510 con 0x5649b515c4d0 2024-09-21T01:23:38.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.978+0000 7f190f7f6640 1 -- 172.21.15.37:0/138443291 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f19240a95a0 con 0x5649b515c4d0 2024-09-21T01:23:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.979+0000 7f190f7f6640 1 -- 172.21.15.37:0/138443291 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f19240a91b0 con 0x5649b515c4d0 2024-09-21T01:23:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.983+0000 7f19390c7740 10 client.26092 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.983+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5649b5261620 con 0x5649b515c4d0 2024-09-21T01:23:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f190f7f6640 1 -- 172.21.15.37:0/138443291 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c040510 con 0x5649b515c4d0 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f190f7f6640 1 -- 172.21.15.37:0/138443291 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f19240b3600 con 0x5649b515c4d0 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f19390c7740 10 client.26092 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f19390c7740 10 client.26092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f19390c7740 20 client.26092 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f19390c7740 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b513bd80 0x5649b553c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f19390c7740 4 client.26092 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.989+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649b5499640 con 0x5649b513bd80 2024-09-21T01:23:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:38.990+0000 7f192b7fe640 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b513bd80 0x5649b553c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.007+0000 7f192b7fe640 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b513bd80 0x5649b553c4e0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a396253f22177c server_cookie=34bf6ad332ffd50b in_seq=0 out_seq=0 2024-09-21T01:23:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.007+0000 7f190f7f6640 10 client.26092 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:39.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.014+0000 7f190f7f6640 1 -- 172.21.15.37:0/138443291 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5649b5499640 con 0x5649b513bd80 2024-09-21T01:23:39.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.014+0000 7f190f7f6640 10 client.26092 handle_command_reply: tid=0 2024-09-21T01:23:39.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.014+0000 7f19390c7740 1 client.26092 shutdown 2024-09-21T01:23:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.023+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 msgr2=0x5649b552ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.023+0000 7f19390c7740 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b552ef40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f19240aacb0 tx=0x7f1924010ba0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 shutdown_connections 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b513bd80 0x5649b553c4e0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b517d1b0 0x5649b552fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b515c4d0 0x5649b552ef40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 --2- 172.21.15.37:0/138443291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b552e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 >> 172.21.15.37:0/138443291 conn(0x5649b5171300 msgr2=0x5649b551f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f190f7f6640 0 client.26092 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 shutdown_connections 2024-09-21T01:23:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.027+0000 7f19390c7740 1 -- 172.21.15.37:0/138443291 wait complete. 2024-09-21T01:23:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.028+0000 7f19390c7740 20 client.26092 trim_cache size 0 max 16384 2024-09-21T01:23:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.105+0000 7f19390c7740 1 Processor -- start 2024-09-21T01:23:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.105+0000 7f19390c7740 1 -- start start 2024-09-21T01:23:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.106+0000 7f19390c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b5525e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.107+0000 7f19390c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b515c4d0 0x5649b5536990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.107+0000 7f192b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b5525e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.107+0000 7f192b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b5525e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46132/0 (socket says 172.21.15.37:46132) 2024-09-21T01:23:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.107+0000 7f192b7fe640 1 -- 172.21.15.37:0/2079115966 learned_addr learned my addr 172.21.15.37:0/2079115966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.108+0000 7f19390c7740 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b552cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.108+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b1500 con 0x5649b515c4d0 2024-09-21T01:23:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.108+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b3040 con 0x5649b51542f0 2024-09-21T01:23:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.108+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b1bd0 con 0x5649b517d1b0 2024-09-21T01:23:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.111+0000 7f192bfff640 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b552cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.116+0000 7f192affd640 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b515c4d0 0x5649b5536990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.117+0000 7f192bfff640 1 -- 172.21.15.37:0/2079115966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 msgr2=0x5649b5525e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.117+0000 7f192bfff640 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b5525e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.117+0000 7f192bfff640 1 -- 172.21.15.37:0/2079115966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b515c4d0 msgr2=0x5649b5536990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.117+0000 7f192bfff640 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b515c4d0 0x5649b5536990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.117+0000 7f192bfff640 1 -- 172.21.15.37:0/2079115966 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b553a1d0 con 0x5649b517d1b0 2024-09-21T01:23:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.121+0000 7f192bfff640 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b552cdd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f191c03ba20 tx=0x7f191c04a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e06071923623573 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.132+0000 7f19117fa640 1 -- 172.21.15.37:0/2079115966 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c068030 con 0x5649b517d1b0 2024-09-21T01:23:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.132+0000 7f19117fa640 1 -- 172.21.15.37:0/2079115966 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c0048b0 con 0x5649b517d1b0 2024-09-21T01:23:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.136+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 msgr2=0x5649b552cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.136+0000 7f19390c7740 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b552cdd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f191c03ba20 tx=0x7f191c04a000 comp rx=0 tx=0).stop 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 shutdown_connections 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b552cdd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b515c4d0 0x5649b5536990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 --2- 172.21.15.37:0/2079115966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b51542f0 0x5649b5525e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 >> 172.21.15.37:0/2079115966 conn(0x5649b5171300 msgr2=0x5649b5520410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 shutdown_connections 2024-09-21T01:23:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.137+0000 7f19390c7740 1 -- 172.21.15.37:0/2079115966 wait complete. 2024-09-21T01:23:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.138+0000 7f19390c7740 1 -- start start 2024-09-21T01:23:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.139+0000 7f19390c7740 1 Processor -- start 2024-09-21T01:23:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.139+0000 7f19390c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b5533a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f19390c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b515c4d0 0x5649b55340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f19390c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b5534bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f19390c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b2970 con 0x5649b51542f0 2024-09-21T01:23:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f19390c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b22a0 con 0x5649b515c4d0 2024-09-21T01:23:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f19390c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1af4c0 con 0x5649b517d1b0 2024-09-21T01:23:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f192affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b515c4d0 0x5649b55340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f192affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b515c4d0 0x5649b55340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:46146/0 (socket says 172.21.15.37:46146) 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.140+0000 7f192affd640 1 -- 172.21.15.37:0/77712962 learned_addr learned my addr 172.21.15.37:0/77712962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.144+0000 7f192b7fe640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b5533a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.144+0000 7f192bfff640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b5534bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.144+0000 7f19390c7740 10 client.0 _ll_register_callbacks cb 0x7f19240aa090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.145+0000 7f192bfff640 1 -- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b515c4d0 msgr2=0x5649b55340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.145+0000 7f192bfff640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b515c4d0 0x5649b55340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.145+0000 7f192bfff640 1 -- 172.21.15.37:0/77712962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 msgr2=0x5649b5533a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.145+0000 7f192bfff640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b5533a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.145+0000 7f192bfff640 1 -- 172.21.15.37:0/77712962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b5535350 con 0x5649b517d1b0 2024-09-21T01:23:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.145+0000 7f192bfff640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b5534bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f191c03ba20 tx=0x7f191c03b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe87bfd30a6a84dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.150+0000 7f190f7f6640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.150+0000 7f190f7f6640 1 -- 172.21.15.37:0/77712962 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c077020 con 0x5649b517d1b0 2024-09-21T01:23:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.151+0000 7f190f7f6640 1 -- 172.21.15.37:0/77712962 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f191c04f5a0 con 0x5649b517d1b0 2024-09-21T01:23:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.163+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191c0048b0 con 0x5649b517d1b0 2024-09-21T01:23:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.165+0000 7f190f7f6640 1 -- 172.21.15.37:0/77712962 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f191c068040 con 0x5649b517d1b0 2024-09-21T01:23:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.167+0000 7f19390c7740 10 client.26098 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.167+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5649b5536610 con 0x5649b517d1b0 2024-09-21T01:23:39.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:38 smithi144 ceph-mon[34818]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 730 MiB/s wr, 2.34k op/s 2024-09-21T01:23:39.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:38 smithi137 ceph-mon[34607]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 730 MiB/s wr, 2.34k op/s 2024-09-21T01:23:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.169+0000 7f190f7f6640 1 -- 172.21.15.37:0/77712962 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c040510 con 0x5649b517d1b0 2024-09-21T01:23:39.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.169+0000 7f190f7f6640 1 -- 172.21.15.37:0/77712962 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f191c04b030 con 0x5649b517d1b0 2024-09-21T01:23:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.170+0000 7f19390c7740 10 client.26098 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.171+0000 7f19390c7740 10 client.26098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.171+0000 7f19390c7740 20 client.26098 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.171+0000 7f19390c7740 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b51111c0 0x5649b55a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.171+0000 7f19390c7740 4 client.26098 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:23:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.171+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f191c0048b0 con 0x5649b51111c0 2024-09-21T01:23:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.176+0000 7f192b7fe640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b51111c0 0x5649b55a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.192+0000 7f192b7fe640 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b51111c0 0x5649b55a8ef0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d4ce0ae0f5f5d5 server_cookie=87cb15212c86555f in_seq=0 out_seq=0 2024-09-21T01:23:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:39.194+0000 7f190f7f6640 10 client.26098 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:39.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:38 smithi037 ceph-mon[31105]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 730 MiB/s wr, 2.34k op/s 2024-09-21T01:23:40.947 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:40 smithi037 ceph-mon[31105]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 905 MiB/s wr, 2.84k op/s 2024-09-21T01:23:41.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:40 smithi137 ceph-mon[34607]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 905 MiB/s wr, 2.84k op/s 2024-09-21T01:23:41.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:40 smithi144 ceph-mon[34818]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 905 MiB/s wr, 2.84k op/s 2024-09-21T01:23:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.943+0000 7f8b13a67640 1 -- 172.21.15.37:0/543329120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c1021f0 msgr2=0x7f8b0c102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.943+0000 7f8b13a67640 1 --2- 172.21.15.37:0/543329120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c1021f0 0x7f8b0c102600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800da00 tx=0x7f8b0802e6c0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.946+0000 7f8b13a67640 1 -- 172.21.15.37:0/543329120 shutdown_connections 2024-09-21T01:23:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.946+0000 7f8b13a67640 1 --2- 172.21.15.37:0/543329120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b0c108480 0x7f8b0c10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.946+0000 7f8b13a67640 1 --2- 172.21.15.37:0/543329120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.946+0000 7f8b13a67640 1 --2- 172.21.15.37:0/543329120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c1021f0 0x7f8b0c102600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.946+0000 7f8b13a67640 1 -- 172.21.15.37:0/543329120 >> 172.21.15.37:0/543329120 conn(0x7f8b0c077c60 msgr2=0x7f8b0c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.949+0000 7f8b13a67640 1 -- 172.21.15.37:0/543329120 shutdown_connections 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.949+0000 7f8b13a67640 1 -- 172.21.15.37:0/543329120 wait complete. 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.951+0000 7f8b13a67640 1 Processor -- start 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.951+0000 7f8b13a67640 1 -- start start 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b13a67640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b0c1021f0 0x7f8b0c074ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b13a67640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b13a67640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c108480 0x7f8b0c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b13a67640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c122a00 con 0x7f8b0c107b30 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b13a67640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c122880 con 0x7f8b0c1021f0 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b13a67640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c122b80 con 0x7f8b0c108480 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b11002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b11002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c06e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50516/0 (socket says 172.21.15.37:50516) 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.952+0000 7f8b11002640 1 -- 172.21.15.37:0/519501945 learned_addr learned my addr 172.21.15.37:0/519501945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.956+0000 7f8b11002640 1 -- 172.21.15.37:0/519501945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c108480 msgr2=0x7f8b0c06e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.956+0000 7f8b11002640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c108480 0x7f8b0c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.956+0000 7f8b11002640 1 -- 172.21.15.37:0/519501945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b0c1021f0 msgr2=0x7f8b0c074ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.956+0000 7f8b11002640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b0c1021f0 0x7f8b0c074ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.956+0000 7f8b11002640 1 -- 172.21.15.37:0/519501945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c06efb0 con 0x7f8b0c107b30 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.956+0000 7f8b11002640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c06e1a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8afc006fd0 tx=0x7f8afc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.957+0000 7f8b02ffd640 1 -- 172.21.15.37:0/519501945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011830 con 0x7f8b0c107b30 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.957+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c073c60 con 0x7f8b0c107b30 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.957+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c0741f0 con 0x7f8b0c107b30 2024-09-21T01:23:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.957+0000 7f8b02ffd640 1 -- 172.21.15.37:0/519501945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8afc016070 con 0x7f8b0c107b30 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.957+0000 7f8b02ffd640 1 -- 172.21.15.37:0/519501945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc010df0 con 0x7f8b0c107b30 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.966+0000 7f8b19fdb740 1 Processor -- start 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.967+0000 7f8b19fdb740 1 -- start start 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.968+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x56084160a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.968+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084160a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.968+0000 7f8b12004640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x56084160a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.968+0000 7f8b12004640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x56084160a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50520/0 (socket says 172.21.15.37:50520) 2024-09-21T01:23:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.968+0000 7f8b12004640 1 -- 172.21.15.37:0/1548775604 learned_addr learned my addr 172.21.15.37:0/1548775604 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.969+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084160ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.969+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560841580ea0 con 0x560841263070 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.969+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5608415702d0 con 0x56084123a1b0 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.969+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5608415740e0 con 0x560841242390 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.970+0000 7f8b11803640 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084160a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.970+0000 7f8b12004640 1 -- 172.21.15.37:0/1548775604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 msgr2=0x56084160ad40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.970+0000 7f8b12004640 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084160ad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.970+0000 7f8b12004640 1 -- 172.21.15.37:0/1548775604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 msgr2=0x56084160a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.970+0000 7f8b12004640 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084160a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.970+0000 7f8b12004640 1 -- 172.21.15.37:0/1548775604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608412ce650 con 0x560841263070 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.971+0000 7f8b12004640 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x56084160a2c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009d20 tx=0x7f8b0400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11382926374aaa4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.974+0000 7f8af7fff640 1 -- 172.21.15.37:0/1548775604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400bd40 con 0x560841263070 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.974+0000 7f8b02ffd640 1 -- 172.21.15.37:0/519501945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8afc010380 con 0x7f8b0c107b30 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.976+0000 7f8af7fff640 1 -- 172.21.15.37:0/1548775604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b04017070 con 0x560841263070 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.976+0000 7f8af7fff640 1 -- 172.21.15.37:0/1548775604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04011700 con 0x560841263070 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.977+0000 7f8b02ffd640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8af80b6710 0x7f8af80b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.977+0000 7f8b11803640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8af80b6710 0x7f8af80b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 msgr2=0x56084160a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x56084160a2c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009d20 tx=0x7f8b0400b420 comp rx=0 tx=0).stop 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 shutdown_connections 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084160ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084160a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/1548775604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x56084160a2c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 >> 172.21.15.37:0/1548775604 conn(0x560841257460 msgr2=0x5608416081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.978+0000 7f8b02ffd640 1 -- 172.21.15.37:0/519501945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8afc0e6550 con 0x7f8b0c107b30 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.979+0000 7f8b11803640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8af80b6710 0x7f8af80b8c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x560841608f40 tx=0x7f8b08033510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.985+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 shutdown_connections 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.985+0000 7f8b19fdb740 1 -- 172.21.15.37:0/1548775604 wait complete. 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.986+0000 7f8b19fdb740 1 -- start start 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.987+0000 7f8b19fdb740 1 Processor -- start 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x560841615a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841615f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841621e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5608413d1700 con 0x560841263070 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56084150b160 con 0x560841242390 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560841618af0 con 0x56084123a1b0 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.988+0000 7f8b19fdb740 10 client.0 _ll_register_callbacks cb 0x5608415249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.989+0000 7f8b11002640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841615f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.990+0000 7f8b12004640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841621e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.990+0000 7f8b12004640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841621e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50522/0 (socket says 172.21.15.37:50522) 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.990+0000 7f8b12004640 1 -- 172.21.15.37:0/4153549832 learned_addr learned my addr 172.21.15.37:0/4153549832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.993+0000 7f8b11803640 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x560841615a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.993+0000 7f8b11002640 1 -- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 msgr2=0x560841615a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.993+0000 7f8b11002640 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x560841615a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.993+0000 7f8b11002640 1 -- 172.21.15.37:0/4153549832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 msgr2=0x560841621e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.993+0000 7f8b11002640 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841621e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.993+0000 7f8b11002640 1 -- 172.21.15.37:0/4153549832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560841538c90 con 0x560841242390 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.997+0000 7f8b11002640 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841615f50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0e4010 tx=0x7f8afc0a8e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f98d2ceb60efa07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.998+0000 7f8af57fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:40.999+0000 7f8af57fa640 1 -- 172.21.15.37:0/4153549832 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc021450 con 0x560841242390 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.000+0000 7f8af57fa640 1 -- 172.21.15.37:0/4153549832 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8afc0e60e0 con 0x560841242390 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.000+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b04017070 con 0x560841242390 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.007+0000 7f8af57fa640 1 -- 172.21.15.37:0/4153549832 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8afc0acda0 con 0x560841242390 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.009+0000 7f8b19fdb740 10 client.26117 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.009+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5608416248c0 con 0x560841242390 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.010+0000 7f8af57fa640 1 -- 172.21.15.37:0/4153549832 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b04017070 con 0x560841242390 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.010+0000 7f8af57fa640 1 -- 172.21.15.37:0/4153549832 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8afc0b51e0 con 0x560841242390 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.011+0000 7f8b19fdb740 10 client.26117 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.011+0000 7f8b19fdb740 10 client.26117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.011+0000 7f8b19fdb740 20 client.26117 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.011+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608412219f0 0x560841627d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.011+0000 7f8b19fdb740 4 client.26117 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.011+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560841582df0 con 0x5608412219f0 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.012+0000 7f8b11803640 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608412219f0 0x560841627d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.020+0000 7f8af57fa640 10 client.26117 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.020+0000 7f8b11803640 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608412219f0 0x560841627d90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=834d8f5da4ca9bc1 server_cookie=1a3eb86dae82bb6 in_seq=0 out_seq=0 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.023+0000 7f8af57fa640 1 -- 172.21.15.37:0/4153549832 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560841582df0 con 0x5608412219f0 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.023+0000 7f8af57fa640 10 client.26117 handle_command_reply: tid=0 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.023+0000 7f8b19fdb740 1 client.26117 shutdown 2024-09-21T01:23:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.029+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 msgr2=0x560841615f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.029+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841615f50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0e4010 tx=0x7f8afc0a8e00 comp rx=0 tx=0).stop 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.031+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 shutdown_connections 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.032+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608412219f0 0x560841627d90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.032+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841621e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.032+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841615f50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.032+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/4153549832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x560841615a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.033+0000 7f8af57fa640 0 client.26117 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.033+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 >> 172.21.15.37:0/4153549832 conn(0x560841257460 msgr2=0x56084160d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.040+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 shutdown_connections 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.040+0000 7f8b19fdb740 1 -- 172.21.15.37:0/4153549832 wait complete. 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.041+0000 7f8b19fdb740 20 client.26117 trim_cache size 0 max 16384 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.076+0000 7f8b19fdb740 1 Processor -- start 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.078+0000 7f8b19fdb740 1 -- start start 2024-09-21T01:23:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.078+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x56084160bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.078+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841606e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.078+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841612c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.079+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8af000e510 con 0x560841263070 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.079+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8af0010050 con 0x560841242390 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.079+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8af000ebe0 con 0x56084123a1b0 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.079+0000 7f8b11803640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x56084160bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.080+0000 7f8b12004640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841612c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.080+0000 7f8b11803640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x56084160bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45720/0 (socket says 172.21.15.37:45720) 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.080+0000 7f8b11803640 1 -- 172.21.15.37:0/3805875493 learned_addr learned my addr 172.21.15.37:0/3805875493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.081+0000 7f8b11803640 1 -- 172.21.15.37:0/3805875493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 msgr2=0x560841606e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.081+0000 7f8b11803640 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841606e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.081+0000 7f8b11803640 1 -- 172.21.15.37:0/3805875493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 msgr2=0x560841612c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.081+0000 7f8b11803640 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841612c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.081+0000 7f8b11803640 1 -- 172.21.15.37:0/3805875493 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560841221c20 con 0x56084123a1b0 2024-09-21T01:23:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.082+0000 7f8b11803640 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x56084160bcb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800d9d0 tx=0x7f8b0800f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b69d2ff93bc775 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.083+0000 7f8af77fe640 1 -- 172.21.15.37:0/3805875493 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0804e040 con 0x56084123a1b0 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.083+0000 7f8af77fe640 1 -- 172.21.15.37:0/3805875493 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08033dc0 con 0x56084123a1b0 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.083+0000 7f8af77fe640 1 -- 172.21.15.37:0/3805875493 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0803f7a0 con 0x56084123a1b0 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.084+0000 7f8b19fdb740 1 -- 172.21.15.37:0/3805875493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 msgr2=0x56084160bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.084+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x56084160bcb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800d9d0 tx=0x7f8b0800f050 comp rx=0 tx=0).stop 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.085+0000 7f8b19fdb740 1 -- 172.21.15.37:0/3805875493 shutdown_connections 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.085+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x560841612c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.085+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560841242390 0x560841606e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.085+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/3805875493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56084123a1b0 0x56084160bcb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.085+0000 7f8b19fdb740 1 -- 172.21.15.37:0/3805875493 >> 172.21.15.37:0/3805875493 conn(0x560841257460 msgr2=0x560841606750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.086+0000 7f8b19fdb740 1 -- 172.21.15.37:0/3805875493 shutdown_connections 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.087+0000 7f8b19fdb740 1 -- 172.21.15.37:0/3805875493 wait complete. 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.087+0000 7f8b19fdb740 1 -- start start 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.088+0000 7f8b19fdb740 1 Processor -- start 2024-09-21T01:23:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084161a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084161abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x5608416917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8af000f980 con 0x560841263070 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8af000f2b0 con 0x56084123a1b0 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8af000c4d0 con 0x560841242390 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.089+0000 7f8b19fdb740 10 client.0 _ll_register_callbacks cb 0x7f8afc010f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.091+0000 7f8b11002640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084161abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.092+0000 7f8b11803640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084161a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.093+0000 7f8b11002640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084161abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45728/0 (socket says 172.21.15.37:45728) 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.093+0000 7f8b11002640 1 -- 172.21.15.37:0/2033840378 learned_addr learned my addr 172.21.15.37:0/2033840378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.097+0000 7f8b11002640 1 -- 172.21.15.37:0/2033840378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 msgr2=0x56084161a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.097+0000 7f8b11002640 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084161a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.097+0000 7f8b11002640 1 -- 172.21.15.37:0/2033840378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 msgr2=0x5608416917e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.097+0000 7f8b11002640 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x5608416917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.097+0000 7f8b11002640 1 -- 172.21.15.37:0/2033840378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560841691e50 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.100+0000 7f8b11002640 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084161abb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0ac3a0 tx=0x7f8afc021560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c702c5c4f2045692 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.100+0000 7f8af57fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.102+0000 7f8af57fa640 1 -- 172.21.15.37:0/2033840378 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0a8540 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.102+0000 7f8af57fa640 1 -- 172.21.15.37:0/2033840378 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f8afc0b25f0 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.102+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b08033dc0 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.104+0000 7f8af57fa640 1 -- 172.21.15.37:0/2033840378 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8afc0b1180 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.104+0000 7f8b19fdb740 10 client.26110 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.104+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5608416930b0 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8af57fa640 1 -- 172.21.15.37:0/2033840378 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08033dc0 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8af57fa640 1 -- 172.21.15.37:0/2033840378 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8afc0e60d0 con 0x560841242390 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8b19fdb740 10 client.26110 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8b19fdb740 10 client.26110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:23:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8b19fdb740 20 client.26110 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608411f6da0 0x5608416955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8b19fdb740 4 client.26110 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.106+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56084157e8a0 con 0x5608411f6da0 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.109+0000 7f8b11803640 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608411f6da0 0x5608416955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.128+0000 7f8af57fa640 10 client.26110 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.128+0000 7f8b11803640 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608411f6da0 0x5608416955a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f8ac6266184c5b3 server_cookie=4efa4a58e868f0e in_seq=0 out_seq=0 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8af57fa640 1 -- 172.21.15.37:0/2033840378 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56084157e8a0 con 0x5608411f6da0 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8af57fa640 10 client.26110 handle_command_reply: tid=0 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 client.26110 shutdown 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 msgr2=0x56084161abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084161abb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0ac3a0 tx=0x7f8afc021560 comp rx=0 tx=0).stop 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 shutdown_connections 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x5608411f6da0 0x5608416955a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560841263070 0x5608416917e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560841242390 0x56084161abb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 --2- 172.21.15.37:0/2033840378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56084123a1b0 0x56084161a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.129+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 >> 172.21.15.37:0/2033840378 conn(0x560841257460 msgr2=0x56084160ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.130+0000 7f8af57fa640 0 client.26110 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:23:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.130+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 shutdown_connections 2024-09-21T01:23:41.302 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:23:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.130+0000 7f8b19fdb740 1 -- 172.21.15.37:0/2033840378 wait complete. 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.130+0000 7f8b19fdb740 20 client.26110 trim_cache size 0 max 16384 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.131+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8af80b6710 msgr2=0x7f8af80b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.131+0000 7f8b13a67640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8af80b6710 0x7f8af80b8c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x560841608f40 tx=0x7f8b08033510 comp rx=0 tx=0).stop 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.131+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 msgr2=0x7f8b0c06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.131+0000 7f8b13a67640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c06e1a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8afc006fd0 tx=0x7f8afc00b8e0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 shutdown_connections 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f8af80b6710 0x7f8af80b8c20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0c108480 0x7f8b0c06e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c107b30 0x7f8b0c06e1a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 --2- 172.21.15.37:0/519501945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b0c1021f0 0x7f8b0c074ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 >> 172.21.15.37:0/519501945 conn(0x7f8b0c077c60 msgr2=0x7f8b0c105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 shutdown_connections 2024-09-21T01:23:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:41.132+0000 7f8b13a67640 1 -- 172.21.15.37:0/519501945 wait complete. 2024-09-21T01:23:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f190f7f6640 1 -- 172.21.15.37:0/77712962 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f191c0048b0 con 0x5649b51111c0 2024-09-21T01:23:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f190f7f6640 10 client.26098 handle_command_reply: tid=0 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 client.26098 shutdown 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 msgr2=0x5649b5534bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b5534bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f191c03ba20 tx=0x7f191c03b430 comp rx=0 tx=0).stop 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 shutdown_connections 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5649b51111c0 0x5649b55a8ef0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5649b517d1b0 0x5649b5534bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5649b515c4d0 0x5649b55340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 --2- 172.21.15.37:0/77712962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649b51542f0 0x5649b5533a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 >> 172.21.15.37:0/77712962 conn(0x5649b5171300 msgr2=0x5649b55203a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.045+0000 7f190f7f6640 0 client.26098 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.046+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 shutdown_connections 2024-09-21T01:23:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.046+0000 7f19390c7740 1 -- 172.21.15.37:0/77712962 wait complete. 2024-09-21T01:23:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.046+0000 7f19390c7740 20 client.26098 trim_cache size 0 max 16384 2024-09-21T01:23:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:23:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:23:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:23:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:23:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.060+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f19140b6720 msgr2=0x7f19140b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.060+0000 7f1932157640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f19140b6720 0x7f19140b8c30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5649b55269f0 tx=0x7f191c04f7a0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.060+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 msgr2=0x7f192c1a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:42.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.060+0000 7f1932157640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c1a09c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f192400ebc0 tx=0x7f192400c6a0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.062+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 shutdown_connections 2024-09-21T01:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.062+0000 7f1932157640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f19140b6720 0x7f19140b8c30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.062+0000 7f1932157640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f192c10f830 0x7f192c1a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.062+0000 7f1932157640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f192c10cd20 0x7f192c1a09c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.062+0000 7f1932157640 1 --2- 172.21.15.37:0/753594793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c10a3c0 0x7f192c1a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:42.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.062+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 >> 172.21.15.37:0/753594793 conn(0x7f192c070670 msgr2=0x7f192c070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.064+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 shutdown_connections 2024-09-21T01:23:42.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:42.064+0000 7f1932157640 1 -- 172.21.15.37:0/753594793 wait complete. 2024-09-21T01:23:43.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:42 smithi037 ceph-mon[31105]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 790 MiB/s wr, 2.40k op/s 2024-09-21T01:23:43.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:42 smithi144 ceph-mon[34818]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 790 MiB/s wr, 2.40k op/s 2024-09-21T01:23:43.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:42 smithi137 ceph-mon[34607]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 790 MiB/s wr, 2.40k op/s 2024-09-21T01:23:45.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:23:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:44 smithi137 ceph-mon[34607]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 900 MiB/s wr, 2.44k op/s 2024-09-21T01:23:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:44 smithi144 ceph-mon[34818]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 900 MiB/s wr, 2.44k op/s 2024-09-21T01:23:45.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:44 smithi037 ceph-mon[31105]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 900 MiB/s wr, 2.44k op/s 2024-09-21T01:23:45.967 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:47.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:46 smithi137 ceph-mon[34607]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 2.27k op/s 2024-09-21T01:23:47.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:46 smithi144 ceph-mon[34818]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 2.27k op/s 2024-09-21T01:23:47.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:46 smithi037 ceph-mon[31105]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 910 MiB/s wr, 2.27k op/s 2024-09-21T01:23:49.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:48 smithi037 ceph-mon[31105]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 744 MiB/s wr, 1.68k op/s 2024-09-21T01:23:49.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:48 smithi137 ceph-mon[34607]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 744 MiB/s wr, 1.68k op/s 2024-09-21T01:23:49.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:48 smithi144 ceph-mon[34818]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 744 MiB/s wr, 1.68k op/s 2024-09-21T01:23:49.399 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.056+0000 7fd7f382a640 1 -- 172.21.15.37:0/1124139897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec111f40 msgr2=0x7fd7ec10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.056+0000 7fd7f382a640 1 --2- 172.21.15.37:0/1124139897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec111f40 0x7fd7ec10a3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009900 tx=0x7fd7e802a440 comp rx=0 tx=0).stop 2024-09-21T01:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.061+0000 7fd7f382a640 1 -- 172.21.15.37:0/1124139897 shutdown_connections 2024-09-21T01:23:49.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.061+0000 7fd7f382a640 1 --2- 172.21.15.37:0/1124139897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7ec11cc30 0x7fd7ec11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.061+0000 7fd7f382a640 1 --2- 172.21.15.37:0/1124139897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.061+0000 7fd7f382a640 1 --2- 172.21.15.37:0/1124139897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec111f40 0x7fd7ec10a3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.061+0000 7fd7f382a640 1 -- 172.21.15.37:0/1124139897 >> 172.21.15.37:0/1124139897 conn(0x7fd7ec070ec0 msgr2=0x7fd7ec0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.065+0000 7fd7f382a640 1 -- 172.21.15.37:0/1124139897 shutdown_connections 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.069+0000 7fd7f382a640 1 -- 172.21.15.37:0/1124139897 wait complete. 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.071+0000 7fd7f382a640 1 Processor -- start 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.071+0000 7fd7f382a640 1 -- start start 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.076+0000 7fd7f382a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec1a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.076+0000 7fd7f382a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7ec111f40 0x7fd7ec1a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.076+0000 7fd7f382a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7ec11cc30 0x7fd7ec1aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.076+0000 7fd7f382a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec1229e0 con 0x7fd7ec11cc30 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.076+0000 7fd7f382a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec122860 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.076+0000 7fd7f382a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec122b60 con 0x7fd7ec111f40 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.078+0000 7fd7f15c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec1a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.078+0000 7fd7f15c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec1a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43014/0 (socket says 172.21.15.37:43014) 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.078+0000 7fd7f15c6640 1 -- 172.21.15.37:0/616220122 learned_addr learned my addr 172.21.15.37:0/616220122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.078+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7ec11cc30 0x7fd7ec1aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.079+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7ec111f40 0x7fd7ec1a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.079+0000 7fd7f15c6640 1 -- 172.21.15.37:0/616220122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7ec111f40 msgr2=0x7fd7ec1a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.079+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7ec111f40 0x7fd7ec1a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.079+0000 7fd7f15c6640 1 -- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7ec11cc30 msgr2=0x7fd7ec1aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.079+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7ec11cc30 0x7fd7ec1aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.079+0000 7fd7f15c6640 1 -- 172.21.15.37:0/616220122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec1af3a0 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.087+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec1a9430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd7e802aa30 tx=0x7fd7e8003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.092+0000 7fd7e27fc640 1 -- 172.21.15.37:0/616220122 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8040030 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.092+0000 7fd7e27fc640 1 -- 172.21.15.37:0/616220122 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e803c8f0 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.092+0000 7fd7e27fc640 1 -- 172.21.15.37:0/616220122 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8031830 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.092+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec1af630 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.092+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec1b5df0 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.098+0000 7fd7f9d9e740 1 Processor -- start 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.099+0000 7fd7f9d9e740 1 -- start start 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.099+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf490816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.099+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49081be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.099+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf49082120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.100+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bf48ff7ea0 con 0x55bf48cda070 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.100+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bf48fe72d0 con 0x55bf48cb9390 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.100+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bf48feb0e0 con 0x55bf48cb11b0 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.104+0000 7fd7f1dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf490816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.104+0000 7fd7f1dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf490816a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45744/0 (socket says 172.21.15.37:45744) 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.104+0000 7fd7f1dc7640 1 -- 172.21.15.37:0/3046952797 learned_addr learned my addr 172.21.15.37:0/3046952797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:49.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.104+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf49082120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.107+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49081be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.107+0000 7fd7e27fc640 1 -- 172.21.15.37:0/616220122 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd7e8043030 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.109+0000 7fd7e27fc640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7d80b6720 0x7fd7d80b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.109+0000 7fd7e27fc640 1 -- 172.21.15.37:0/616220122 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd7e81079b0 con 0x7fd7ec10a9e0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.115+0000 7fd7f15c6640 1 -- 172.21.15.37:0/3046952797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 msgr2=0x55bf49082120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.115+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf49082120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.115+0000 7fd7f15c6640 1 -- 172.21.15.37:0/3046952797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 msgr2=0x55bf490816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.115+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf490816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.115+0000 7fd7f15c6640 1 -- 172.21.15.37:0/3046952797 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf48d45650 con 0x55bf48cb11b0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.117+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49081be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80cd800 tx=0x7fd7e802a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61407aa21b6604d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.118+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7d80b6720 0x7fd7d80b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.119+0000 7fd7d77fe640 1 -- 172.21.15.37:0/3046952797 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e804a050 con 0x55bf48cb11b0 2024-09-21T01:23:49.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.119+0000 7fd7d77fe640 1 -- 172.21.15.37:0/3046952797 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e80cd610 con 0x55bf48cb11b0 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.121+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/3046952797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 msgr2=0x55bf49081be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.121+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49081be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80cd800 tx=0x7fd7e802a440 comp rx=0 tx=0).stop 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.123+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/3046952797 shutdown_connections 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.123+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf49082120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.123+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49081be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.123+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/3046952797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf490816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.123+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/3046952797 >> 172.21.15.37:0/3046952797 conn(0x55bf48cce460 msgr2=0x55bf4907f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.124+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/3046952797 shutdown_connections 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.124+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/3046952797 wait complete. 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.124+0000 7fd7f9d9e740 1 -- start start 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.124+0000 7fd7f9d9e740 1 Processor -- start 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf4908cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf4908d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf4908d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bf48e48700 con 0x55bf48cda070 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bf48f82160 con 0x55bf48cb9390 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bf4908fc40 con 0x55bf48cb11b0 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.126+0000 7fd7f9d9e740 10 client.0 _ll_register_callbacks cb 0x55bf48f9b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.131+0000 7fd7f0dc5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf4908d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.131+0000 7fd7f0dc5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf4908d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43040/0 (socket says 172.21.15.37:43040) 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.131+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/1863632233 learned_addr learned my addr 172.21.15.37:0/1863632233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.131+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf4908d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.132+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7d80b6720 0x7fd7d80b8c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400a4c0 tx=0x7fd7e400c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.132+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf4908cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.133+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/1863632233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 msgr2=0x55bf4908cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.133+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf4908cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.133+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/1863632233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 msgr2=0x55bf4908d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.133+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf4908d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.133+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/1863632233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf48fafc90 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.136+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf4908d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e80 tx=0x7fd7dc011630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc80effe782babe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.136+0000 7fd7d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.139+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/1863632233 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc019070 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.139+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e80cd610 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.140+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/1863632233 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd7dc015660 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.141+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/1863632233 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7dc025050 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.146+0000 7fd7f9d9e740 10 client.26132 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.146+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bf4909b7b0 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.152+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/1863632233 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e80cd610 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.153+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/1863632233 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd7dc014a60 con 0x55bf48cb9390 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.158+0000 7fd7f9d9e740 10 client.26132 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:49.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.158+0000 7fd7f9d9e740 10 client.26132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.159+0000 7fd7f9d9e740 20 client.26132 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.159+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf48c989f0 0x55bf4909ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.159+0000 7fd7f9d9e740 4 client.26132 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.159+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf48ff9df0 con 0x55bf48c989f0 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.160+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf48c989f0 0x55bf4909ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.174+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf48c989f0 0x55bf4909ed00 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2721e4ee27f2a23c server_cookie=810c1d7f809b1545 in_seq=0 out_seq=0 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.175+0000 7fd7d4ff9640 10 client.26132 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.181+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/1863632233 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf48ff9df0 con 0x55bf48c989f0 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.181+0000 7fd7d4ff9640 10 client.26132 handle_command_reply: tid=0 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.181+0000 7fd7f9d9e740 1 client.26132 shutdown 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 msgr2=0x55bf4908d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf4908d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e80 tx=0x7fd7dc011630 comp rx=0 tx=0).stop 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 shutdown_connections 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf48c989f0 0x55bf4909ed00 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cda070 0x55bf4908d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cb9390 0x55bf4908d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/1863632233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf4908cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 >> 172.21.15.37:0/1863632233 conn(0x55bf48cce460 msgr2=0x55bf490826d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7d4ff9640 0 client.26132 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 shutdown_connections 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/1863632233 wait complete. 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.182+0000 7fd7f9d9e740 20 client.26132 trim_cache size 0 max 16384 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.217+0000 7fd7f9d9e740 1 Processor -- start 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.217+0000 7fd7f9d9e740 1 -- start start 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49083090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 0x55bf4908e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cda070 0x55bf49089d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d000e620 con 0x55bf48cb9390 2024-09-21T01:23:49.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0010160 con 0x55bf48cda070 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d000ecf0 con 0x55bf48cb11b0 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f0dc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 0x55bf4908e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f15c6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49083090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f15c6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49083090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35324/0 (socket says 172.21.15.37:35324) 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f0dc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 0x55bf4908e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45754/0 (socket says 172.21.15.37:45754) 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.218+0000 7fd7f15c6640 1 -- 172.21.15.37:0/2867711670 learned_addr learned my addr 172.21.15.37:0/2867711670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cda070 0x55bf49089d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/2867711670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 msgr2=0x55bf49083090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49083090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/2867711670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cda070 msgr2=0x55bf49089d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cda070 0x55bf49089d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f0dc5640 1 -- 172.21.15.37:0/2867711670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf490877c0 con 0x55bf48cb9390 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.219+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cda070 0x55bf49089d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:23:49.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.220+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 0x55bf4908e7b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e80 tx=0x7fd7dc004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301e9b25923dbdff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.220+0000 7fd7d6ffd640 1 -- 172.21.15.37:0/2867711670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc019040 con 0x55bf48cb9390 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.220+0000 7fd7d6ffd640 1 -- 172.21.15.37:0/2867711670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7dc01dd20 con 0x55bf48cb9390 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/2867711670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 msgr2=0x55bf4908e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 0x55bf4908e7b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e80 tx=0x7fd7dc004640 comp rx=0 tx=0).stop 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/2867711670 shutdown_connections 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48cda070 0x55bf49089d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb9390 0x55bf4908e7b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/2867711670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cb11b0 0x55bf49083090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.222+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/2867711670 >> 172.21.15.37:0/2867711670 conn(0x55bf48cce460 msgr2=0x55bf4908e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.229+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/2867711670 shutdown_connections 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.229+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/2867711670 wait complete. 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.230+0000 7fd7f9d9e740 1 -- start start 2024-09-21T01:23:49.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.231+0000 7fd7f9d9e740 1 Processor -- start 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 0x55bf49095560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cda070 0x55bf49090a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48c6dda0 0x55bf49090f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d000fa90 con 0x55bf48cb11b0 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d000f3c0 con 0x55bf48c6dda0 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d000c5e0 con 0x55bf48cda070 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.233+0000 7fd7f9d9e740 10 client.0 _ll_register_callbacks cb 0x7fd7dc009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.235+0000 7fd7f15c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 0x55bf49095560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.236+0000 7fd7f15c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 0x55bf49095560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45764/0 (socket says 172.21.15.37:45764) 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.236+0000 7fd7f15c6640 1 -- 172.21.15.37:0/83165533 learned_addr learned my addr 172.21.15.37:0/83165533 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f1dc7640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48c6dda0 0x55bf49090f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f15c6640 1 -- 172.21.15.37:0/83165533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cda070 msgr2=0x55bf49090a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cda070 0x55bf49090a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cda070 0x55bf49090a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f15c6640 1 -- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48c6dda0 msgr2=0x55bf49090f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48c6dda0 0x55bf49090f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.238+0000 7fd7f15c6640 1 -- 172.21.15.37:0/83165533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf49091590 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.241+0000 7fd7f15c6640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 0x55bf49095560 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c9350 tx=0x7fd7e80cd370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9869591ffb399 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.241+0000 7fd7d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.242+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/83165533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e804a040 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.243+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf48ff58a0 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.243+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/83165533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd7e80d7090 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.244+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/83165533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7e80d23e0 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.247+0000 7fd7f9d9e740 10 client.16719 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.247+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bf4911a570 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.248+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/83165533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bf48ff58a0 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.249+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/83165533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd7e80cba50 con 0x55bf48cb11b0 2024-09-21T01:23:49.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.250+0000 7fd7f9d9e740 10 client.16719 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.250+0000 7fd7f9d9e740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.250+0000 7fd7f9d9e740 20 client.16719 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.250+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf4911aa50 0x55bf4911ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.250+0000 7fd7f9d9e740 4 client.16719 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.250+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf48ff2cd0 con 0x55bf4911aa50 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.255+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf4911aa50 0x55bf4911ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.258+0000 7fd7f0dc5640 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf4911aa50 0x55bf4911ce70 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9710e2b74ee7d60b server_cookie=e1404bbc035ad188 in_seq=0 out_seq=0 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.259+0000 7fd7d4ff9640 10 client.16719 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.265+0000 7fd7d4ff9640 1 -- 172.21.15.37:0/83165533 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf48ff2cd0 con 0x55bf4911aa50 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.266+0000 7fd7d4ff9640 10 client.16719 handle_command_reply: tid=0 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.266+0000 7fd7f9d9e740 1 client.16719 shutdown 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 msgr2=0x55bf49095560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 0x55bf49095560 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c9350 tx=0x7fd7e80cd370 comp rx=0 tx=0).stop 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 shutdown_connections 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55bf4911aa50 0x55bf4911ce70 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bf48c6dda0 0x55bf49090f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf48cda070 0x55bf49090a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 --2- 172.21.15.37:0/83165533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf48cb11b0 0x55bf49095560 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7d4ff9640 0 client.16719 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.267+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 >> 172.21.15.37:0/83165533 conn(0x55bf48cce460 msgr2=0x55bf490867b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.269+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 shutdown_connections 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.269+0000 7fd7f9d9e740 1 -- 172.21.15.37:0/83165533 wait complete. 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.270+0000 7fd7f9d9e740 20 client.16719 trim_cache size 0 max 16384 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7d80b6720 msgr2=0x7fd7d80b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7d80b6720 0x7fd7d80b8c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400a4c0 tx=0x7fd7e400c040 comp rx=0 tx=0).stop 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 msgr2=0x7fd7ec1a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec1a9430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd7e802aa30 tx=0x7fd7e8003e90 comp rx=0 tx=0).stop 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 shutdown_connections 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd7d80b6720 0x7fd7d80b8c30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7ec11cc30 0x7fd7ec1aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7ec111f40 0x7fd7ec1a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 --2- 172.21.15.37:0/616220122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd7ec10a9e0 0x7fd7ec1a9430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 >> 172.21.15.37:0/616220122 conn(0x7fd7ec070ec0 msgr2=0x7fd7ec11e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.279+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 shutdown_connections 2024-09-21T01:23:49.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:49.281+0000 7fd7f382a640 1 -- 172.21.15.37:0/616220122 wait complete. 2024-09-21T01:23:51.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:50 smithi137 ceph-mon[34607]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 968 MiB/s wr, 2.38k op/s 2024-09-21T01:23:51.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:50 smithi144 ceph-mon[34818]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 968 MiB/s wr, 2.38k op/s 2024-09-21T01:23:51.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:50 smithi037 ceph-mon[31105]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 968 MiB/s wr, 2.38k op/s 2024-09-21T01:23:53.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:52 smithi037 ceph-mon[31105]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 844 MiB/s wr, 2.04k op/s 2024-09-21T01:23:53.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:52 smithi137 ceph-mon[34607]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 844 MiB/s wr, 2.04k op/s 2024-09-21T01:23:53.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:52 smithi144 ceph-mon[34818]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 844 MiB/s wr, 2.04k op/s 2024-09-21T01:23:55.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:54 smithi037 ceph-mon[31105]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 864 MiB/s wr, 2.11k op/s 2024-09-21T01:23:55.288 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:23:55.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:23:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.286+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1370320711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 msgr2=0x7f05f806abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.286+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1370320711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f806abe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009c90 tx=0x7f05f002a860 comp rx=0 tx=0).stop 2024-09-21T01:23:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.287+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1370320711 shutdown_connections 2024-09-21T01:23:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.287+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1370320711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f806abe0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.287+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1370320711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05f8103620 0x7f05f8103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.287+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1370320711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.287+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1370320711 >> 172.21.15.37:0/1370320711 conn(0x7f05f80fdee0 msgr2=0x7f05f8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.288+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1370320711 shutdown_connections 2024-09-21T01:23:55.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.289+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1370320711 wait complete. 2024-09-21T01:23:55.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.291+0000 7f05ff9a8640 1 Processor -- start 2024-09-21T01:23:55.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.291+0000 7f05ff9a8640 1 -- start start 2024-09-21T01:23:55.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05ff9a8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f81a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05ff9a8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05f8103620 0x7f05f81a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05ff9a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f81a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05ff9a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05f8106540 con 0x7f05f8103fc0 2024-09-21T01:23:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05ff9a8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81063c0 con 0x7f05f81025a0 2024-09-21T01:23:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05ff9a8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81066c0 con 0x7f05f8103620 2024-09-21T01:23:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05fd744640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f81a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.292+0000 7f05fd744640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f81a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43086/0 (socket says 172.21.15.37:43086) 2024-09-21T01:23:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fd744640 1 -- 172.21.15.37:0/1792013623 learned_addr learned my addr 172.21.15.37:0/1792013623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fdf45640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f81a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fd744640 1 -- 172.21.15.37:0/1792013623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05f8103620 msgr2=0x7f05f81a0b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:23:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fd744640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05f8103620 0x7f05f81a0b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fd744640 1 -- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 msgr2=0x7f05f81a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:55.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fd744640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f81a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fd744640 1 -- 172.21.15.37:0/1792013623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f81a1f00 con 0x7f05f81025a0 2024-09-21T01:23:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.293+0000 7f05fdf45640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f81a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:23:55.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.295+0000 7f05fd744640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f81a04c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f05f400b4a0 tx=0x7f05f400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:55.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.297+0000 7f05ee7fc640 1 -- 172.21.15.37:0/1792013623 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4014070 con 0x7f05f81025a0 2024-09-21T01:23:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.297+0000 7f05ee7fc640 1 -- 172.21.15.37:0/1792013623 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f4010ac0 con 0x7f05f81025a0 2024-09-21T01:23:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.297+0000 7f05ee7fc640 1 -- 172.21.15.37:0/1792013623 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4017b60 con 0x7f05f81025a0 2024-09-21T01:23:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.297+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f81a21f0 con 0x7f05f81025a0 2024-09-21T01:23:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.298+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f81a88e0 con 0x7f05f81025a0 2024-09-21T01:23:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.302+0000 7f06069ef740 1 Processor -- start 2024-09-21T01:23:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.302+0000 7f06069ef740 1 -- start start 2024-09-21T01:23:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.303+0000 7f06069ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f43e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.303+0000 7f06069ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b732f0 0x563224f444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.303+0000 7f06069ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b7b4d0 0x563224f45010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.303+0000 7f06069ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563224eb66f0 con 0x563224b9c1b0 2024-09-21T01:23:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.303+0000 7f06069ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563224ea5b20 con 0x563224b732f0 2024-09-21T01:23:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.303+0000 7f06069ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563224ea9930 con 0x563224b7b4d0 2024-09-21T01:23:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.304+0000 7f05fdf45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f43e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.304+0000 7f05fdf45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f43e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45786/0 (socket says 172.21.15.37:45786) 2024-09-21T01:23:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.304+0000 7f05fdf45640 1 -- 172.21.15.37:0/1572307039 learned_addr learned my addr 172.21.15.37:0/1572307039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.305+0000 7f05fdf45640 1 -- 172.21.15.37:0/1572307039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b7b4d0 msgr2=0x563224f45010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:23:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.305+0000 7f05fdf45640 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b7b4d0 0x563224f45010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.305+0000 7f05fdf45640 1 -- 172.21.15.37:0/1572307039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b732f0 msgr2=0x563224f444c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:23:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.305+0000 7f05fdf45640 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b732f0 0x563224f444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.305+0000 7f05fdf45640 1 -- 172.21.15.37:0/1572307039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563224e6b530 con 0x563224b9c1b0 2024-09-21T01:23:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.305+0000 7f05fdf45640 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f43e50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f05f0035000 tx=0x7f05f00314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4c60356f4fef10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.311+0000 7f05ee7fc640 1 -- 172.21.15.37:0/1792013623 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f05f4017070 con 0x7f05f81025a0 2024-09-21T01:23:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.314+0000 7f05ee7fc640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f05e40b65d0 0x7f05e40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.314+0000 7f05ee7fc640 1 -- 172.21.15.37:0/1792013623 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f05f40e6620 con 0x7f05f81025a0 2024-09-21T01:23:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.317+0000 7f05e37fe640 1 -- 172.21.15.37:0/1572307039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0031bf0 con 0x563224b9c1b0 2024-09-21T01:23:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.317+0000 7f05e37fe640 1 -- 172.21.15.37:0/1572307039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f0036030 con 0x563224b9c1b0 2024-09-21T01:23:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.319+0000 7f06069ef740 1 -- 172.21.15.37:0/1572307039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 msgr2=0x563224f43e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.319+0000 7f06069ef740 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f43e50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f05f0035000 tx=0x7f05f00314a0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.323+0000 7f06069ef740 1 -- 172.21.15.37:0/1572307039 shutdown_connections 2024-09-21T01:23:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.323+0000 7f06069ef740 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b7b4d0 0x563224f45010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.323+0000 7f06069ef740 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b732f0 0x563224f444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.323+0000 7f06069ef740 1 --2- 172.21.15.37:0/1572307039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f43e50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.323+0000 7f06069ef740 1 -- 172.21.15.37:0/1572307039 >> 172.21.15.37:0/1572307039 conn(0x563224b90300 msgr2=0x563224f3f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.330+0000 7f06069ef740 1 -- 172.21.15.37:0/1572307039 shutdown_connections 2024-09-21T01:23:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.330+0000 7f06069ef740 1 -- 172.21.15.37:0/1572307039 wait complete. 2024-09-21T01:23:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.331+0000 7f06069ef740 1 -- start start 2024-09-21T01:23:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.331+0000 7f06069ef740 1 Processor -- start 2024-09-21T01:23:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.332+0000 7f06069ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 0x563224f4d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f06069ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f4dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f06069ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f4e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f05fdf45640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 0x563224f4d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f05fdf45640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 0x563224f4d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:35368/0 (socket says 172.21.15.37:35368) 2024-09-21T01:23:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f05fdf45640 1 -- 172.21.15.37:0/3181400669 learned_addr learned my addr 172.21.15.37:0/3181400669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563224dddab0 con 0x563224b9c1b0 2024-09-21T01:23:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.333+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563224e4b730 con 0x563224b7b4d0 2024-09-21T01:23:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.334+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563224f45b20 con 0x563224b732f0 2024-09-21T01:23:55.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.334+0000 7f06069ef740 10 client.0 _ll_register_callbacks cb 0x563224e9f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fcf43640 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f4dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fdf45640 1 -- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 msgr2=0x563224f4dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f4dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fdf45640 1 -- 172.21.15.37:0/3181400669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 msgr2=0x563224f4e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f4e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fdf45640 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563224c07790 con 0x563224b732f0 2024-09-21T01:23:55.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.338+0000 7f05fd744640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f05e40b65d0 0x7f05e40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.341+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 0x563224f4d580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009a20 tx=0x7f05f00317d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69617fa4da820909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:55.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.342+0000 7f05e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:23:55.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.342+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3181400669 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0030760 con 0x563224b732f0 2024-09-21T01:23:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.343+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f0036030 con 0x563224b732f0 2024-09-21T01:23:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.343+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3181400669 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f05f0030900 con 0x563224b732f0 2024-09-21T01:23:55.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.344+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3181400669 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f05f0032ec0 con 0x563224b732f0 2024-09-21T01:23:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.347+0000 7f06069ef740 10 client.26122 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.347+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563224c80620 con 0x563224b732f0 2024-09-21T01:23:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.349+0000 7f05fd744640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f05e40b65d0 0x7f05e40b8ae0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05f400be60 tx=0x7f05f4010f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3181400669 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f0036030 con 0x563224b732f0 2024-09-21T01:23:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3181400669 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f05f0043070 con 0x563224b732f0 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f06069ef740 10 client.26122 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f06069ef740 10 client.26122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f06069ef740 20 client.26122 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f06069ef740 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b5ad80 0x563224f5abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f06069ef740 4 client.26122 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.350+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563224eb8640 con 0x563224b5ad80 2024-09-21T01:23:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.351+0000 7f05fcf43640 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b5ad80 0x563224f5abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.354+0000 7f05fcf43640 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b5ad80 0x563224f5abf0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2186fa04c2f5387d server_cookie=c3ec2be9fcc0c919 in_seq=0 out_seq=0 2024-09-21T01:23:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.356+0000 7f05e0ff9640 10 client.26122 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.360+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3181400669 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563224eb8640 con 0x563224b5ad80 2024-09-21T01:23:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.360+0000 7f05e0ff9640 10 client.26122 handle_command_reply: tid=0 2024-09-21T01:23:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.360+0000 7f06069ef740 1 client.26122 shutdown 2024-09-21T01:23:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.366+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 msgr2=0x563224f4d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:55.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.366+0000 7f06069ef740 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 0x563224f4d580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009a20 tx=0x7f05f00317d0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 shutdown_connections 2024-09-21T01:23:55.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f06069ef740 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b5ad80 0x563224f5abf0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f06069ef740 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b9c1b0 0x563224f4e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f06069ef740 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f4dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f06069ef740 1 --2- 172.21.15.37:0/3181400669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b732f0 0x563224f4d580 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 >> 172.21.15.37:0/3181400669 conn(0x563224b90300 msgr2=0x563224f3dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.369+0000 7f05e0ff9640 0 client.26122 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.371+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 shutdown_connections 2024-09-21T01:23:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.373+0000 7f06069ef740 1 -- 172.21.15.37:0/3181400669 wait complete. 2024-09-21T01:23:55.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.373+0000 7f06069ef740 20 client.26122 trim_cache size 0 max 16384 2024-09-21T01:23:55.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:54 smithi137 ceph-mon[34607]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 864 MiB/s wr, 2.11k op/s 2024-09-21T01:23:55.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:54 smithi144 ceph-mon[34818]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 864 MiB/s wr, 2.11k op/s 2024-09-21T01:23:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.427+0000 7f06069ef740 1 Processor -- start 2024-09-21T01:23:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.427+0000 7f06069ef740 1 -- start start 2024-09-21T01:23:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.427+0000 7f06069ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f4c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.428+0000 7f06069ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f44ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.428+0000 7f06069ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f4ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.428+0000 7f06069ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b1800 con 0x563224b732f0 2024-09-21T01:23:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.428+0000 7f06069ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b3340 con 0x563224b7b4d0 2024-09-21T01:23:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.428+0000 7f06069ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b1ed0 con 0x563224b9c1b0 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.429+0000 7f05fcf43640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f44ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.429+0000 7f05fcf43640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f44ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:43104/0 (socket says 172.21.15.37:43104) 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.429+0000 7f05fcf43640 1 -- 172.21.15.37:0/3240161916 learned_addr learned my addr 172.21.15.37:0/3240161916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.429+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f4ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.429+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f4c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.430+0000 7f05fdf45640 1 -- 172.21.15.37:0/3240161916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 msgr2=0x563224f4ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.430+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f4ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.430+0000 7f05fdf45640 1 -- 172.21.15.37:0/3240161916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 msgr2=0x563224f44ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.430+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f44ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.430+0000 7f05fdf45640 1 -- 172.21.15.37:0/3240161916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563224f45ca0 con 0x563224b732f0 2024-09-21T01:23:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.431+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f4c7a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f05f003c470 tx=0x7f05f0031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb6746a9e517d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.431+0000 7f05e2ffd640 1 -- 172.21.15.37:0/3240161916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0030d70 con 0x563224b732f0 2024-09-21T01:23:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.431+0000 7f05e2ffd640 1 -- 172.21.15.37:0/3240161916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f0036040 con 0x563224b732f0 2024-09-21T01:23:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.433+0000 7f06069ef740 1 -- 172.21.15.37:0/3240161916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 msgr2=0x563224f4c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.433+0000 7f06069ef740 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f4c7a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f05f003c470 tx=0x7f05f0031000 comp rx=0 tx=0).stop 2024-09-21T01:23:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.437+0000 7f06069ef740 1 -- 172.21.15.37:0/3240161916 shutdown_connections 2024-09-21T01:23:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.437+0000 7f06069ef740 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f4ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.437+0000 7f06069ef740 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f44ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.437+0000 7f06069ef740 1 --2- 172.21.15.37:0/3240161916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f4c7a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.437+0000 7f06069ef740 1 -- 172.21.15.37:0/3240161916 >> 172.21.15.37:0/3240161916 conn(0x563224b90300 msgr2=0x563224f3a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.442+0000 7f06069ef740 1 -- 172.21.15.37:0/3240161916 shutdown_connections 2024-09-21T01:23:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.442+0000 7f06069ef740 1 -- 172.21.15.37:0/3240161916 wait complete. 2024-09-21T01:23:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.443+0000 7f06069ef740 1 -- start start 2024-09-21T01:23:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.443+0000 7f06069ef740 1 Processor -- start 2024-09-21T01:23:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.444+0000 7f06069ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.445+0000 7f06069ef740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f52350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.445+0000 7f06069ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f52e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.445+0000 7f06069ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b2c70 con 0x563224b732f0 2024-09-21T01:23:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.445+0000 7f06069ef740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b25a0 con 0x563224b7b4d0 2024-09-21T01:23:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.445+0000 7f06069ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81af7c0 con 0x563224b9c1b0 2024-09-21T01:23:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.445+0000 7f06069ef740 10 client.0 _ll_register_callbacks cb 0x7f05f00313f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.446+0000 7f05fdf45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.446+0000 7f05fdf45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f51c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45806/0 (socket says 172.21.15.37:45806) 2024-09-21T01:23:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.446+0000 7f05fdf45640 1 -- 172.21.15.37:0/3629046866 learned_addr learned my addr 172.21.15.37:0/3629046866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.447+0000 7f05fdf45640 1 -- 172.21.15.37:0/3629046866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 msgr2=0x563224f52e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.447+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f52e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.447+0000 7f05fdf45640 1 -- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 msgr2=0x563224f52350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.447+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f52350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.447+0000 7f05fdf45640 1 -- 172.21.15.37:0/3629046866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563224f535d0 con 0x563224b732f0 2024-09-21T01:23:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.448+0000 7f05fdf45640 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f51c90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f05f0031840 tx=0x7f05f0009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7767a4cc8d7dcb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.448+0000 7f05e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.449+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3629046866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0030cc0 con 0x563224b732f0 2024-09-21T01:23:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.449+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f0036040 con 0x563224b732f0 2024-09-21T01:23:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.450+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3629046866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f05f003c8a0 con 0x563224b732f0 2024-09-21T01:23:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.451+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3629046866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f05f003caa0 con 0x563224b732f0 2024-09-21T01:23:55.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.451+0000 7f06069ef740 10 client.16734 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:55.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.452+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563224f548c0 con 0x563224b732f0 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3629046866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f0036040 con 0x563224b732f0 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3629046866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f05f0043070 con 0x563224b732f0 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f06069ef740 10 client.16734 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f06069ef740 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f06069ef740 20 client.16734 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f06069ef740 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b301c0 0x563224fd85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:55.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f06069ef740 4 client.16734 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:23:55.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.453+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563224eb40f0 con 0x563224b301c0 2024-09-21T01:23:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.456+0000 7f05fcf43640 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b301c0 0x563224fd85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.466+0000 7f05fcf43640 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b301c0 0x563224fd85d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd4559a5b313da6 server_cookie=1e76b9000efd1c8c in_seq=0 out_seq=0 2024-09-21T01:23:55.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:55.467+0000 7f05e0ff9640 10 client.16734 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:23:57.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:56 smithi037 ceph-mon[31105]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 899 MiB/s wr, 2.32k op/s 2024-09-21T01:23:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.270+0000 7f05e0ff9640 1 -- 172.21.15.37:0/3629046866 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563224eb40f0 con 0x563224b301c0 2024-09-21T01:23:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.270+0000 7f05e0ff9640 10 client.16734 handle_command_reply: tid=0 2024-09-21T01:23:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.270+0000 7f06069ef740 1 client.16734 shutdown 2024-09-21T01:23:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.270+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 msgr2=0x563224f51c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.270+0000 7f06069ef740 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f51c90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f05f0031840 tx=0x7f05f0009430 comp rx=0 tx=0).stop 2024-09-21T01:23:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 shutdown_connections 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563224b301c0 0x563224fd85d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563224b9c1b0 0x563224f52e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563224b7b4d0 0x563224f52350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 --2- 172.21.15.37:0/3629046866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563224b732f0 0x563224f51c90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 >> 172.21.15.37:0/3629046866 conn(0x563224b90300 msgr2=0x563224f44ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f05e0ff9640 0 client.16734 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.271+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 shutdown_connections 2024-09-21T01:23:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.272+0000 7f06069ef740 1 -- 172.21.15.37:0/3629046866 wait complete. 2024-09-21T01:23:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.272+0000 7f06069ef740 20 client.16734 trim_cache size 0 max 16384 2024-09-21T01:23:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:23:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:23:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:23:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:23:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.274+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f05e40b65d0 msgr2=0x7f05e40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.274+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f05e40b65d0 0x7f05e40b8ae0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05f400be60 tx=0x7f05f4010f70 comp rx=0 tx=0).stop 2024-09-21T01:23:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.274+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 msgr2=0x7f05f81a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.274+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f81a04c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f05f400b4a0 tx=0x7f05f400b960 comp rx=0 tx=0).stop 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.279+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 shutdown_connections 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.279+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f05e40b65d0 0x7f05e40b8ae0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.279+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f8103fc0 0x7f05f81a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.279+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05f8103620 0x7f05f81a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.279+0000 7f05ff9a8640 1 --2- 172.21.15.37:0/1792013623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05f81025a0 0x7f05f81a04c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.279+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 >> 172.21.15.37:0/1792013623 conn(0x7f05f80fdee0 msgr2=0x7f05f8100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.280+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 shutdown_connections 2024-09-21T01:23:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:23:57.280+0000 7f05ff9a8640 1 -- 172.21.15.37:0/1792013623 wait complete. 2024-09-21T01:23:57.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:56 smithi144 ceph-mon[34818]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 899 MiB/s wr, 2.32k op/s 2024-09-21T01:23:57.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:56 smithi137 ceph-mon[34607]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 899 MiB/s wr, 2.32k op/s 2024-09-21T01:23:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 -- 172.21.15.37:0/3191526513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 msgr2=0x7f588011f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 --2- 172.21.15.37:0/3191526513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 0x7f588011f140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f587c009900 tx=0x7f587c02a400 comp rx=0 tx=0).stop 2024-09-21T01:23:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 -- 172.21.15.37:0/3191526513 shutdown_connections 2024-09-21T01:23:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 --2- 172.21.15.37:0/3191526513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 0x7f588011f140 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 --2- 172.21.15.37:0/3191526513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f588010a9e0 0x7f588010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 --2- 172.21.15.37:0/3191526513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5880111f40 0x7f588010a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.373+0000 7f5887528640 1 -- 172.21.15.37:0/3191526513 >> 172.21.15.37:0/3191526513 conn(0x7f5880070ec0 msgr2=0x7f58800712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.375+0000 7f5887528640 1 -- 172.21.15.37:0/3191526513 shutdown_connections 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.377+0000 7f5887528640 1 -- 172.21.15.37:0/3191526513 wait complete. 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.378+0000 7f5887528640 1 Processor -- start 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 -- start start 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f588010a9e0 0x7f58801a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5880111f40 0x7f58801a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 0x7f58801aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58801228b0 con 0x7f588010a9e0 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5880122730 con 0x7f5880111f40 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.379+0000 7f5887528640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5880122a30 con 0x7f588011cc30 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.380+0000 7f5884ac3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5880111f40 0x7f58801a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.380+0000 7f5884ac3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5880111f40 0x7f58801a97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:49642/0 (socket says 172.21.15.37:49642) 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.380+0000 7f5884ac3640 1 -- 172.21.15.37:0/4042723737 learned_addr learned my addr 172.21.15.37:0/4042723737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.380+0000 7f5885ac5640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 0x7f58801aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.380+0000 7f58852c4640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f588010a9e0 0x7f58801a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.382+0000 7f58852c4640 1 -- 172.21.15.37:0/4042723737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 msgr2=0x7f58801aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.382+0000 7f58852c4640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 0x7f58801aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.382+0000 7f58852c4640 1 -- 172.21.15.37:0/4042723737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5880111f40 msgr2=0x7f58801a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.382+0000 7f58852c4640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5880111f40 0x7f58801a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.382+0000 7f58852c4640 1 -- 172.21.15.37:0/4042723737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58801af170 con 0x7f588010a9e0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.383+0000 7f58852c4640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f588010a9e0 0x7f58801a9200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f587800e9f0 tx=0x7f587800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.384+0000 7f58767fc640 1 -- 172.21.15.37:0/4042723737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587800cd80 con 0x7f588010a9e0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.384+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58801af460 con 0x7f588010a9e0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.385+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58801b5bc0 con 0x7f588010a9e0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.387+0000 7f58767fc640 1 -- 172.21.15.37:0/4042723737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5878011920 con 0x7f588010a9e0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.387+0000 7f58767fc640 1 -- 172.21.15.37:0/4042723737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587801a9f0 con 0x7f588010a9e0 2024-09-21T01:23:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.396+0000 7f588da9c740 1 Processor -- start 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.397+0000 7f588da9c740 1 -- start start 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.398+0000 7f588da9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92611d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.398+0000 7f588da9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92611d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.398+0000 7f588da9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92611deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.399+0000 7f588da9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f926093e60 con 0x55f925d4d490 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.399+0000 7f588da9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f926083290 con 0x55f925d55670 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.399+0000 7f588da9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f9260870a0 con 0x55f925d76350 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.399+0000 7f58767fc640 1 -- 172.21.15.37:0/4042723737 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f587801ab90 con 0x7f588010a9e0 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.400+0000 7f5885ac5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92611d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.400+0000 7f5884ac3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92611deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.400+0000 7f5885ac5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92611d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45784/0 (socket says 172.21.15.37:45784) 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.400+0000 7f5885ac5640 1 -- 172.21.15.37:0/3560702819 learned_addr learned my addr 172.21.15.37:0/3560702819 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.401+0000 7f5884ac3640 1 -- 172.21.15.37:0/3560702819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 msgr2=0x55f92611d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.401+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92611d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.401+0000 7f5884ac3640 1 -- 172.21.15.37:0/3560702819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 msgr2=0x55f92611d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.401+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92611d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.401+0000 7f5884ac3640 1 -- 172.21.15.37:0/3560702819 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f925de1930 con 0x55f925d55670 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.401+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92611deb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f587000cb60 tx=0x7f587000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdfae0b64b852851 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.403+0000 7f586b7fe640 1 -- 172.21.15.37:0/3560702819 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587000ce60 con 0x55f925d55670 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.403+0000 7f586b7fe640 1 -- 172.21.15.37:0/3560702819 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58700047a0 con 0x55f925d55670 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.403+0000 7f586b7fe640 1 -- 172.21.15.37:0/3560702819 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870010700 con 0x55f925d55670 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.403+0000 7f58767fc640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f586c0b6720 0x7f586c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.404+0000 7f58767fc640 1 -- 172.21.15.37:0/4042723737 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f58780e7510 con 0x7f588010a9e0 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.405+0000 7f5885ac5640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f586c0b6720 0x7f586c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.405+0000 7f588da9c740 1 -- 172.21.15.37:0/3560702819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 msgr2=0x55f92611deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.405+0000 7f588da9c740 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92611deb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f587000cb60 tx=0x7f587000e720 comp rx=0 tx=0).stop 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.406+0000 7f5885ac5640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f586c0b6720 0x7f586c0b8c30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f587c031440 tx=0x7f587c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.406+0000 7f588da9c740 1 -- 172.21.15.37:0/3560702819 shutdown_connections 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.406+0000 7f588da9c740 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92611deb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.406+0000 7f588da9c740 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92611d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.406+0000 7f588da9c740 1 --2- 172.21.15.37:0/3560702819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92611d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.406+0000 7f588da9c740 1 -- 172.21.15.37:0/3560702819 >> 172.21.15.37:0/3560702819 conn(0x55f925d6a740 msgr2=0x55f92611b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.414+0000 7f588da9c740 1 -- 172.21.15.37:0/3560702819 shutdown_connections 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.415+0000 7f588da9c740 1 -- 172.21.15.37:0/3560702819 wait complete. 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.416+0000 7f588da9c740 1 -- start start 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.416+0000 7f588da9c740 1 Processor -- start 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.417+0000 7f588da9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d4d490 0x55f926129080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.417+0000 7f588da9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d55670 0x55f926129600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f588da9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d76350 0x55f926134f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f588da9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f925ee4890 con 0x55f925d55670 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f588da9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f92601dd40 con 0x55f925d76350 2024-09-21T01:23:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f588da9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f92612bc10 con 0x55f925d4d490 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f5885ac5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d76350 0x55f926134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f5885ac5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d76350 0x55f926134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:49662/0 (socket says 172.21.15.37:49662) 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f5885ac5640 1 -- 172.21.15.37:0/3654100042 learned_addr learned my addr 172.21.15.37:0/3654100042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f58852c4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d4d490 0x55f926129080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.418+0000 7f588da9c740 10 client.0 _ll_register_callbacks cb 0x55f926081c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.419+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d55670 0x55f926129600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.420+0000 7f5884ac3640 1 -- 172.21.15.37:0/3654100042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d4d490 msgr2=0x55f926129080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.420+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d4d490 0x55f926129080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.420+0000 7f5884ac3640 1 -- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d76350 msgr2=0x55f926134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.420+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d76350 0x55f926134f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.420+0000 7f5884ac3640 1 -- 172.21.15.37:0/3654100042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9261355a0 con 0x55f925d55670 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.420+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d55670 0x55f926129600 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5870018000 tx=0x7f5870005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23567056f279640c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.421+0000 7f5868ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.421+0000 7f5868ff9640 1 -- 172.21.15.37:0/3654100042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587000ce60 con 0x55f925d55670 2024-09-21T01:23:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.421+0000 7f5868ff9640 1 -- 172.21.15.37:0/3654100042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f58700055e0 con 0x55f925d55670 2024-09-21T01:23:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.421+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58700047a0 con 0x55f925d55670 2024-09-21T01:23:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.422+0000 7f5868ff9640 1 -- 172.21.15.37:0/3654100042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5870004020 con 0x55f925d55670 2024-09-21T01:23:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.422+0000 7f588da9c740 10 client.16743 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.422+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f926137ed0 con 0x55f925d55670 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.423+0000 7f5868ff9640 1 -- 172.21.15.37:0/3654100042 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58700041c0 con 0x55f925d55670 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f5868ff9640 1 -- 172.21.15.37:0/3654100042 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5870010430 con 0x55f925d55670 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f588da9c740 10 client.16743 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f588da9c740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f588da9c740 20 client.16743 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f588da9c740 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d34cd0 0x55f92613b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f588da9c740 4 client.16743 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:23:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.425+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f58700047a0 con 0x55f925d34cd0 2024-09-21T01:23:58.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.433+0000 7f58852c4640 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d34cd0 0x55f92613b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.449+0000 7f58852c4640 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d34cd0 0x55f92613b230 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54147bccc9470d1a server_cookie=4dab3f7714fb93aa in_seq=0 out_seq=0 2024-09-21T01:23:58.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.449+0000 7f5868ff9640 10 client.16743 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.457+0000 7f5868ff9640 1 -- 172.21.15.37:0/3654100042 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f58700047a0 con 0x55f925d34cd0 2024-09-21T01:23:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.457+0000 7f5868ff9640 10 client.16743 handle_command_reply: tid=0 2024-09-21T01:23:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.458+0000 7f588da9c740 1 client.16743 shutdown 2024-09-21T01:23:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.459+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d55670 msgr2=0x55f926129600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.459+0000 7f588da9c740 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d55670 0x55f926129600 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5870018000 tx=0x7f5870005230 comp rx=0 tx=0).stop 2024-09-21T01:23:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.460+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 shutdown_connections 2024-09-21T01:23:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.460+0000 7f588da9c740 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d34cd0 0x55f92613b230 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.460+0000 7f588da9c740 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d76350 0x55f926134f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.460+0000 7f588da9c740 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d55670 0x55f926129600 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.460+0000 7f588da9c740 1 --2- 172.21.15.37:0/3654100042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d4d490 0x55f926129080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.460+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 >> 172.21.15.37:0/3654100042 conn(0x55f925d6a740 msgr2=0x55f9261205c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.462+0000 7f5868ff9640 0 client.16743 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.463+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 shutdown_connections 2024-09-21T01:23:58.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.464+0000 7f588da9c740 1 -- 172.21.15.37:0/3654100042 wait complete. 2024-09-21T01:23:58.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.464+0000 7f588da9c740 20 client.16743 trim_cache size 0 max 16384 2024-09-21T01:23:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.502+0000 7f588da9c740 1 Processor -- start 2024-09-21T01:23:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.503+0000 7f588da9c740 1 -- start start 2024-09-21T01:23:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.504+0000 7f588da9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f9261296f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.504+0000 7f588da9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f926134f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.505+0000 7f588da9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f9261224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.505+0000 7f588da9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f586400e430 con 0x55f925d4d490 2024-09-21T01:23:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.505+0000 7f588da9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f586400ff70 con 0x55f925d55670 2024-09-21T01:23:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.505+0000 7f58852c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f9261296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.505+0000 7f58852c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f9261296f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58934/0 (socket says 172.21.15.37:58934) 2024-09-21T01:23:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.505+0000 7f58852c4640 1 -- 172.21.15.37:0/3223438633 learned_addr learned my addr 172.21.15.37:0/3223438633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f5884ac3640 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f926134f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f588da9c740 1 -- 172.21.15.37:0/3223438633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f586400eb00 con 0x55f925d76350 2024-09-21T01:23:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f5885ac5640 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f9261224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f58852c4640 1 -- 172.21.15.37:0/3223438633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 msgr2=0x55f9261224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f58852c4640 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f9261224c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f58852c4640 1 -- 172.21.15.37:0/3223438633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 msgr2=0x55f926134f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f58852c4640 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f926134f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.506+0000 7f58852c4640 1 -- 172.21.15.37:0/3223438633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f926124980 con 0x55f925d4d490 2024-09-21T01:23:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.507+0000 7f58852c4640 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f9261296f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f587800c640 tx=0x7f587801a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb1fb71b321dc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.508+0000 7f586affd640 1 -- 172.21.15.37:0/3223438633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587801a490 con 0x55f925d4d490 2024-09-21T01:23:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.508+0000 7f586affd640 1 -- 172.21.15.37:0/3223438633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58780ad1e0 con 0x55f925d4d490 2024-09-21T01:23:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.508+0000 7f586affd640 1 -- 172.21.15.37:0/3223438633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780e70b0 con 0x55f925d4d490 2024-09-21T01:23:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.509+0000 7f588da9c740 1 -- 172.21.15.37:0/3223438633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 msgr2=0x55f9261296f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:23:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.509+0000 7f588da9c740 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f9261296f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f587800c640 tx=0x7f587801a670 comp rx=0 tx=0).stop 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 -- 172.21.15.37:0/3223438633 shutdown_connections 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f9261224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f926134f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 --2- 172.21.15.37:0/3223438633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f9261296f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 -- 172.21.15.37:0/3223438633 >> 172.21.15.37:0/3223438633 conn(0x55f925d6a740 msgr2=0x55f926127700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 -- 172.21.15.37:0/3223438633 shutdown_connections 2024-09-21T01:23:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.510+0000 7f588da9c740 1 -- 172.21.15.37:0/3223438633 wait complete. 2024-09-21T01:23:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.511+0000 7f588da9c740 1 -- start start 2024-09-21T01:23:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.511+0000 7f588da9c740 1 Processor -- start 2024-09-21T01:23:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.512+0000 7f588da9c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92613a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.512+0000 7f588da9c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92613a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.512+0000 7f588da9c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92613aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.512+0000 7f588da9c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f586400f8a0 con 0x55f925d4d490 2024-09-21T01:23:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.512+0000 7f588da9c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f586400f1d0 con 0x55f925d55670 2024-09-21T01:23:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.512+0000 7f588da9c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f586400c4c0 con 0x55f925d76350 2024-09-21T01:23:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.513+0000 7f588da9c740 10 client.0 _ll_register_callbacks cb 0x7f5870014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:23:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.513+0000 7f5885ac5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92613aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.513+0000 7f5885ac5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92613aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45816/0 (socket says 172.21.15.37:45816) 2024-09-21T01:23:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.513+0000 7f5885ac5640 1 -- 172.21.15.37:0/709207623 learned_addr learned my addr 172.21.15.37:0/709207623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:23:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.513+0000 7f5884ac3640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92613a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92613a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 -- 172.21.15.37:0/709207623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 msgr2=0x55f92613aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92613aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 -- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 msgr2=0x55f92613a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92613a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 -- 172.21.15.37:0/709207623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9261a4bd0 con 0x55f925d4d490 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f58852c4640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92613a450 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f587800c640 tx=0x7f587801a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3b874ecb75560e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.514+0000 7f5868ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f5868ff9640 1 -- 172.21.15.37:0/709207623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780b2140 con 0x55f925d4d490 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f5868ff9640 1 -- 172.21.15.37:0/709207623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f58780e70c0 con 0x55f925d4d490 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58780ad1e0 con 0x55f925d4d490 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f5868ff9640 1 -- 172.21.15.37:0/709207623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f58780b7080 con 0x55f925d4d490 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f588da9c740 10 client.16749 fetch_fsmap learned FSMap version 30 2024-09-21T01:23:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f9261a5e90 con 0x55f925d4d490 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.515+0000 7f5868ff9640 1 -- 172.21.15.37:0/709207623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58780ad1e0 con 0x55f925d4d490 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f5868ff9640 1 -- 172.21.15.37:0/709207623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f58780c0070 con 0x55f925d4d490 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f588da9c740 10 client.16749 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f588da9c740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f588da9c740 20 client.16749 populate_metadata read hostname 'smithi037' 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f588da9c740 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d0a080 0x55f9261a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f588da9c740 4 client.16749 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:23:58.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.516+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f926095db0 con 0x55f925d0a080 2024-09-21T01:23:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.517+0000 7f5884ac3640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d0a080 0x55f9261a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:23:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.518+0000 7f5884ac3640 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d0a080 0x55f9261a85b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc6be57aedd2f5b server_cookie=5efcfcdfea8920c8 in_seq=0 out_seq=0 2024-09-21T01:23:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:23:58.518+0000 7f5868ff9640 10 client.16749 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:23:59.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:23:58 smithi037 ceph-mon[31105]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 736 MiB/s wr, 1.97k op/s 2024-09-21T01:23:59.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:23:58 smithi137 ceph-mon[34607]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 736 MiB/s wr, 1.97k op/s 2024-09-21T01:23:59.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:23:58 smithi144 ceph-mon[34818]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 736 MiB/s wr, 1.97k op/s 2024-09-21T01:24:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.421+0000 7f5868ff9640 1 -- 172.21.15.37:0/709207623 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f926095db0 con 0x55f925d0a080 2024-09-21T01:24:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.421+0000 7f5868ff9640 10 client.16749 handle_command_reply: tid=0 2024-09-21T01:24:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.421+0000 7f588da9c740 1 client.16749 shutdown 2024-09-21T01:24:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.422+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 msgr2=0x55f92613a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.422+0000 7f588da9c740 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92613a450 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f587800c640 tx=0x7f587801a490 comp rx=0 tx=0).stop 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.422+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 shutdown_connections 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.422+0000 7f588da9c740 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55f925d0a080 0x55f9261a85b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.423+0000 7f588da9c740 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f925d76350 0x55f92613aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.423+0000 7f5868ff9640 0 client.16749 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.423+0000 7f588da9c740 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f925d55670 0x55f92613a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.423+0000 7f588da9c740 1 --2- 172.21.15.37:0/709207623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f925d4d490 0x55f92613a450 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.423+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 >> 172.21.15.37:0/709207623 conn(0x55f925d6a740 msgr2=0x55f926127570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.424+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 shutdown_connections 2024-09-21T01:24:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.424+0000 7f588da9c740 1 -- 172.21.15.37:0/709207623 wait complete. 2024-09-21T01:24:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:24:00.428 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:24:00.428 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "656f7af4-6b4c-4346-a643-f4e121674f9d", 2024-09-21T01:24:00.428 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:24:00.428 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:24:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.424+0000 7f588da9c740 20 client.16749 trim_cache size 0 max 16384 2024-09-21T01:24:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.426+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f586c0b6720 msgr2=0x7f586c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.426+0000 7f5887528640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f586c0b6720 0x7f586c0b8c30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f587c031440 tx=0x7f587c005d50 comp rx=0 tx=0).stop 2024-09-21T01:24:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.426+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f588010a9e0 msgr2=0x7f58801a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.427+0000 7f5887528640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f588010a9e0 0x7f58801a9200 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f587800e9f0 tx=0x7f587800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.428+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 shutdown_connections 2024-09-21T01:24:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.428+0000 7f5887528640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f586c0b6720 0x7f586c0b8c30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.428+0000 7f5887528640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f588011cc30 0x7f58801aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.428+0000 7f5887528640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5880111f40 0x7f58801a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.428+0000 7f5887528640 1 --2- 172.21.15.37:0/4042723737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f588010a9e0 0x7f58801a9200 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.428+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 >> 172.21.15.37:0/4042723737 conn(0x7f5880070ec0 msgr2=0x7f5880071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.430+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 shutdown_connections 2024-09-21T01:24:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:00.434+0000 7f5887528640 1 -- 172.21.15.37:0/4042723737 wait complete. 2024-09-21T01:24:01.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:00 smithi037 ceph-mon[31105]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 963 MiB/s wr, 2.52k op/s 2024-09-21T01:24:01.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:00 smithi137 ceph-mon[34607]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 963 MiB/s wr, 2.52k op/s 2024-09-21T01:24:01.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:00 smithi144 ceph-mon[34818]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 963 MiB/s wr, 2.52k op/s 2024-09-21T01:24:02.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:01 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:24:02.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:01 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:02.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:01 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:24:02.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:01 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:24:02.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:01 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:02.321 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:01 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:24:02.322 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:01 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:24:02.322 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:01 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:02.322 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:01 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:24:03.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:02 smithi037 ceph-mon[31105]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 841 MiB/s wr, 2.07k op/s 2024-09-21T01:24:03.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:02 smithi137 ceph-mon[34607]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 841 MiB/s wr, 2.07k op/s 2024-09-21T01:24:03.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:02 smithi144 ceph-mon[34818]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 841 MiB/s wr, 2.07k op/s 2024-09-21T01:24:03.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:24:04.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:04 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:24:04.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:04 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:04.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:04 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:24:04.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:04 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:04.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:04 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:24:04.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:04 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:04.516 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:24:05.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:05 smithi137 ceph-mon[34607]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 877 MiB/s wr, 1.98k op/s 2024-09-21T01:24:05.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:05 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:05.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:05 smithi144 ceph-mon[34818]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 877 MiB/s wr, 1.98k op/s 2024-09-21T01:24:05.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:05 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:05.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:05 smithi037 ceph-mon[31105]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 877 MiB/s wr, 1.98k op/s 2024-09-21T01:24:05.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:05 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.383+0000 7fce88794640 1 -- 172.21.15.37:0/2072314733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80103b80 msgr2=0x7fce80103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.383+0000 7fce88794640 1 --2- 172.21.15.37:0/2072314733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80103b80 0x7fce80103f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fce7001a910 tx=0x7fce70043c40 comp rx=0 tx=0).stop 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.386+0000 7fce88794640 1 -- 172.21.15.37:0/2072314733 shutdown_connections 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.386+0000 7fce88794640 1 --2- 172.21.15.37:0/2072314733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce80109e10 0x7fce80110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.386+0000 7fce88794640 1 --2- 172.21.15.37:0/2072314733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 0x7fce801098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.386+0000 7fce88794640 1 --2- 172.21.15.37:0/2072314733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80103b80 0x7fce80103f90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.386+0000 7fce88794640 1 -- 172.21.15.37:0/2072314733 >> 172.21.15.37:0/2072314733 conn(0x7fce800ff610 msgr2=0x7fce80101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.387+0000 7fce88794640 1 -- 172.21.15.37:0/2072314733 shutdown_connections 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.388+0000 7fce88794640 1 -- 172.21.15.37:0/2072314733 wait complete. 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.389+0000 7fce88794640 1 Processor -- start 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.389+0000 7fce88794640 1 -- start start 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.391+0000 7fce88794640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce80103b80 0x7fce80076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.391+0000 7fce88794640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 0x7fce80071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.391+0000 7fce88794640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80109e10 0x7fce80071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.391+0000 7fce88794640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce8006f670 con 0x7fce801094c0 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.391+0000 7fce88794640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce8006f4f0 con 0x7fce80109e10 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.391+0000 7fce88794640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce8006f7f0 con 0x7fce80103b80 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.393+0000 7fce85d2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 0x7fce80071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.393+0000 7fce85d2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 0x7fce80071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37198/0 (socket says 172.21.15.37:37198) 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.393+0000 7fce86d31640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80109e10 0x7fce80071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.393+0000 7fce85d2f640 1 -- 172.21.15.37:0/2474639140 learned_addr learned my addr 172.21.15.37:0/2474639140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.393+0000 7fce86530640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce80103b80 0x7fce80076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.394+0000 7fce86d31640 1 -- 172.21.15.37:0/2474639140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce80103b80 msgr2=0x7fce80076e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.394+0000 7fce86d31640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce80103b80 0x7fce80076e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.394+0000 7fce86d31640 1 -- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 msgr2=0x7fce80071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.394+0000 7fce86d31640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 0x7fce80071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.394+0000 7fce86d31640 1 -- 172.21.15.37:0/2474639140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80071c90 con 0x7fce80109e10 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.397+0000 7fce86d31640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80109e10 0x7fce80071650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce78009fd0 tx=0x7fce7800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.401+0000 7fce777fe640 1 -- 172.21.15.37:0/2474639140 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7800ce20 con 0x7fce80109e10 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.402+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801acfe0 con 0x7fce80109e10 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.402+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801ad380 con 0x7fce80109e10 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.402+0000 7fce777fe640 1 -- 172.21.15.37:0/2474639140 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce78005020 con 0x7fce80109e10 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.402+0000 7fce777fe640 1 -- 172.21.15.37:0/2474639140 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78010670 con 0x7fce80109e10 2024-09-21T01:24:07.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.419+0000 7fce8ed08740 1 Processor -- start 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.421+0000 7fce777fe640 1 -- 172.21.15.37:0/2474639140 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fce78004a40 con 0x7fce80109e10 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.424+0000 7fce8ed08740 1 -- start start 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.428+0000 7fce777fe640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fce6c0b6720 0x7fce6c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.429+0000 7fce777fe640 1 -- 172.21.15.37:0/2474639140 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fce780e7560 con 0x7fce80109e10 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce85d2f640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fce6c0b6720 0x7fce6c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4fae070 0x562cc5355270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f851b0 0x562cc53557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 0x562cc5355cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce8ed08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562cc52cbe50 con 0x562cc4f851b0 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce8ed08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562cc52bb280 con 0x562cc4fae070 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.431+0000 7fce8ed08740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562cc52bf090 con 0x562cc4f8d390 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.432+0000 7fce86d31640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 0x562cc5355cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.434+0000 7fce86d31640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 0x562cc5355cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56826/0 (socket says 172.21.15.37:56826) 2024-09-21T01:24:07.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.434+0000 7fce86d31640 1 -- 172.21.15.37:0/2510046710 learned_addr learned my addr 172.21.15.37:0/2510046710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.434+0000 7fce85d2f640 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f851b0 0x562cc53557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.434+0000 7fce85d2f640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fce6c0b6720 0x7fce6c0b8c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fce80102e60 tx=0x7fce7c00a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.436+0000 7fce86d31640 1 -- 172.21.15.37:0/2510046710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4fae070 msgr2=0x562cc5355270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.436+0000 7fce86d31640 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4fae070 0x562cc5355270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.436+0000 7fce86d31640 1 -- 172.21.15.37:0/2510046710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f851b0 msgr2=0x562cc53557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.436+0000 7fce86d31640 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f851b0 0x562cc53557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.436+0000 7fce86d31640 1 -- 172.21.15.37:0/2510046710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc5019650 con 0x562cc4f8d390 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.446+0000 7fce86d31640 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 0x562cc5355cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce780a9c80 tx=0x7fce780ad130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a71c2f2c3a4bdf52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.451+0000 7fce74ff9640 1 -- 172.21.15.37:0/2510046710 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce780b2190 con 0x562cc4f8d390 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.451+0000 7fce74ff9640 1 -- 172.21.15.37:0/2510046710 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce780b70d0 con 0x562cc4f8d390 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.452+0000 7fce8ed08740 1 -- 172.21.15.37:0/2510046710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 msgr2=0x562cc5355cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.452+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 0x562cc5355cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce780a9c80 tx=0x7fce780ad130 comp rx=0 tx=0).stop 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.454+0000 7fce8ed08740 1 -- 172.21.15.37:0/2510046710 shutdown_connections 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.454+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4f8d390 0x562cc5355cf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.454+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f851b0 0x562cc53557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.454+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2510046710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4fae070 0x562cc5355270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.454+0000 7fce8ed08740 1 -- 172.21.15.37:0/2510046710 >> 172.21.15.37:0/2510046710 conn(0x562cc4fa2460 msgr2=0x562cc5353160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.459+0000 7fce8ed08740 1 -- 172.21.15.37:0/2510046710 shutdown_connections 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.459+0000 7fce8ed08740 1 -- 172.21.15.37:0/2510046710 wait complete. 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.459+0000 7fce8ed08740 1 -- start start 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 Processor -- start 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc5360e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5361390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562cc511c700 con 0x562cc4f8d390 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562cc5256110 con 0x562cc4f851b0 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562cc5363aa0 con 0x562cc4fae070 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.460+0000 7fce8ed08740 10 client.0 _ll_register_callbacks cb 0x562cc526f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.461+0000 7fce85d2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc5360e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.461+0000 7fce85d2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc5360e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37216/0 (socket says 172.21.15.37:37216) 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.461+0000 7fce85d2f640 1 -- 172.21.15.37:0/3698986021 learned_addr learned my addr 172.21.15.37:0/3698986021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.462+0000 7fce86d31640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5361390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.462+0000 7fce86530640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.464+0000 7fce85d2f640 1 -- 172.21.15.37:0/3698986021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 msgr2=0x562cc5361390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.464+0000 7fce85d2f640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5361390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.464+0000 7fce85d2f640 1 -- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 msgr2=0x562cc53608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.464+0000 7fce85d2f640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.464+0000 7fce85d2f640 1 -- 172.21.15.37:0/3698986021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc5283c40 con 0x562cc4f8d390 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.465+0000 7fce85d2f640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc5360e30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fce7c003850 tx=0x7fce7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eda261bcc901bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.465+0000 7fce69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.466+0000 7fce69ffb640 1 -- 172.21.15.37:0/3698986021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c02a060 con 0x562cc4f8d390 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.466+0000 7fce69ffb640 1 -- 172.21.15.37:0/3698986021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fce7c01ab30 con 0x562cc4f8d390 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.466+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cc52cdda0 con 0x562cc4f8d390 2024-09-21T01:24:07.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.467+0000 7fce69ffb640 1 -- 172.21.15.37:0/3698986021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce7c01ad30 con 0x562cc4f8d390 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.467+0000 7fce8ed08740 10 client.16761 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.467+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562cc536f8f0 con 0x562cc4f8d390 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce69ffb640 1 -- 172.21.15.37:0/3698986021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562cc52cdda0 con 0x562cc4f8d390 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce69ffb640 1 -- 172.21.15.37:0/3698986021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fce7c019070 con 0x562cc4f8d390 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce8ed08740 10 client.16761 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce8ed08740 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce8ed08740 20 client.16761 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce8ed08740 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc4f6c9f0 0x562cc5372e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce8ed08740 4 client.16761 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.468+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cc52c9850 con 0x562cc4f6c9f0 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.470+0000 7fce86530640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc4f6c9f0 0x562cc5372e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.474+0000 7fce69ffb640 10 client.16761 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.474+0000 7fce86530640 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc4f6c9f0 0x562cc5372e10 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee423a97c3243cd2 server_cookie=4bae3f300ab5281a in_seq=0 out_seq=0 2024-09-21T01:24:07.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.481+0000 7fce69ffb640 1 -- 172.21.15.37:0/3698986021 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cc52c9850 con 0x562cc4f6c9f0 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.481+0000 7fce69ffb640 10 client.16761 handle_command_reply: tid=0 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.481+0000 7fce8ed08740 1 client.16761 shutdown 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.483+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 msgr2=0x562cc5360e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.483+0000 7fce8ed08740 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc5360e30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fce7c003850 tx=0x7fce7c004730 comp rx=0 tx=0).stop 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 shutdown_connections 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc4f6c9f0 0x562cc5372e10 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5361390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc5360e30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 --2- 172.21.15.37:0/3698986021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 >> 172.21.15.37:0/3698986021 conn(0x562cc4fa2460 msgr2=0x562cc5358400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce69ffb640 0 client.16761 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 shutdown_connections 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.484+0000 7fce8ed08740 1 -- 172.21.15.37:0/3698986021 wait complete. 2024-09-21T01:24:07.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.485+0000 7fce8ed08740 20 client.16761 trim_cache size 0 max 16384 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.521+0000 7fce8ed08740 1 Processor -- start 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.521+0000 7fce8ed08740 1 -- start start 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.522+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.522+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc535dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce85d2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc535dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce86530640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce86530640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:37490/0 (socket says 172.21.15.37:37490) 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce86530640 1 -- 172.21.15.37:0/75215351 learned_addr learned my addr 172.21.15.37:0/75215351 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce8ed08740 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc535e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400e560 con 0x562cc4f8d390 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce640100a0 con 0x562cc4f851b0 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.523+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400ec30 con 0x562cc4fae070 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.524+0000 7fce85d2f640 1 -- 172.21.15.37:0/75215351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 msgr2=0x562cc535e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.524+0000 7fce85d2f640 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc535e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.524+0000 7fce85d2f640 1 -- 172.21.15.37:0/75215351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 msgr2=0x562cc53569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.524+0000 7fce85d2f640 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.524+0000 7fce85d2f640 1 -- 172.21.15.37:0/75215351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc5357560 con 0x562cc4f8d390 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.525+0000 7fce85d2f640 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc535dae0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fce7c02e470 tx=0x7fce7c02e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708943c2455bd967 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.527+0000 7fce6bfff640 1 -- 172.21.15.37:0/75215351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c03c070 con 0x562cc4f8d390 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.528+0000 7fce6bfff640 1 -- 172.21.15.37:0/75215351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce7c00a510 con 0x562cc4f8d390 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.528+0000 7fce6bfff640 1 -- 172.21.15.37:0/75215351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c034080 con 0x562cc4f8d390 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.529+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 msgr2=0x562cc535dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.529+0000 7fce8ed08740 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc535dae0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fce7c02e470 tx=0x7fce7c02e890 comp rx=0 tx=0).stop 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.530+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 shutdown_connections 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.530+0000 7fce8ed08740 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc535e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.530+0000 7fce8ed08740 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f8d390 0x562cc535dae0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.530+0000 7fce8ed08740 1 --2- 172.21.15.37:0/75215351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc53569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.530+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 >> 172.21.15.37:0/75215351 conn(0x562cc4fa2460 msgr2=0x562cc53562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.531+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 shutdown_connections 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.531+0000 7fce8ed08740 1 -- 172.21.15.37:0/75215351 wait complete. 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.531+0000 7fce8ed08740 1 -- start start 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.532+0000 7fce8ed08740 1 Processor -- start 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc5364f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5365450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f41da0 0x562cc5365990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400f9d0 con 0x562cc4f41da0 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400f300 con 0x562cc4f851b0 2024-09-21T01:24:07.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce6400c520 con 0x562cc4fae070 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.533+0000 7fce8ed08740 10 client.0 _ll_register_callbacks cb 0x7fce7c00ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "656f7af4-6b4c-4346-a643-f4e121674f9d", 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:24:07.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:24:00.417164+0000", 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.029 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.030 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:24:07.031 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:24:07.032 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.534+0000 7fce86530640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc5364f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.534+0000 7fce86530640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc5364f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:37500/0 (socket says 172.21.15.37:37500) 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.534+0000 7fce86530640 1 -- 172.21.15.37:0/2131883437 learned_addr learned my addr 172.21.15.37:0/2131883437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.534+0000 7fce85d2f640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5365450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.534+0000 7fce86d31640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f41da0 0x562cc5365990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.535+0000 7fce86530640 1 -- 172.21.15.37:0/2131883437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 msgr2=0x562cc5365450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.535+0000 7fce86530640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5365450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.535+0000 7fce86530640 1 -- 172.21.15.37:0/2131883437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f41da0 msgr2=0x562cc5365990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:07.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.535+0000 7fce86530640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f41da0 0x562cc5365990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.535+0000 7fce86530640 1 -- 172.21.15.37:0/2131883437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc53dc930 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.536+0000 7fce86530640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc5364f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce7001a440 tx=0x7fce70004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfd6f1107199557 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.536+0000 7fce69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.541+0000 7fce69ffb640 1 -- 172.21.15.37:0/2131883437 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70044790 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.541+0000 7fce69ffb640 1 -- 172.21.15.37:0/2131883437 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fce70044930 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.541+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce7c00a510 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.543+0000 7fce69ffb640 1 -- 172.21.15.37:0/2131883437 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce70044b30 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.543+0000 7fce8ed08740 10 client.26174 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.543+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562cc53ddbf0 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.544+0000 7fce69ffb640 1 -- 172.21.15.37:0/2131883437 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce70058070 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.545+0000 7fce69ffb640 1 -- 172.21.15.37:0/2131883437 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fce7001f040 con 0x562cc4f851b0 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.546+0000 7fce8ed08740 10 client.26174 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.546+0000 7fce8ed08740 10 client.26174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.546+0000 7fce8ed08740 20 client.26174 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.546+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc53de350 0x562cc53e0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.546+0000 7fce8ed08740 4 client.26174 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.546+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fce7c00a510 con 0x562cc53de350 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.548+0000 7fce85d2f640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc53de350 0x562cc53e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.552+0000 7fce85d2f640 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc53de350 0x562cc53e0770 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a34c181724686a6 server_cookie=2d9c8268c5f9ddca in_seq=0 out_seq=0 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.552+0000 7fce69ffb640 10 client.26174 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.556+0000 7fce69ffb640 1 -- 172.21.15.37:0/2131883437 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x7fce7c00a510 con 0x562cc53de350 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.556+0000 7fce69ffb640 10 client.26174 handle_command_reply: tid=0 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.556+0000 7fce8ed08740 1 client.26174 shutdown 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.559+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 msgr2=0x562cc5364f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.559+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc5364f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce7001a440 tx=0x7fce70004590 comp rx=0 tx=0).stop 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 shutdown_connections 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x562cc53de350 0x562cc53e0770 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562cc4f41da0 0x562cc5365990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cc4fae070 0x562cc5365450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce69ffb640 0 client.26174 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce8ed08740 1 --2- 172.21.15.37:0/2131883437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562cc4f851b0 0x562cc5364f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.562+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 >> 172.21.15.37:0/2131883437 conn(0x562cc4fa2460 msgr2=0x562cc53562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.563+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 shutdown_connections 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.563+0000 7fce8ed08740 1 -- 172.21.15.37:0/2131883437 wait complete. 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.563+0000 7fce8ed08740 20 client.26174 trim_cache size 0 max 16384 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.565+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fce6c0b6720 msgr2=0x7fce6c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.565+0000 7fce88794640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fce6c0b6720 0x7fce6c0b8c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fce80102e60 tx=0x7fce7c00a400 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.565+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80109e10 msgr2=0x7fce80071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.565+0000 7fce88794640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80109e10 0x7fce80071650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce78009fd0 tx=0x7fce7800ef10 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.568+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 shutdown_connections 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.568+0000 7fce88794640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fce6c0b6720 0x7fce6c0b8c30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.568+0000 7fce88794640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce80109e10 0x7fce80071650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.568+0000 7fce88794640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce801094c0 0x7fce80071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.568+0000 7fce88794640 1 --2- 172.21.15.37:0/2474639140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce80103b80 0x7fce80076e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.568+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 >> 172.21.15.37:0/2474639140 conn(0x7fce800ff610 msgr2=0x7fce80108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.574+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 shutdown_connections 2024-09-21T01:24:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:06.574+0000 7fce88794640 1 -- 172.21.15.37:0/2474639140 wait complete. 2024-09-21T01:24:07.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:07 smithi137 ceph-mon[34607]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 946 MiB/s wr, 1.99k op/s 2024-09-21T01:24:07.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:07 smithi144 ceph-mon[34818]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 946 MiB/s wr, 1.99k op/s 2024-09-21T01:24:07.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:07 smithi037 ceph-mon[31105]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 946 MiB/s wr, 1.99k op/s 2024-09-21T01:24:09.300 INFO:tasks.cephfs.filesystem:scrub status for tag:656f7af4-6b4c-4346-a643-f4e121674f9d - {'path': '/', 'tag': '656f7af4-6b4c-4346-a643-f4e121674f9d', 'options': 'recursive,force'} 2024-09-21T01:24:09.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:09 smithi137 ceph-mon[34607]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 745 MiB/s wr, 1.56k op/s 2024-09-21T01:24:09.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:09 smithi144 ceph-mon[34818]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 745 MiB/s wr, 1.56k op/s 2024-09-21T01:24:09.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:09 smithi037 ceph-mon[31105]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 745 MiB/s wr, 1.56k op/s 2024-09-21T01:24:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 -- 172.21.15.37:0/3737103311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf007ac00 msgr2=0x7f0bf007d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/3737103311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf007ac00 0x7f0bf007d110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009900 tx=0x7f0bec02a440 comp rx=0 tx=0).stop 2024-09-21T01:24:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 -- 172.21.15.37:0/3737103311 shutdown_connections 2024-09-21T01:24:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/3737103311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf007ac00 0x7f0bf007d110 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/3737103311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf00782a0 0x7f0bf007a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/3737103311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bf00754e0 0x7f0bf0075950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.604+0000 7f0bf75a9640 1 -- 172.21.15.37:0/3737103311 >> 172.21.15.37:0/3737103311 conn(0x7f0bf0070810 msgr2=0x7f0bf0072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.607+0000 7f0bf75a9640 1 -- 172.21.15.37:0/3737103311 shutdown_connections 2024-09-21T01:24:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.609+0000 7f0bf75a9640 1 -- 172.21.15.37:0/3737103311 wait complete. 2024-09-21T01:24:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.610+0000 7f0bf75a9640 1 Processor -- start 2024-09-21T01:24:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 -- start start 2024-09-21T01:24:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf00754e0 0x7f0bf00825f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bf00782a0 0x7f0bf0082c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 0x7f0bf0083810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf012d1d0 con 0x7f0bf007ac00 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf012d050 con 0x7f0bf00782a0 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.611+0000 7f0bf75a9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf012d350 con 0x7f0bf00754e0 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.612+0000 7f0bf5b46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 0x7f0bf0083810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.612+0000 7f0bf5b46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 0x7f0bf0083810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37254/0 (socket says 172.21.15.37:37254) 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.612+0000 7f0bf5b46640 1 -- 172.21.15.37:0/2849794455 learned_addr learned my addr 172.21.15.37:0/2849794455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.612+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bf00782a0 0x7f0bf0082c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.613+0000 7f0bf5b46640 1 -- 172.21.15.37:0/2849794455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf00754e0 msgr2=0x7f0bf00825f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T01:24:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.613+0000 7f0bf5b46640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf00754e0 0x7f0bf00825f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.613+0000 7f0bf5b46640 1 -- 172.21.15.37:0/2849794455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bf00782a0 msgr2=0x7f0bf0082c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.613+0000 7f0bf5b46640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bf00782a0 0x7f0bf0082c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.613+0000 7f0bf5b46640 1 -- 172.21.15.37:0/2849794455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf0084030 con 0x7f0bf007ac00 2024-09-21T01:24:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.613+0000 7f0bf5b46640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 0x7f0bf0083810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0bec004ae0 tx=0x7f0bec004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.617+0000 7f0be67fc640 1 -- 172.21.15.37:0/2849794455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec062030 con 0x7f0bf007ac00 2024-09-21T01:24:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.617+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf00842c0 con 0x7f0bf007ac00 2024-09-21T01:24:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.617+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf00845d0 con 0x7f0bf007ac00 2024-09-21T01:24:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.620+0000 7f0be67fc640 1 -- 172.21.15.37:0/2849794455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bec05e900 con 0x7f0bf007ac00 2024-09-21T01:24:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.620+0000 7f0be67fc640 1 -- 172.21.15.37:0/2849794455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec005170 con 0x7f0bf007ac00 2024-09-21T01:24:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.624+0000 7f0bfe5ed740 1 Processor -- start 2024-09-21T01:24:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.624+0000 7f0bfe5ed740 1 -- start start 2024-09-21T01:24:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec82061b0 0x556ec85ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81e54d0 0x556ec85af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ec85206f0 con 0x556ec81e54d0 2024-09-21T01:24:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556ec850fb20 con 0x556ec82061b0 2024-09-21T01:24:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ec8513930 con 0x556ec81dd2f0 2024-09-21T01:24:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec82061b0 0x556ec85ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bf5345640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec82061b0 0x556ec85ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:37526/0 (socket says 172.21.15.37:37526) 2024-09-21T01:24:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bf4b44640 1 -- 172.21.15.37:0/1504789505 learned_addr learned my addr 172.21.15.37:0/1504789505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.625+0000 7f0bf5345640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56858/0 (socket says 172.21.15.37:56858) 2024-09-21T01:24:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81e54d0 0x556ec85af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf5345640 1 -- 172.21.15.37:0/1504789505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec82061b0 msgr2=0x556ec85ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf5345640 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec82061b0 0x556ec85ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf5345640 1 -- 172.21.15.37:0/1504789505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81e54d0 msgr2=0x556ec85af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf5345640 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81e54d0 0x556ec85af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf5345640 1 -- 172.21.15.37:0/1504789505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec84d5530 con 0x556ec81dd2f0 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.626+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81e54d0 0x556ec85af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:24:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.627+0000 7f0bf5345640 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85ae4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a8c0 tx=0x7f0be000ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ace85b92e5cd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.627+0000 7f0bdb7fe640 1 -- 172.21.15.37:0/1504789505 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be000ccc0 con 0x556ec81dd2f0 2024-09-21T01:24:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.628+0000 7f0bdb7fe640 1 -- 172.21.15.37:0/1504789505 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be000f900 con 0x556ec81dd2f0 2024-09-21T01:24:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.628+0000 7f0bdb7fe640 1 -- 172.21.15.37:0/1504789505 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00187e0 con 0x556ec81dd2f0 2024-09-21T01:24:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.629+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/1504789505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 msgr2=0x556ec85ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.629+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85ae4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a8c0 tx=0x7f0be000ad80 comp rx=0 tx=0).stop 2024-09-21T01:24:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.631+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/1504789505 shutdown_connections 2024-09-21T01:24:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.631+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81e54d0 0x556ec85af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.631+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85ae4c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.631+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/1504789505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec82061b0 0x556ec85ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.631+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/1504789505 >> 172.21.15.37:0/1504789505 conn(0x556ec81fa300 msgr2=0x556ec85a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.632+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/1504789505 shutdown_connections 2024-09-21T01:24:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.632+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/1504789505 wait complete. 2024-09-21T01:24:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.632+0000 7f0bfe5ed740 1 -- start start 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.632+0000 7f0bfe5ed740 1 Processor -- start 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81dd2f0 0x556ec85b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 0x556ec85b8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ec8447ab0 con 0x556ec82061b0 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556ec84b5730 con 0x556ec81dd2f0 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ec85afb30 con 0x556ec81e54d0 2024-09-21T01:24:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.633+0000 7f0bfe5ed740 10 client.0 _ll_register_callbacks cb 0x556ec85096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.634+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 0x556ec85b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.635+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 0x556ec85b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37278/0 (socket says 172.21.15.37:37278) 2024-09-21T01:24:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.635+0000 7f0bf4b44640 1 -- 172.21.15.37:0/3064780711 learned_addr learned my addr 172.21.15.37:0/3064780711 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.635+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81dd2f0 0x556ec85b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.635+0000 7f0bf5345640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.636+0000 7f0bf4b44640 1 -- 172.21.15.37:0/3064780711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 msgr2=0x556ec85b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.636+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.636+0000 7f0bf4b44640 1 -- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81dd2f0 msgr2=0x556ec85b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.636+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81dd2f0 0x556ec85b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.636+0000 7f0bf4b44640 1 -- 172.21.15.37:0/3064780711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec8271790 con 0x556ec82061b0 2024-09-21T01:24:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.637+0000 7f0be67fc640 1 -- 172.21.15.37:0/2849794455 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0bec065030 con 0x7f0bf007ac00 2024-09-21T01:24:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.637+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 0x556ec85b8820 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0be80108b0 tx=0x7f0be8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd0241374a12ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.637+0000 7f0bd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:24:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.639+0000 7f0be67fc640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0bdc0b6630 0x7f0bdc0b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.639+0000 7f0bf5345640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0bdc0b6630 0x7f0bdc0b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.640+0000 7f0be67fc640 1 -- 172.21.15.37:0/2849794455 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0bec129af0 con 0x7f0bf007ac00 2024-09-21T01:24:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.642+0000 7f0bf5345640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0bdc0b6630 0x7f0bdc0b8b40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a890 tx=0x7f0be000a580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.644+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/3064780711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be801b040 con 0x556ec82061b0 2024-09-21T01:24:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.645+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be000f900 con 0x556ec82061b0 2024-09-21T01:24:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.645+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/3064780711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0be800fb70 con 0x556ec82061b0 2024-09-21T01:24:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.651+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/3064780711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0be800fd70 con 0x556ec82061b0 2024-09-21T01:24:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.651+0000 7f0bfe5ed740 10 client.16779 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.651+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ec82ea620 con 0x556ec82061b0 2024-09-21T01:24:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.652+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/3064780711 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be000f900 con 0x556ec82061b0 2024-09-21T01:24:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.652+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/3064780711 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0be800f040 con 0x556ec82061b0 2024-09-21T01:24:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.653+0000 7f0bfe5ed740 10 client.16779 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.653+0000 7f0bfe5ed740 10 client.16779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.653+0000 7f0bfe5ed740 20 client.16779 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.653+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec81c4d80 0x556ec85c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.653+0000 7f0bfe5ed740 4 client.16779 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.653+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ec8522640 con 0x556ec81c4d80 2024-09-21T01:24:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.657+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec81c4d80 0x556ec85c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.666+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec81c4d80 0x556ec85c4d20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57bd89d25a51eef2 server_cookie=3d2ac2950fef81c2 in_seq=0 out_seq=0 2024-09-21T01:24:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.667+0000 7f0bd8ff9640 10 client.16779 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.671+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/3064780711 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ec8522640 con 0x556ec81c4d80 2024-09-21T01:24:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.671+0000 7f0bd8ff9640 10 client.16779 handle_command_reply: tid=0 2024-09-21T01:24:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 client.16779 shutdown 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 msgr2=0x556ec85b8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 0x556ec85b8820 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0be80108b0 tx=0x7f0be8014040 comp rx=0 tx=0).stop 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 shutdown_connections 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec81c4d80 0x556ec85c4d20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec82061b0 0x556ec85b8820 secure :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0be80108b0 tx=0x7f0be8014040 comp rx=0 tx=0).stop 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/3064780711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81dd2f0 0x556ec85b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.672+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 >> 172.21.15.37:0/3064780711 conn(0x556ec81fa300 msgr2=0x556ec85a7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.673+0000 7f0bd8ff9640 0 client.16779 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.677+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 shutdown_connections 2024-09-21T01:24:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.677+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/3064780711 wait complete. 2024-09-21T01:24:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.677+0000 7f0bfe5ed740 20 client.16779 trim_cache size 0 max 16384 2024-09-21T01:24:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.743+0000 7f0bfe5ed740 1 Processor -- start 2024-09-21T01:24:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 -- start start 2024-09-21T01:24:10.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 0x556ec85b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec819a1c0 0x556ec85b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd400e5e0 con 0x556ec819a1c0 2024-09-21T01:24:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4010120 con 0x556ec81e54d0 2024-09-21T01:24:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.744+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd400ecb0 con 0x556ec81dd2f0 2024-09-21T01:24:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.746+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 0x556ec85b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.746+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 0x556ec85b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:37552/0 (socket says 172.21.15.37:37552) 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.746+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2846408089 learned_addr learned my addr 172.21.15.37:0/2846408089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.746+0000 7f0bf5b46640 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec819a1c0 0x556ec85b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.747+0000 7f0bf5345640 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.748+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2846408089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 msgr2=0x556ec85c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.748+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.748+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2846408089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec819a1c0 msgr2=0x556ec85b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.748+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec819a1c0 0x556ec85b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.748+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2846408089 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec85b8020 con 0x556ec81e54d0 2024-09-21T01:24:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.749+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 0x556ec85b67f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0be80129c0 tx=0x7f0be8009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa3cc0136bf881b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.750+0000 7f0bdaffd640 1 -- 172.21.15.37:0/2846408089 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be800efa0 con 0x556ec81e54d0 2024-09-21T01:24:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.750+0000 7f0bdaffd640 1 -- 172.21.15.37:0/2846408089 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be800f140 con 0x556ec81e54d0 2024-09-21T01:24:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.750+0000 7f0bdaffd640 1 -- 172.21.15.37:0/2846408089 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be800e460 con 0x556ec81e54d0 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2846408089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 msgr2=0x556ec85b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 0x556ec85b67f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0be80129c0 tx=0x7f0be8009680 comp rx=0 tx=0).stop 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2846408089 shutdown_connections 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec819a1c0 0x556ec85b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec81e54d0 0x556ec85b67f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2846408089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81dd2f0 0x556ec85c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.753+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2846408089 >> 172.21.15.37:0/2846408089 conn(0x556ec81fa300 msgr2=0x556ec85a45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.754+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2846408089 shutdown_connections 2024-09-21T01:24:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.755+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2846408089 wait complete. 2024-09-21T01:24:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.755+0000 7f0bfe5ed740 1 -- start start 2024-09-21T01:24:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.755+0000 7f0bfe5ed740 1 Processor -- start 2024-09-21T01:24:10.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec819a1c0 0x556ec85bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 0x556ec85bb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd400fa50 con 0x556ec81dd2f0 2024-09-21T01:24:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd400f380 con 0x556ec819a1c0 2024-09-21T01:24:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd400c5a0 con 0x556ec81e54d0 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bfe5ed740 10 client.0 _ll_register_callbacks cb 0x7f0be80128a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 0x556ec85bb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bf4b44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 0x556ec85bb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37308/0 (socket says 172.21.15.37:37308) 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.756+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2357311396 learned_addr learned my addr 172.21.15.37:0/2357311396 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf5b46640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf5345640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec819a1c0 0x556ec85bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2357311396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 msgr2=0x556ec85bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85bb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec819a1c0 msgr2=0x556ec85bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:10.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec819a1c0 0x556ec85bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.757+0000 7f0bf4b44640 1 -- 172.21.15.37:0/2357311396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec85bc450 con 0x556ec81dd2f0 2024-09-21T01:24:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bf4b44640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 0x556ec85bb1e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0be800f730 tx=0x7f0be8010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd7598aff1512c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:24:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/2357311396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be800ef20 con 0x556ec81dd2f0 2024-09-21T01:24:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/2357311396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0be8003970 con 0x556ec81dd2f0 2024-09-21T01:24:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be800f140 con 0x556ec81dd2f0 2024-09-21T01:24:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/2357311396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0be8046050 con 0x556ec81dd2f0 2024-09-21T01:24:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bfe5ed740 10 client.16785 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.758+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ec862fab0 con 0x556ec81dd2f0 2024-09-21T01:24:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/2357311396 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be800f140 con 0x556ec81dd2f0 2024-09-21T01:24:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/2357311396 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0be802c470 con 0x556ec81dd2f0 2024-09-21T01:24:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bfe5ed740 10 client.16785 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bfe5ed740 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bfe5ed740 20 client.16785 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec8630350 0x556ec8632770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bfe5ed740 4 client.16785 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:24:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.759+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ec851e0f0 con 0x556ec8630350 2024-09-21T01:24:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.760+0000 7f0bf5345640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec8630350 0x556ec8632770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.762+0000 7f0bf5345640 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec8630350 0x556ec8632770 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81793c09f6c68798 server_cookie=8bc9673a780d2157 in_seq=0 out_seq=0 2024-09-21T01:24:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:10.762+0000 7f0bd8ff9640 10 client.16785 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:11 smithi137 ceph-mon[34607]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 944 MiB/s wr, 2.06k op/s 2024-09-21T01:24:11.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:11 smithi144 ceph-mon[34818]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 944 MiB/s wr, 2.06k op/s 2024-09-21T01:24:11.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:11 smithi037 ceph-mon[31105]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 944 MiB/s wr, 2.06k op/s 2024-09-21T01:24:12.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:12 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:24:12.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:12 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:24:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:12 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:24:12.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:12 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:24:12.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:12 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:24:12.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:12 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.954+0000 7f0bd8ff9640 1 -- 172.21.15.37:0/2357311396 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ec851e0f0 con 0x556ec8630350 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.954+0000 7f0bd8ff9640 10 client.16785 handle_command_reply: tid=0 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 client.16785 shutdown 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 msgr2=0x556ec85bb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 0x556ec85bb1e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0be800f730 tx=0x7f0be8010f10 comp rx=0 tx=0).stop 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 shutdown_connections 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556ec8630350 0x556ec8632770 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ec81e54d0 0x556ec85bb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ec81dd2f0 0x556ec85bb1e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 --2- 172.21.15.37:0/2357311396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556ec819a1c0 0x556ec85bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 >> 172.21.15.37:0/2357311396 conn(0x556ec81fa300 msgr2=0x556ec85a85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bd8ff9640 0 client.16785 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.955+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 shutdown_connections 2024-09-21T01:24:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.956+0000 7f0bfe5ed740 1 -- 172.21.15.37:0/2357311396 wait complete. 2024-09-21T01:24:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.956+0000 7f0bfe5ed740 20 client.16785 trim_cache size 0 max 16384 2024-09-21T01:24:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:24:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:24:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:24:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:24:12.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.960+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0bdc0b6630 msgr2=0x7f0bdc0b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.960+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0bdc0b6630 0x7f0bdc0b8b40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a890 tx=0x7f0be000a580 comp rx=0 tx=0).stop 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.960+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 msgr2=0x7f0bf0083810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.960+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 0x7f0bf0083810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0bec004ae0 tx=0x7f0bec004580 comp rx=0 tx=0).stop 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.961+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 shutdown_connections 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.961+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0bdc0b6630 0x7f0bdc0b8b40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.961+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bf007ac00 0x7f0bf0083810 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.961+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0bf00782a0 0x7f0bf0082c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.961+0000 7f0bf75a9640 1 --2- 172.21.15.37:0/2849794455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bf00754e0 0x7f0bf00825f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.961+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 >> 172.21.15.37:0/2849794455 conn(0x7f0bf0070810 msgr2=0x7f0bf0079110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:12.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.963+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 shutdown_connections 2024-09-21T01:24:12.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:12.963+0000 7f0bf75a9640 1 -- 172.21.15.37:0/2849794455 wait complete. 2024-09-21T01:24:13.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:13 smithi037 ceph-mon[31105]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 1.74k op/s 2024-09-21T01:24:13.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:13 smithi137 ceph-mon[34607]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 1.74k op/s 2024-09-21T01:24:13.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:13 smithi144 ceph-mon[34818]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 824 MiB/s wr, 1.74k op/s 2024-09-21T01:24:15.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:15 smithi144 ceph-mon[34818]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 855 MiB/s wr, 1.68k op/s 2024-09-21T01:24:15.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:15 smithi137 ceph-mon[34607]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 855 MiB/s wr, 1.68k op/s 2024-09-21T01:24:15.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:15 smithi037 ceph-mon[31105]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 855 MiB/s wr, 1.68k op/s 2024-09-21T01:24:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:17 smithi144 ceph-mon[34818]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 914 MiB/s wr, 1.81k op/s 2024-09-21T01:24:17.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:17 smithi137 ceph-mon[34607]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 914 MiB/s wr, 1.81k op/s 2024-09-21T01:24:17.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:17 smithi037 ceph-mon[31105]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 914 MiB/s wr, 1.81k op/s 2024-09-21T01:24:19.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:19 smithi137 ceph-mon[34607]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 734 MiB/s wr, 1.54k op/s 2024-09-21T01:24:19.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:19 smithi144 ceph-mon[34818]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 734 MiB/s wr, 1.54k op/s 2024-09-21T01:24:19.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:19 smithi037 ceph-mon[31105]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 734 MiB/s wr, 1.54k op/s 2024-09-21T01:24:21.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:21 smithi137 ceph-mon[34607]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 942 MiB/s wr, 2.06k op/s 2024-09-21T01:24:21.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:21 smithi144 ceph-mon[34818]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 942 MiB/s wr, 2.06k op/s 2024-09-21T01:24:21.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:21 smithi037 ceph-mon[31105]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 942 MiB/s wr, 2.06k op/s 2024-09-21T01:24:22.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:22 smithi137 ceph-mon[34607]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 831 MiB/s wr, 1.79k op/s 2024-09-21T01:24:22.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:22 smithi144 ceph-mon[34818]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 831 MiB/s wr, 1.79k op/s 2024-09-21T01:24:22.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:22 smithi037 ceph-mon[31105]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 831 MiB/s wr, 1.79k op/s 2024-09-21T01:24:24.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:24 smithi037 ceph-mon[31105]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 857 MiB/s wr, 1.85k op/s 2024-09-21T01:24:24.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:24 smithi137 ceph-mon[34607]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 857 MiB/s wr, 1.85k op/s 2024-09-21T01:24:24.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:24 smithi144 ceph-mon[34818]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 857 MiB/s wr, 1.85k op/s 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.249+0000 7f6f557a1640 1 -- 172.21.15.37:0/3800836413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010f830 msgr2=0x7f6f5010fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.249+0000 7f6f557a1640 1 --2- 172.21.15.37:0/3800836413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010f830 0x7f6f5010fd30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009be0 tx=0x7f6f4802a6c0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.250+0000 7f6f557a1640 1 -- 172.21.15.37:0/3800836413 shutdown_connections 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.250+0000 7f6f557a1640 1 --2- 172.21.15.37:0/3800836413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010f830 0x7f6f5010fd30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.250+0000 7f6f557a1640 1 --2- 172.21.15.37:0/3800836413 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5010cd20 0x7f6f5010f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.250+0000 7f6f557a1640 1 --2- 172.21.15.37:0/3800836413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010a3c0 0x7f6f5010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.250+0000 7f6f557a1640 1 -- 172.21.15.37:0/3800836413 >> 172.21.15.37:0/3800836413 conn(0x7f6f50070670 msgr2=0x7f6f50072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.264+0000 7f6f557a1640 1 -- 172.21.15.37:0/3800836413 shutdown_connections 2024-09-21T01:24:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.265+0000 7f6f557a1640 1 -- 172.21.15.37:0/3800836413 wait complete. 2024-09-21T01:24:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.266+0000 7f6f557a1640 1 Processor -- start 2024-09-21T01:24:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.271+0000 7f6f557a1640 1 -- start start 2024-09-21T01:24:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.271+0000 7f6f557a1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010a3c0 0x7f6f501a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.271+0000 7f6f557a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 0x7f6f501a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.271+0000 7f6f557a1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5010f830 0x7f6f501a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.272+0000 7f6f557a1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5011df80 con 0x7f6f5010cd20 2024-09-21T01:24:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.272+0000 7f6f557a1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5011de00 con 0x7f6f5010f830 2024-09-21T01:24:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.272+0000 7f6f557a1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5011e100 con 0x7f6f5010a3c0 2024-09-21T01:24:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.274+0000 7f6f4effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010a3c0 0x7f6f501a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.274+0000 7f6f4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 0x7f6f501a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.274+0000 7f6f4e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 0x7f6f501a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47200/0 (socket says 172.21.15.37:47200) 2024-09-21T01:24:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.274+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/929985174 learned_addr learned my addr 172.21.15.37:0/929985174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.275+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5010f830 0x7f6f501a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.278+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/929985174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010a3c0 msgr2=0x7f6f501a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.278+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010a3c0 0x7f6f501a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.279+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/929985174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5010f830 msgr2=0x7f6f501a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.279+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5010f830 0x7f6f501a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.279+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/929985174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f501aa5b0 con 0x7f6f5010cd20 2024-09-21T01:24:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.279+0000 7f6f4effd640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010a3c0 0x7f6f501a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:24:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.284+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 0x7f6f501a91e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e9f0 tx=0x7f6f4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.286+0000 7f6f37fff640 1 -- 172.21.15.37:0/929985174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400cd80 con 0x7f6f5010cd20 2024-09-21T01:24:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.286+0000 7f6f37fff640 1 -- 172.21.15.37:0/929985174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f440108e0 con 0x7f6f5010cd20 2024-09-21T01:24:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.286+0000 7f6f37fff640 1 -- 172.21.15.37:0/929985174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44018980 con 0x7f6f5010cd20 2024-09-21T01:24:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.286+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f501aa8a0 con 0x7f6f5010cd20 2024-09-21T01:24:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.287+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f501b0db0 con 0x7f6f5010cd20 2024-09-21T01:24:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.297+0000 7f6f5c7e7740 1 Processor -- start 2024-09-21T01:24:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.297+0000 7f6f5c7e7740 1 -- start start 2024-09-21T01:24:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.298+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 0x55a1e51e4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.298+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.298+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51e5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.299+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a1e51566f0 con 0x55a1e4e132f0 2024-09-21T01:24:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.299+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a1e5145b20 con 0x55a1e4e3c1b0 2024-09-21T01:24:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.299+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a1e5149930 con 0x55a1e4e1b4d0 2024-09-21T01:24:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.301+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 0x55a1e51e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.301+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 0x55a1e51e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35918/0 (socket says 172.21.15.37:35918) 2024-09-21T01:24:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.301+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/1396654276 learned_addr learned my addr 172.21.15.37:0/1396654276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f37fff640 1 -- 172.21.15.37:0/929985174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6f44010430 con 0x7f6f5010cd20 2024-09-21T01:24:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4effd640 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/1396654276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 msgr2=0x55a1e51e5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51e5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/1396654276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 msgr2=0x55a1e51e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51e46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.302+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/1396654276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1e510b530 con 0x55a1e4e3c1b0 2024-09-21T01:24:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.303+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 0x55a1e51e4040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6f48033000 tx=0x7f6f480303a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9772d6ee0b3051b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.305+0000 7f6f37fff640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f380b66a0 0x7f6f380b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.305+0000 7f6f37fff640 1 -- 172.21.15.37:0/929985174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6f440e8b30 con 0x7f6f5010cd20 2024-09-21T01:24:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.306+0000 7f6f357fa640 1 -- 172.21.15.37:0/1396654276 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48040030 con 0x55a1e4e3c1b0 2024-09-21T01:24:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.306+0000 7f6f357fa640 1 -- 172.21.15.37:0/1396654276 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f48030540 con 0x55a1e4e3c1b0 2024-09-21T01:24:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1396654276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 msgr2=0x55a1e51e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 0x55a1e51e4040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6f48033000 tx=0x7f6f480303a0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1396654276 shutdown_connections 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51e5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1396654276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e3c1b0 0x55a1e51e4040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.308+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1396654276 >> 172.21.15.37:0/1396654276 conn(0x55a1e4e30300 msgr2=0x55a1e51dfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.310+0000 7f6f4effd640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f380b66a0 0x7f6f380b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.310+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1396654276 shutdown_connections 2024-09-21T01:24:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.311+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1396654276 wait complete. 2024-09-21T01:24:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.311+0000 7f6f5c7e7740 1 -- start start 2024-09-21T01:24:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.311+0000 7f6f5c7e7740 1 Processor -- start 2024-09-21T01:24:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51edc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 0x55a1e51ee800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a1e507dab0 con 0x55a1e4e132f0 2024-09-21T01:24:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a1e50eb730 con 0x55a1e4e1b4d0 2024-09-21T01:24:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a1e51e5d10 con 0x55a1e4dfad80 2024-09-21T01:24:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.312+0000 7f6f5c7e7740 10 client.0 _ll_register_callbacks cb 0x55a1e513f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.314+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 0x55a1e51ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.314+0000 7f6f4e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.314+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 0x55a1e51ee800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59186/0 (socket says 172.21.15.37:59186) 2024-09-21T01:24:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.314+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/2029876496 learned_addr learned my addr 172.21.15.37:0/2029876496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.315+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e1b4d0 msgr2=0x55a1e51edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.315+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51edc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.315+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/2029876496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 msgr2=0x55a1e51ed5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.315+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.315+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/2029876496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1e4ea7790 con 0x55a1e4dfad80 2024-09-21T01:24:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.316+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 0x55a1e51ee800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6f48034040 tx=0x7f6f480094a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b193cee9f79e50fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.317+0000 7f6f32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:24:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.318+0000 7f6f32ff5640 1 -- 172.21.15.37:0/2029876496 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48040040 con 0x55a1e4dfad80 2024-09-21T01:24:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.318+0000 7f6f32ff5640 1 -- 172.21.15.37:0/2029876496 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6f48004440 con 0x55a1e4dfad80 2024-09-21T01:24:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.318+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1e5158640 con 0x55a1e4dfad80 2024-09-21T01:24:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.318+0000 7f6f4effd640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f380b66a0 0x7f6f380b8bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005fd0 tx=0x7f6f40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.323+0000 7f6f32ff5640 1 -- 172.21.15.37:0/2029876496 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6f48057050 con 0x55a1e4dfad80 2024-09-21T01:24:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.323+0000 7f6f5c7e7740 10 client.26182 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.323+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a1e4f20620 con 0x55a1e4dfad80 2024-09-21T01:24:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f32ff5640 1 -- 172.21.15.37:0/2029876496 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a1e5158640 con 0x55a1e4dfad80 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f32ff5640 1 -- 172.21.15.37:0/2029876496 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6f48003bf0 con 0x55a1e4dfad80 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f5c7e7740 10 client.26182 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f5c7e7740 10 client.26182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f5c7e7740 20 client.26182 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e4dd01c0 0x55a1e520bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f5c7e7740 4 client.26182 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.326+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1e51540f0 con 0x55a1e4dd01c0 2024-09-21T01:24:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.327+0000 7f6f4effd640 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e4dd01c0 0x55a1e520bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.339+0000 7f6f4effd640 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e4dd01c0 0x55a1e520bea0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ef128bbf98eadcb server_cookie=fa6b09cf28f9d77c in_seq=0 out_seq=0 2024-09-21T01:24:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.339+0000 7f6f32ff5640 10 client.26182 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.346+0000 7f6f32ff5640 1 -- 172.21.15.37:0/2029876496 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1e51540f0 con 0x55a1e4dd01c0 2024-09-21T01:24:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.346+0000 7f6f32ff5640 10 client.26182 handle_command_reply: tid=0 2024-09-21T01:24:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.346+0000 7f6f5c7e7740 1 client.26182 shutdown 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 msgr2=0x55a1e51ee800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 0x55a1e51ee800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6f48034040 tx=0x7f6f480094a0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 shutdown_connections 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e4dd01c0 0x55a1e520bea0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4dfad80 0x55a1e51ee800 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/2029876496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e132f0 0x55a1e51ed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 >> 172.21.15.37:0/2029876496 conn(0x55a1e4e30300 msgr2=0x55a1e51de150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.348+0000 7f6f32ff5640 0 client.26182 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.349+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 shutdown_connections 2024-09-21T01:24:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.349+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/2029876496 wait complete. 2024-09-21T01:24:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.349+0000 7f6f5c7e7740 20 client.26182 trim_cache size 0 max 16384 2024-09-21T01:24:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.391+0000 7f6f5c7e7740 1 Processor -- start 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.392+0000 7f6f5c7e7740 1 -- start start 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.393+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4dfad80 0x55a1e51da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.393+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 0x55a1e51df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.393+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51df950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.393+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501b1530 con 0x55a1e4dfad80 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.393+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501b3070 con 0x55a1e4e132f0 2024-09-21T01:24:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.393+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501b1c00 con 0x55a1e4e1b4d0 2024-09-21T01:24:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.394+0000 7f6f4e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 0x55a1e51df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.394+0000 7f6f4e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 0x55a1e51df410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:35940/0 (socket says 172.21.15.37:35940) 2024-09-21T01:24:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.394+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/424623156 learned_addr learned my addr 172.21.15.37:0/424623156 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.395+0000 7f6f4f7fe640 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4effd640 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4dfad80 0x55a1e51da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/424623156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 msgr2=0x55a1e51df950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51df950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/424623156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4dfad80 msgr2=0x55a1e51da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4dfad80 0x55a1e51da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4e7fc640 1 -- 172.21.15.37:0/424623156 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1e51dfe90 con 0x55a1e4e132f0 2024-09-21T01:24:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.396+0000 7f6f4effd640 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4dfad80 0x55a1e51da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:24:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.397+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 0x55a1e51df410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f440ad750 tx=0x7f6f44018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679270a55ffab12d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.398+0000 7f6f34ff9640 1 -- 172.21.15.37:0/424623156 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f440acf30 con 0x55a1e4e132f0 2024-09-21T01:24:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.399+0000 7f6f34ff9640 1 -- 172.21.15.37:0/424623156 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f44010720 con 0x55a1e4e132f0 2024-09-21T01:24:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.400+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/424623156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 msgr2=0x55a1e51df410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.400+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 0x55a1e51df410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f440ad750 tx=0x7f6f44018420 comp rx=0 tx=0).stop 2024-09-21T01:24:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/424623156 shutdown_connections 2024-09-21T01:24:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51df950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4e132f0 0x55a1e51df410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/424623156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4dfad80 0x55a1e51da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/424623156 >> 172.21.15.37:0/424623156 conn(0x55a1e4e30300 msgr2=0x55a1e51e5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/424623156 shutdown_connections 2024-09-21T01:24:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.403+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/424623156 wait complete. 2024-09-21T01:24:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.404+0000 7f6f5c7e7740 1 -- start start 2024-09-21T01:24:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.404+0000 7f6f5c7e7740 1 Processor -- start 2024-09-21T01:24:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4dfad80 0x55a1e51f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e132f0 0x55a1e51f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501b29a0 con 0x55a1e4e1b4d0 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501b22d0 con 0x55a1e4dfad80 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50118800 con 0x55a1e4e132f0 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.405+0000 7f6f5c7e7740 10 client.0 _ll_register_callbacks cb 0x7f6f40005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.406+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.406+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47234/0 (socket says 172.21.15.37:47234) 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.406+0000 7f6f4f7fe640 1 -- 172.21.15.37:0/1815153123 learned_addr learned my addr 172.21.15.37:0/1815153123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.406+0000 7f6f4effd640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4dfad80 0x55a1e51f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.406+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e132f0 0x55a1e51f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.408+0000 7f6f4effd640 1 -- 172.21.15.37:0/1815153123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e132f0 msgr2=0x55a1e51f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.408+0000 7f6f4effd640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e132f0 0x55a1e51f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.408+0000 7f6f4effd640 1 -- 172.21.15.37:0/1815153123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e1b4d0 msgr2=0x55a1e51f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.408+0000 7f6f4effd640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.408+0000 7f6f4effd640 1 -- 172.21.15.37:0/1815153123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1e51f3a40 con 0x55a1e4dfad80 2024-09-21T01:24:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.410+0000 7f6f4effd640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4dfad80 0x55a1e51f20b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55a1e5209e20 tx=0x7f6f400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698cbb7f06a1e439 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.411+0000 7f6f32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:24:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.411+0000 7f6f32ff5640 1 -- 172.21.15.37:0/1815153123 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40020630 con 0x55a1e4dfad80 2024-09-21T01:24:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.411+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1e5151520 con 0x55a1e4dfad80 2024-09-21T01:24:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.411+0000 7f6f32ff5640 1 -- 172.21.15.37:0/1815153123 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6f400207d0 con 0x55a1e4dfad80 2024-09-21T01:24:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.412+0000 7f6f32ff5640 1 -- 172.21.15.37:0/1815153123 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6f40004020 con 0x55a1e4dfad80 2024-09-21T01:24:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.412+0000 7f6f5c7e7740 10 client.26207 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.412+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a1e51f4d70 con 0x55a1e4dfad80 2024-09-21T01:24:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.413+0000 7f6f32ff5640 1 -- 172.21.15.37:0/1815153123 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a1e5151520 con 0x55a1e4dfad80 2024-09-21T01:24:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.413+0000 7f6f32ff5640 1 -- 172.21.15.37:0/1815153123 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6f400039d0 con 0x55a1e4dfad80 2024-09-21T01:24:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.414+0000 7f6f5c7e7740 10 client.26207 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.414+0000 7f6f5c7e7740 10 client.26207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.414+0000 7f6f5c7e7740 20 client.26207 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.414+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e52768a0 0x55a1e5278cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.414+0000 7f6f5c7e7740 4 client.26207 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:24:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.414+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1e50c7800 con 0x55a1e52768a0 2024-09-21T01:24:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.415+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e52768a0 0x55a1e5278cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.417+0000 7f6f4e7fc640 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e52768a0 0x55a1e5278cc0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d0fbae75357022 server_cookie=d3d11017b5ae58b3 in_seq=0 out_seq=0 2024-09-21T01:24:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:26.417+0000 7f6f32ff5640 10 client.26207 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:26.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:26 smithi037 ceph-mon[31105]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 919 MiB/s wr, 2.12k op/s 2024-09-21T01:24:26.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:26 smithi137 ceph-mon[34607]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 919 MiB/s wr, 2.12k op/s 2024-09-21T01:24:26.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:26 smithi144 ceph-mon[34818]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 919 MiB/s wr, 2.12k op/s 2024-09-21T01:24:28.755 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:28 smithi037 ceph-mon[31105]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 749 MiB/s wr, 1.82k op/s 2024-09-21T01:24:28.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:28 smithi137 ceph-mon[34607]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 749 MiB/s wr, 1.82k op/s 2024-09-21T01:24:28.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:28 smithi144 ceph-mon[34818]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 749 MiB/s wr, 1.82k op/s 2024-09-21T01:24:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.516+0000 7f6f32ff5640 1 -- 172.21.15.37:0/1815153123 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1e50c7800 con 0x55a1e52768a0 2024-09-21T01:24:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.516+0000 7f6f32ff5640 10 client.26207 handle_command_reply: tid=0 2024-09-21T01:24:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.516+0000 7f6f5c7e7740 1 client.26207 shutdown 2024-09-21T01:24:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4dfad80 msgr2=0x55a1e51f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4dfad80 0x55a1e51f20b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55a1e5209e20 tx=0x7f6f400046c0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 shutdown_connections 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a1e52768a0 0x55a1e5278cc0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1e4e1b4d0 0x55a1e51f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1e4e132f0 0x55a1e51f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 --2- 172.21.15.37:0/1815153123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a1e4dfad80 0x55a1e51f20b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 >> 172.21.15.37:0/1815153123 conn(0x55a1e4e30300 msgr2=0x55a1e51da870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f32ff5640 0 client.26207 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.517+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 shutdown_connections 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.518+0000 7f6f5c7e7740 1 -- 172.21.15.37:0/1815153123 wait complete. 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.518+0000 7f6f5c7e7740 20 client.26207 trim_cache size 0 max 16384 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:24:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.519+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f380b66a0 msgr2=0x7f6f380b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.519+0000 7f6f557a1640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f380b66a0 0x7f6f380b8bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005fd0 tx=0x7f6f40009260 comp rx=0 tx=0).stop 2024-09-21T01:24:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.519+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 msgr2=0x7f6f501a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.519+0000 7f6f557a1640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 0x7f6f501a91e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e9f0 tx=0x7f6f4400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 shutdown_connections 2024-09-21T01:24:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f6f380b66a0 0x7f6f380b8bb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5010f830 0x7f6f501a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f5010cd20 0x7f6f501a91e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 --2- 172.21.15.37:0/929985174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f5010a3c0 0x7f6f501a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 >> 172.21.15.37:0/929985174 conn(0x7f6f50070670 msgr2=0x7f6f5010b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 shutdown_connections 2024-09-21T01:24:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:29.521+0000 7f6f557a1640 1 -- 172.21.15.37:0/929985174 wait complete. 2024-09-21T01:24:30.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:30 smithi037 ceph-mon[31105]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 974 MiB/s wr, 2.18k op/s 2024-09-21T01:24:30.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:30 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:24:30.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:30 smithi137 ceph-mon[34607]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 974 MiB/s wr, 2.18k op/s 2024-09-21T01:24:30.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:30 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:24:30.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:30 smithi144 ceph-mon[34818]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 974 MiB/s wr, 2.18k op/s 2024-09-21T01:24:30.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:30 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:24:32.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:32 smithi037 ceph-mon[31105]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 1.77k op/s 2024-09-21T01:24:32.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:32 smithi137 ceph-mon[34607]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 1.77k op/s 2024-09-21T01:24:32.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:32 smithi144 ceph-mon[34818]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 1.77k op/s 2024-09-21T01:24:34.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:34 smithi037 ceph-mon[31105]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 877 MiB/s wr, 1.77k op/s 2024-09-21T01:24:34.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:34 smithi137 ceph-mon[34607]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 877 MiB/s wr, 1.77k op/s 2024-09-21T01:24:34.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:34 smithi144 ceph-mon[34818]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 877 MiB/s wr, 1.77k op/s 2024-09-21T01:24:35.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:24:35.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:24:35.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:24:35.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:24:35.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:24:35.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:24:36.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:24:36.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:24:36.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:24:37.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:37 smithi137 ceph-mon[34607]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 943 MiB/s wr, 1.94k op/s 2024-09-21T01:24:37.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:37 smithi144 ceph-mon[34818]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 943 MiB/s wr, 1.94k op/s 2024-09-21T01:24:37.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:37 smithi037 ceph-mon[31105]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 943 MiB/s wr, 1.94k op/s 2024-09-21T01:24:39.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:24:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:39 smithi137 ceph-mon[34607]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 772 MiB/s wr, 1.51k op/s 2024-09-21T01:24:39.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:39 smithi144 ceph-mon[34818]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 772 MiB/s wr, 1.51k op/s 2024-09-21T01:24:39.430 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:39 smithi037 ceph-mon[31105]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 772 MiB/s wr, 1.51k op/s 2024-09-21T01:24:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:24:41.258 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:41 smithi037 ceph-mon[31105]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 983 MiB/s wr, 1.85k op/s 2024-09-21T01:24:41.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:41 smithi137 ceph-mon[34607]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 983 MiB/s wr, 1.85k op/s 2024-09-21T01:24:41.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:41 smithi144 ceph-mon[34818]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 983 MiB/s wr, 1.85k op/s 2024-09-21T01:24:42.556 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:24:42.556 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:24:42.556 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:24:42.556 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:24:00.417164+0000", 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.557 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:24:42.558 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:42.559 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:24:42.560 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:24:42.561 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:24:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:24:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 -- 172.21.15.37:0/573731200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae4111f40 msgr2=0x7f0ae410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/573731200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae4111f40 0x7f0ae410a3c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009ca0 tx=0x7f0adc02a8f0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 -- 172.21.15.37:0/573731200 shutdown_connections 2024-09-21T01:24:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/573731200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae411cc30 0x7f0ae411f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/573731200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/573731200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae4111f40 0x7f0ae410a3c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 -- 172.21.15.37:0/573731200 >> 172.21.15.37:0/573731200 conn(0x7f0ae4070ec0 msgr2=0x7f0ae40712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 -- 172.21.15.37:0/573731200 shutdown_connections 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.139+0000 7f0ae9d34640 1 -- 172.21.15.37:0/573731200 wait complete. 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.140+0000 7f0ae9d34640 1 Processor -- start 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.141+0000 7f0ae9d34640 1 -- start start 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.141+0000 7f0ae9d34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae411c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.141+0000 7f0ae9d34640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae4111f40 0x7f0ae41167d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.141+0000 7f0ae9d34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae411cc30 0x7f0ae4116e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.142+0000 7f0ae9d34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4112c80 con 0x7f0ae411cc30 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.142+0000 7f0ae9d34640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4112b00 con 0x7f0ae410a9e0 2024-09-21T01:24:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.142+0000 7f0ae9d34640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4112e00 con 0x7f0ae4111f40 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.143+0000 7f0ae37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae411c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.143+0000 7f0ae2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae4111f40 0x7f0ae41167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.143+0000 7f0ae37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae411c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:53536/0 (socket says 172.21.15.37:53536) 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.143+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1445878893 learned_addr learned my addr 172.21.15.37:0/1445878893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.145+0000 7f0ae3fff640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae411cc30 0x7f0ae4116e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.145+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1445878893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae4111f40 msgr2=0x7f0ae41167d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.145+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae4111f40 0x7f0ae41167d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.145+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae411cc30 msgr2=0x7f0ae4116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.145+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae411cc30 0x7f0ae4116e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.145+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1445878893 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae41bde50 con 0x7f0ae410a9e0 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.147+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae411c510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0adc02aee0 tx=0x7f0adc003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.148+0000 7f0ae0ff9640 1 -- 172.21.15.37:0/1445878893 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc003e20 con 0x7f0ae410a9e0 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.148+0000 7f0ae0ff9640 1 -- 172.21.15.37:0/1445878893 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0adc02d070 con 0x7f0ae410a9e0 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.148+0000 7f0ae0ff9640 1 -- 172.21.15.37:0/1445878893 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc02fb10 con 0x7f0ae410a9e0 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.149+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae41be020 con 0x7f0ae410a9e0 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.150+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae41be500 con 0x7f0ae410a9e0 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.154+0000 7f0af02a8740 1 Processor -- start 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.157+0000 7f0af02a8740 1 -- start start 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.157+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd67650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.158+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd67b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.158+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.158+0000 7f0af02a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56436dcdde50 con 0x56436d9c0070 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.158+0000 7f0af02a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56436dccd280 con 0x56436d99f390 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.158+0000 7f0af02a8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56436dcd1090 con 0x56436d9971b0 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.160+0000 7f0ae2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.161+0000 7f0ae2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd680d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:53550/0 (socket says 172.21.15.37:53550) 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.161+0000 7f0ae2ffd640 1 -- 172.21.15.37:0/3291561925 learned_addr learned my addr 172.21.15.37:0/3291561925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.161+0000 7f0ae0ff9640 1 -- 172.21.15.37:0/1445878893 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0adc004660 con 0x7f0ae410a9e0 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.161+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd67b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.161+0000 7f0ae3fff640 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd67650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.162+0000 7f0ae37fe640 1 -- 172.21.15.37:0/3291561925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 msgr2=0x56436dd680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.162+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.162+0000 7f0ae37fe640 1 -- 172.21.15.37:0/3291561925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 msgr2=0x56436dd67650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.162+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd67650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.162+0000 7f0ae37fe640 1 -- 172.21.15.37:0/3291561925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56436da2b650 con 0x56436d9971b0 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.165+0000 7f0ae0ff9640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0acc0b6590 0x7f0acc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.165+0000 7f0ae0ff9640 1 -- 172.21.15.37:0/1445878893 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0adc10ab30 con 0x7f0ae410a9e0 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.166+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd67b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0adc108590 tx=0x7f0adc10eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b779c3a358520127 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.167+0000 7f0ac9ffb640 1 -- 172.21.15.37:0/3291561925 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0cd2d0 con 0x56436d9971b0 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.168+0000 7f0ae3fff640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0acc0b6590 0x7f0acc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.168+0000 7f0ac9ffb640 1 -- 172.21.15.37:0/3291561925 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0adc036030 con 0x56436d9971b0 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.170+0000 7f0af02a8740 1 -- 172.21.15.37:0/3291561925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 msgr2=0x56436dd67b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.170+0000 7f0af02a8740 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd67b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0adc108590 tx=0x7f0adc10eb90 comp rx=0 tx=0).stop 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.172+0000 7f0af02a8740 1 -- 172.21.15.37:0/3291561925 shutdown_connections 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.172+0000 7f0af02a8740 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.172+0000 7f0af02a8740 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd67b90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.172+0000 7f0af02a8740 1 --2- 172.21.15.37:0/3291561925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd67650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.172+0000 7f0af02a8740 1 -- 172.21.15.37:0/3291561925 >> 172.21.15.37:0/3291561925 conn(0x56436d9b4460 msgr2=0x56436dd65540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.173+0000 7f0af02a8740 1 -- 172.21.15.37:0/3291561925 shutdown_connections 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.177+0000 7f0ae3fff640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0acc0b6590 0x7f0acc0b8aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8006fd0 tx=0x7f0ad8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.177+0000 7f0af02a8740 1 -- 172.21.15.37:0/3291561925 wait complete. 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.178+0000 7f0af02a8740 1 -- start start 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.178+0000 7f0af02a8740 1 Processor -- start 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd72ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd73620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56436db2e700 con 0x56436d9c0070 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56436dc68110 con 0x56436d99f390 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56436dd75bf0 con 0x56436d9971b0 2024-09-21T01:24:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.179+0000 7f0af02a8740 10 client.0 _ll_register_callbacks cb 0x56436dc81990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.180+0000 7f0ae3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd73620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.180+0000 7f0ae3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd73620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34574/0 (socket says 172.21.15.37:34574) 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.180+0000 7f0ae3fff640 1 -- 172.21.15.37:0/1663964051 learned_addr learned my addr 172.21.15.37:0/1663964051 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.180+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd72ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.182+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 msgr2=0x56436dd730e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.182+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd730e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.182+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1663964051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 msgr2=0x56436dd73620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.182+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd73620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.182+0000 7f0ae37fe640 1 -- 172.21.15.37:0/1663964051 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56436dc95c40 con 0x56436d9971b0 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.183+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd72ba0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56436dd662d0 tx=0x7f0adc02a8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17d6f3f762fa8626 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.183+0000 7f0ac2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:24:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.183+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/1663964051 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0d05d0 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.183+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/1663964051 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0adc0f40c0 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.184+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0adc036030 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.184+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/1663964051 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0adc0d0a50 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.184+0000 7f0af02a8740 10 client.26197 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.184+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56436dd817a0 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/1663964051 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0adc036030 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/1663964051 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0adc0da210 con 0x56436d9971b0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0af02a8740 10 client.26197 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0af02a8740 10 client.26197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0af02a8740 20 client.26197 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0af02a8740 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d97e9f0 0x56436dd84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0af02a8740 4 client.26197 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.187+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56436dcdfda0 con 0x56436d97e9f0 2024-09-21T01:24:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.191+0000 7f0ae2ffd640 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d97e9f0 0x56436dd84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.209+0000 7f0ae2ffd640 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d97e9f0 0x56436dd84b00 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=712abea195e97b82 server_cookie=c7d1e392aa231d4d in_seq=0 out_seq=0 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.209+0000 7f0ac2ffd640 10 client.26197 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.214+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/1663964051 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56436dcdfda0 con 0x56436d97e9f0 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.214+0000 7f0ac2ffd640 10 client.26197 handle_command_reply: tid=0 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.214+0000 7f0af02a8740 1 client.26197 shutdown 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.215+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 msgr2=0x56436dd72ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.215+0000 7f0af02a8740 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd72ba0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56436dd662d0 tx=0x7f0adc02a8f0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 shutdown_connections 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0af02a8740 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d97e9f0 0x56436dd84b00 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0af02a8740 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9c0070 0x56436dd73620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0af02a8740 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0af02a8740 1 --2- 172.21.15.37:0/1663964051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9971b0 0x56436dd72ba0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 >> 172.21.15.37:0/1663964051 conn(0x56436d9b4460 msgr2=0x56436dd68680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.218+0000 7f0ac2ffd640 0 client.26197 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.223+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 shutdown_connections 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.224+0000 7f0af02a8740 1 -- 172.21.15.37:0/1663964051 wait complete. 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.226+0000 7f0af02a8740 20 client.26197 trim_cache size 0 max 16384 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.253+0000 7f0af02a8740 1 Processor -- start 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.253+0000 7f0af02a8740 1 -- start start 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 0x56436dd69040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd73060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0af02a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41c6ad0 con 0x56436d9971b0 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0af02a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41c8610 con 0x56436d99f390 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0af02a8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41c71a0 con 0x56436d9c0070 2024-09-21T01:24:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 0x56436dd69040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 0x56436dd69040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34580/0 (socket says 172.21.15.37:34580) 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 -- 172.21.15.37:0/2884448006 learned_addr learned my addr 172.21.15.37:0/2884448006 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 -- 172.21.15.37:0/2884448006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 msgr2=0x56436dd735a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd735a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 -- 172.21.15.37:0/2884448006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 msgr2=0x56436dd73060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd73060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.254+0000 7f0ae37fe640 1 -- 172.21.15.37:0/2884448006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56436dd65a50 con 0x56436d9971b0 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.255+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 0x56436dd69040 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0da610 tx=0x7f0adc0da6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b815ecb870b3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.255+0000 7f0ac97fa640 1 -- 172.21.15.37:0/2884448006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0ccb20 con 0x56436d9971b0 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.255+0000 7f0ac97fa640 1 -- 172.21.15.37:0/2884448006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0adc036050 con 0x56436d9971b0 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.255+0000 7f0ac97fa640 1 -- 172.21.15.37:0/2884448006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0cd2d0 con 0x56436d9971b0 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 -- 172.21.15.37:0/2884448006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 msgr2=0x56436dd69040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 0x56436dd69040 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0da610 tx=0x7f0adc0da6a0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 -- 172.21.15.37:0/2884448006 shutdown_connections 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d99f390 0x56436dd73060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 --2- 172.21.15.37:0/2884448006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d9971b0 0x56436dd69040 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 -- 172.21.15.37:0/2884448006 >> 172.21.15.37:0/2884448006 conn(0x56436d9b4460 msgr2=0x56436dd72950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 -- 172.21.15.37:0/2884448006 shutdown_connections 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.256+0000 7f0af02a8740 1 -- 172.21.15.37:0/2884448006 wait complete. 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.257+0000 7f0af02a8740 1 -- start start 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.258+0000 7f0af02a8740 1 Processor -- start 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.258+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d9971b0 0x56436dd7b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.258+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 0x56436dd76b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.258+0000 7f0af02a8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd77090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0af02a8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41c7f40 con 0x56436d99f390 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0af02a8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41c7870 con 0x56436d9971b0 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0af02a8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae41c4a90 con 0x56436d9c0070 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0af02a8740 10 client.0 _ll_register_callbacks cb 0x7f0adc10e900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0ae2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 0x56436dd76b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0ae2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 0x56436dd76b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34584/0 (socket says 172.21.15.37:34584) 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0ae2ffd640 1 -- 172.21.15.37:0/799718436 learned_addr learned my addr 172.21.15.37:0/799718436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.259+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d9971b0 0x56436dd7b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.260+0000 7f0ae3fff640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd77090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.260+0000 7f0ae2ffd640 1 -- 172.21.15.37:0/799718436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 msgr2=0x56436dd77090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.260+0000 7f0ae2ffd640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd77090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.260+0000 7f0ae2ffd640 1 -- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d9971b0 msgr2=0x56436dd7b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.261+0000 7f0ae2ffd640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d9971b0 0x56436dd7b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.261+0000 7f0ae2ffd640 1 -- 172.21.15.37:0/799718436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56436dd777a0 con 0x56436d99f390 2024-09-21T01:24:42.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.261+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d9971b0 0x56436dd7b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.261+0000 7f0ae3fff640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd77090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.262+0000 7f0ae2ffd640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 0x56436dd76b50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098e0 tx=0x7f0ad4009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505c013fcf3d7587 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.262+0000 7f0ac2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.264+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/799718436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4016d30 con 0x56436d99f390 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.264+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/799718436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0ad4005990 con 0x56436d99f390 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.264+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0adc036050 con 0x56436d99f390 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.264+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/799718436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0ad4005b90 con 0x56436d99f390 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.264+0000 7f0af02a8740 10 client.16815 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.264+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56436ddef2c0 con 0x56436d99f390 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/799718436 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0adc036050 con 0x56436d99f390 2024-09-21T01:24:42.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/799718436 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0ad402e420 con 0x56436d99f390 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0af02a8740 10 client.16815 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0af02a8740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0af02a8740 20 client.16815 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0af02a8740 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d953da0 0x56436ddf1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0af02a8740 4 client.16815 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.265+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56436dcdb850 con 0x56436d953da0 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.267+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d953da0 0x56436ddf1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.269+0000 7f0ae37fe640 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d953da0 0x56436ddf1b00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a618b03ea6e676 server_cookie=cdb214a9961018fa in_seq=0 out_seq=0 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.269+0000 7f0ac2ffd640 10 client.16815 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.275+0000 7f0ac2ffd640 1 -- 172.21.15.37:0/799718436 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x56436dcdb850 con 0x56436d953da0 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.275+0000 7f0ac2ffd640 10 client.16815 handle_command_reply: tid=0 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.275+0000 7f0af02a8740 1 client.16815 shutdown 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 msgr2=0x56436dd76b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 0x56436dd76b50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098e0 tx=0x7f0ad4009720 comp rx=0 tx=0).stop 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 shutdown_connections 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56436d953da0 0x56436ddf1b00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56436d9c0070 0x56436dd77090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0ac2ffd640 0 client.16815 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56436d99f390 0x56436dd76b50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 --2- 172.21.15.37:0/799718436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56436d9971b0 0x56436dd7b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 >> 172.21.15.37:0/799718436 conn(0x56436d9b4460 msgr2=0x56436dd73310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 shutdown_connections 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 1 -- 172.21.15.37:0/799718436 wait complete. 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.276+0000 7f0af02a8740 20 client.16815 trim_cache size 0 max 16384 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.277+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0acc0b6590 msgr2=0x7f0acc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.277+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0acc0b6590 0x7f0acc0b8aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8006fd0 tx=0x7f0ad8008040 comp rx=0 tx=0).stop 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.277+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 msgr2=0x7f0ae411c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.277+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae411c510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0adc02aee0 tx=0x7f0adc003970 comp rx=0 tx=0).stop 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 shutdown_connections 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0acc0b6590 0x7f0acc0b8aa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae411cc30 0x7f0ae4116e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ae4111f40 0x7f0ae41167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 --2- 172.21.15.37:0/1445878893 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ae410a9e0 0x7f0ae411c510 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 >> 172.21.15.37:0/1445878893 conn(0x7f0ae4070ec0 msgr2=0x7f0ae4073e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 shutdown_connections 2024-09-21T01:24:42.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:42.278+0000 7f0ae9d34640 1 -- 172.21.15.37:0/1445878893 wait complete. 2024-09-21T01:24:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.837+0000 7f4b85784640 1 -- 172.21.15.37:0/1867776674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 msgr2=0x7f4b8010c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.837+0000 7f4b85784640 1 --2- 172.21.15.37:0/1867776674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 0x7f4b8010c7e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009900 tx=0x7f4b7002a420 comp rx=0 tx=0).stop 2024-09-21T01:24:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.841+0000 7f4b85784640 1 -- 172.21.15.37:0/1867776674 shutdown_connections 2024-09-21T01:24:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.841+0000 7f4b85784640 1 --2- 172.21.15.37:0/1867776674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b8010f830 0x7f4b8010fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.841+0000 7f4b85784640 1 --2- 172.21.15.37:0/1867776674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010cd20 0x7f4b8010f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.841+0000 7f4b85784640 1 --2- 172.21.15.37:0/1867776674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 0x7f4b8010c7e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.841+0000 7f4b85784640 1 -- 172.21.15.37:0/1867776674 >> 172.21.15.37:0/1867776674 conn(0x7f4b80070640 msgr2=0x7f4b80072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.851+0000 7f4b85784640 1 -- 172.21.15.37:0/1867776674 shutdown_connections 2024-09-21T01:24:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.851+0000 7f4b85784640 1 -- 172.21.15.37:0/1867776674 wait complete. 2024-09-21T01:24:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.853+0000 7f4b85784640 1 Processor -- start 2024-09-21T01:24:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 -- start start 2024-09-21T01:24:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 0x7f4b801a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b8010cd20 0x7f4b801a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 0x7f4b801a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8011dfb0 con 0x7f4b8010f830 2024-09-21T01:24:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8011de30 con 0x7f4b8010cd20 2024-09-21T01:24:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.854+0000 7f4b85784640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8011e130 con 0x7f4b8010a3c0 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.855+0000 7f4b84f83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 0x7f4b801a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.855+0000 7f4b84f83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 0x7f4b801a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34598/0 (socket says 172.21.15.37:34598) 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.855+0000 7f4b84f83640 1 -- 172.21.15.37:0/3265102163 learned_addr learned my addr 172.21.15.37:0/3265102163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.855+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 0x7f4b801a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.855+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b8010cd20 0x7f4b801a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.856+0000 7f4b84f83640 1 -- 172.21.15.37:0/3265102163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 msgr2=0x7f4b801a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.856+0000 7f4b84f83640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 0x7f4b801a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.856+0000 7f4b84f83640 1 -- 172.21.15.37:0/3265102163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b8010cd20 msgr2=0x7f4b801a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.856+0000 7f4b84f83640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b8010cd20 0x7f4b801a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.856+0000 7f4b84f83640 1 -- 172.21.15.37:0/3265102163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b801aa3f0 con 0x7f4b8010f830 2024-09-21T01:24:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.856+0000 7f4b84f83640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 0x7f4b801a9bd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800e970 tx=0x7f4b7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.857+0000 7f4b7dffb640 1 -- 172.21.15.37:0/3265102163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800ccc0 con 0x7f4b8010f830 2024-09-21T01:24:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.857+0000 7f4b7dffb640 1 -- 172.21.15.37:0/3265102163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b7800ce60 con 0x7f4b8010f830 2024-09-21T01:24:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.857+0000 7f4b7dffb640 1 -- 172.21.15.37:0/3265102163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78010430 con 0x7f4b8010f830 2024-09-21T01:24:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.857+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b801aa6e0 con 0x7f4b8010f830 2024-09-21T01:24:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.857+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801b0dd0 con 0x7f4b8010f830 2024-09-21T01:24:42.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.864+0000 7f4b7dffb640 1 -- 172.21.15.37:0/3265102163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4b780046c0 con 0x7f4b8010f830 2024-09-21T01:24:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.864+0000 7f4b8da2c740 1 Processor -- start 2024-09-21T01:24:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.864+0000 7f4b8da2c740 1 -- start start 2024-09-21T01:24:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa90040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b7dffb640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b6c0b66a0 0x7f4b6c0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa91200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d7cfa026f0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d7cf9f1b20 con 0x55d7cf6c74d0 2024-09-21T01:24:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.867+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d7cf9f5930 con 0x55d7cf6e81b0 2024-09-21T01:24:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.868+0000 7f4b7dffb640 1 -- 172.21.15.37:0/3265102163 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b780e7650 con 0x7f4b8010f830 2024-09-21T01:24:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.868+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.868+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa906b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34606/0 (socket says 172.21.15.37:34606) 2024-09-21T01:24:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.868+0000 7f4b7ffff640 1 -- 172.21.15.37:0/2579890851 learned_addr learned my addr 172.21.15.37:0/2579890851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.868+0000 7f4b84f83640 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa91200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.870+0000 7f4b7ffff640 1 -- 172.21.15.37:0/2579890851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 msgr2=0x55d7cfa90040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:24:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.870+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa90040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.870+0000 7f4b7ffff640 1 -- 172.21.15.37:0/2579890851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 msgr2=0x55d7cfa91200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.870+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa91200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.870+0000 7f4b7ffff640 1 -- 172.21.15.37:0/2579890851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7cf9b7530 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.871+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b6c0b66a0 0x7f4b6c0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.872+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b6c0b66a0 0x7f4b6c0b8bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b68005fd0 tx=0x7f4b68009440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.873+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa906b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009900 tx=0x7f4b70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6911751ccdfb23c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.876+0000 7f4b767fc640 1 -- 172.21.15.37:0/2579890851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b700036b0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.876+0000 7f4b767fc640 1 -- 172.21.15.37:0/2579890851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b700318f0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.878+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2579890851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 msgr2=0x55d7cfa906b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.878+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa906b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009900 tx=0x7f4b70000bc0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.882+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2579890851 shutdown_connections 2024-09-21T01:24:42.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.882+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa91200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.882+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa906b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.882+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2579890851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa90040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.883+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2579890851 >> 172.21.15.37:0/2579890851 conn(0x55d7cf6dc300 msgr2=0x55d7cfa8bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.887+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2579890851 shutdown_connections 2024-09-21T01:24:42.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.887+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2579890851 wait complete. 2024-09-21T01:24:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 -- start start 2024-09-21T01:24:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 Processor -- start 2024-09-21T01:24:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa99790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa99e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa9a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d7cf929ab0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d7cf997730 con 0x55d7cf6c74d0 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.888+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d7cfa91d10 con 0x55d7cf6e81b0 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.889+0000 7f4b8da2c740 10 client.0 _ll_register_callbacks cb 0x55d7cf9eb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.889+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa99790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.889+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa99790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34622/0 (socket says 172.21.15.37:34622) 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.889+0000 7f4b7ffff640 1 -- 172.21.15.37:0/2928724515 learned_addr learned my addr 172.21.15.37:0/2928724515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.889+0000 7f4b77fff640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa99e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.889+0000 7f4b84f83640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa9a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.890+0000 7f4b77fff640 1 -- 172.21.15.37:0/2928724515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 msgr2=0x55d7cfa9a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.890+0000 7f4b77fff640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa9a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.890+0000 7f4b77fff640 1 -- 172.21.15.37:0/2928724515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 msgr2=0x55d7cfa99790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.890+0000 7f4b77fff640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa99790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.890+0000 7f4b77fff640 1 -- 172.21.15.37:0/2928724515 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7cf753790 con 0x55d7cf6c74d0 2024-09-21T01:24:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.891+0000 7f4b77fff640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa99e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b68011c30 tx=0x7f4b68004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5456c100c5db3af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.891+0000 7f4b5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:24:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.892+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/2928724515 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68022020 con 0x55d7cf6c74d0 2024-09-21T01:24:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.892+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/2928724515 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b68011c60 con 0x55d7cf6c74d0 2024-09-21T01:24:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.892+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b700318f0 con 0x55d7cf6c74d0 2024-09-21T01:24:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.893+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/2928724515 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4b68011e60 con 0x55d7cf6c74d0 2024-09-21T01:24:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.893+0000 7f4b8da2c740 10 client.26225 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.893+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7cf7cc620 con 0x55d7cf6c74d0 2024-09-21T01:24:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.894+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/2928724515 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b68017030 con 0x55d7cf6c74d0 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/2928724515 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4b6800f040 con 0x55d7cf6c74d0 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b8da2c740 10 client.26225 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b8da2c740 10 client.26225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b8da2c740 20 client.26225 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6a6d80 0x55d7cfaa7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b8da2c740 4 client.26225 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.895+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4b700318f0 con 0x55d7cf6a6d80 2024-09-21T01:24:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.897+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6a6d80 0x55d7cfaa7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.899+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6a6d80 0x55d7cfaa7060 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3309f7f45ac481d4 server_cookie=1602ffcb65c36b8e in_seq=0 out_seq=0 2024-09-21T01:24:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.899+0000 7f4b5f7fe640 10 client.26225 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.903+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/2928724515 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4b700318f0 con 0x55d7cf6a6d80 2024-09-21T01:24:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.903+0000 7f4b5f7fe640 10 client.26225 handle_command_reply: tid=0 2024-09-21T01:24:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.903+0000 7f4b8da2c740 1 client.26225 shutdown 2024-09-21T01:24:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.903+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 msgr2=0x55d7cfa99e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.903+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa99e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b68011c30 tx=0x7f4b68004a40 comp rx=0 tx=0).stop 2024-09-21T01:24:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 shutdown_connections 2024-09-21T01:24:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6a6d80 0x55d7cfaa7060 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6e81b0 0x55d7cfa9a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b5f7fe640 0 client.26225 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa99e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/2928724515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa99790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 >> 172.21.15.37:0/2928724515 conn(0x55d7cf6dc300 msgr2=0x55d7cfa8a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.904+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 shutdown_connections 2024-09-21T01:24:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.905+0000 7f4b8da2c740 1 -- 172.21.15.37:0/2928724515 wait complete. 2024-09-21T01:24:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.905+0000 7f4b8da2c740 20 client.26225 trim_cache size 0 max 16384 2024-09-21T01:24:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.942+0000 7f4b8da2c740 1 Processor -- start 2024-09-21T01:24:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 -- start start 2024-09-21T01:24:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa8cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa90fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa90470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801b9c10 con 0x55d7cf6a6d80 2024-09-21T01:24:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801bb750 con 0x55d7cf6c74d0 2024-09-21T01:24:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.944+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801ba2e0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.947+0000 7f4b77fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa90fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.947+0000 7f4b84f83640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.947+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa8cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.947+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa8cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34630/0 (socket says 172.21.15.37:34630) 2024-09-21T01:24:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.947+0000 7f4b7ffff640 1 -- 172.21.15.37:0/3676583883 learned_addr learned my addr 172.21.15.37:0/3676583883 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.955+0000 7f4b77fff640 1 -- 172.21.15.37:0/3676583883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 msgr2=0x55d7cfa90470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.955+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa90470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.955+0000 7f4b77fff640 1 -- 172.21.15.37:0/3676583883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6a6d80 msgr2=0x55d7cfa8cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.955+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa8cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.955+0000 7f4b77fff640 1 -- 172.21.15.37:0/3676583883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7cfa9ad30 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.958+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa90fa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b68000f80 tx=0x7f4b68005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ccf1c698f8da07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.959+0000 7f4b75ffb640 1 -- 172.21.15.37:0/3676583883 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68010b70 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.959+0000 7f4b75ffb640 1 -- 172.21.15.37:0/3676583883 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b68017050 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.959+0000 7f4b75ffb640 1 -- 172.21.15.37:0/3676583883 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68030680 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.960+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3676583883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6bf2f0 msgr2=0x55d7cfa90fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.960+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa90fa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b68000f80 tx=0x7f4b68005ab0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.961+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3676583883 shutdown_connections 2024-09-21T01:24:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.961+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa90470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.961+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa90fa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.961+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3676583883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa8cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.961+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3676583883 >> 172.21.15.37:0/3676583883 conn(0x55d7cf6dc300 msgr2=0x55d7cfa949e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.962+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3676583883 shutdown_connections 2024-09-21T01:24:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.963+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3676583883 wait complete. 2024-09-21T01:24:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.963+0000 7f4b8da2c740 1 -- start start 2024-09-21T01:24:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 Processor -- start 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa9ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa9f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa9fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801bb080 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801ba9b0 con 0x55d7cf6a6d80 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801b7bd0 con 0x55d7cf6c74d0 2024-09-21T01:24:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.964+0000 7f4b8da2c740 10 client.0 _ll_register_callbacks cb 0x7f4b6800ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.965+0000 7f4b77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa9f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.965+0000 7f4b77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa9f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34642/0 (socket says 172.21.15.37:34642) 2024-09-21T01:24:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.965+0000 7f4b77fff640 1 -- 172.21.15.37:0/3154352967 learned_addr learned my addr 172.21.15.37:0/3154352967 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.966+0000 7f4b84f83640 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa9fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.966+0000 7f4b77fff640 1 -- 172.21.15.37:0/3154352967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6c74d0 msgr2=0x55d7cfa9fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.966+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa9fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.966+0000 7f4b77fff640 1 -- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6a6d80 msgr2=0x55d7cfa9ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.966+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa9ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.966+0000 7f4b77fff640 1 -- 172.21.15.37:0/3154352967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7cfaa0580 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.967+0000 7f4b77fff640 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa9f2b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800eb50 tx=0x7f4b6801e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611ba8ecb97185b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.967+0000 7f4b5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:24:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.968+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/3154352967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b680049a0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.968+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b68017050 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.968+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/3154352967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b68030420 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.969+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/3154352967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4b68030620 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.970+0000 7f4b8da2c740 10 client.16833 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.970+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7cfaa1870 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.979+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/3154352967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b68017050 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.979+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/3154352967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4b680275e0 con 0x55d7cf6bf2f0 2024-09-21T01:24:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.987+0000 7f4b8da2c740 10 client.16833 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.987+0000 7f4b8da2c740 10 client.16833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.987+0000 7f4b8da2c740 20 client.16833 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.987+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6e81b0 0x55d7cfb24db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.987+0000 7f4b8da2c740 4 client.16833 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:24:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.987+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7cfa04640 con 0x55d7cf6e81b0 2024-09-21T01:24:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:42.991+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6e81b0 0x55d7cfb24db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:43.007+0000 7f4b7ffff640 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6e81b0 0x55d7cfb24db0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7dd2d78b4378e4d server_cookie=8426de2c96ef5176 in_seq=0 out_seq=0 2024-09-21T01:24:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:43.007+0000 7f4b5f7fe640 10 client.16833 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:43.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:43 smithi137 ceph-mon[34607]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 841 MiB/s wr, 1.63k op/s 2024-09-21T01:24:43.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:43 smithi144 ceph-mon[34818]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 841 MiB/s wr, 1.63k op/s 2024-09-21T01:24:43.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:43 smithi037 ceph-mon[31105]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 841 MiB/s wr, 1.63k op/s 2024-09-21T01:24:45.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:45 smithi137 ceph-mon[34607]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 858 MiB/s wr, 1.62k op/s 2024-09-21T01:24:45.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:45 smithi144 ceph-mon[34818]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 858 MiB/s wr, 1.62k op/s 2024-09-21T01:24:45.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:45 smithi037 ceph-mon[31105]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 858 MiB/s wr, 1.62k op/s 2024-09-21T01:24:46.107 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:24:46.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:24:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.615+0000 7f4b5f7fe640 1 -- 172.21.15.37:0/3154352967 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7cfa04640 con 0x55d7cf6e81b0 2024-09-21T01:24:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.615+0000 7f4b5f7fe640 10 client.16833 handle_command_reply: tid=0 2024-09-21T01:24:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.616+0000 7f4b8da2c740 1 client.16833 shutdown 2024-09-21T01:24:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.617+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 msgr2=0x55d7cfa9f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.617+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa9f2b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800eb50 tx=0x7f4b6801e670 comp rx=0 tx=0).stop 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 shutdown_connections 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7cf6e81b0 0x55d7cfb24db0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7cf6c74d0 0x55d7cfa9fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7cf6bf2f0 0x55d7cfa9f2b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b8da2c740 1 --2- 172.21.15.37:0/3154352967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7cf6a6d80 0x55d7cfa9ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 >> 172.21.15.37:0/3154352967 conn(0x55d7cf6dc300 msgr2=0x55d7cfa949e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.619+0000 7f4b5f7fe640 0 client.16833 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.620+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 shutdown_connections 2024-09-21T01:24:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.620+0000 7f4b8da2c740 1 -- 172.21.15.37:0/3154352967 wait complete. 2024-09-21T01:24:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.622+0000 7f4b8da2c740 20 client.16833 trim_cache size 0 max 16384 2024-09-21T01:24:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:24:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:24:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:24:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:24:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.636+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b6c0b66a0 msgr2=0x7f4b6c0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.636+0000 7f4b85784640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b6c0b66a0 0x7f4b6c0b8bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b68005fd0 tx=0x7f4b68009440 comp rx=0 tx=0).stop 2024-09-21T01:24:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.636+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 msgr2=0x7f4b801a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.636+0000 7f4b85784640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 0x7f4b801a9bd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800e970 tx=0x7f4b7800ed70 comp rx=0 tx=0).stop 2024-09-21T01:24:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.640+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 shutdown_connections 2024-09-21T01:24:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.640+0000 7f4b85784640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b6c0b66a0 0x7f4b6c0b8bb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.640+0000 7f4b85784640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b8010f830 0x7f4b801a9bd0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.640+0000 7f4b85784640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b8010cd20 0x7f4b801a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.640+0000 7f4b85784640 1 --2- 172.21.15.37:0/3265102163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b8010a3c0 0x7f4b801a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.640+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 >> 172.21.15.37:0/3265102163 conn(0x7f4b80070640 msgr2=0x7f4b8010b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.643+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 shutdown_connections 2024-09-21T01:24:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:46.643+0000 7f4b85784640 1 -- 172.21.15.37:0/3265102163 wait complete. 2024-09-21T01:24:46.864 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:24:47.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:47 smithi137 ceph-mon[34607]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 944 MiB/s wr, 1.68k op/s 2024-09-21T01:24:47.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:47 smithi144 ceph-mon[34818]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 944 MiB/s wr, 1.68k op/s 2024-09-21T01:24:47.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:47 smithi037 ceph-mon[31105]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 944 MiB/s wr, 1.68k op/s 2024-09-21T01:24:49.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.010+0000 7f17939b4640 1 -- 172.21.15.37:0/2147585471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c10a9e0 msgr2=0x7f178c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:49.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.010+0000 7f17939b4640 1 --2- 172.21.15.37:0/2147585471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c10a9e0 0x7f178c10adf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1784009ca0 tx=0x7f178402a8f0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.016+0000 7f17939b4640 1 -- 172.21.15.37:0/2147585471 shutdown_connections 2024-09-21T01:24:49.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.016+0000 7f17939b4640 1 --2- 172.21.15.37:0/2147585471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c11cc30 0x7f178c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.016+0000 7f17939b4640 1 --2- 172.21.15.37:0/2147585471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c10a9e0 0x7f178c10adf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.016+0000 7f17939b4640 1 --2- 172.21.15.37:0/2147585471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f178c111f40 0x7f178c10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.016+0000 7f17939b4640 1 -- 172.21.15.37:0/2147585471 >> 172.21.15.37:0/2147585471 conn(0x7f178c070ec0 msgr2=0x7f178c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:49.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.024+0000 7f17939b4640 1 -- 172.21.15.37:0/2147585471 shutdown_connections 2024-09-21T01:24:49.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.024+0000 7f17939b4640 1 -- 172.21.15.37:0/2147585471 wait complete. 2024-09-21T01:24:49.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.026+0000 7f17939b4640 1 Processor -- start 2024-09-21T01:24:49.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 -- start start 2024-09-21T01:24:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f178c10a9e0 0x7f178c1a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 0x7f178c1a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c11cc30 0x7f178c1aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f178c122940 con 0x7f178c111f40 2024-09-21T01:24:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1227c0 con 0x7f178c10a9e0 2024-09-21T01:24:49.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.040+0000 7f17939b4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f178c122ac0 con 0x7f178c11cc30 2024-09-21T01:24:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.043+0000 7f1791750640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f178c10a9e0 0x7f178c1a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.043+0000 7f1790f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 0x7f178c1a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.043+0000 7f1790f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 0x7f178c1a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49884/0 (socket says 172.21.15.37:49884) 2024-09-21T01:24:49.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.043+0000 7f1790f4f640 1 -- 172.21.15.37:0/2625718077 learned_addr learned my addr 172.21.15.37:0/2625718077 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:49.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.044+0000 7f1791f51640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c11cc30 0x7f178c1aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:49.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.047+0000 7f1790f4f640 1 -- 172.21.15.37:0/2625718077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c11cc30 msgr2=0x7f178c1aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:49.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.047+0000 7f1790f4f640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c11cc30 0x7f178c1aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.048+0000 7f1790f4f640 1 -- 172.21.15.37:0/2625718077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f178c10a9e0 msgr2=0x7f178c1a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:49.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.048+0000 7f1790f4f640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f178c10a9e0 0x7f178c1a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.048+0000 7f1790f4f640 1 -- 172.21.15.37:0/2625718077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c1af360 con 0x7f178c111f40 2024-09-21T01:24:49.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.053+0000 7f1790f4f640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 0x7f178c1a9990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f80 tx=0x7f17840305f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:49.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.054+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784030960 con 0x7f178c111f40 2024-09-21T01:24:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.055+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f178402d070 con 0x7f178c111f40 2024-09-21T01:24:49.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.055+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178403a420 con 0x7f178c111f40 2024-09-21T01:24:49.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.055+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c1af5f0 con 0x7f178c111f40 2024-09-21T01:24:49.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.055+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c1b5db0 con 0x7f178c111f40 2024-09-21T01:24:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.059+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1770005290 con 0x7f178c111f40 2024-09-21T01:24:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.064+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1784004b40 con 0x7f178c111f40 2024-09-21T01:24:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.066+0000 7f17827fc640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17780b66a0 0x7f17780b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.067+0000 7f1791750640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17780b66a0 0x7f17780b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.068+0000 7f1791750640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17780b66a0 0x7f17780b8bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1788009bd0 tx=0x7f1788005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.069+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1784105ce0 con 0x7f178c111f40 2024-09-21T01:24:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.100+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17840cea70 con 0x7f178c111f40 2024-09-21T01:24:49.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:49 smithi137 ceph-mon[34607]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 763 MiB/s wr, 1.28k op/s 2024-09-21T01:24:49.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:49 smithi144 ceph-mon[34818]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 763 MiB/s wr, 1.28k op/s 2024-09-21T01:24:49.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:49 smithi037 ceph-mon[31105]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 763 MiB/s wr, 1.28k op/s 2024-09-21T01:24:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.624+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1770005580 con 0x7f178c111f40 2024-09-21T01:24:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.632+0000 7f17827fc640 1 -- 172.21.15.37:0/2625718077 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11976 (secure 0 0 0) 0x7f17840d2e50 con 0x7f178c111f40 2024-09-21T01:24:49.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:24:49.640 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-21T01:19:26:088830+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:19:25.613490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:24:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-21T01:24:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.637+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17780b66a0 msgr2=0x7f17780b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.637+0000 7f17939b4640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17780b66a0 0x7f17780b8bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1788009bd0 tx=0x7f1788005f90 comp rx=0 tx=0).stop 2024-09-21T01:24:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.637+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 msgr2=0x7f178c1a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.637+0000 7f17939b4640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 0x7f178c1a9990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f80 tx=0x7f17840305f0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 shutdown_connections 2024-09-21T01:24:49.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17780b66a0 0x7f17780b8bb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f178c11cc30 0x7f178c1aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c111f40 0x7f178c1a9990 secure :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1784000f80 tx=0x7f17840305f0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 --2- 172.21.15.37:0/2625718077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f178c10a9e0 0x7f178c1a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 >> 172.21.15.37:0/2625718077 conn(0x7f178c070ec0 msgr2=0x7f178c11e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:49.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 shutdown_connections 2024-09-21T01:24:49.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:49.638+0000 7f17939b4640 1 -- 172.21.15.37:0/2625718077 wait complete. 2024-09-21T01:24:50.485 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:50 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2625718077' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:24:50.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:50 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2625718077' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:24:50.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:50 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2625718077' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:24:51.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:51 smithi037 ceph-mon[31105]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 956 MiB/s wr, 1.89k op/s 2024-09-21T01:24:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:51 smithi137 ceph-mon[34607]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 956 MiB/s wr, 1.89k op/s 2024-09-21T01:24:51.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:51 smithi144 ceph-mon[34818]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 956 MiB/s wr, 1.89k op/s 2024-09-21T01:24:52.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:52 smithi037 ceph-mon[31105]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 821 MiB/s wr, 1.78k op/s 2024-09-21T01:24:52.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:52 smithi137 ceph-mon[34607]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 821 MiB/s wr, 1.78k op/s 2024-09-21T01:24:52.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:52 smithi144 ceph-mon[34818]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 821 MiB/s wr, 1.78k op/s 2024-09-21T01:24:52.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:24:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:24:54.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:54 smithi037 ceph-mon[31105]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 802 MiB/s wr, 1.72k op/s 2024-09-21T01:24:54.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:54 smithi137 ceph-mon[34607]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 802 MiB/s wr, 1.72k op/s 2024-09-21T01:24:54.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:54 smithi144 ceph-mon[34818]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 802 MiB/s wr, 1.72k op/s 2024-09-21T01:24:55.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.214+0000 7f4b384c1640 1 -- 172.21.15.37:0/3610423410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300757b0 msgr2=0x7f4b30075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.214+0000 7f4b384c1640 1 --2- 172.21.15.37:0/3610423410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300757b0 0x7f4b30075bc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01a910 tx=0x7f4b2c03b470 comp rx=0 tx=0).stop 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.219+0000 7f4b384c1640 1 -- 172.21.15.37:0/3610423410 shutdown_connections 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.219+0000 7f4b384c1640 1 --2- 172.21.15.37:0/3610423410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 0x7f4b30116b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.219+0000 7f4b384c1640 1 --2- 172.21.15.37:0/3610423410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b30076100 0x7f4b301141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.219+0000 7f4b384c1640 1 --2- 172.21.15.37:0/3610423410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300757b0 0x7f4b30075bc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.219+0000 7f4b384c1640 1 -- 172.21.15.37:0/3610423410 >> 172.21.15.37:0/3610423410 conn(0x7f4b300ff4a0 msgr2=0x7f4b301018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.225+0000 7f4b384c1640 1 -- 172.21.15.37:0/3610423410 shutdown_connections 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.225+0000 7f4b384c1640 1 -- 172.21.15.37:0/3610423410 wait complete. 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.226+0000 7f4b384c1640 1 Processor -- start 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.229+0000 7f4b384c1640 1 -- start start 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.230+0000 7f4b384c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b300757b0 0x7f4b30072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.230+0000 7f4b384c1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b30076100 0x7f4b30072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.230+0000 7f4b384c1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 0x7f4b300730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.230+0000 7f4b384c1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3010a340 con 0x7f4b300757b0 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.230+0000 7f4b384c1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3010a1c0 con 0x7f4b30114720 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.230+0000 7f4b384c1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3010a4c0 con 0x7f4b30076100 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.231+0000 7f4b36a5e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 0x7f4b300730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.231+0000 7f4b36a5e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 0x7f4b300730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50676/0 (socket says 172.21.15.37:50676) 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.231+0000 7f4b36a5e640 1 -- 172.21.15.37:0/1469530136 learned_addr learned my addr 172.21.15.37:0/1469530136 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.231+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b30076100 0x7f4b30072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.232+0000 7f4b3625d640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b300757b0 0x7f4b30072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.239+0000 7f4b3625d640 1 -- 172.21.15.37:0/1469530136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b30076100 msgr2=0x7f4b30072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.239+0000 7f4b3625d640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b30076100 0x7f4b30072ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.239+0000 7f4b3625d640 1 -- 172.21.15.37:0/1469530136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 msgr2=0x7f4b300730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.239+0000 7f4b3625d640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 0x7f4b300730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.239+0000 7f4b3625d640 1 -- 172.21.15.37:0/1469530136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b30113cc0 con 0x7f4b300757b0 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.248+0000 7f4b3625d640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b300757b0 0x7f4b30072660 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c006010 tx=0x7f4b2c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.252+0000 7f4b277fe640 1 -- 172.21.15.37:0/1469530136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c04f020 con 0x7f4b300757b0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.252+0000 7f4b277fe640 1 -- 172.21.15.37:0/1469530136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c0035f0 con 0x7f4b300757b0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.252+0000 7f4b277fe640 1 -- 172.21.15.37:0/1469530136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c046070 con 0x7f4b300757b0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.253+0000 7f4b384c1640 1 -- 172.21.15.37:0/1469530136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b30113f50 con 0x7f4b300757b0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.255+0000 7f4b384c1640 1 -- 172.21.15.37:0/1469530136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b301143e0 con 0x7f4b300757b0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.269+0000 7f4b3ea35740 1 Processor -- start 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.272+0000 7f4b3ea35740 1 -- start start 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.273+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a916b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.273+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a5461b0 0x55ef2a917090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.273+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a9175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.273+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef2a88cea0 con 0x55ef2a5461b0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.273+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ef2a87c2d0 con 0x55ef2a56f070 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.273+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ef2a8800e0 con 0x55ef2a54e390 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.276+0000 7f4b36a5e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a916b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.276+0000 7f4b35a5c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a9175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.279+0000 7f4b36a5e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a916b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50686/0 (socket says 172.21.15.37:50686) 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.279+0000 7f4b36a5e640 1 -- 172.21.15.37:0/4119063688 learned_addr learned my addr 172.21.15.37:0/4119063688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.280+0000 7f4b3625d640 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a5461b0 0x55ef2a917090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.283+0000 7f4b36a5e640 1 -- 172.21.15.37:0/4119063688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 msgr2=0x55ef2a9175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.283+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a9175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.283+0000 7f4b36a5e640 1 -- 172.21.15.37:0/4119063688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a5461b0 msgr2=0x55ef2a917090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.283+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a5461b0 0x55ef2a917090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.283+0000 7f4b36a5e640 1 -- 172.21.15.37:0/4119063688 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2a5da650 con 0x55ef2a56f070 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.285+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a916b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b28010470 tx=0x7f4b28010930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf13bc4e55163d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.286+0000 7f4b1bfff640 1 -- 172.21.15.37:0/4119063688 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28012710 con 0x55ef2a56f070 2024-09-21T01:24:55.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.287+0000 7f4b1bfff640 1 -- 172.21.15.37:0/4119063688 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b28012d60 con 0x55ef2a56f070 2024-09-21T01:24:55.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.290+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4119063688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 msgr2=0x55ef2a916b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.290+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a916b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b28010470 tx=0x7f4b28010930 comp rx=0 tx=0).stop 2024-09-21T01:24:55.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.291+0000 7f4b277fe640 1 -- 172.21.15.37:0/1469530136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4b2c052020 con 0x7f4b300757b0 2024-09-21T01:24:55.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.291+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4119063688 shutdown_connections 2024-09-21T01:24:55.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.291+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a9175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.291+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a5461b0 0x55ef2a917090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.291+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4119063688 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a916b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.291+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4119063688 >> 172.21.15.37:0/4119063688 conn(0x55ef2a563460 msgr2=0x55ef2a914a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:55.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.292+0000 7f4b277fe640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b1c0b6660 0x7f4b1c0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.293+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b1c0b6660 0x7f4b1c0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.293+0000 7f4b277fe640 1 -- 172.21.15.37:0/1469530136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b2c0037a0 con 0x7f4b300757b0 2024-09-21T01:24:55.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.294+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b1c0b6660 0x7f4b1c0b8b70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b30116750 tx=0x7f4b20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:55.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.300+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4119063688 shutdown_connections 2024-09-21T01:24:55.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.301+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4119063688 wait complete. 2024-09-21T01:24:55.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.302+0000 7f4b3ea35740 1 -- start start 2024-09-21T01:24:55.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.302+0000 7f4b3ea35740 1 Processor -- start 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a922050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a56f070 0x55ef2a922590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a52d9f0 0x55ef2a922ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef2a6dd700 con 0x55ef2a56f070 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ef2a817160 con 0x55ef2a52d9f0 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ef2a9252f0 con 0x55ef2a54e390 2024-09-21T01:24:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.307+0000 7f4b3ea35740 10 client.0 _ll_register_callbacks cb 0x55ef2a8309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:55.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.311+0000 7f4b35a5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a56f070 0x55ef2a922590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.311+0000 7f4b35a5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a56f070 0x55ef2a922590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49928/0 (socket says 172.21.15.37:49928) 2024-09-21T01:24:55.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.311+0000 7f4b35a5c640 1 -- 172.21.15.37:0/3820420637 learned_addr learned my addr 172.21.15.37:0/3820420637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:55.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.321+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a52d9f0 0x55ef2a922ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.321+0000 7f4b3625d640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a922050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.324+0000 7f4b36a5e640 1 -- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 msgr2=0x55ef2a922050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.324+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a922050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.324+0000 7f4b36a5e640 1 -- 172.21.15.37:0/3820420637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a56f070 msgr2=0x55ef2a922590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.324+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a56f070 0x55ef2a922590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.324+0000 7f4b36a5e640 1 -- 172.21.15.37:0/3820420637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2a844c90 con 0x55ef2a52d9f0 2024-09-21T01:24:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.332+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a52d9f0 0x55ef2a922ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b28010470 tx=0x7f4b28011670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3a3219da798efd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:55.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.332+0000 7f4b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:24:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.334+0000 7f4b19ffb640 1 -- 172.21.15.37:0/3820420637 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2802a060 con 0x55ef2a52d9f0 2024-09-21T01:24:55.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.334+0000 7f4b19ffb640 1 -- 172.21.15.37:0/3820420637 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b28011970 con 0x55ef2a52d9f0 2024-09-21T01:24:55.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.336+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef2a88edf0 con 0x55ef2a52d9f0 2024-09-21T01:24:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.338+0000 7f4b19ffb640 1 -- 172.21.15.37:0/3820420637 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4b28011ea0 con 0x55ef2a52d9f0 2024-09-21T01:24:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.341+0000 7f4b3ea35740 10 client.26246 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:55.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.341+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef2a930f20 con 0x55ef2a52d9f0 2024-09-21T01:24:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.343+0000 7f4b19ffb640 1 -- 172.21.15.37:0/3820420637 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ef2a88edf0 con 0x55ef2a52d9f0 2024-09-21T01:24:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.343+0000 7f4b19ffb640 1 -- 172.21.15.37:0/3820420637 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4b2800f040 con 0x55ef2a52d9f0 2024-09-21T01:24:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.344+0000 7f4b3ea35740 10 client.26246 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.344+0000 7f4b3ea35740 10 client.26246 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:24:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.344+0000 7f4b3ea35740 20 client.26246 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.344+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a502da0 0x55ef2a934700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.344+0000 7f4b3ea35740 4 client.26246 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.344+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef2a88a8a0 con 0x55ef2a502da0 2024-09-21T01:24:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.349+0000 7f4b3625d640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a502da0 0x55ef2a934700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.354+0000 7f4b3625d640 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a502da0 0x55ef2a934700 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dafac7e120c99ccb server_cookie=af6bc5085afd0f16 in_seq=0 out_seq=0 2024-09-21T01:24:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.354+0000 7f4b19ffb640 10 client.26246 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:24:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.360+0000 7f4b19ffb640 1 -- 172.21.15.37:0/3820420637 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef2a88a8a0 con 0x55ef2a502da0 2024-09-21T01:24:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.360+0000 7f4b19ffb640 10 client.26246 handle_command_reply: tid=0 2024-09-21T01:24:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.360+0000 7f4b3ea35740 1 client.26246 shutdown 2024-09-21T01:24:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.361+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a52d9f0 msgr2=0x55ef2a922ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.361+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a52d9f0 0x55ef2a922ad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b28010470 tx=0x7f4b28011670 comp rx=0 tx=0).stop 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 shutdown_connections 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a502da0 0x55ef2a934700 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a52d9f0 0x55ef2a922ad0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a56f070 0x55ef2a922590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/3820420637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a922050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 >> 172.21.15.37:0/3820420637 conn(0x55ef2a563460 msgr2=0x55ef2a919d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.364+0000 7f4b19ffb640 0 client.26246 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:24:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.365+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 shutdown_connections 2024-09-21T01:24:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.366+0000 7f4b3ea35740 1 -- 172.21.15.37:0/3820420637 wait complete. 2024-09-21T01:24:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.368+0000 7f4b3ea35740 20 client.26246 trim_cache size 0 max 16384 2024-09-21T01:24:55.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.405+0000 7f4b3ea35740 1 Processor -- start 2024-09-21T01:24:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.411+0000 7f4b3ea35740 1 -- start start 2024-09-21T01:24:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.412+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 0x55ef2a914780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.413+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a91f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.413+0000 7f4b3625d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 0x55ef2a914780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.413+0000 7f4b3625d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 0x55ef2a914780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49932/0 (socket says 172.21.15.37:49932) 2024-09-21T01:24:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.414+0000 7f4b3625d640 1 -- 172.21.15.37:0/587713052 learned_addr learned my addr 172.21.15.37:0/587713052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.414+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a91f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.414+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a91f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.415+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b5840 con 0x55ef2a52d9f0 2024-09-21T01:24:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.415+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b7380 con 0x55ef2a56f070 2024-09-21T01:24:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.415+0000 7f4b36a5e640 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a91f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.415+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b5f10 con 0x55ef2a54e390 2024-09-21T01:24:55.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.417+0000 7f4b3625d640 1 -- 172.21.15.37:0/587713052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 msgr2=0x55ef2a91f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.417+0000 7f4b3625d640 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a91f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.417+0000 7f4b3625d640 1 -- 172.21.15.37:0/587713052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 msgr2=0x55ef2a91f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.417+0000 7f4b3625d640 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a91f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.417+0000 7f4b3625d640 1 -- 172.21.15.37:0/587713052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2a8ef650 con 0x55ef2a52d9f0 2024-09-21T01:24:55.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.419+0000 7f4b3625d640 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 0x55ef2a914780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c000c00 tx=0x7f4b2c0ed0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7800ad2109066b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:55.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.420+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/587713052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0e1a40 con 0x55ef2a52d9f0 2024-09-21T01:24:55.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.420+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/587713052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c03fec0 con 0x55ef2a52d9f0 2024-09-21T01:24:55.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.422+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 msgr2=0x55ef2a914780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.422+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 0x55ef2a914780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c000c00 tx=0x7f4b2c0ed0d0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.423+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 shutdown_connections 2024-09-21T01:24:55.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.423+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a56f070 0x55ef2a91f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.423+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a54e390 0x55ef2a91f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.423+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/587713052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a52d9f0 0x55ef2a914780 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.423+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 >> 172.21.15.37:0/587713052 conn(0x55ef2a563460 msgr2=0x55ef2a914070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:55.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.425+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 shutdown_connections 2024-09-21T01:24:55.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.425+0000 7f4b3ea35740 1 -- 172.21.15.37:0/587713052 wait complete. 2024-09-21T01:24:55.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.426+0000 7f4b3ea35740 1 -- start start 2024-09-21T01:24:55.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.426+0000 7f4b3ea35740 1 Processor -- start 2024-09-21T01:24:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a54e390 0x55ef2a913430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a56f070 0x55ef2a913970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a913eb0 0x55ef2a929590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b6cb0 con 0x55ef2a54e390 2024-09-21T01:24:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b65e0 con 0x55ef2a913eb0 2024-09-21T01:24:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b3800 con 0x55ef2a56f070 2024-09-21T01:24:55.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.427+0000 7f4b3ea35740 10 client.0 _ll_register_callbacks cb 0x7f4b28016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:55.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.429+0000 7f4b36a5e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a913eb0 0x55ef2a929590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.429+0000 7f4b35a5c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a56f070 0x55ef2a913970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.429+0000 7f4b36a5e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a913eb0 0x55ef2a929590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50706/0 (socket says 172.21.15.37:50706) 2024-09-21T01:24:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.429+0000 7f4b36a5e640 1 -- 172.21.15.37:0/4098496453 learned_addr learned my addr 172.21.15.37:0/4098496453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.430+0000 7f4b3625d640 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a54e390 0x55ef2a913430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.430+0000 7f4b35a5c640 1 -- 172.21.15.37:0/4098496453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a913eb0 msgr2=0x55ef2a929590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.430+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a913eb0 0x55ef2a929590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.430+0000 7f4b35a5c640 1 -- 172.21.15.37:0/4098496453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a54e390 msgr2=0x55ef2a913430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.430+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a54e390 0x55ef2a913430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.430+0000 7f4b35a5c640 1 -- 172.21.15.37:0/4098496453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2a929b00 con 0x55ef2a56f070 2024-09-21T01:24:55.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.431+0000 7f4b35a5c640 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a56f070 0x55ef2a913970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b20013010 tx=0x7f4b20004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d9285fb8714584 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:55.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.434+0000 7f4b197fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:24:55.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.434+0000 7f4b197fa640 1 -- 172.21.15.37:0/4098496453 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002f060 con 0x55ef2a56f070 2024-09-21T01:24:55.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.435+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef2a887cd0 con 0x55ef2a56f070 2024-09-21T01:24:55.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.435+0000 7f4b197fa640 1 -- 172.21.15.37:0/4098496453 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f4b20003e00 con 0x55ef2a56f070 2024-09-21T01:24:55.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.437+0000 7f4b197fa640 1 -- 172.21.15.37:0/4098496453 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4b2001f430 con 0x55ef2a56f070 2024-09-21T01:24:55.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.443+0000 7f4b3ea35740 10 client.26239 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:55.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.443+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ef2a92ae50 con 0x55ef2a56f070 2024-09-21T01:24:55.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b197fa640 1 -- 172.21.15.37:0/4098496453 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ef2a887cd0 con 0x55ef2a56f070 2024-09-21T01:24:55.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b197fa640 1 -- 172.21.15.37:0/4098496453 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4b20034070 con 0x55ef2a56f070 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b3ea35740 10 client.26239 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b3ea35740 10 client.26239 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b3ea35740 20 client.26239 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a99f190 0x55ef2a9a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b3ea35740 4 client.26239 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.446+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef2a7fdaa0 con 0x55ef2a99f190 2024-09-21T01:24:55.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.447+0000 7f4b3625d640 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a99f190 0x55ef2a9a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:55.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.448+0000 7f4b3625d640 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a99f190 0x55ef2a9a15b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dde1aa0e9d44496c server_cookie=eb3a7a516b82d37b in_seq=0 out_seq=0 2024-09-21T01:24:55.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.449+0000 7f4b197fa640 10 client.26239 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:24:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.451+0000 7f4b197fa640 1 -- 172.21.15.37:0/4098496453 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef2a7fdaa0 con 0x55ef2a99f190 2024-09-21T01:24:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.451+0000 7f4b197fa640 10 client.26239 handle_command_reply: tid=0 2024-09-21T01:24:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.451+0000 7f4b3ea35740 1 client.26239 shutdown 2024-09-21T01:24:55.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.453+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a56f070 msgr2=0x55ef2a913970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.453+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a56f070 0x55ef2a913970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b20013010 tx=0x7f4b20004730 comp rx=0 tx=0).stop 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 shutdown_connections 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x55ef2a99f190 0x55ef2a9a15b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ef2a913eb0 0x55ef2a929590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ef2a56f070 0x55ef2a913970 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 --2- 172.21.15.37:0/4098496453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef2a54e390 0x55ef2a913430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 >> 172.21.15.37:0/4098496453 conn(0x55ef2a563460 msgr2=0x55ef2a92dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b197fa640 0 client.26239 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:24:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 shutdown_connections 2024-09-21T01:24:55.457 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:24:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.454+0000 7f4b3ea35740 1 -- 172.21.15.37:0/4098496453 wait complete. 2024-09-21T01:24:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.455+0000 7f4b3ea35740 20 client.26239 trim_cache size 0 max 16384 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.456+0000 7f4b2559b640 1 -- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b1c0b6660 msgr2=0x7f4b1c0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.456+0000 7f4b2559b640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b1c0b6660 0x7f4b1c0b8b70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b30116750 tx=0x7f4b20005f90 comp rx=0 tx=0).stop 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 -- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b300757b0 msgr2=0x7f4b30072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b300757b0 0x7f4b30072660 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c006010 tx=0x7f4b2c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 -- 172.21.15.37:0/1469530136 shutdown_connections 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f4b1c0b6660 0x7f4b1c0b8b70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b30114720 0x7f4b300730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b30076100 0x7f4b30072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 --2- 172.21.15.37:0/1469530136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b300757b0 0x7f4b30072660 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 -- 172.21.15.37:0/1469530136 >> 172.21.15.37:0/1469530136 conn(0x7f4b300ff4a0 msgr2=0x7f4b30101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.457+0000 7f4b2559b640 1 -- 172.21.15.37:0/1469530136 shutdown_connections 2024-09-21T01:24:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:24:55.459+0000 7f4b2559b640 1 -- 172.21.15.37:0/1469530136 wait complete. 2024-09-21T01:24:56.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:56 smithi037 ceph-mon[31105]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 938 MiB/s wr, 1.93k op/s 2024-09-21T01:24:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:56 smithi137 ceph-mon[34607]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 938 MiB/s wr, 1.93k op/s 2024-09-21T01:24:56.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:56 smithi144 ceph-mon[34818]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 938 MiB/s wr, 1.93k op/s 2024-09-21T01:24:58.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:24:58.757 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:24:58 smithi037 ceph-mon[31105]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 755 MiB/s wr, 1.65k op/s 2024-09-21T01:24:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:24:58 smithi137 ceph-mon[34607]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 755 MiB/s wr, 1.65k op/s 2024-09-21T01:24:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:24:58 smithi144 ceph-mon[34818]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 755 MiB/s wr, 1.65k op/s 2024-09-21T01:24:59.048 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:24:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 -- 172.21.15.37:0/3742676025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1058d0 msgr2=0x7f902c105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 --2- 172.21.15.37:0/3742676025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1058d0 0x7f902c105d40 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9020009900 tx=0x7f902002a410 comp rx=0 tx=0).stop 2024-09-21T01:24:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 -- 172.21.15.37:0/3742676025 shutdown_connections 2024-09-21T01:24:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 --2- 172.21.15.37:0/3742676025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902c1072f0 0x7f902c10dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 --2- 172.21.15.37:0/3742676025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f902c106950 0x7f902c106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 --2- 172.21.15.37:0/3742676025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1058d0 0x7f902c105d40 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 -- 172.21.15.37:0/3742676025 >> 172.21.15.37:0/3742676025 conn(0x7f902c1011f0 msgr2=0x7f902c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 -- 172.21.15.37:0/3742676025 shutdown_connections 2024-09-21T01:24:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.863+0000 7f90315a8640 1 -- 172.21.15.37:0/3742676025 wait complete. 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.864+0000 7f90315a8640 1 Processor -- start 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 -- start start 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f902c1058d0 0x7f902c113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 0x7f902c113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902c1072f0 0x7f902c114340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f902c078cb0 con 0x7f902c106950 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f902c078b30 con 0x7f902c1072f0 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f90315a8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f902c078e30 con 0x7f902c1058d0 2024-09-21T01:24:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f902a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 0x7f902c113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f902a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 0x7f902c113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45584/0 (socket says 172.21.15.37:45584) 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.865+0000 7f902a7fc640 1 -- 172.21.15.37:0/1544749295 learned_addr learned my addr 172.21.15.37:0/1544749295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902b7fe640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902c1072f0 0x7f902c114340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902a7fc640 1 -- 172.21.15.37:0/1544749295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f902c1058d0 msgr2=0x7f902c113120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902a7fc640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f902c1058d0 0x7f902c113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902a7fc640 1 -- 172.21.15.37:0/1544749295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902c1072f0 msgr2=0x7f902c114340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902a7fc640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902c1072f0 0x7f902c114340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902a7fc640 1 -- 172.21.15.37:0/1544749295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c114b60 con 0x7f902c106950 2024-09-21T01:24:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.866+0000 7f902a7fc640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 0x7f902c113790 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f901c00d980 tx=0x7f901c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.868+0000 7f9013fff640 1 -- 172.21.15.37:0/1544749295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c017070 con 0x7f902c106950 2024-09-21T01:24:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.868+0000 7f9013fff640 1 -- 172.21.15.37:0/1544749295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f901c009cf0 con 0x7f902c106950 2024-09-21T01:24:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.868+0000 7f9013fff640 1 -- 172.21.15.37:0/1544749295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c010460 con 0x7f902c106950 2024-09-21T01:24:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.868+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c114e50 con 0x7f902c106950 2024-09-21T01:24:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.868+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c117520 con 0x7f902c106950 2024-09-21T01:24:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.874+0000 7f90385f1740 1 Processor -- start 2024-09-21T01:24:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.874+0000 7f90385f1740 1 -- start start 2024-09-21T01:24:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.875+0000 7f90385f1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.875+0000 7f90385f1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd12152f0 0x563dd15e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.875+0000 7f90385f1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd121d4d0 0x563dd15e7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.876+0000 7f90385f1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563dd15586f0 con 0x563dd123e1b0 2024-09-21T01:24:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.876+0000 7f90385f1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563dd1547b20 con 0x563dd121d4d0 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.876+0000 7f90385f1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563dd154b930 con 0x563dd12152f0 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.876+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.876+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15e5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45588/0 (socket says 172.21.15.37:45588) 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.876+0000 7f902b7fe640 1 -- 172.21.15.37:0/2281609334 learned_addr learned my addr 172.21.15.37:0/2281609334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.877+0000 7f902b7fe640 1 -- 172.21.15.37:0/2281609334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd12152f0 msgr2=0x563dd15e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.877+0000 7f902b7fe640 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd12152f0 0x563dd15e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.877+0000 7f902b7fe640 1 -- 172.21.15.37:0/2281609334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd121d4d0 msgr2=0x563dd15e7010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:24:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.877+0000 7f902b7fe640 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd121d4d0 0x563dd15e7010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.877+0000 7f902b7fe640 1 -- 172.21.15.37:0/2281609334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd150d530 con 0x563dd123e1b0 2024-09-21T01:24:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.877+0000 7f902b7fe640 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15e5e50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9024009f20 tx=0x7f902400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20340e38f253aa29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.878+0000 7f9013fff640 1 -- 172.21.15.37:0/1544749295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f901c004ee0 con 0x7f902c106950 2024-09-21T01:24:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.878+0000 7f90117fa640 1 -- 172.21.15.37:0/2281609334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902401a070 con 0x563dd123e1b0 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.878+0000 7f90117fa640 1 -- 172.21.15.37:0/2281609334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90240158c0 con 0x563dd123e1b0 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.878+0000 7f90117fa640 1 -- 172.21.15.37:0/2281609334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902400a960 con 0x563dd123e1b0 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 -- 172.21.15.37:0/2281609334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 msgr2=0x563dd15e5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15e5e50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9024009f20 tx=0x7f902400c8b0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 -- 172.21.15.37:0/2281609334 shutdown_connections 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd121d4d0 0x563dd15e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd12152f0 0x563dd15e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 --2- 172.21.15.37:0/2281609334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15e5e50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.880+0000 7f90385f1740 1 -- 172.21.15.37:0/2281609334 >> 172.21.15.37:0/2281609334 conn(0x563dd1232300 msgr2=0x563dd15e18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.881+0000 7f9013fff640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90140b66e0 0x7f90140b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.881+0000 7f9013fff640 1 -- 172.21.15.37:0/1544749295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f901c0e6fd0 con 0x7f902c106950 2024-09-21T01:24:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.881+0000 7f902affd640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90140b66e0 0x7f90140b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.883+0000 7f90385f1740 1 -- 172.21.15.37:0/2281609334 shutdown_connections 2024-09-21T01:24:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.883+0000 7f90385f1740 1 -- 172.21.15.37:0/2281609334 wait complete. 2024-09-21T01:24:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.885+0000 7f90385f1740 1 -- start start 2024-09-21T01:24:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.885+0000 7f90385f1740 1 Processor -- start 2024-09-21T01:24:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15efd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563dd147fab0 con 0x563dd121d4d0 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563dd14ed730 con 0x563dd12152f0 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563dd15e7b30 con 0x563dd123e1b0 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f90385f1740 10 client.0 _ll_register_callbacks cb 0x563dd15416b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f902affd640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90140b66e0 0x7f90140b8bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f90200096c0 tx=0x7f9020000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f902a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f902a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45602/0 (socket says 172.21.15.37:45602) 2024-09-21T01:24:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.886+0000 7f902a7fc640 1 -- 172.21.15.37:0/3545555471 learned_addr learned my addr 172.21.15.37:0/3545555471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:24:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.887+0000 7f902affd640 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.887+0000 7f902a7fc640 1 -- 172.21.15.37:0/3545555471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 msgr2=0x563dd15f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.887+0000 7f902a7fc640 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.887+0000 7f902a7fc640 1 -- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 msgr2=0x563dd15ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:24:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.887+0000 7f902a7fc640 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15ef6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.887+0000 7f902a7fc640 1 -- 172.21.15.37:0/3545555471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd12a9790 con 0x563dd121d4d0 2024-09-21T01:24:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.888+0000 7f902a7fc640 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15efd80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f901c0ad0b0 tx=0x7f901c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6895ac86d3dc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:24:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.888+0000 7f900eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:24:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.888+0000 7f900eff5640 1 -- 172.21.15.37:0/3545555471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c020040 con 0x563dd121d4d0 2024-09-21T01:24:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.888+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90240158c0 con 0x563dd121d4d0 2024-09-21T01:24:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.889+0000 7f900eff5640 1 -- 172.21.15.37:0/3545555471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f901c0ac580 con 0x563dd121d4d0 2024-09-21T01:24:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.889+0000 7f900eff5640 1 -- 172.21.15.37:0/3545555471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f901c0b1c00 con 0x563dd121d4d0 2024-09-21T01:24:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.890+0000 7f90385f1740 10 client.16866 fetch_fsmap learned FSMap version 30 2024-09-21T01:24:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.890+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563dd1322620 con 0x563dd121d4d0 2024-09-21T01:24:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.892+0000 7f900eff5640 1 -- 172.21.15.37:0/3545555471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90240158c0 con 0x563dd121d4d0 2024-09-21T01:24:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.893+0000 7f900eff5640 1 -- 172.21.15.37:0/3545555471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f901c0d0aa0 con 0x563dd121d4d0 2024-09-21T01:24:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.893+0000 7f90385f1740 10 client.16866 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:24:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.893+0000 7f90385f1740 10 client.16866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:24:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.893+0000 7f90385f1740 20 client.16866 populate_metadata read hostname 'smithi037' 2024-09-21T01:24:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.894+0000 7f90385f1740 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11fcd80 0x563dd15fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.894+0000 7f90385f1740 4 client.16866 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:24:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.894+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dd155a640 con 0x563dd11fcd80 2024-09-21T01:24:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.899+0000 7f902affd640 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11fcd80 0x563dd15fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.932+0000 7f902affd640 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11fcd80 0x563dd15fcda0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=929d3e4a585682f8 server_cookie=1a655f5a0118fabe in_seq=0 out_seq=0 2024-09-21T01:24:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.933+0000 7f900eff5640 10 client.16866 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.939+0000 7f900eff5640 1 -- 172.21.15.37:0/3545555471 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563dd155a640 con 0x563dd11fcd80 2024-09-21T01:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.939+0000 7f900eff5640 10 client.16866 handle_command_reply: tid=0 2024-09-21T01:24:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.939+0000 7f90385f1740 1 client.16866 shutdown 2024-09-21T01:24:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.947+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 msgr2=0x563dd15efd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:24:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.947+0000 7f90385f1740 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15efd80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f901c0ad0b0 tx=0x7f901c0048f0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.948+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 shutdown_connections 2024-09-21T01:24:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.949+0000 7f90385f1740 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11fcd80 0x563dd15fcda0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.949+0000 7f90385f1740 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.949+0000 7f90385f1740 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15efd80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.949+0000 7f90385f1740 1 --2- 172.21.15.37:0/3545555471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:24:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.949+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 >> 172.21.15.37:0/3545555471 conn(0x563dd1232300 msgr2=0x563dd15dfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:24:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.951+0000 7f900eff5640 0 client.16866 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:24:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.951+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 shutdown_connections 2024-09-21T01:24:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.951+0000 7f90385f1740 1 -- 172.21.15.37:0/3545555471 wait complete. 2024-09-21T01:24:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.955+0000 7f90385f1740 20 client.16866 trim_cache size 0 max 16384 2024-09-21T01:24:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.994+0000 7f90385f1740 1 Processor -- start 2024-09-21T01:24:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.995+0000 7f90385f1740 1 -- start start 2024-09-21T01:24:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.995+0000 7f90385f1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.995+0000 7f90385f1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.995+0000 7f90385f1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:24:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.996+0000 7f90385f1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1b9eb0 con 0x563dd121d4d0 2024-09-21T01:24:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.996+0000 7f90385f1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1bb9f0 con 0x563dd12152f0 2024-09-21T01:24:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.996+0000 7f90385f1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1ba580 con 0x563dd123e1b0 2024-09-21T01:24:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.997+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:24:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.997+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15edfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43532/0 (socket says 172.21.15.37:43532) 2024-09-21T01:24:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.997+0000 7f902b7fe640 1 -- 172.21.15.37:0/3776353916 learned_addr learned my addr 172.21.15.37:0/3776353916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:24:59.998+0000 7f902affd640 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.001+0000 7f902a7fc640 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.001+0000 7f902b7fe640 1 -- 172.21.15.37:0/3776353916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 msgr2=0x563dd15dc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.001+0000 7f902b7fe640 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15dc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.001+0000 7f902b7fe640 1 -- 172.21.15.37:0/3776353916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 msgr2=0x563dd15f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.001+0000 7f902b7fe640 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.001+0000 7f902b7fe640 1 -- 172.21.15.37:0/3776353916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd15f05e0 con 0x563dd123e1b0 2024-09-21T01:25:00.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.010+0000 7f902b7fe640 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15edfc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f902400a010 tx=0x7f9024009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32e307f4e2db648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.014+0000 7f9010ff9640 1 -- 172.21.15.37:0/3776353916 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902401a040 con 0x563dd123e1b0 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.014+0000 7f9010ff9640 1 -- 172.21.15.37:0/3776353916 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9024023070 con 0x563dd123e1b0 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.014+0000 7f9010ff9640 1 -- 172.21.15.37:0/3776353916 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024015720 con 0x563dd123e1b0 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.016+0000 7f90385f1740 1 -- 172.21.15.37:0/3776353916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 msgr2=0x563dd15edfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.016+0000 7f90385f1740 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15edfc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f902400a010 tx=0x7f9024009550 comp rx=0 tx=0).stop 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.018+0000 7f90385f1740 1 -- 172.21.15.37:0/3776353916 shutdown_connections 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.018+0000 7f90385f1740 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd123e1b0 0x563dd15edfc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.018+0000 7f90385f1740 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd121d4d0 0x563dd15f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.018+0000 7f90385f1740 1 --2- 172.21.15.37:0/3776353916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15dc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.018+0000 7f90385f1740 1 -- 172.21.15.37:0/3776353916 >> 172.21.15.37:0/3776353916 conn(0x563dd1232300 msgr2=0x563dd15e2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.024+0000 7f90385f1740 1 -- 172.21.15.37:0/3776353916 shutdown_connections 2024-09-21T01:25:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.030+0000 7f90385f1740 1 -- 172.21.15.37:0/3776353916 wait complete. 2024-09-21T01:25:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.031+0000 7f90385f1740 1 -- start start 2024-09-21T01:25:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.031+0000 7f90385f1740 1 Processor -- start 2024-09-21T01:25:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.031+0000 7f90385f1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.032+0000 7f90385f1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd121d4d0 0x563dd15f3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.032+0000 7f90385f1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15f7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.032+0000 7f90385f1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1bb320 con 0x563dd123e1b0 2024-09-21T01:25:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.032+0000 7f90385f1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1bac50 con 0x563dd12152f0 2024-09-21T01:25:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.032+0000 7f90385f1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1b7e70 con 0x563dd121d4d0 2024-09-21T01:25:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.032+0000 7f90385f1740 10 client.0 _ll_register_callbacks cb 0x7f901c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.035+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.035+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45620/0 (socket says 172.21.15.37:45620) 2024-09-21T01:25:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.035+0000 7f902b7fe640 1 -- 172.21.15.37:0/761050122 learned_addr learned my addr 172.21.15.37:0/761050122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.035+0000 7f902a7fc640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd121d4d0 0x563dd15f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.038+0000 7f902affd640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.043+0000 7f902b7fe640 1 -- 172.21.15.37:0/761050122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd121d4d0 msgr2=0x563dd15f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.043+0000 7f902b7fe640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd121d4d0 0x563dd15f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.043+0000 7f902b7fe640 1 -- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 msgr2=0x563dd15f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.043+0000 7f902b7fe640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.043+0000 7f902b7fe640 1 -- 172.21.15.37:0/761050122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd15f7790 con 0x563dd123e1b0 2024-09-21T01:25:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.053+0000 7f902b7fe640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15f7030 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f902400c8f0 tx=0x7f902401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c324c0583728151 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.053+0000 7f900eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.061+0000 7f900eff5640 1 -- 172.21.15.37:0/761050122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902401a040 con 0x563dd123e1b0 2024-09-21T01:25:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.061+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9024023070 con 0x563dd123e1b0 2024-09-21T01:25:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.061+0000 7f900eff5640 1 -- 172.21.15.37:0/761050122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f9024015690 con 0x563dd123e1b0 2024-09-21T01:25:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.067+0000 7f900eff5640 1 -- 172.21.15.37:0/761050122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9024009390 con 0x563dd123e1b0 2024-09-21T01:25:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.072+0000 7f90385f1740 10 client.16872 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.072+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563dd15f4c10 con 0x563dd123e1b0 2024-09-21T01:25:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f900eff5640 1 -- 172.21.15.37:0/761050122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9024023070 con 0x563dd123e1b0 2024-09-21T01:25:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f900eff5640 1 -- 172.21.15.37:0/761050122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f902401d070 con 0x563dd123e1b0 2024-09-21T01:25:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f90385f1740 10 client.16872 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f90385f1740 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f90385f1740 20 client.16872 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f90385f1740 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11d21c0 0x563dd167ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f90385f1740 4 client.16872 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:25:00.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.077+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563dd15560f0 con 0x563dd11d21c0 2024-09-21T01:25:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.083+0000 7f902affd640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11d21c0 0x563dd167ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.099+0000 7f902affd640 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11d21c0 0x563dd167ada0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7939d2ea21a6bbe1 server_cookie=e9a209c673db28aa in_seq=0 out_seq=0 2024-09-21T01:25:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:00.099+0000 7f900eff5640 10 client.16872 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:00.818 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:00 smithi037 ceph-mon[31105]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 953 MiB/s wr, 2.08k op/s 2024-09-21T01:25:00.826 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:25:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.241+0000 7f41f359e640 1 -- 172.21.15.37:0/1935581064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 msgr2=0x7f41f410e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.241+0000 7f41f359e640 1 --2- 172.21.15.37:0/1935581064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f410e000 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009900 tx=0x7f41e802a440 comp rx=0 tx=0).stop 2024-09-21T01:25:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.242+0000 7f41f359e640 1 -- 172.21.15.37:0/1935581064 shutdown_connections 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.242+0000 7f41f359e640 1 --2- 172.21.15.37:0/1935581064 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 0x7f41f411efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.242+0000 7f41f359e640 1 --2- 172.21.15.37:0/1935581064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f410e000 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.242+0000 7f41f359e640 1 --2- 172.21.15.37:0/1935581064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41f4111cd0 0x7f41f410d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.242+0000 7f41f359e640 1 -- 172.21.15.37:0/1935581064 >> 172.21.15.37:0/1935581064 conn(0x7f41f406e9f0 msgr2=0x7f41f406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.243+0000 7f41f359e640 1 -- 172.21.15.37:0/1935581064 shutdown_connections 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.243+0000 7f41f359e640 1 -- 172.21.15.37:0/1935581064 wait complete. 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.245+0000 7f41f359e640 1 Processor -- start 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.245+0000 7f41f359e640 1 -- start start 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.246+0000 7f41f359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f41a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.246+0000 7f41f359e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41f4111cd0 0x7f41f41a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.247+0000 7f41f359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 0x7f41f41ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.247+0000 7f41f359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41226d0 con 0x7f41f410dbf0 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.247+0000 7f41f359e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4122550 con 0x7f41f411cba0 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.247+0000 7f41f359e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4122850 con 0x7f41f4111cd0 2024-09-21T01:25:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.248+0000 7f41f2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 0x7f41f41ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.248+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f41a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.248+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f41a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45638/0 (socket says 172.21.15.37:45638) 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.248+0000 7f41f259c640 1 -- 172.21.15.37:0/449013011 learned_addr learned my addr 172.21.15.37:0/449013011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.248+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41f4111cd0 0x7f41f41a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.249+0000 7f41f2d9d640 1 -- 172.21.15.37:0/449013011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41f4111cd0 msgr2=0x7f41f41a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.249+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41f4111cd0 0x7f41f41a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.249+0000 7f41f2d9d640 1 -- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 msgr2=0x7f41f41a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.249+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f41a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.249+0000 7f41f2d9d640 1 -- 172.21.15.37:0/449013011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f41af070 con 0x7f41f411cba0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.250+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 0x7f41f41ae940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009fd0 tx=0x7f41ec00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.250+0000 7f41e37fe640 1 -- 172.21.15.37:0/449013011 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec00ce20 con 0x7f41f411cba0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.251+0000 7f41f359e640 1 -- 172.21.15.37:0/449013011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f41af360 con 0x7f41f411cba0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.251+0000 7f41e37fe640 1 -- 172.21.15.37:0/449013011 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41ec005020 con 0x7f41f411cba0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.251+0000 7f41f359e640 1 -- 172.21.15.37:0/449013011 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f41b5ac0 con 0x7f41f411cba0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.251+0000 7f41e37fe640 1 -- 172.21.15.37:0/449013011 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec010690 con 0x7f41f411cba0 2024-09-21T01:25:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.256+0000 7f41ff481740 1 Processor -- start 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.257+0000 7f41ff481740 1 -- start start 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.258+0000 7f41ff481740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9bad070 0x5556f9f54b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.258+0000 7f41ff481740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 0x5556f9f55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.258+0000 7f41ff481740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9b8c390 0x5556f9f555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.258+0000 7f41ff481740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5556f9ecaea0 con 0x5556f9bad070 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.258+0000 7f41ff481740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5556f9eba2d0 con 0x5556f9b841b0 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.258+0000 7f41ff481740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5556f9ebe0e0 con 0x5556f9b8c390 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.261+0000 7f41f259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 0x5556f9f55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.262+0000 7f41f259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 0x5556f9f55090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:48860/0 (socket says 172.21.15.37:48860) 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.262+0000 7f41f259c640 1 -- 172.21.15.37:0/1274761574 learned_addr learned my addr 172.21.15.37:0/1274761574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.262+0000 7f41e37fe640 1 -- 172.21.15.37:0/449013011 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f41ec0054d0 con 0x7f41f411cba0 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.263+0000 7f41f259c640 1 -- 172.21.15.37:0/1274761574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9b8c390 msgr2=0x5556f9f555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.263+0000 7f41f259c640 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9b8c390 0x5556f9f555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.264+0000 7f41f259c640 1 -- 172.21.15.37:0/1274761574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9bad070 msgr2=0x5556f9f54b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.264+0000 7f41f259c640 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9bad070 0x5556f9f54b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.264+0000 7f41f259c640 1 -- 172.21.15.37:0/1274761574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f9c18650 con 0x5556f9b841b0 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.265+0000 7f41f259c640 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 0x5556f9f55090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009d60 tx=0x7f41e4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb30c920131ac73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.266+0000 7f41e37fe640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41dc0b6650 0x7f41dc0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.267+0000 7f41e37fe640 1 -- 172.21.15.37:0/449013011 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f41ec0e7a50 con 0x7f41f411cba0 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.267+0000 7f41dbfff640 1 -- 172.21.15.37:0/1274761574 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4004230 con 0x5556f9b841b0 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.267+0000 7f41dbfff640 1 -- 172.21.15.37:0/1274761574 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e40043d0 con 0x5556f9b841b0 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.269+0000 7f41ff481740 1 -- 172.21.15.37:0/1274761574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 msgr2=0x5556f9f55090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.269+0000 7f41ff481740 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 0x5556f9f55090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009d60 tx=0x7f41e4011810 comp rx=0 tx=0).stop 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.270+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41dc0b6650 0x7f41dc0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.270+0000 7f41ff481740 1 -- 172.21.15.37:0/1274761574 shutdown_connections 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.270+0000 7f41ff481740 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9b8c390 0x5556f9f555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.270+0000 7f41ff481740 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b841b0 0x5556f9f55090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.270+0000 7f41ff481740 1 --2- 172.21.15.37:0/1274761574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9bad070 0x5556f9f54b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.270+0000 7f41ff481740 1 -- 172.21.15.37:0/1274761574 >> 172.21.15.37:0/1274761574 conn(0x5556f9ba1460 msgr2=0x5556f9f52a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.271+0000 7f41ff481740 1 -- 172.21.15.37:0/1274761574 shutdown_connections 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.271+0000 7f41ff481740 1 -- 172.21.15.37:0/1274761574 wait complete. 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.272+0000 7f41ff481740 1 -- start start 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.272+0000 7f41ff481740 1 Processor -- start 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f60a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5556f9d1b700 con 0x5556f9b841b0 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5556f9e55160 con 0x5556f9b8c390 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5556f9f632a0 con 0x5556f9bad070 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.273+0000 7f41ff481740 10 client.0 _ll_register_callbacks cb 0x5556f9e6e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.274+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41dc0b6650 0x7f41dc0b8b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006010 tx=0x7f41e8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.275+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.275+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f5ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45660/0 (socket says 172.21.15.37:45660) 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.275+0000 7f41f259c640 1 -- 172.21.15.37:0/1461206295 learned_addr learned my addr 172.21.15.37:0/1461206295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.275+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f60a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.275+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.276+0000 7f41f2d9d640 1 -- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 msgr2=0x5556f9f604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.276+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.276+0000 7f41f2d9d640 1 -- 172.21.15.37:0/1461206295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 msgr2=0x5556f9f5ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.276+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f5ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.276+0000 7f41f2d9d640 1 -- 172.21.15.37:0/1461206295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f9e82c90 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.277+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f60a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0aae10 tx=0x7f41ec0a9310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44cc61d8f927a0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.279+0000 7f41d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.281+0000 7f41d9ffb640 1 -- 172.21.15.37:0/1461206295 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0cfdb0 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.281+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41e40043d0 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.281+0000 7f41d9ffb640 1 -- 172.21.15.37:0/1461206295 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f41ec0ace00 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.283+0000 7f41d9ffb640 1 -- 172.21.15.37:0/1461206295 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f41ec0ae2a0 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.284+0000 7f41ff481740 10 client.26257 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.284+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5556f9f6ede0 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.288+0000 7f41d9ffb640 1 -- 172.21.15.37:0/1461206295 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e40043d0 con 0x5556f9bad070 2024-09-21T01:25:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.288+0000 7f41d9ffb640 1 -- 172.21.15.37:0/1461206295 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f41ec0b20f0 con 0x5556f9bad070 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.295+0000 7f41ff481740 10 client.26257 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.295+0000 7f41ff481740 10 client.26257 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.295+0000 7f41ff481740 20 client.26257 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.295+0000 7f41ff481740 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b6b9f0 0x5556f9f722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.295+0000 7f41ff481740 4 client.26257 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.295+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556f9eccdf0 con 0x5556f9b6b9f0 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.297+0000 7f41f259c640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b6b9f0 0x5556f9f722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.298+0000 7f41f259c640 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b6b9f0 0x5556f9f722b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=68a3142532747545 server_cookie=1b12d18ff4ada10c in_seq=0 out_seq=0 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.300+0000 7f41d9ffb640 10 client.26257 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.300+0000 7f41d9ffb640 1 -- 172.21.15.37:0/1461206295 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556f9eccdf0 con 0x5556f9b6b9f0 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.300+0000 7f41d9ffb640 10 client.26257 handle_command_reply: tid=0 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.300+0000 7f41ff481740 1 client.26257 shutdown 2024-09-21T01:25:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 msgr2=0x5556f9f60a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f60a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0aae10 tx=0x7f41ec0a9310 comp rx=0 tx=0).stop 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 shutdown_connections 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b6b9f0 0x5556f9f722b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f60a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 --2- 172.21.15.37:0/1461206295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f5ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41d9ffb640 0 client.26257 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 >> 172.21.15.37:0/1461206295 conn(0x5556f9ba1460 msgr2=0x5556f9f57d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 shutdown_connections 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.302+0000 7f41ff481740 1 -- 172.21.15.37:0/1461206295 wait complete. 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.303+0000 7f41ff481740 20 client.26257 trim_cache size 0 max 16384 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.357+0000 7f41ff481740 1 Processor -- start 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.358+0000 7f41ff481740 1 -- start start 2024-09-21T01:25:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.359+0000 7f41ff481740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f61e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.359+0000 7f41ff481740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f55b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.359+0000 7f41ff481740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f6c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.359+0000 7f41ff481740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41be230 con 0x5556f9b841b0 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.359+0000 7f41ff481740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41bfd70 con 0x5556f9b8c390 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.359+0000 7f41ff481740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41be900 con 0x5556f9bad070 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.360+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f61e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.360+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f61e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45662/0 (socket says 172.21.15.37:45662) 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.360+0000 7f41f259c640 1 -- 172.21.15.37:0/3229851023 learned_addr learned my addr 172.21.15.37:0/3229851023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.360+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f55b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.361+0000 7f41f1d9b640 1 -- 172.21.15.37:0/3229851023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 msgr2=0x5556f9f6c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.361+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f6c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.361+0000 7f41f1d9b640 1 -- 172.21.15.37:0/3229851023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 msgr2=0x5556f9f61e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.361+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f61e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.361+0000 7f41f1d9b640 1 -- 172.21.15.37:0/3229851023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f9e70890 con 0x5556f9b8c390 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.362+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f55b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009850 tx=0x7f41e803c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2412418bc82f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.363+0000 7f41db7fe640 1 -- 172.21.15.37:0/3229851023 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e804d070 con 0x5556f9b8c390 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.363+0000 7f41db7fe640 1 -- 172.21.15.37:0/3229851023 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e80054f0 con 0x5556f9b8c390 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.364+0000 7f41db7fe640 1 -- 172.21.15.37:0/3229851023 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8036040 con 0x5556f9b8c390 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.365+0000 7f41ff481740 1 -- 172.21.15.37:0/3229851023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 msgr2=0x5556f9f55b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.365+0000 7f41ff481740 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f55b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009850 tx=0x7f41e803c000 comp rx=0 tx=0).stop 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 -- 172.21.15.37:0/3229851023 shutdown_connections 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9f6c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f55b80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 --2- 172.21.15.37:0/3229851023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f61e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 -- 172.21.15.37:0/3229851023 >> 172.21.15.37:0/3229851023 conn(0x5556f9ba1460 msgr2=0x5556f9f5fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 -- 172.21.15.37:0/3229851023 shutdown_connections 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.368+0000 7f41ff481740 1 -- 172.21.15.37:0/3229851023 wait complete. 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.369+0000 7f41ff481740 1 -- start start 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.369+0000 7f41ff481740 1 Processor -- start 2024-09-21T01:25:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.370+0000 7f41ff481740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f64c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.371+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f64c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.371+0000 7f41f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f64c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45668/0 (socket says 172.21.15.37:45668) 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.371+0000 7f41f259c640 1 -- 172.21.15.37:0/3359124267 learned_addr learned my addr 172.21.15.37:0/3359124267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.372+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f65150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.372+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9fdbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.372+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41bf6a0 con 0x5556f9b841b0 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.373+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f65150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.373+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41befd0 con 0x5556f9b8c390 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.373+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41bc1f0 con 0x5556f9bad070 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.374+0000 7f41ff481740 10 client.0 _ll_register_callbacks cb 0x7f41ec0ad4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.374+0000 7f41f2d9d640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9fdbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.375+0000 7f41f259c640 1 -- 172.21.15.37:0/3359124267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 msgr2=0x5556f9fdbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.375+0000 7f41f259c640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9fdbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.375+0000 7f41f259c640 1 -- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 msgr2=0x5556f9f65150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.375+0000 7f41f259c640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f65150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.375+0000 7f41f259c640 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f9fdc1d0 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.376+0000 7f41f259c640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f64c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f41e4003f30 tx=0x7f41e4009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f4649856212bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.376+0000 7f41d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.377+0000 7f41d9ffb640 1 -- 172.21.15.37:0/3359124267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4005570 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.377+0000 7f41d9ffb640 1 -- 172.21.15.37:0/3359124267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f41e40198f0 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.377+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41e80054f0 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.377+0000 7f41d9ffb640 1 -- 172.21.15.37:0/3359124267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f41e403a050 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.377+0000 7f41ff481740 10 client.16887 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.378+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5556f9fdd430 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.379+0000 7f41d9ffb640 1 -- 172.21.15.37:0/3359124267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e402f030 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.380+0000 7f41d9ffb640 1 -- 172.21.15.37:0/3359124267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f41e4034420 con 0x5556f9b841b0 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.380+0000 7f41ff481740 10 client.16887 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.381+0000 7f41ff481740 10 client.16887 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.381+0000 7f41ff481740 20 client.16887 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.381+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b40da0 0x5556f9fdfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.381+0000 7f41ff481740 4 client.16887 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.381+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f41e80054f0 con 0x5556f9b40da0 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.381+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b40da0 0x5556f9fdfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.385+0000 7f41d9ffb640 10 client.16887 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.385+0000 7f41f1d9b640 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b40da0 0x5556f9fdfa90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=94883e17a72a5d31 server_cookie=71ba3a532bc4df in_seq=0 out_seq=0 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.385+0000 7f41d9ffb640 1 -- 172.21.15.37:0/3359124267 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f41e80054f0 con 0x5556f9b40da0 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41d9ffb640 10 client.16887 handle_command_reply: tid=0 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41ff481740 1 client.16887 shutdown 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 msgr2=0x5556f9f64c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f64c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f41e4003f30 tx=0x7f41e4009950 comp rx=0 tx=0).stop 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 shutdown_connections 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x5556f9b40da0 0x5556f9fdfa90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5556f9bad070 0x5556f9fdbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.386+0000 7f41d9ffb640 0 client.16887 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.387+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5556f9b8c390 0x5556f9f65150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.387+0000 7f41ff481740 1 --2- 172.21.15.37:0/3359124267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556f9b841b0 0x5556f9f64c10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.387+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 >> 172.21.15.37:0/3359124267 conn(0x5556f9ba1460 msgr2=0x5556f9f61450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.387+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 shutdown_connections 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.387+0000 7f41ff481740 1 -- 172.21.15.37:0/3359124267 wait complete. 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.387+0000 7f41ff481740 20 client.16887 trim_cache size 0 max 16384 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 -- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41dc0b6650 msgr2=0x7f41dc0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41dc0b6650 0x7f41dc0b8b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006010 tx=0x7f41e8005a20 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 -- 172.21.15.37:0/449013011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 msgr2=0x7f41f41ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 0x7f41f41ae940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009fd0 tx=0x7f41ec00ef10 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 -- 172.21.15.37:0/449013011 shutdown_connections 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f41dc0b6650 0x7f41dc0b8b60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41f411cba0 0x7f41f41ae940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41f4111cd0 0x7f41f41a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 --2- 172.21.15.37:0/449013011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41f410dbf0 0x7f41f41a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:00.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.389+0000 7f41e17fa640 1 -- 172.21.15.37:0/449013011 >> 172.21.15.37:0/449013011 conn(0x7f41f406e9f0 msgr2=0x7f41f4110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:00.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.390+0000 7f41e17fa640 1 -- 172.21.15.37:0/449013011 shutdown_connections 2024-09-21T01:25:00.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:00.390+0000 7f41e17fa640 1 -- 172.21.15.37:0/449013011 wait complete. 2024-09-21T01:25:00.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:00 smithi137 ceph-mon[34607]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 953 MiB/s wr, 2.08k op/s 2024-09-21T01:25:00.922 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:00 smithi144 ceph-mon[34818]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 953 MiB/s wr, 2.08k op/s 2024-09-21T01:25:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.555+0000 7f900eff5640 1 -- 172.21.15.37:0/761050122 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563dd15560f0 con 0x563dd11d21c0 2024-09-21T01:25:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.555+0000 7f900eff5640 10 client.16872 handle_command_reply: tid=0 2024-09-21T01:25:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.555+0000 7f90385f1740 1 client.16872 shutdown 2024-09-21T01:25:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.555+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 msgr2=0x563dd15f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.555+0000 7f90385f1740 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15f7030 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f902400c8f0 tx=0x7f902401eb40 comp rx=0 tx=0).stop 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 shutdown_connections 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x563dd11d21c0 0x563dd167ada0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dd123e1b0 0x563dd15f7030 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd121d4d0 0x563dd15f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 --2- 172.21.15.37:0/761050122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563dd12152f0 0x563dd15f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 >> 172.21.15.37:0/761050122 conn(0x563dd1232300 msgr2=0x563dd15e2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f900eff5640 0 client.16872 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 shutdown_connections 2024-09-21T01:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 1 -- 172.21.15.37:0/761050122 wait complete. 2024-09-21T01:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.556+0000 7f90385f1740 20 client.16872 trim_cache size 0 max 16384 2024-09-21T01:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.558+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90140b66e0 msgr2=0x7f90140b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.558+0000 7f90315a8640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90140b66e0 0x7f90140b8bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f90200096c0 tx=0x7f9020000bc0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.558+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 msgr2=0x7f902c113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.558+0000 7f90315a8640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 0x7f902c113790 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f901c00d980 tx=0x7f901c00de40 comp rx=0 tx=0).stop 2024-09-21T01:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 shutdown_connections 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90140b66e0 0x7f90140b8bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f902c1072f0 0x7f902c114340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c106950 0x7f902c113790 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 --2- 172.21.15.37:0/1544749295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f902c1058d0 0x7f902c113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 >> 172.21.15.37:0/1544749295 conn(0x7f902c1011f0 msgr2=0x7f902c107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 shutdown_connections 2024-09-21T01:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:02.560+0000 7f90315a8640 1 -- 172.21.15.37:0/1544749295 wait complete. 2024-09-21T01:25:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:02 smithi137 ceph-mon[34607]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 838 MiB/s wr, 1.61k op/s 2024-09-21T01:25:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:02 smithi144 ceph-mon[34818]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 838 MiB/s wr, 1.61k op/s 2024-09-21T01:25:02.985 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:02 smithi037 ceph-mon[31105]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 838 MiB/s wr, 1.61k op/s 2024-09-21T01:25:03.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:25:03.980 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:25:04.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:04 smithi037 ceph-mon[31105]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 823 MiB/s wr, 1.47k op/s 2024-09-21T01:25:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:04 smithi137 ceph-mon[34607]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 823 MiB/s wr, 1.47k op/s 2024-09-21T01:25:04.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:04 smithi144 ceph-mon[34818]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 823 MiB/s wr, 1.47k op/s 2024-09-21T01:25:06.103 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:25:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.560+0000 7f624d54c640 1 -- 172.21.15.37:0/1030196493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6248102a60 msgr2=0x7f6248102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.560+0000 7f624d54c640 1 --2- 172.21.15.37:0/1030196493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6248102a60 0x7f6248102e70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f623c009900 tx=0x7f623c02a410 comp rx=0 tx=0).stop 2024-09-21T01:25:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.567+0000 7f624d54c640 1 -- 172.21.15.37:0/1030196493 shutdown_connections 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.567+0000 7f624d54c640 1 --2- 172.21.15.37:0/1030196493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6248108cf0 0x7f624806ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.567+0000 7f624d54c640 1 --2- 172.21.15.37:0/1030196493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62481083a0 0x7f62481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.567+0000 7f624d54c640 1 --2- 172.21.15.37:0/1030196493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6248102a60 0x7f6248102e70 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.567+0000 7f624d54c640 1 -- 172.21.15.37:0/1030196493 >> 172.21.15.37:0/1030196493 conn(0x7f6248079730 msgr2=0x7f6248079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.570+0000 7f624d54c640 1 -- 172.21.15.37:0/1030196493 shutdown_connections 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.570+0000 7f624d54c640 1 -- 172.21.15.37:0/1030196493 wait complete. 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.571+0000 7f624d54c640 1 Processor -- start 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.572+0000 7f624d54c640 1 -- start start 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.572+0000 7f624d54c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6248102a60 0x7f624810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.572+0000 7f624d54c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 0x7f624810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.573+0000 7f624d54c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248108cf0 0x7f624810f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.573+0000 7f624d54c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f624810b060 con 0x7f62481083a0 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.573+0000 7f624d54c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f624810aee0 con 0x7f6248102a60 2024-09-21T01:25:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.573+0000 7f624d54c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f624810b1e0 con 0x7f6248108cf0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.573+0000 7f6246ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6248102a60 0x7f624810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.573+0000 7f62467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 0x7f624810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.574+0000 7f62467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 0x7f624810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42124/0 (socket says 172.21.15.37:42124) 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.574+0000 7f62467fc640 1 -- 172.21.15.37:0/990859850 learned_addr learned my addr 172.21.15.37:0/990859850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.574+0000 7f62477fe640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248108cf0 0x7f624810f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.575+0000 7f62467fc640 1 -- 172.21.15.37:0/990859850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248108cf0 msgr2=0x7f624810f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.575+0000 7f62467fc640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248108cf0 0x7f624810f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.575+0000 7f62467fc640 1 -- 172.21.15.37:0/990859850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6248102a60 msgr2=0x7f624810e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.575+0000 7f62467fc640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6248102a60 0x7f624810e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.575+0000 7f62467fc640 1 -- 172.21.15.37:0/990859850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62481a22a0 con 0x7f62481083a0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.577+0000 7f62467fc640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 0x7f624810eb30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f623800c970 tx=0x7f623800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.578+0000 7f622ffff640 1 -- 172.21.15.37:0/990859850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238007bb0 con 0x7f62481083a0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.578+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62481a2590 con 0x7f62481083a0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.578+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62481a2ad0 con 0x7f62481083a0 2024-09-21T01:25:06.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.578+0000 7f622ffff640 1 -- 172.21.15.37:0/990859850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6238007d50 con 0x7f62481083a0 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.578+0000 7f622ffff640 1 -- 172.21.15.37:0/990859850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623800f450 con 0x7f62481083a0 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.586+0000 7f622ffff640 1 -- 172.21.15.37:0/990859850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f623800f5f0 con 0x7f62481083a0 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.593+0000 7f6253ac0740 1 Processor -- start 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.593+0000 7f6253ac0740 1 -- start start 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c457070 0x55741c7fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c7fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f6253ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55741c774ea0 con 0x55741c42e1b0 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f62477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c457070 0x55741c7fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f62477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c457070 0x55741c7fe2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:57740/0 (socket says 172.21.15.37:57740) 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.595+0000 7f62477fe640 1 -- 172.21.15.37:0/1539020978 learned_addr learned my addr 172.21.15.37:0/1539020978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.596+0000 7f62467fc640 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.596+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55741c7642d0 con 0x55741c457070 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.596+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55741c7680e0 con 0x55741c436390 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.598+0000 7f622ffff640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f62300b6720 0x7f62300b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.598+0000 7f62467fc640 1 -- 172.21.15.37:0/1539020978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c457070 msgr2=0x55741c7fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.598+0000 7f62467fc640 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c457070 0x55741c7fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.598+0000 7f62467fc640 1 -- 172.21.15.37:0/1539020978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 msgr2=0x55741c7fe800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.598+0000 7f62467fc640 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c7fe800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.598+0000 7f62467fc640 1 -- 172.21.15.37:0/1539020978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55741c4c2650 con 0x55741c436390 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.599+0000 7f62477fe640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f62300b6720 0x7f62300b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.599+0000 7f622ffff640 1 -- 172.21.15.37:0/990859850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f62380e8270 con 0x7f62481083a0 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.600+0000 7f62477fe640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f62300b6720 0x7f62300b8c30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6240005f40 tx=0x7f6240009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.602+0000 7f62467fc640 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fed40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62380e5d00 tx=0x7f6238005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b4e54be1a3fb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.607+0000 7f622d7fa640 1 -- 172.21.15.37:0/1539020978 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623801d070 con 0x55741c436390 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.607+0000 7f622d7fa640 1 -- 172.21.15.37:0/1539020978 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62380aded0 con 0x55741c436390 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.609+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 msgr2=0x55741c7fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.609+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fed40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62380e5d00 tx=0x7f6238005d90 comp rx=0 tx=0).stop 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.610+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 shutdown_connections 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.610+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fed40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.610+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c7fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.610+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1539020978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c457070 0x55741c7fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.610+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 >> 172.21.15.37:0/1539020978 conn(0x55741c44b460 msgr2=0x55741c7fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.617+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 shutdown_connections 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.618+0000 7f6253ac0740 1 -- 172.21.15.37:0/1539020978 wait complete. 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.619+0000 7f6253ac0740 1 -- start start 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.619+0000 7f6253ac0740 1 Processor -- start 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.625+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c809980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.625+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 0x55741c809ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c815da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f6253ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55741c5c5700 con 0x55741c436390 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f6253ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55741c6ff160 con 0x55741c42e1b0 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f6253ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55741c80ca30 con 0x55741c457070 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f62467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 0x55741c809ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f62467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 0x55741c809ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42132/0 (socket says 172.21.15.37:42132) 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f62467fc640 1 -- 172.21.15.37:0/1315388091 learned_addr learned my addr 172.21.15.37:0/1315388091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.626+0000 7f6253ac0740 10 client.0 _ll_register_callbacks cb 0x55741c7189e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.627+0000 7f62467fc640 1 -- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 msgr2=0x55741c815da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.627+0000 7f62467fc640 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c815da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.627+0000 7f62467fc640 1 -- 172.21.15.37:0/1315388091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 msgr2=0x55741c809980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.627+0000 7f62467fc640 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c809980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.627+0000 7f62467fc640 1 -- 172.21.15.37:0/1315388091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55741c72cc90 con 0x55741c436390 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.628+0000 7f62467fc640 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 0x55741c809ec0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6238005e20 tx=0x7f62380b7b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888856fa3bed69db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.628+0000 7f622aff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.628+0000 7f622aff5640 1 -- 172.21.15.37:0/1315388091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623801d070 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.628+0000 7f622aff5640 1 -- 172.21.15.37:0/1315388091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f62380ad620 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.629+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62380aded0 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.629+0000 7f622aff5640 1 -- 172.21.15.37:0/1315388091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f62380ae190 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.629+0000 7f6253ac0740 10 client.16896 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.629+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55741c818740 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.630+0000 7f622aff5640 1 -- 172.21.15.37:0/1315388091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62380aeac0 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.632+0000 7f622aff5640 1 -- 172.21.15.37:0/1315388091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f62380a9d10 con 0x55741c436390 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.632+0000 7f6253ac0740 10 client.16896 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.632+0000 7f6253ac0740 10 client.16896 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.632+0000 7f6253ac0740 20 client.16896 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.632+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c4159f0 0x55741c81baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.632+0000 7f6253ac0740 4 client.16896 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.633+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f62380aded0 con 0x55741c4159f0 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.634+0000 7f6246ffd640 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c4159f0 0x55741c81baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.642+0000 7f622aff5640 10 client.16896 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.642+0000 7f6246ffd640 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c4159f0 0x55741c81baa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e1d54b6b6d48271 server_cookie=875e237e4d6212d1 in_seq=0 out_seq=0 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.645+0000 7f622aff5640 1 -- 172.21.15.37:0/1315388091 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f62380aded0 con 0x55741c4159f0 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.645+0000 7f622aff5640 10 client.16896 handle_command_reply: tid=0 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.646+0000 7f6253ac0740 1 client.16896 shutdown 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.653+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 msgr2=0x55741c809ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.653+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 0x55741c809ec0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6238005e20 tx=0x7f62380b7b80 comp rx=0 tx=0).stop 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 shutdown_connections 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c4159f0 0x55741c81baa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c815da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c436390 0x55741c809ec0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1315388091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c809980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 >> 172.21.15.37:0/1315388091 conn(0x55741c44b460 msgr2=0x55741c801450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f622aff5640 0 client.16896 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 shutdown_connections 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.656+0000 7f6253ac0740 1 -- 172.21.15.37:0/1315388091 wait complete. 2024-09-21T01:25:06.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.657+0000 7f6253ac0740 20 client.16896 trim_cache size 0 max 16384 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.693+0000 7f6253ac0740 1 Processor -- start 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.693+0000 7f6253ac0740 1 -- start start 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.694+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c7ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.694+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.694+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c457070 0x55741c7fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.694+0000 7f6253ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f623400e3e0 con 0x55741c457070 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.694+0000 7f6253ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f623400ff20 con 0x55741c42e1b0 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.694+0000 7f6253ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f623400eab0 con 0x55741c436390 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.695+0000 7f62467fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.695+0000 7f62467fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59450/0 (socket says 172.21.15.37:59450) 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.695+0000 7f62467fc640 1 -- 172.21.15.37:0/1718747228 learned_addr learned my addr 172.21.15.37:0/1718747228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:06.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.695+0000 7f6246ffd640 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c7ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.699+0000 7f62467fc640 1 -- 172.21.15.37:0/1718747228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 msgr2=0x55741c7ffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.699+0000 7f62467fc640 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c7ffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.699+0000 7f62467fc640 1 -- 172.21.15.37:0/1718747228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c457070 msgr2=0x55741c7fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.699+0000 7f62467fc640 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c457070 0x55741c7fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.699+0000 7f62467fc640 1 -- 172.21.15.37:0/1718747228 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55741c80ac40 con 0x55741c436390 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.700+0000 7f62467fc640 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fb760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f623800afd0 tx=0x7f62380ad970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666df7d2619bca03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.700+0000 7f622cff9640 1 -- 172.21.15.37:0/1718747228 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623801d040 con 0x55741c436390 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.701+0000 7f622cff9640 1 -- 172.21.15.37:0/1718747228 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62380aded0 con 0x55741c436390 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 -- 172.21.15.37:0/1718747228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 msgr2=0x55741c7fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fb760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f623800afd0 tx=0x7f62380ad970 comp rx=0 tx=0).stop 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 -- 172.21.15.37:0/1718747228 shutdown_connections 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c457070 0x55741c7fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c436390 0x55741c7fb760 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 --2- 172.21.15.37:0/1718747228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c42e1b0 0x55741c7ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.702+0000 7f6253ac0740 1 -- 172.21.15.37:0/1718747228 >> 172.21.15.37:0/1718747228 conn(0x55741c44b460 msgr2=0x55741c7ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.704+0000 7f6253ac0740 1 -- 172.21.15.37:0/1718747228 shutdown_connections 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.705+0000 7f6253ac0740 1 -- 172.21.15.37:0/1718747228 wait complete. 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.705+0000 7f6253ac0740 1 -- start start 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 Processor -- start 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c81f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c81ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c3eada0 0x55741c81d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f623400f850 con 0x55741c42e1b0 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f623400f180 con 0x55741c3eada0 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f623400c470 con 0x55741c457070 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.706+0000 7f6253ac0740 10 client.0 _ll_register_callbacks cb 0x7f6240009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.707+0000 7f62467fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c81ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.707+0000 7f62467fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c81ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59452/0 (socket says 172.21.15.37:59452) 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.707+0000 7f62467fc640 1 -- 172.21.15.37:0/3592958528 learned_addr learned my addr 172.21.15.37:0/3592958528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.707+0000 7f62477fe640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c3eada0 0x55741c81d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.709+0000 7f6246ffd640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c81f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.709+0000 7f62477fe640 1 -- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 msgr2=0x55741c81ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.709+0000 7f62477fe640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c81ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.710+0000 7f62477fe640 1 -- 172.21.15.37:0/3592958528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 msgr2=0x55741c81f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.710+0000 7f62477fe640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c81f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.710+0000 7f62477fe640 1 -- 172.21.15.37:0/3592958528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55741c885220 con 0x55741c3eada0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.710+0000 7f6246ffd640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c81f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.713+0000 7f62477fe640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c3eada0 0x55741c81d130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6240005fd0 tx=0x7f6240004690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3327724b78e46418 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.713+0000 7f622aff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.713+0000 7f622aff5640 1 -- 172.21.15.37:0/3592958528 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240011d30 con 0x55741c3eada0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.713+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55741c776df0 con 0x55741c3eada0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.715+0000 7f622aff5640 1 -- 172.21.15.37:0/3592958528 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6240020420 con 0x55741c3eada0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.715+0000 7f622aff5640 1 -- 172.21.15.37:0/3592958528 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6240020620 con 0x55741c3eada0 2024-09-21T01:25:06.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.716+0000 7f6253ac0740 10 client.26294 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.716+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55741c886490 con 0x55741c3eada0 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.721+0000 7f622aff5640 1 -- 172.21.15.37:0/3592958528 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55741c776df0 con 0x55741c3eada0 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f622aff5640 1 -- 172.21.15.37:0/3592958528 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f624000f040 con 0x55741c3eada0 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f6253ac0740 10 client.26294 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f6253ac0740 10 client.26294 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f6253ac0740 20 client.26294 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f6253ac0740 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c886c20 0x55741c889040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f6253ac0740 4 client.26294 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.723+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55741c7728a0 con 0x55741c886c20 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.729+0000 7f6246ffd640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c886c20 0x55741c889040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.737+0000 7f6246ffd640 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c886c20 0x55741c889040 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31b5cfad67d486f1 server_cookie=968274c543793785 in_seq=0 out_seq=0 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.738+0000 7f622aff5640 10 client.26294 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.739+0000 7f622aff5640 1 -- 172.21.15.37:0/3592958528 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55741c7728a0 con 0x55741c886c20 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.739+0000 7f622aff5640 10 client.26294 handle_command_reply: tid=0 2024-09-21T01:25:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.739+0000 7f6253ac0740 1 client.26294 shutdown 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.741+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c3eada0 msgr2=0x55741c81d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.741+0000 7f6253ac0740 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c3eada0 0x55741c81d130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6240005fd0 tx=0x7f6240004690 comp rx=0 tx=0).stop 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 shutdown_connections 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f6253ac0740 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55741c886c20 0x55741c889040 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f6253ac0740 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55741c3eada0 0x55741c81d130 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f6253ac0740 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55741c457070 0x55741c81ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f6253ac0740 1 --2- 172.21.15.37:0/3592958528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55741c42e1b0 0x55741c81f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 >> 172.21.15.37:0/3592958528 conn(0x55741c44b460 msgr2=0x55741c7ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.743+0000 7f622aff5640 0 client.26294 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.744+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 shutdown_connections 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.744+0000 7f6253ac0740 1 -- 172.21.15.37:0/3592958528 wait complete. 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.744+0000 7f6253ac0740 20 client.26294 trim_cache size 0 max 16384 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.753+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f62300b6720 msgr2=0x7f62300b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.753+0000 7f624d54c640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f62300b6720 0x7f62300b8c30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6240005f40 tx=0x7f6240009600 comp rx=0 tx=0).stop 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.753+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 msgr2=0x7f624810eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.753+0000 7f624d54c640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 0x7f624810eb30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f623800c970 tx=0x7f623800ce30 comp rx=0 tx=0).stop 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.754+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 shutdown_connections 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.754+0000 7f624d54c640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f62300b6720 0x7f62300b8c30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.754+0000 7f624d54c640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6248108cf0 0x7f624810f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.754+0000 7f624d54c640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62481083a0 0x7f624810eb30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.754+0000 7f624d54c640 1 --2- 172.21.15.37:0/990859850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6248102a60 0x7f624810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.754+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 >> 172.21.15.37:0/990859850 conn(0x7f6248079730 msgr2=0x7f6248106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.755+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 shutdown_connections 2024-09-21T01:25:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:05.756+0000 7f624d54c640 1 -- 172.21.15.37:0/990859850 wait complete. 2024-09-21T01:25:06.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:06 smithi137 ceph-mon[34607]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1004 MiB/s wr, 1.87k op/s 2024-09-21T01:25:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:06 smithi144 ceph-mon[34818]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1004 MiB/s wr, 1.87k op/s 2024-09-21T01:25:07.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:06 smithi037 ceph-mon[31105]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1004 MiB/s wr, 1.87k op/s 2024-09-21T01:25:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:08 smithi137 ceph-mon[34607]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 760 MiB/s wr, 1.53k op/s 2024-09-21T01:25:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:08 smithi144 ceph-mon[34818]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 760 MiB/s wr, 1.53k op/s 2024-09-21T01:25:08.925 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:08 smithi037 ceph-mon[31105]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 760 MiB/s wr, 1.53k op/s 2024-09-21T01:25:09.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:25:09.890 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:25:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:10 smithi137 ceph-mon[34607]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 955 MiB/s wr, 2.09k op/s 2024-09-21T01:25:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:10 smithi144 ceph-mon[34818]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 955 MiB/s wr, 2.09k op/s 2024-09-21T01:25:11.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:10 smithi037 ceph-mon[31105]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 955 MiB/s wr, 2.09k op/s 2024-09-21T01:25:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.103+0000 7f1800074640 1 -- 172.21.15.37:0/1704632579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f810a9e0 msgr2=0x7f17f810adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.103+0000 7f1800074640 1 --2- 172.21.15.37:0/1704632579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f810a9e0 0x7f17f810adf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009900 tx=0x7f17e802a410 comp rx=0 tx=0).stop 2024-09-21T01:25:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.104+0000 7f1800074640 1 -- 172.21.15.37:0/1704632579 shutdown_connections 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.104+0000 7f1800074640 1 --2- 172.21.15.37:0/1704632579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17f811cc30 0x7f17f811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.104+0000 7f1800074640 1 --2- 172.21.15.37:0/1704632579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f810a9e0 0x7f17f810adf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.104+0000 7f1800074640 1 --2- 172.21.15.37:0/1704632579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f8111f40 0x7f17f810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.104+0000 7f1800074640 1 -- 172.21.15.37:0/1704632579 >> 172.21.15.37:0/1704632579 conn(0x7f17f8070ec0 msgr2=0x7f17f80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.105+0000 7f1800074640 1 -- 172.21.15.37:0/1704632579 shutdown_connections 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.105+0000 7f1800074640 1 -- 172.21.15.37:0/1704632579 wait complete. 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.107+0000 7f1800074640 1 Processor -- start 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.108+0000 7f1800074640 1 -- start start 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.109+0000 7f1800074640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f810a9e0 0x7f17f81a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.109+0000 7f1800074640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 0x7f17f81a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.109+0000 7f1800074640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17f811cc30 0x7f17f81aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.109+0000 7f1800074640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17f81229c0 con 0x7f17f8111f40 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.109+0000 7f1800074640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17f8122840 con 0x7f17f811cc30 2024-09-21T01:25:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.109+0000 7f1800074640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17f8122b40 con 0x7f17f810a9e0 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.110+0000 7f17fd60f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 0x7f17f81a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.110+0000 7f17fd60f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 0x7f17f81a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42174/0 (socket says 172.21.15.37:42174) 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.110+0000 7f17fd60f640 1 -- 172.21.15.37:0/1648809787 learned_addr learned my addr 172.21.15.37:0/1648809787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.110+0000 7f17fd60f640 1 -- 172.21.15.37:0/1648809787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f810a9e0 msgr2=0x7f17f81a9370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.110+0000 7f17fd60f640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f810a9e0 0x7f17f81a9370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.111+0000 7f17fd60f640 1 -- 172.21.15.37:0/1648809787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17f811cc30 msgr2=0x7f17f81aebb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.111+0000 7f17fd60f640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17f811cc30 0x7f17f81aebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.111+0000 7f17fd60f640 1 -- 172.21.15.37:0/1648809787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f81af330 con 0x7f17f8111f40 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.111+0000 7f17fd60f640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 0x7f17f81a9910 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005700 tx=0x7f17e8005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.112+0000 7f17eeffd640 1 -- 172.21.15.37:0/1648809787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e803f030 con 0x7f17f8111f40 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.112+0000 7f17eeffd640 1 -- 172.21.15.37:0/1648809787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e8004a10 con 0x7f17f8111f40 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.112+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f81af5c0 con 0x7f17f8111f40 2024-09-21T01:25:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.112+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f81b5d30 con 0x7f17f8111f40 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.112+0000 7f17eeffd640 1 -- 172.21.15.37:0/1648809787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8035070 con 0x7f17f8111f40 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.121+0000 7f18065e8740 1 Processor -- start 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.125+0000 7f18065e8740 1 -- start start 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.126+0000 7f17eeffd640 1 -- 172.21.15.37:0/1648809787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f17e8003b60 con 0x7f17f8111f40 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.126+0000 7f18065e8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.127+0000 7f18065e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.127+0000 7f18065e8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.127+0000 7f18065e8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56235d224ea0 con 0x56235cf07070 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.127+0000 7f18065e8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56235d2142d0 con 0x56235cee6390 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.127+0000 7f18065e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56235d2180e0 con 0x56235cede1b0 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17fd60f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17fde10640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17eeffd640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17e40b6710 0x7f17e40b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17fde10640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59464/0 (socket says 172.21.15.37:59464) 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17fde10640 1 -- 172.21.15.37:0/508693233 learned_addr learned my addr 172.21.15.37:0/508693233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17fe611640 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.128+0000 7f17eeffd640 1 -- 172.21.15.37:0/1648809787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f17e8107b50 con 0x7f17f8111f40 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.129+0000 7f17fe611640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17e40b6710 0x7f17e40b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.129+0000 7f17fe611640 1 -- 172.21.15.37:0/508693233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 msgr2=0x56235d2ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.129+0000 7f17fe611640 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.129+0000 7f17fe611640 1 -- 172.21.15.37:0/508693233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 msgr2=0x56235d2aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.129+0000 7f17fe611640 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.129+0000 7f17fe611640 1 -- 172.21.15.37:0/508693233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56235cf72650 con 0x56235cf07070 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.130+0000 7f17fe611640 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ae2c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f17f000d460 tx=0x7f17f000d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8344657ff1e2793 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.131+0000 7f17e3fff640 1 -- 172.21.15.37:0/508693233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0016a20 con 0x56235cf07070 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.131+0000 7f17e3fff640 1 -- 172.21.15.37:0/508693233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17f0016bc0 con 0x56235cf07070 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.132+0000 7f17e3fff640 1 -- 172.21.15.37:0/508693233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f001e5a0 con 0x56235cf07070 2024-09-21T01:25:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 -- 172.21.15.37:0/508693233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 msgr2=0x56235d2ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f17fe611640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17e40b6710 0x7f17e40b8c20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17f001d000 tx=0x7f17f001ec10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ae2c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f17f000d460 tx=0x7f17f000d920 comp rx=0 tx=0).stop 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 -- 172.21.15.37:0/508693233 shutdown_connections 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 --2- 172.21.15.37:0/508693233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ae2c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.133+0000 7f18065e8740 1 -- 172.21.15.37:0/508693233 >> 172.21.15.37:0/508693233 conn(0x56235cefb460 msgr2=0x56235d2ac1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.134+0000 7f18065e8740 1 -- 172.21.15.37:0/508693233 shutdown_connections 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.134+0000 7f18065e8740 1 -- 172.21.15.37:0/508693233 wait complete. 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.135+0000 7f18065e8740 1 -- start start 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.135+0000 7f18065e8740 1 Processor -- start 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.136+0000 7f18065e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2b9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.136+0000 7f18065e8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.136+0000 7f18065e8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f18065e8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56235d075700 con 0x56235cf07070 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f18065e8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56235d1af160 con 0x56235cee6390 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f18065e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56235d2bcaa0 con 0x56235cede1b0 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f18065e8740 10 client.0 _ll_register_callbacks cb 0x56235d1c89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f17fd60f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f17fd60f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:57794/0 (socket says 172.21.15.37:57794) 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f17fe611640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f17fd60f640 1 -- 172.21.15.37:0/3511400919 learned_addr learned my addr 172.21.15.37:0/3511400919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.137+0000 7f17fde10640 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.139+0000 7f17fd60f640 1 -- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 msgr2=0x56235d2b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.139+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.139+0000 7f17fd60f640 1 -- 172.21.15.37:0/3511400919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 msgr2=0x56235d2ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.139+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.139+0000 7f17fd60f640 1 -- 172.21.15.37:0/3511400919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56235d1dcc90 con 0x56235cee6390 2024-09-21T01:25:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.140+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2b9e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17e80cae80 tx=0x7f17e80cd6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb870491cc60d5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.141+0000 7f17e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.141+0000 7f17e17fa640 1 -- 172.21.15.37:0/3511400919 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8049040 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.141+0000 7f17e17fa640 1 -- 172.21.15.37:0/3511400919 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f17e80d7230 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.141+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f0016bc0 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.143+0000 7f17e17fa640 1 -- 172.21.15.37:0/3511400919 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f17e80035f0 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.143+0000 7f18065e8740 10 client.26300 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.143+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56235d2c87d0 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f17e17fa640 1 -- 172.21.15.37:0/3511400919 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e80cd7b0 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f17e17fa640 1 -- 172.21.15.37:0/3511400919 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f17e80f10c0 con 0x56235cee6390 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f18065e8740 10 client.26300 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f18065e8740 10 client.26300 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f18065e8740 20 client.26300 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f18065e8740 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cec59f0 0x56235d2cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f18065e8740 4 client.26300 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.146+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f17f0016bc0 con 0x56235cec59f0 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.148+0000 7f17fde10640 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cec59f0 0x56235d2cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.153+0000 7f17fde10640 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cec59f0 0x56235d2cbca0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=578cbaa652328808 server_cookie=6ecb8091a99f5873 in_seq=0 out_seq=0 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.154+0000 7f17e17fa640 10 client.26300 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.158+0000 7f17e17fa640 1 -- 172.21.15.37:0/3511400919 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f17f0016bc0 con 0x56235cec59f0 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.158+0000 7f17e17fa640 10 client.26300 handle_command_reply: tid=0 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.158+0000 7f18065e8740 1 client.26300 shutdown 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.159+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 msgr2=0x56235d2b9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.159+0000 7f18065e8740 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2b9e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17e80cae80 tx=0x7f17e80cd6b0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 shutdown_connections 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f18065e8740 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cec59f0 0x56235d2cbca0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f17e17fa640 0 client.26300 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f18065e8740 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cf07070 0x56235d2ba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f18065e8740 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cee6390 0x56235d2b9e90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f18065e8740 1 --2- 172.21.15.37:0/3511400919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cede1b0 0x56235d2b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.163+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 >> 172.21.15.37:0/3511400919 conn(0x56235cefb460 msgr2=0x56235d2b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.170+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 shutdown_connections 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.174+0000 7f18065e8740 1 -- 172.21.15.37:0/3511400919 wait complete. 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.177+0000 7f18065e8740 20 client.26300 trim_cache size 0 max 16384 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.218+0000 7f18065e8740 1 Processor -- start 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.218+0000 7f18065e8740 1 -- start start 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.219+0000 7f18065e8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.220+0000 7f18065e8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.220+0000 7f18065e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.220+0000 7f18065e8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc00e550 con 0x56235cede1b0 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.221+0000 7f18065e8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc010090 con 0x56235cec59f0 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.221+0000 7f18065e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc00ec20 con 0x56235cee6390 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.221+0000 7f17fe611640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.221+0000 7f17fe611640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59476/0 (socket says 172.21.15.37:59476) 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.221+0000 7f17fe611640 1 -- 172.21.15.37:0/3143659382 learned_addr learned my addr 172.21.15.37:0/3143659382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.222+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.223+0000 7f17fd60f640 1 -- 172.21.15.37:0/3143659382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 msgr2=0x56235d2abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.223+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.223+0000 7f17fd60f640 1 -- 172.21.15.37:0/3143659382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 msgr2=0x56235d2afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.223+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.223+0000 7f17fd60f640 1 -- 172.21.15.37:0/3143659382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56235d2bac10 con 0x56235cede1b0 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.225+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2ab760 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f17e802aa00 tx=0x7f17e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f6e506e4938281 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.226+0000 7f17e37fe640 1 -- 172.21.15.37:0/3143659382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8049020 con 0x56235cede1b0 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.227+0000 7f17e37fe640 1 -- 172.21.15.37:0/3143659382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e80f5240 con 0x56235cede1b0 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.229+0000 7f18065e8740 1 -- 172.21.15.37:0/3143659382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 msgr2=0x56235d2ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.229+0000 7f18065e8740 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2ab760 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f17e802aa00 tx=0x7f17e8009260 comp rx=0 tx=0).stop 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.234+0000 7f18065e8740 1 -- 172.21.15.37:0/3143659382 shutdown_connections 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.234+0000 7f18065e8740 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.234+0000 7f18065e8740 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2ab760 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.234+0000 7f18065e8740 1 --2- 172.21.15.37:0/3143659382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.234+0000 7f18065e8740 1 -- 172.21.15.37:0/3143659382 >> 172.21.15.37:0/3143659382 conn(0x56235cefb460 msgr2=0x56235d2af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.237+0000 7f18065e8740 1 -- 172.21.15.37:0/3143659382 shutdown_connections 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.237+0000 7f18065e8740 1 -- 172.21.15.37:0/3143659382 wait complete. 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.238+0000 7f18065e8740 1 -- start start 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.238+0000 7f18065e8740 1 Processor -- start 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.239+0000 7f18065e8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.239+0000 7f18065e8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.240+0000 7f18065e8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.372 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:25:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.240+0000 7f18065e8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc00f9c0 con 0x56235cede1b0 2024-09-21T01:25:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.240+0000 7f18065e8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc00f2f0 con 0x56235cec59f0 2024-09-21T01:25:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.241+0000 7f18065e8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc00c510 con 0x56235cee6390 2024-09-21T01:25:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.241+0000 7f18065e8740 10 client.0 _ll_register_callbacks cb 0x7f17e80ca260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.245+0000 7f17fde10640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.245+0000 7f17fde10640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2c22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:57808/0 (socket says 172.21.15.37:57808) 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.245+0000 7f17fde10640 1 -- 172.21.15.37:0/3546560267 learned_addr learned my addr 172.21.15.37:0/3546560267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.245+0000 7f17fe611640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.246+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.248+0000 7f17fd60f640 1 -- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 msgr2=0x56235d2becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.248+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2becf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.248+0000 7f17fd60f640 1 -- 172.21.15.37:0/3546560267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 msgr2=0x56235d2c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.248+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.248+0000 7f17fd60f640 1 -- 172.21.15.37:0/3546560267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56235d2bf230 con 0x56235cede1b0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.250+0000 7f17fd60f640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2be7b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x56235d2b46c0 tx=0x7f17e8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef74f57211934cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.251+0000 7f17e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.251+0000 7f17e17fa640 1 -- 172.21.15.37:0/3546560267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8049040 con 0x56235cede1b0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.251+0000 7f17e17fa640 1 -- 172.21.15.37:0/3546560267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f17e80d5d10 con 0x56235cede1b0 2024-09-21T01:25:12.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.252+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56235d226df0 con 0x56235cede1b0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.253+0000 7f17e17fa640 1 -- 172.21.15.37:0/3546560267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f17e80d27c0 con 0x56235cede1b0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.253+0000 7f18065e8740 10 client.16917 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.253+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56235d2bf230 con 0x56235cede1b0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.255+0000 7f17e17fa640 1 -- 172.21.15.37:0/3546560267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17e80e3e50 con 0x56235cede1b0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f17e17fa640 1 -- 172.21.15.37:0/3546560267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f17e8105ad0 con 0x56235cede1b0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f18065e8740 10 client.16917 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f18065e8740 10 client.16917 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f18065e8740 20 client.16917 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f18065e8740 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cf07070 0x56235d3396e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f18065e8740 4 client.16917 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.256+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56235d2228a0 con 0x56235cf07070 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.262+0000 7f17fde10640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cf07070 0x56235d3396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.265+0000 7f17fde10640 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cf07070 0x56235d3396e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f5ad5b30b9d0234 server_cookie=e2670a6bac21bff1 in_seq=0 out_seq=0 2024-09-21T01:25:12.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.266+0000 7f17e17fa640 10 client.16917 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.267+0000 7f17e17fa640 1 -- 172.21.15.37:0/3546560267 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56235d2228a0 con 0x56235cf07070 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.267+0000 7f17e17fa640 10 client.16917 handle_command_reply: tid=0 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.267+0000 7f18065e8740 1 client.16917 shutdown 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.267+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 msgr2=0x56235d2be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.267+0000 7f18065e8740 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2be7b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x56235d2b46c0 tx=0x7f17e8009680 comp rx=0 tx=0).stop 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 shutdown_connections 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f18065e8740 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x56235cf07070 0x56235d3396e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f18065e8740 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56235cee6390 0x56235d2becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f18065e8740 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56235cede1b0 0x56235d2be7b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f18065e8740 1 --2- 172.21.15.37:0/3546560267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56235cec59f0 0x56235d2c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 >> 172.21.15.37:0/3546560267 conn(0x56235cefb460 msgr2=0x56235d2c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.277+0000 7f17e17fa640 0 client.16917 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:25:12.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.278+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 shutdown_connections 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.278+0000 7f18065e8740 1 -- 172.21.15.37:0/3546560267 wait complete. 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.278+0000 7f18065e8740 20 client.16917 trim_cache size 0 max 16384 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.280+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17e40b6710 msgr2=0x7f17e40b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.280+0000 7f1800074640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17e40b6710 0x7f17e40b8c20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17f001d000 tx=0x7f17f001ec10 comp rx=0 tx=0).stop 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.280+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 msgr2=0x7f17f81a9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.280+0000 7f1800074640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 0x7f17f81a9910 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005700 tx=0x7f17e8005730 comp rx=0 tx=0).stop 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.280+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 shutdown_connections 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f17e40b6710 0x7f17e40b8c20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17f811cc30 0x7f17f81aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17f8111f40 0x7f17f81a9910 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 --2- 172.21.15.37:0/1648809787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f810a9e0 0x7f17f81a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 >> 172.21.15.37:0/1648809787 conn(0x7f17f8070ec0 msgr2=0x7f17f8071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 shutdown_connections 2024-09-21T01:25:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:12.281+0000 7f1800074640 1 -- 172.21.15.37:0/1648809787 wait complete. 2024-09-21T01:25:12.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:12 smithi037 ceph-mon[31105]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 844 MiB/s wr, 1.88k op/s 2024-09-21T01:25:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:12 smithi137 ceph-mon[34607]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 844 MiB/s wr, 1.88k op/s 2024-09-21T01:25:12.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:12 smithi144 ceph-mon[34818]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 844 MiB/s wr, 1.88k op/s 2024-09-21T01:25:14.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:14 smithi144 ceph-mon[34818]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 830 MiB/s wr, 1.79k op/s 2024-09-21T01:25:14.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:14 smithi137 ceph-mon[34607]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 830 MiB/s wr, 1.79k op/s 2024-09-21T01:25:14.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:14 smithi037 ceph-mon[31105]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 830 MiB/s wr, 1.79k op/s 2024-09-21T01:25:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.835+0000 7fde3f59e640 1 -- 172.21.15.37:0/970259594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 msgr2=0x7fde40109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.835+0000 7fde3f59e640 1 --2- 172.21.15.37:0/970259594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40109f60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fde30009900 tx=0x7fde3002a420 comp rx=0 tx=0).stop 2024-09-21T01:25:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.843+0000 7fde3f59e640 1 -- 172.21.15.37:0/970259594 shutdown_connections 2024-09-21T01:25:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.843+0000 7fde3f59e640 1 --2- 172.21.15.37:0/970259594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010b510 0x7fde40111eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.843+0000 7fde3f59e640 1 --2- 172.21.15.37:0/970259594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde4010ab70 0x7fde4010af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.843+0000 7fde3f59e640 1 --2- 172.21.15.37:0/970259594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40109f60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.843+0000 7fde3f59e640 1 -- 172.21.15.37:0/970259594 >> 172.21.15.37:0/970259594 conn(0x7fde40078e80 msgr2=0x7fde4007b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:15.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.845+0000 7fde3f59e640 1 -- 172.21.15.37:0/970259594 shutdown_connections 2024-09-21T01:25:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.847+0000 7fde3f59e640 1 -- 172.21.15.37:0/970259594 wait complete. 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.848+0000 7fde3f59e640 1 Processor -- start 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.849+0000 7fde3f59e640 1 -- start start 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.850+0000 7fde3f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40081180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.850+0000 7fde3f59e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010ab70 0x7fde400817f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.850+0000 7fde3f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde4010b510 0x7fde400823a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.850+0000 7fde3f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde40115800 con 0x7fde40109af0 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.850+0000 7fde3f59e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde40115680 con 0x7fde4010b510 2024-09-21T01:25:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.850+0000 7fde3f59e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde40115980 con 0x7fde4010ab70 2024-09-21T01:25:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.851+0000 7fde3e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40081180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.851+0000 7fde3e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40081180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45198/0 (socket says 172.21.15.37:45198) 2024-09-21T01:25:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.851+0000 7fde3e59c640 1 -- 172.21.15.37:0/3011842488 learned_addr learned my addr 172.21.15.37:0/3011842488 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.851+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010ab70 0x7fde400817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.852+0000 7fde3dd9b640 1 -- 172.21.15.37:0/3011842488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde4010b510 msgr2=0x7fde400823a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:25:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.852+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde4010b510 0x7fde400823a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.852+0000 7fde3dd9b640 1 -- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 msgr2=0x7fde40081180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.852+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40081180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.852+0000 7fde3dd9b640 1 -- 172.21.15.37:0/3011842488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde40082bc0 con 0x7fde4010ab70 2024-09-21T01:25:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.853+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010ab70 0x7fde400817f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fde34009fd0 tx=0x7fde3400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.854+0000 7fde2f7fe640 1 -- 172.21.15.37:0/3011842488 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34015020 con 0x7fde4010ab70 2024-09-21T01:25:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.854+0000 7fde2f7fe640 1 -- 172.21.15.37:0/3011842488 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde34011ce0 con 0x7fde4010ab70 2024-09-21T01:25:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.854+0000 7fde2f7fe640 1 -- 172.21.15.37:0/3011842488 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34010e00 con 0x7fde4010ab70 2024-09-21T01:25:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.855+0000 7fde3f59e640 1 -- 172.21.15.37:0/3011842488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde40082eb0 con 0x7fde4010ab70 2024-09-21T01:25:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.855+0000 7fde3f59e640 1 -- 172.21.15.37:0/3011842488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde400835f0 con 0x7fde4010ab70 2024-09-21T01:25:15.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.860+0000 7fde4b87b740 1 Processor -- start 2024-09-21T01:25:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.861+0000 7fde4b87b740 1 -- start start 2024-09-21T01:25:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.862+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b56f8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.862+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b56f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.862+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b56f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.862+0000 7fde4b87b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602b566a6f0 con 0x5602b532f4d0 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.862+0000 7fde4b87b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602b5659b20 con 0x5602b53501b0 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.862+0000 7fde4b87b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5602b565d930 con 0x5602b53272f0 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.865+0000 7fde2f7fe640 1 -- 172.21.15.37:0/3011842488 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fde34018020 con 0x7fde4010ab70 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.867+0000 7fde3e59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b56f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.867+0000 7fde2f7fe640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde280b6650 0x7fde280b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.868+0000 7fde2f7fe640 1 -- 172.21.15.37:0/3011842488 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fde340e6a20 con 0x7fde4010ab70 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.868+0000 7fde3e59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b56f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40984/0 (socket says 172.21.15.37:40984) 2024-09-21T01:25:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.868+0000 7fde3e59c640 1 -- 172.21.15.37:0/3312399062 learned_addr learned my addr 172.21.15.37:0/3312399062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.871+0000 7fde3e59c640 1 -- 172.21.15.37:0/3312399062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 msgr2=0x5602b56f8050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:25:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.871+0000 7fde3e59c640 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b56f8050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.871+0000 7fde3e59c640 1 -- 172.21.15.37:0/3312399062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 msgr2=0x5602b56f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.871+0000 7fde3e59c640 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b56f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.871+0000 7fde3e59c640 1 -- 172.21.15.37:0/3312399062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b561f530 con 0x5602b53272f0 2024-09-21T01:25:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.871+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde280b6650 0x7fde280b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.872+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde280b6650 0x7fde280b8b60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fde38007b30 tx=0x7fde38005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:15.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.873+0000 7fde3e59c640 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b56f86c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde30004440 tx=0x7fde30004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48921b5f3e3ed77f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:15.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.875+0000 7fde3f59e640 1 -- 172.21.15.37:0/3312399062 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30035030 con 0x5602b53272f0 2024-09-21T01:25:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.875+0000 7fde3f59e640 1 -- 172.21.15.37:0/3312399062 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde30040070 con 0x5602b53272f0 2024-09-21T01:25:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.877+0000 7fde4b87b740 1 -- 172.21.15.37:0/3312399062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 msgr2=0x5602b56f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.877+0000 7fde4b87b740 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b56f86c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde30004440 tx=0x7fde30004470 comp rx=0 tx=0).stop 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.878+0000 7fde4b87b740 1 -- 172.21.15.37:0/3312399062 shutdown_connections 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.878+0000 7fde4b87b740 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b56f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.878+0000 7fde4b87b740 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b56f86c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.878+0000 7fde4b87b740 1 --2- 172.21.15.37:0/3312399062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b56f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.878+0000 7fde4b87b740 1 -- 172.21.15.37:0/3312399062 >> 172.21.15.37:0/3312399062 conn(0x5602b5344300 msgr2=0x5602b56f3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.879+0000 7fde4b87b740 1 -- 172.21.15.37:0/3312399062 shutdown_connections 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.879+0000 7fde4b87b740 1 -- 172.21.15.37:0/3312399062 wait complete. 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 -- start start 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 Processor -- start 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53272f0 0x5602b5712830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b5712ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5713a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602b5591ab0 con 0x5602b532f4d0 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5602b55ff730 con 0x5602b53272f0 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5602b56f9cf0 con 0x5602b53501b0 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.880+0000 7fde4b87b740 10 client.0 _ll_register_callbacks cb 0x5602b56536b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.883+0000 7fde3e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53272f0 0x5602b5712830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.883+0000 7fde3ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5713a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.884+0000 7fde3ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5713a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:40992/0 (socket says 172.21.15.37:40992) 2024-09-21T01:25:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.884+0000 7fde3ed9d640 1 -- 172.21.15.37:0/936717905 learned_addr learned my addr 172.21.15.37:0/936717905 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.886+0000 7fde3ed9d640 1 -- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53272f0 msgr2=0x5602b5712830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.886+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53272f0 0x5602b5712830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.886+0000 7fde3ed9d640 1 -- 172.21.15.37:0/936717905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 msgr2=0x5602b5712ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.886+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b5712ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.886+0000 7fde3ed9d640 1 -- 172.21.15.37:0/936717905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b53bb790 con 0x5602b53501b0 2024-09-21T01:25:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.888+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5713a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fde3800f9d0 tx=0x7fde38004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a094c2aa8bd8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.888+0000 7fde25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:25:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.890+0000 7fde25ffb640 1 -- 172.21.15.37:0/936717905 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38020020 con 0x5602b53501b0 2024-09-21T01:25:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.890+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde30040070 con 0x5602b53501b0 2024-09-21T01:25:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.890+0000 7fde25ffb640 1 -- 172.21.15.37:0/936717905 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fde3800eb30 con 0x5602b53501b0 2024-09-21T01:25:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.890+0000 7fde25ffb640 1 -- 172.21.15.37:0/936717905 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fde3800ed30 con 0x5602b53501b0 2024-09-21T01:25:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.891+0000 7fde4b87b740 10 client.26293 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.891+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5602b5434620 con 0x5602b53501b0 2024-09-21T01:25:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde25ffb640 1 -- 172.21.15.37:0/936717905 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde30040070 con 0x5602b53501b0 2024-09-21T01:25:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde25ffb640 1 -- 172.21.15.37:0/936717905 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fde38027450 con 0x5602b53501b0 2024-09-21T01:25:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde4b87b740 10 client.26293 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde4b87b740 10 client.26293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde4b87b740 20 client.26293 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde4b87b740 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b530ed80 0x5602b5720540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde4b87b740 4 client.26293 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.892+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602b566c640 con 0x5602b530ed80 2024-09-21T01:25:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.894+0000 7fde3e59c640 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b530ed80 0x5602b5720540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.898+0000 7fde3e59c640 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b530ed80 0x5602b5720540 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f698af876ba524 server_cookie=62129a3bde4fbb3 in_seq=0 out_seq=0 2024-09-21T01:25:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.898+0000 7fde25ffb640 10 client.26293 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.911+0000 7fde25ffb640 1 -- 172.21.15.37:0/936717905 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fde30003730 con 0x5602b530ed80 2024-09-21T01:25:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.911+0000 7fde25ffb640 10 client.26293 handle_command_reply: tid=0 2024-09-21T01:25:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.912+0000 7fde4b87b740 1 client.26293 shutdown 2024-09-21T01:25:15.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 msgr2=0x5602b5713a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:15.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5713a60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fde3800f9d0 tx=0x7fde38004ab0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 shutdown_connections 2024-09-21T01:25:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b530ed80 0x5602b5720540 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5713a60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b5712ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 --2- 172.21.15.37:0/936717905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53272f0 0x5602b5712830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 >> 172.21.15.37:0/936717905 conn(0x5602b5344300 msgr2=0x5602b56f23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.917+0000 7fde25ffb640 0 client.26293 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.921+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 shutdown_connections 2024-09-21T01:25:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.921+0000 7fde4b87b740 1 -- 172.21.15.37:0/936717905 wait complete. 2024-09-21T01:25:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.922+0000 7fde4b87b740 20 client.26293 trim_cache size 0 max 16384 2024-09-21T01:25:15.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.972+0000 7fde4b87b740 1 Processor -- start 2024-09-21T01:25:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.976+0000 7fde4b87b740 1 -- start start 2024-09-21T01:25:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.976+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b5714090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.977+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b57111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.977+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b5720470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.977+0000 7fde4b87b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde40074ca0 con 0x5602b532f4d0 2024-09-21T01:25:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.977+0000 7fde4b87b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde401b3120 con 0x5602b53501b0 2024-09-21T01:25:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.977+0000 7fde4b87b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde40075370 con 0x5602b53272f0 2024-09-21T01:25:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.978+0000 7fde3ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b5720470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.979+0000 7fde3ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b5720470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50890/0 (socket says 172.21.15.37:50890) 2024-09-21T01:25:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.979+0000 7fde3ed9d640 1 -- 172.21.15.37:0/1412563655 learned_addr learned my addr 172.21.15.37:0/1412563655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.980+0000 7fde3ed9d640 1 -- 172.21.15.37:0/1412563655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 msgr2=0x5602b5714090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:25:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.980+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b5714090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.981+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b57111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.982+0000 7fde3ed9d640 1 -- 172.21.15.37:0/1412563655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 msgr2=0x5602b57111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.982+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b57111c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.982+0000 7fde3ed9d640 1 -- 172.21.15.37:0/1412563655 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b5713260 con 0x5602b53501b0 2024-09-21T01:25:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.982+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b57111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:25:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.983+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b5720470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde38027ab0 tx=0x7fde38027df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca2dc5b5dd953a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.990+0000 7fde27fff640 1 -- 172.21.15.37:0/1412563655 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38020070 con 0x5602b53501b0 2024-09-21T01:25:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.990+0000 7fde27fff640 1 -- 172.21.15.37:0/1412563655 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde38015030 con 0x5602b53501b0 2024-09-21T01:25:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.990+0000 7fde27fff640 1 -- 172.21.15.37:0/1412563655 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3801c6a0 con 0x5602b53501b0 2024-09-21T01:25:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.991+0000 7fde4b87b740 1 -- 172.21.15.37:0/1412563655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 msgr2=0x5602b5720470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.991+0000 7fde4b87b740 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b5720470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde38027ab0 tx=0x7fde38027df0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.996+0000 7fde4b87b740 1 -- 172.21.15.37:0/1412563655 shutdown_connections 2024-09-21T01:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.996+0000 7fde4b87b740 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b53501b0 0x5602b5720470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.996+0000 7fde4b87b740 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b532f4d0 0x5602b57111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.996+0000 7fde4b87b740 1 --2- 172.21.15.37:0/1412563655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53272f0 0x5602b5714090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.996+0000 7fde4b87b740 1 -- 172.21.15.37:0/1412563655 >> 172.21.15.37:0/1412563655 conn(0x5602b5344300 msgr2=0x5602b56eeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.998+0000 7fde4b87b740 1 -- 172.21.15.37:0/1412563655 shutdown_connections 2024-09-21T01:25:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.999+0000 7fde4b87b740 1 -- 172.21.15.37:0/1412563655 wait complete. 2024-09-21T01:25:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:15.999+0000 7fde4b87b740 1 -- start start 2024-09-21T01:25:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.000+0000 7fde4b87b740 1 Processor -- start 2024-09-21T01:25:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.000+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b53272f0 0x5602b5717960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.000+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b532f4d0 0x5602b5718020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.006+0000 7fde4b87b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5718b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.006+0000 7fde4b87b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde401b2a50 con 0x5602b53272f0 2024-09-21T01:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.006+0000 7fde4b87b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde401b2380 con 0x5602b532f4d0 2024-09-21T01:25:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.007+0000 7fde4b87b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde40072c60 con 0x5602b53501b0 2024-09-21T01:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.007+0000 7fde4b87b740 10 client.0 _ll_register_callbacks cb 0x7fde380073c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.007+0000 7fde3ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5718b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.007+0000 7fde3ed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5718b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41012/0 (socket says 172.21.15.37:41012) 2024-09-21T01:25:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.007+0000 7fde3ed9d640 1 -- 172.21.15.37:0/2316693007 learned_addr learned my addr 172.21.15.37:0/2316693007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.010+0000 7fde3dd9b640 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b532f4d0 0x5602b5718020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.011+0000 7fde3ed9d640 1 -- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b532f4d0 msgr2=0x5602b5718020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.011+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b532f4d0 0x5602b5718020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.011+0000 7fde3ed9d640 1 -- 172.21.15.37:0/2316693007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b53272f0 msgr2=0x5602b5717960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.011+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b53272f0 0x5602b5717960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.011+0000 7fde3ed9d640 1 -- 172.21.15.37:0/2316693007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b57192a0 con 0x5602b53501b0 2024-09-21T01:25:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.017+0000 7fde3ed9d640 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5718b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde38005ec0 tx=0x7fde38003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47037d8d5079a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.017+0000 7fde25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:25:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.020+0000 7fde25ffb640 1 -- 172.21.15.37:0/2316693007 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38020040 con 0x5602b53501b0 2024-09-21T01:25:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.021+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde38015030 con 0x5602b53501b0 2024-09-21T01:25:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.021+0000 7fde25ffb640 1 -- 172.21.15.37:0/2316693007 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fde38004d40 con 0x5602b53501b0 2024-09-21T01:25:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.025+0000 7fde25ffb640 1 -- 172.21.15.37:0/2316693007 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fde3800eb70 con 0x5602b53501b0 2024-09-21T01:25:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.028+0000 7fde4b87b740 10 client.26296 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.028+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5602b571a530 con 0x5602b53501b0 2024-09-21T01:25:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.032+0000 7fde25ffb640 1 -- 172.21.15.37:0/2316693007 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde38015030 con 0x5602b53501b0 2024-09-21T01:25:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde25ffb640 1 -- 172.21.15.37:0/2316693007 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fde380050f0 con 0x5602b53501b0 2024-09-21T01:25:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde4b87b740 10 client.26296 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde4b87b740 10 client.26296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde4b87b740 20 client.26296 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde4b87b740 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b52e41c0 0x5602b578cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde4b87b740 4 client.26296 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:25:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.035+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602b56680f0 con 0x5602b52e41c0 2024-09-21T01:25:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.037+0000 7fde3e59c640 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b52e41c0 0x5602b578cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:16.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.052+0000 7fde3e59c640 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b52e41c0 0x5602b578cf50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2c97b28a84d359 server_cookie=42f426ed4a7fd2c8 in_seq=0 out_seq=0 2024-09-21T01:25:16.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:16.054+0000 7fde25ffb640 10 client.26296 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:16.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:16 smithi037 ceph-mon[31105]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1002 MiB/s wr, 2.30k op/s 2024-09-21T01:25:16.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:16 smithi137 ceph-mon[34607]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1002 MiB/s wr, 2.30k op/s 2024-09-21T01:25:16.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:16 smithi144 ceph-mon[34818]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1002 MiB/s wr, 2.30k op/s 2024-09-21T01:25:17.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:25:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:25:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:18 smithi137 ceph-mon[34607]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 757 MiB/s wr, 1.87k op/s 2024-09-21T01:25:18.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:18 smithi144 ceph-mon[34818]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 757 MiB/s wr, 1.87k op/s 2024-09-21T01:25:19.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:18 smithi037 ceph-mon[31105]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 757 MiB/s wr, 1.87k op/s 2024-09-21T01:25:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.297+0000 7fde25ffb640 1 -- 172.21.15.37:0/2316693007 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602b56680f0 con 0x5602b52e41c0 2024-09-21T01:25:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.297+0000 7fde25ffb640 10 client.26296 handle_command_reply: tid=0 2024-09-21T01:25:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.297+0000 7fde4b87b740 1 client.26296 shutdown 2024-09-21T01:25:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.299+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 msgr2=0x5602b5718b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.299+0000 7fde4b87b740 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5718b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde38005ec0 tx=0x7fde38003ba0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 shutdown_connections 2024-09-21T01:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde4b87b740 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5602b52e41c0 0x5602b578cf50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde4b87b740 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602b53501b0 0x5602b5718b40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde4b87b740 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5602b532f4d0 0x5602b5718020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde4b87b740 1 --2- 172.21.15.37:0/2316693007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602b53272f0 0x5602b5717960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 >> 172.21.15.37:0/2316693007 conn(0x5602b5344300 msgr2=0x5602b56eec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.300+0000 7fde25ffb640 0 client.26296 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.302+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 shutdown_connections 2024-09-21T01:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.302+0000 7fde4b87b740 1 -- 172.21.15.37:0/2316693007 wait complete. 2024-09-21T01:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.304+0000 7fde4b87b740 20 client.26296 trim_cache size 0 max 16384 2024-09-21T01:25:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:25:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:25:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:25:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.311+0000 7fde2d7fa640 1 -- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde280b6650 msgr2=0x7fde280b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.311+0000 7fde2d7fa640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde280b6650 0x7fde280b8b60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fde38007b30 tx=0x7fde38005f70 comp rx=0 tx=0).stop 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.311+0000 7fde2d7fa640 1 -- 172.21.15.37:0/3011842488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010ab70 msgr2=0x7fde400817f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.311+0000 7fde2d7fa640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010ab70 0x7fde400817f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fde34009fd0 tx=0x7fde3400b870 comp rx=0 tx=0).stop 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 -- 172.21.15.37:0/3011842488 shutdown_connections 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fde280b6650 0x7fde280b8b60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde4010b510 0x7fde400823a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde4010ab70 0x7fde400817f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 --2- 172.21.15.37:0/3011842488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde40109af0 0x7fde40081180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 -- 172.21.15.37:0/3011842488 >> 172.21.15.37:0/3011842488 conn(0x7fde40078e80 msgr2=0x7fde4010de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 -- 172.21.15.37:0/3011842488 shutdown_connections 2024-09-21T01:25:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:19.312+0000 7fde2d7fa640 1 -- 172.21.15.37:0/3011842488 wait complete. 2024-09-21T01:25:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.012+0000 7f3a28588640 1 -- 172.21.15.37:0/4013542449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 msgr2=0x7f3a20107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.012+0000 7f3a28588640 1 --2- 172.21.15.37:0/4013542449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 0x7f3a20107460 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009930 tx=0x7f3a1c02a480 comp rx=0 tx=0).stop 2024-09-21T01:25:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.013+0000 7f3a28588640 1 -- 172.21.15.37:0/4013542449 shutdown_connections 2024-09-21T01:25:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.013+0000 7f3a28588640 1 --2- 172.21.15.37:0/4013542449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a20107a20 0x7f3a20107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.013+0000 7f3a28588640 1 --2- 172.21.15.37:0/4013542449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 0x7f3a20107460 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.013+0000 7f3a28588640 1 --2- 172.21.15.37:0/4013542449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a201025e0 0x7f3a201029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.013+0000 7f3a28588640 1 -- 172.21.15.37:0/4013542449 >> 172.21.15.37:0/4013542449 conn(0x7f3a200fe2f0 msgr2=0x7f3a20100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.013+0000 7f3a28588640 1 -- 172.21.15.37:0/4013542449 shutdown_connections 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.017+0000 7f3a28588640 1 -- 172.21.15.37:0/4013542449 wait complete. 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 Processor -- start 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 -- start start 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a201025e0 0x7f3a20116a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 0x7f3a2010fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 0x7f3a201102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20119f50 con 0x7f3a201025e0 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20119dd0 con 0x7f3a20102f30 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.018+0000 7f3a28588640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2011a0d0 con 0x7f3a20107a20 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.020+0000 7f3a26b25640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 0x7f3a201102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.020+0000 7f3a26b25640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 0x7f3a201102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:41026/0 (socket says 172.21.15.37:41026) 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.020+0000 7f3a26b25640 1 -- 172.21.15.37:0/542935092 learned_addr learned my addr 172.21.15.37:0/542935092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.023+0000 7f3a25b23640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 0x7f3a2010fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.024+0000 7f3a26b25640 1 -- 172.21.15.37:0/542935092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 msgr2=0x7f3a2010fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.024+0000 7f3a26b25640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 0x7f3a2010fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.024+0000 7f3a26b25640 1 -- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a201025e0 msgr2=0x7f3a20116a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.024+0000 7f3a26b25640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a201025e0 0x7f3a20116a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.024+0000 7f3a26b25640 1 -- 172.21.15.37:0/542935092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20110ac0 con 0x7f3a20107a20 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.027+0000 7f3a26b25640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 0x7f3a201102a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800b970 tx=0x7f3a1800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.029+0000 7f3a177fe640 1 -- 172.21.15.37:0/542935092 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18019070 con 0x7f3a20107a20 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.029+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a20115760 con 0x7f3a20107a20 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.029+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a20115c70 con 0x7f3a20107a20 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.029+0000 7f3a177fe640 1 -- 172.21.15.37:0/542935092 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a18014440 con 0x7f3a20107a20 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.029+0000 7f3a177fe640 1 -- 172.21.15.37:0/542935092 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a180075d0 con 0x7f3a20107a20 2024-09-21T01:25:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.036+0000 7f3a2eafc740 1 Processor -- start 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 -- start start 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b43974070 0x561b43d1b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d1b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b43c91ea0 con 0x561b4394b1b0 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b43c812d0 con 0x561b43953390 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561b43c850e0 con 0x561b43974070 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a177fe640 1 -- 172.21.15.37:0/542935092 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3a1801c070 con 0x7f3a20107a20 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.043+0000 7f3a26324640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d1b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.044+0000 7f3a26324640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d1b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45270/0 (socket says 172.21.15.37:45270) 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.044+0000 7f3a26324640 1 -- 172.21.15.37:0/3701016643 learned_addr learned my addr 172.21.15.37:0/3701016643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.044+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b43974070 0x561b43d1b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.045+0000 7f3a25b23640 1 -- 172.21.15.37:0/3701016643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 msgr2=0x561b43d1bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.045+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.045+0000 7f3a25b23640 1 -- 172.21.15.37:0/3701016643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 msgr2=0x561b43d1b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.045+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d1b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.045+0000 7f3a25b23640 1 -- 172.21.15.37:0/3701016643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b439df650 con 0x561b43974070 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.046+0000 7f3a177fe640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3a0c0b6710 0x7f3a0c0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.046+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b43974070 0x561b43d1b460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c02aa70 tx=0x7f3a1c0047a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0801be853537111 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.046+0000 7f3a177fe640 1 -- 172.21.15.37:0/542935092 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3a180e6690 con 0x7f3a20107a20 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.048+0000 7f3a14ff9640 1 -- 172.21.15.37:0/3701016643 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c043070 con 0x561b43974070 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.048+0000 7f3a14ff9640 1 -- 172.21.15.37:0/3701016643 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1c03f8f0 con 0x561b43974070 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.049+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3701016643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b43974070 msgr2=0x561b43d1b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.049+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b43974070 0x561b43d1b460 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c02aa70 tx=0x7f3a1c0047a0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a26324640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3a0c0b6710 0x7f3a0c0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3701016643 shutdown_connections 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d1b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3701016643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b43974070 0x561b43d1b460 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3701016643 >> 172.21.15.37:0/3701016643 conn(0x561b43968460 msgr2=0x561b43d19350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3701016643 shutdown_connections 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.054+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3701016643 wait complete. 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.055+0000 7f3a2eafc740 1 -- start start 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.055+0000 7f3a2eafc740 1 Processor -- start 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d292c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 0x561b43d267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d26ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b43ae2700 con 0x561b43953390 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561b43c1c160 con 0x561b439329f0 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561b43d29c30 con 0x561b4394b1b0 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.056+0000 7f3a2eafc740 10 client.0 _ll_register_callbacks cb 0x561b43c359e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.058+0000 7f3a26b25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d26ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.058+0000 7f3a26b25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d26ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50942/0 (socket says 172.21.15.37:50942) 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.058+0000 7f3a26b25640 1 -- 172.21.15.37:0/3541448427 learned_addr learned my addr 172.21.15.37:0/3541448427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.059+0000 7f3a26b25640 1 -- 172.21.15.37:0/3541448427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 msgr2=0x561b43d292c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.059+0000 7f3a26b25640 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d292c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.059+0000 7f3a26b25640 1 -- 172.21.15.37:0/3541448427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 msgr2=0x561b43d267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.059+0000 7f3a26b25640 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 0x561b43d267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.059+0000 7f3a26b25640 1 -- 172.21.15.37:0/3541448427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b43c49c90 con 0x561b439329f0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.060+0000 7f3a26b25640 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d26ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a180e4090 tx=0x7f3a180ac010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc818ec8c98ea12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.060+0000 7f3a09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.061+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3541448427 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a180b1070 con 0x561b439329f0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.061+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b43c93df0 con 0x561b439329f0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.061+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3541448427 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3a180aba40 con 0x561b439329f0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.061+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3541448427 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a180c7050 con 0x561b439329f0 2024-09-21T01:25:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.061+0000 7f3a2eafc740 10 client.26321 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.061+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561b43d2b8f0 con 0x561b439329f0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.062+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3541448427 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561b43c93df0 con 0x561b439329f0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3541448427 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3a180a81c0 con 0x561b439329f0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a2eafc740 10 client.26321 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a2eafc740 10 client.26321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a2eafc740 20 client.26321 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43907da0 0x561b43d2f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a2eafc740 4 client.26321 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.064+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b43c8f8a0 con 0x561b43907da0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.067+0000 7f3a26324640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3a0c0b6710 0x7f3a0c0b8c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x561b43d1a0e0 tx=0x7f3a100095d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.071+0000 7f3a26324640 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43907da0 0x561b43d2f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.084+0000 7f3a09ffb640 10 client.26321 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.084+0000 7f3a26324640 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43907da0 0x561b43d2f310 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf4d501afc5a5def server_cookie=b28dc53ea8ecc3e8 in_seq=0 out_seq=0 2024-09-21T01:25:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.089+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3541448427 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b43c8f8a0 con 0x561b43907da0 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.089+0000 7f3a09ffb640 10 client.26321 handle_command_reply: tid=0 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.089+0000 7f3a2eafc740 1 client.26321 shutdown 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 msgr2=0x561b43d26ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d26ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a180e4090 tx=0x7f3a180ac010 comp rx=0 tx=0).stop 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 shutdown_connections 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43907da0 0x561b43d2f310 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d26ee0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 0x561b43d267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3541448427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d292c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 >> 172.21.15.37:0/3541448427 conn(0x561b43968460 msgr2=0x561b43d1e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a09ffb640 0 client.26321 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 shutdown_connections 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3541448427 wait complete. 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.090+0000 7f3a2eafc740 20 client.26321 trim_cache size 0 max 16384 2024-09-21T01:25:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.136+0000 7f3a2eafc740 1 Processor -- start 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 -- start start 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b439329f0 0x561b43d18c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d191b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0400e500 con 0x561b4394b1b0 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a04010040 con 0x561b43953390 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.138+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0400ebd0 con 0x561b439329f0 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.139+0000 7f3a26b25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.139+0000 7f3a26b25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50944/0 (socket says 172.21.15.37:50944) 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.139+0000 7f3a26b25640 1 -- 172.21.15.37:0/974125735 learned_addr learned my addr 172.21.15.37:0/974125735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.140+0000 7f3a26b25640 1 -- 172.21.15.37:0/974125735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b439329f0 msgr2=0x561b43d18c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.140+0000 7f3a26b25640 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b439329f0 0x561b43d18c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.140+0000 7f3a26b25640 1 -- 172.21.15.37:0/974125735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 msgr2=0x561b43d191b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.140+0000 7f3a26b25640 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.140+0000 7f3a26b25640 1 -- 172.21.15.37:0/974125735 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b43d1d750 con 0x561b43953390 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.141+0000 7f3a26b25640 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1e560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a180ac4e0 tx=0x7f3a18014d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13255674a408f077 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.142+0000 7f3a0bfff640 1 -- 172.21.15.37:0/974125735 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a180cb070 con 0x561b43953390 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.142+0000 7f3a0bfff640 1 -- 172.21.15.37:0/974125735 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a180b12c0 con 0x561b43953390 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.142+0000 7f3a0bfff640 1 -- 172.21.15.37:0/974125735 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a180b1040 con 0x561b43953390 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.145+0000 7f3a2eafc740 1 -- 172.21.15.37:0/974125735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 msgr2=0x561b43d1e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.145+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1e560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a180ac4e0 tx=0x7f3a18014d70 comp rx=0 tx=0).stop 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.147+0000 7f3a2eafc740 1 -- 172.21.15.37:0/974125735 shutdown_connections 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.147+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b43953390 0x561b43d1e560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.147+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b4394b1b0 0x561b43d191b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.147+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/974125735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b439329f0 0x561b43d18c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.147+0000 7f3a2eafc740 1 -- 172.21.15.37:0/974125735 >> 172.21.15.37:0/974125735 conn(0x561b43968460 msgr2=0x561b43d25010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.149+0000 7f3a2eafc740 1 -- 172.21.15.37:0/974125735 shutdown_connections 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.149+0000 7f3a2eafc740 1 -- 172.21.15.37:0/974125735 wait complete. 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.150+0000 7f3a2eafc740 1 -- start start 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.150+0000 7f3a2eafc740 1 Processor -- start 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.151+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.151+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d33820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.151+0000 7f3a2eafc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 0x561b43dc4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.152+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0400f970 con 0x561b43953390 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.152+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0400f2a0 con 0x561b439329f0 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.152+0000 7f3a2eafc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0400c4c0 con 0x561b4394b1b0 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.152+0000 7f3a2eafc740 10 client.0 _ll_register_callbacks cb 0x7f3a180a8e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.155+0000 7f3a26324640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.155+0000 7f3a26324640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:50946/0 (socket says 172.21.15.37:50946) 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.155+0000 7f3a26324640 1 -- 172.21.15.37:0/3570222424 learned_addr learned my addr 172.21.15.37:0/3570222424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.155+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d33820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.158+0000 7f3a25b23640 1 -- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 msgr2=0x561b43d332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.158+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.159+0000 7f3a25b23640 1 -- 172.21.15.37:0/3570222424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 msgr2=0x561b43dc4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.159+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 0x561b43dc4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.159+0000 7f3a25b23640 1 -- 172.21.15.37:0/3570222424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b43dc4620 con 0x561b4394b1b0 2024-09-21T01:25:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.161+0000 7f3a25b23640 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d33820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c006010 tx=0x7f3a1c031670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b16410717b6b4a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.161+0000 7f3a09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:25:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.162+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3570222424 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c043070 con 0x561b4394b1b0 2024-09-21T01:25:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.162+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3570222424 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3a1c031d00 con 0x561b4394b1b0 2024-09-21T01:25:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.162+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a180b12c0 con 0x561b4394b1b0 2024-09-21T01:25:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.162+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3570222424 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3a1c048450 con 0x561b4394b1b0 2024-09-21T01:25:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.162+0000 7f3a2eafc740 10 client.26308 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.162+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561b43dc58a0 con 0x561b4394b1b0 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.163+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3570222424 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1c050070 con 0x561b4394b1b0 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.163+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3570222424 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3a1c03f6b0 con 0x561b4394b1b0 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.163+0000 7f3a2eafc740 10 client.26308 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.163+0000 7f3a2eafc740 10 client.26308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.163+0000 7f3a2eafc740 20 client.26308 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.164+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43dc5a70 0x561b43dc7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.164+0000 7f3a2eafc740 4 client.26308 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:25:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.164+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3a180b12c0 con 0x561b43dc5a70 2024-09-21T01:25:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.164+0000 7f3a26324640 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43dc5a70 0x561b43dc7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.166+0000 7f3a09ffb640 10 client.26308 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.167+0000 7f3a26324640 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43dc5a70 0x561b43dc7e90 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c5dc77e9048458 server_cookie=9428ef19c631cf09 in_seq=0 out_seq=0 2024-09-21T01:25:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.170+0000 7f3a09ffb640 1 -- 172.21.15.37:0/3570222424 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3a180b12c0 con 0x561b43dc5a70 2024-09-21T01:25:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.170+0000 7f3a09ffb640 10 client.26308 handle_command_reply: tid=0 2024-09-21T01:25:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.170+0000 7f3a2eafc740 1 client.26308 shutdown 2024-09-21T01:25:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.170+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 msgr2=0x561b43d33820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.170+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d33820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c006010 tx=0x7f3a1c031670 comp rx=0 tx=0).stop 2024-09-21T01:25:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 shutdown_connections 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x561b43dc5a70 0x561b43dc7e90 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b43953390 0x561b43dc4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561b4394b1b0 0x561b43d33820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 --2- 172.21.15.37:0/3570222424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561b439329f0 0x561b43d332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 >> 172.21.15.37:0/3570222424 conn(0x561b43968460 msgr2=0x561b43d1e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a09ffb640 0 client.26308 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 shutdown_connections 2024-09-21T01:25:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.171+0000 7f3a2eafc740 1 -- 172.21.15.37:0/3570222424 wait complete. 2024-09-21T01:25:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.174+0000 7f3a2eafc740 20 client.26308 trim_cache size 0 max 16384 2024-09-21T01:25:20.176 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3a0c0b6710 msgr2=0x7f3a0c0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3a0c0b6710 0x7f3a0c0b8c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x561b43d1a0e0 tx=0x7f3a100095d0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 msgr2=0x7f3a201102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 0x7f3a201102a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800b970 tx=0x7f3a1800be30 comp rx=0 tx=0).stop 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 shutdown_connections 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3a0c0b6710 0x7f3a0c0b8c20 secure :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0x561b43d1a0e0 tx=0x7f3a100095d0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a20107a20 0x7f3a201102a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20102f30 0x7f3a2010fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 --2- 172.21.15.37:0/542935092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a201025e0 0x7f3a20116a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.176+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 >> 172.21.15.37:0/542935092 conn(0x7f3a200fe2f0 msgr2=0x7f3a20105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.177+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 shutdown_connections 2024-09-21T01:25:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:20.177+0000 7f3a28588640 1 -- 172.21.15.37:0/542935092 wait complete. 2024-09-21T01:25:21.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:20 smithi037 ceph-mon[31105]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 964 MiB/s wr, 2.33k op/s 2024-09-21T01:25:21.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:20 smithi137 ceph-mon[34607]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 964 MiB/s wr, 2.33k op/s 2024-09-21T01:25:21.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:20 smithi144 ceph-mon[34818]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 964 MiB/s wr, 2.33k op/s 2024-09-21T01:25:23.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:22 smithi037 ceph-mon[31105]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 865 MiB/s wr, 1.90k op/s 2024-09-21T01:25:23.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:22 smithi137 ceph-mon[34607]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 865 MiB/s wr, 1.90k op/s 2024-09-21T01:25:23.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:22 smithi144 ceph-mon[34818]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 865 MiB/s wr, 1.90k op/s 2024-09-21T01:25:24.907 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:25:24.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:25:25.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:24 smithi037 ceph-mon[31105]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 833 MiB/s wr, 1.80k op/s 2024-09-21T01:25:25.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:24 smithi137 ceph-mon[34607]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 833 MiB/s wr, 1.80k op/s 2024-09-21T01:25:25.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:24 smithi144 ceph-mon[34818]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 833 MiB/s wr, 1.80k op/s 2024-09-21T01:25:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:25:27.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:26 smithi037 ceph-mon[31105]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 977 MiB/s wr, 2.28k op/s 2024-09-21T01:25:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:26 smithi137 ceph-mon[34607]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 977 MiB/s wr, 2.28k op/s 2024-09-21T01:25:27.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:26 smithi144 ceph-mon[34818]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 977 MiB/s wr, 2.28k op/s 2024-09-21T01:25:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.596+0000 7fb18d78a640 1 -- 172.21.15.37:0/3252636400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 msgr2=0x7fb1800a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.596+0000 7fb18d78a640 1 --2- 172.21.15.37:0/3252636400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb1800a1af0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb174009980 tx=0x7fb17402c650 comp rx=0 tx=0).stop 2024-09-21T01:25:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.601+0000 7fb18d78a640 1 -- 172.21.15.37:0/3252636400 shutdown_connections 2024-09-21T01:25:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.601+0000 7fb18d78a640 1 --2- 172.21.15.37:0/3252636400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb1800a1af0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.601+0000 7fb18d78a640 1 --2- 172.21.15.37:0/3252636400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 0x7fb18009ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.601+0000 7fb18d78a640 1 --2- 172.21.15.37:0/3252636400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 0x7fb180095440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.601+0000 7fb18d78a640 1 -- 172.21.15.37:0/3252636400 >> 172.21.15.37:0/3252636400 conn(0x7fb18000cd80 msgr2=0x7fb18000d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.606+0000 7fb18d78a640 1 -- 172.21.15.37:0/3252636400 shutdown_connections 2024-09-21T01:25:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.607+0000 7fb18d78a640 1 -- 172.21.15.37:0/3252636400 wait complete. 2024-09-21T01:25:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.608+0000 7fb18d78a640 1 Processor -- start 2024-09-21T01:25:27.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.611+0000 7fb18d78a640 1 -- start start 2024-09-21T01:25:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.613+0000 7fb18d78a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 0x7fb1800a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.613+0000 7fb18d78a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 0x7fb1800a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.613+0000 7fb18d78a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb180136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.614+0000 7fb18d78a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800a38e0 con 0x7fb18009b2c0 2024-09-21T01:25:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.614+0000 7fb18d78a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800a3760 con 0x7fb180095030 2024-09-21T01:25:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.614+0000 7fb18d78a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800a3a60 con 0x7fb18009a970 2024-09-21T01:25:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.615+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 0x7fb1800a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.616+0000 7fb18cf89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb180136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.616+0000 7fb18cf89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb180136630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55836/0 (socket says 172.21.15.37:55836) 2024-09-21T01:25:27.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.616+0000 7fb18cf89640 1 -- 172.21.15.37:0/251497370 learned_addr learned my addr 172.21.15.37:0/251497370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:27.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.617+0000 7fb187fff640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 0x7fb1800a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.618+0000 7fb1877fe640 1 -- 172.21.15.37:0/251497370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 msgr2=0x7fb1800a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.618+0000 7fb1877fe640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 0x7fb1800a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.618+0000 7fb1877fe640 1 -- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 msgr2=0x7fb180136630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.618+0000 7fb1877fe640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb180136630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.619+0000 7fb1877fe640 1 -- 172.21.15.37:0/251497370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180136d60 con 0x7fb18009a970 2024-09-21T01:25:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.619+0000 7fb187fff640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 0x7fb1800a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:25:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.622+0000 7fb1877fe640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 0x7fb1800a0f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb180008810 tx=0x7fb17c00db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.627+0000 7fb1857fa640 1 -- 172.21.15.37:0/251497370 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c017070 con 0x7fb18009a970 2024-09-21T01:25:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.627+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb180137050 con 0x7fb18009a970 2024-09-21T01:25:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.627+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18013f980 con 0x7fb18009a970 2024-09-21T01:25:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.627+0000 7fb1857fa640 1 -- 172.21.15.37:0/251497370 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb17c009820 con 0x7fb18009a970 2024-09-21T01:25:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.627+0000 7fb1857fa640 1 -- 172.21.15.37:0/251497370 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c004b90 con 0x7fb18009a970 2024-09-21T01:25:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.634+0000 7fb194f60740 1 Processor -- start 2024-09-21T01:25:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.635+0000 7fb194f60740 1 -- start start 2024-09-21T01:25:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.635+0000 7fb194f60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 0x55d7f813a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.636+0000 7fb194f60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.636+0000 7fb194f60740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f813b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.636+0000 7fb194f60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d7f80b0e60 con 0x55d7f7d6a490 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.636+0000 7fb194f60740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d7f80a0290 con 0x55d7f7d93350 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.636+0000 7fb194f60740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d7f80a40a0 con 0x55d7f7d72670 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.636+0000 7fb18cf89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 0x55d7f813a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.637+0000 7fb18cf89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 0x55d7f813a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:44076/0 (socket says 172.21.15.37:44076) 2024-09-21T01:25:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.637+0000 7fb18cf89640 1 -- 172.21.15.37:0/3823741719 learned_addr learned my addr 172.21.15.37:0/3823741719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.638+0000 7fb18cf89640 1 -- 172.21.15.37:0/3823741719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 msgr2=0x55d7f813b090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:25:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.638+0000 7fb18cf89640 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f813b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.638+0000 7fb18cf89640 1 -- 172.21.15.37:0/3823741719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 msgr2=0x55d7f813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.638+0000 7fb18cf89640 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.638+0000 7fb18cf89640 1 -- 172.21.15.37:0/3823741719 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f7dfe930 con 0x55d7f7d93350 2024-09-21T01:25:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.640+0000 7fb18cf89640 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 0x55d7f813a610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb174009640 tx=0x7fb174009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1526acd0e8030e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.642+0000 7fb1857fa640 1 -- 172.21.15.37:0/251497370 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb17c004d30 con 0x7fb18009a970 2024-09-21T01:25:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.644+0000 7fb1857fa640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb1780b6720 0x7fb1780b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.645+0000 7fb187fff640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb1780b6720 0x7fb1780b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.645+0000 7fb1857fa640 1 -- 172.21.15.37:0/251497370 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb17c0e6590 con 0x7fb18009a970 2024-09-21T01:25:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.647+0000 7fb1727fc640 1 -- 172.21.15.37:0/3823741719 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174032760 con 0x55d7f7d93350 2024-09-21T01:25:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.647+0000 7fb1727fc640 1 -- 172.21.15.37:0/3823741719 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1740329c0 con 0x55d7f7d93350 2024-09-21T01:25:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.649+0000 7fb194f60740 1 -- 172.21.15.37:0/3823741719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 msgr2=0x55d7f813a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.649+0000 7fb194f60740 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 0x55d7f813a610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb174009640 tx=0x7fb174009670 comp rx=0 tx=0).stop 2024-09-21T01:25:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.650+0000 7fb194f60740 1 -- 172.21.15.37:0/3823741719 shutdown_connections 2024-09-21T01:25:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.650+0000 7fb194f60740 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f813b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.650+0000 7fb194f60740 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.650+0000 7fb194f60740 1 --2- 172.21.15.37:0/3823741719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d93350 0x55d7f813a610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.650+0000 7fb194f60740 1 -- 172.21.15.37:0/3823741719 >> 172.21.15.37:0/3823741719 conn(0x55d7f7d87740 msgr2=0x55d7f8138500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:27.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.657+0000 7fb194f60740 1 -- 172.21.15.37:0/3823741719 shutdown_connections 2024-09-21T01:25:27.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.657+0000 7fb194f60740 1 -- 172.21.15.37:0/3823741719 wait complete. 2024-09-21T01:25:27.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.658+0000 7fb194f60740 1 -- start start 2024-09-21T01:25:27.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.659+0000 7fb194f60740 1 Processor -- start 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f8145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d72670 0x55d7f8146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d7f7f01890 con 0x55d7f7d6a490 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d7f803ad40 con 0x55d7f7d72670 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d7f8148de0 con 0x55d7f7d51cd0 2024-09-21T01:25:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.660+0000 7fb194f60740 10 client.0 _ll_register_callbacks cb 0x55d7f809ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:27.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.661+0000 7fb187fff640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb1780b6720 0x7fb1780b8c30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb188051230 tx=0x7fb188069ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:27.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.662+0000 7fb187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f8145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.662+0000 7fb187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f8145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55844/0 (socket says 172.21.15.37:55844) 2024-09-21T01:25:27.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.662+0000 7fb187fff640 1 -- 172.21.15.37:0/3287244763 learned_addr learned my addr 172.21.15.37:0/3287244763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.663+0000 7fb187fff640 1 -- 172.21.15.37:0/3287244763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d51cd0 msgr2=0x55d7f8152180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:25:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.663+0000 7fb187fff640 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.663+0000 7fb187fff640 1 -- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d72670 msgr2=0x55d7f8146200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:25:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.663+0000 7fb187fff640 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d72670 0x55d7f8146200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.663+0000 7fb187fff640 1 -- 172.21.15.37:0/3287244763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f81469f0 con 0x55d7f7d6a490 2024-09-21T01:25:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.663+0000 7fb187fff640 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f8145cc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb1880692a0 tx=0x7fb188051660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566b182548518a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.664+0000 7fb1677fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.664+0000 7fb1677fe640 1 -- 172.21.15.37:0/3287244763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18808e060 con 0x55d7f7d6a490 2024-09-21T01:25:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.664+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7f80b2db0 con 0x55d7f7d6a490 2024-09-21T01:25:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.664+0000 7fb1677fe640 1 -- 172.21.15.37:0/3287244763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb188081b90 con 0x55d7f7d6a490 2024-09-21T01:25:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.666+0000 7fb1677fe640 1 -- 172.21.15.37:0/3287244763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb188081d90 con 0x55d7f7d6a490 2024-09-21T01:25:27.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.666+0000 7fb194f60740 10 client.16935 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:27.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.666+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7f8165ec0 con 0x55d7f7d6a490 2024-09-21T01:25:27.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.672+0000 7fb1677fe640 1 -- 172.21.15.37:0/3287244763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d7f80b2db0 con 0x55d7f7d6a490 2024-09-21T01:25:27.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.672+0000 7fb1677fe640 1 -- 172.21.15.37:0/3287244763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb188093070 con 0x55d7f7d6a490 2024-09-21T01:25:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.673+0000 7fb194f60740 10 client.16935 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.673+0000 7fb194f60740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.673+0000 7fb194f60740 20 client.16935 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.673+0000 7fb194f60740 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f7d27080 0x55d7f8169430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.673+0000 7fb194f60740 4 client.16935 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.673+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7f80ae860 con 0x55d7f7d27080 2024-09-21T01:25:27.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.676+0000 7fb1877fe640 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f7d27080 0x55d7f8169430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.681+0000 7fb1877fe640 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f7d27080 0x55d7f8169430 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=929a797d6cd4b8b3 server_cookie=45644fee63e73292 in_seq=0 out_seq=0 2024-09-21T01:25:27.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.682+0000 7fb1677fe640 10 client.16935 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:27.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.683+0000 7fb1677fe640 1 -- 172.21.15.37:0/3287244763 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7f80ae860 con 0x55d7f7d27080 2024-09-21T01:25:27.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.683+0000 7fb1677fe640 10 client.16935 handle_command_reply: tid=0 2024-09-21T01:25:27.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.684+0000 7fb194f60740 1 client.16935 shutdown 2024-09-21T01:25:27.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.686+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 msgr2=0x55d7f8145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:27.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.686+0000 7fb194f60740 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f8145cc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb1880692a0 tx=0x7fb188051660 comp rx=0 tx=0).stop 2024-09-21T01:25:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.687+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 shutdown_connections 2024-09-21T01:25:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.687+0000 7fb194f60740 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f7d27080 0x55d7f8169430 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.687+0000 7fb194f60740 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.687+0000 7fb194f60740 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d72670 0x55d7f8146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.687+0000 7fb194f60740 1 --2- 172.21.15.37:0/3287244763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d6a490 0x55d7f8145cc0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.687+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 >> 172.21.15.37:0/3287244763 conn(0x55d7f7d87740 msgr2=0x55d7f813d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.688+0000 7fb1677fe640 0 client.16935 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.688+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 shutdown_connections 2024-09-21T01:25:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.688+0000 7fb194f60740 1 -- 172.21.15.37:0/3287244763 wait complete. 2024-09-21T01:25:27.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.692+0000 7fb194f60740 20 client.16935 trim_cache size 0 max 16384 2024-09-21T01:25:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.748+0000 7fb194f60740 1 Processor -- start 2024-09-21T01:25:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.748+0000 7fb194f60740 1 -- start start 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.749+0000 7fb194f60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.749+0000 7fb194f60740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f81478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.749+0000 7fb187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.750+0000 7fb187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55856/0 (socket says 172.21.15.37:55856) 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.750+0000 7fb187fff640 1 -- 172.21.15.37:0/3799628710 learned_addr learned my addr 172.21.15.37:0/3799628710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.750+0000 7fb194f60740 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f8142eb0 0x55d7f81432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.750+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c00e560 con 0x55d7f7d51cd0 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.750+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c0100a0 con 0x55d7f8142eb0 2024-09-21T01:25:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.750+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c00ec30 con 0x55d7f7d72670 2024-09-21T01:25:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.751+0000 7fb1877fe640 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f81478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.751+0000 7fb18cf89640 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f8142eb0 0x55d7f81432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.752+0000 7fb187fff640 1 -- 172.21.15.37:0/3799628710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 msgr2=0x55d7f81478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.752+0000 7fb187fff640 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f81478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.752+0000 7fb187fff640 1 -- 172.21.15.37:0/3799628710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f8142eb0 msgr2=0x55d7f81432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.752+0000 7fb187fff640 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f8142eb0 0x55d7f81432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.752+0000 7fb187fff640 1 -- 172.21.15.37:0/3799628710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f7d93580 con 0x55d7f7d51cd0 2024-09-21T01:25:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.753+0000 7fb187fff640 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152080 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb188070040 tx=0x7fb188069570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3d60067de485ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.764+0000 7fb171ffb640 1 -- 172.21.15.37:0/3799628710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1880a4070 con 0x55d7f7d51cd0 2024-09-21T01:25:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.764+0000 7fb171ffb640 1 -- 172.21.15.37:0/3799628710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb18809b050 con 0x55d7f7d51cd0 2024-09-21T01:25:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.764+0000 7fb171ffb640 1 -- 172.21.15.37:0/3799628710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188099030 con 0x55d7f7d51cd0 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 msgr2=0x55d7f8152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152080 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb188070040 tx=0x7fb188069570 comp rx=0 tx=0).stop 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 shutdown_connections 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f8142eb0 0x55d7f81432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f7d72670 0x55d7f81478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 --2- 172.21.15.37:0/3799628710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d51cd0 0x55d7f8152080 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.766+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 >> 172.21.15.37:0/3799628710 conn(0x55d7f7d87740 msgr2=0x55d7f81471e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:27.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.771+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 shutdown_connections 2024-09-21T01:25:27.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.771+0000 7fb194f60740 1 -- 172.21.15.37:0/3799628710 wait complete. 2024-09-21T01:25:27.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.771+0000 7fb194f60740 1 -- start start 2024-09-21T01:25:27.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.772+0000 7fb194f60740 1 Processor -- start 2024-09-21T01:25:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.773+0000 7fb194f60740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d51cd0 0x55d7f8140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.773+0000 7fb194f60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d72670 0x55d7f814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.773+0000 7fb194f60740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f8142eb0 0x55d7f814e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.773+0000 7fb194f60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c00f9d0 con 0x55d7f7d72670 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb187fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d51cd0 0x55d7f8140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb187fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d51cd0 0x55d7f8140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:44106/0 (socket says 172.21.15.37:44106) 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb187fff640 1 -- 172.21.15.37:0/2046830659 learned_addr learned my addr 172.21.15.37:0/2046830659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c00f300 con 0x55d7f7d51cd0 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c00c520 con 0x55d7f8142eb0 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb18cf89640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f8142eb0 0x55d7f814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.774+0000 7fb194f60740 10 client.0 _ll_register_callbacks cb 0x7fb188075b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.775+0000 7fb1877fe640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d72670 0x55d7f814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.775+0000 7fb1877fe640 1 -- 172.21.15.37:0/2046830659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f8142eb0 msgr2=0x55d7f814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.775+0000 7fb1877fe640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f8142eb0 0x55d7f814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.775+0000 7fb1877fe640 1 -- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d51cd0 msgr2=0x55d7f8140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.775+0000 7fb1877fe640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d51cd0 0x55d7f8140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.775+0000 7fb1877fe640 1 -- 172.21.15.37:0/2046830659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f814eb60 con 0x55d7f7d72670 2024-09-21T01:25:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.776+0000 7fb1877fe640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d72670 0x55d7f814e0e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0a8de0 tx=0x7fb17c0e3f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2bc06b1c1e08c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.776+0000 7fb1677fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.777+0000 7fb1677fe640 1 -- 172.21.15.37:0/2046830659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c097070 con 0x55d7f7d72670 2024-09-21T01:25:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.777+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb18809b050 con 0x55d7f7d72670 2024-09-21T01:25:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.777+0000 7fb1677fe640 1 -- 172.21.15.37:0/2046830659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fb17c0abc70 con 0x55d7f7d72670 2024-09-21T01:25:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.777+0000 7fb1677fe640 1 -- 172.21.15.37:0/2046830659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb17c020040 con 0x55d7f7d72670 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.780+0000 7fb194f60740 10 client.16941 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.780+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d7f81d4e40 con 0x55d7f7d72670 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb1677fe640 1 -- 172.21.15.37:0/2046830659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb18809b050 con 0x55d7f7d72670 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb1677fe640 1 -- 172.21.15.37:0/2046830659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb17c0ab4e0 con 0x55d7f7d72670 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb194f60740 10 client.16941 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb194f60740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb194f60740 20 client.16941 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb194f60740 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f81d5360 0x55d7f81d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb194f60740 4 client.16941 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:25:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.781+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d7f80abc90 con 0x55d7f81d5360 2024-09-21T01:25:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.785+0000 7fb187fff640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f81d5360 0x55d7f81d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.794+0000 7fb187fff640 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f81d5360 0x55d7f81d7780 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574bddbb8e666ad7 server_cookie=d0bbd17c7280aa16 in_seq=0 out_seq=0 2024-09-21T01:25:27.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:27.794+0000 7fb1677fe640 10 client.16941 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:28.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.492+0000 7fb1677fe640 1 -- 172.21.15.37:0/2046830659 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d7f80abc90 con 0x55d7f81d5360 2024-09-21T01:25:28.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.492+0000 7fb1677fe640 10 client.16941 handle_command_reply: tid=0 2024-09-21T01:25:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.492+0000 7fb194f60740 1 client.16941 shutdown 2024-09-21T01:25:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.493+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d72670 msgr2=0x55d7f814e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.493+0000 7fb194f60740 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d72670 0x55d7f814e0e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0a8de0 tx=0x7fb17c0e3f20 comp rx=0 tx=0).stop 2024-09-21T01:25:28.498 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:25:28.498 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:25:28.498 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "e929fe6e-e756-46ca-bb18-0e2677e31537", 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 shutdown_connections 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55d7f81d5360 0x55d7f81d7780 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d7f8142eb0 0x55d7f814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7f7d72670 0x55d7f814e0e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 --2- 172.21.15.37:0/2046830659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d7f7d51cd0 0x55d7f8140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 >> 172.21.15.37:0/2046830659 conn(0x55d7f7d87740 msgr2=0x55d7f813b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb1677fe640 0 client.16941 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 shutdown_connections 2024-09-21T01:25:28.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 1 -- 172.21.15.37:0/2046830659 wait complete. 2024-09-21T01:25:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.494+0000 7fb194f60740 20 client.16941 trim_cache size 0 max 16384 2024-09-21T01:25:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.497+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb1780b6720 msgr2=0x7fb1780b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.497+0000 7fb18d78a640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb1780b6720 0x7fb1780b8c30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb188051230 tx=0x7fb188069ad0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.497+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 msgr2=0x7fb1800a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.497+0000 7fb18d78a640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 0x7fb1800a0f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb180008810 tx=0x7fb17c00db30 comp rx=0 tx=0).stop 2024-09-21T01:25:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.499+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 shutdown_connections 2024-09-21T01:25:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.499+0000 7fb18d78a640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fb1780b6720 0x7fb1780b8c30 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb188051230 tx=0x7fb188069ad0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.499+0000 7fb18d78a640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb18009b2c0 0x7fb180136630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.499+0000 7fb18d78a640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18009a970 0x7fb1800a0f80 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb180008810 tx=0x7fb17c00db30 comp rx=0 tx=0).stop 2024-09-21T01:25:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.499+0000 7fb18d78a640 1 --2- 172.21.15.37:0/251497370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb180095030 0x7fb1800a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.500+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 >> 172.21.15.37:0/251497370 conn(0x7fb18000cd80 msgr2=0x7fb1800a62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.502+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 shutdown_connections 2024-09-21T01:25:28.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:28.502+0000 7fb18d78a640 1 -- 172.21.15.37:0/251497370 wait complete. 2024-09-21T01:25:29.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:28 smithi137 ceph-mon[34607]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 742 MiB/s wr, 1.66k op/s 2024-09-21T01:25:29.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:28 smithi144 ceph-mon[34818]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 742 MiB/s wr, 1.66k op/s 2024-09-21T01:25:29.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:28 smithi037 ceph-mon[31105]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 742 MiB/s wr, 1.66k op/s 2024-09-21T01:25:30.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:29 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:25:30.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:29 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:30.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:29 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:25:30.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:29 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:25:30.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:29 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:30.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:29 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:25:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:29 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:25:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:29 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:30.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:29 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:25:30.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:25:31.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:30 smithi037 ceph-mon[31105]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 966 MiB/s wr, 1.96k op/s 2024-09-21T01:25:31.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:30 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:25:31.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:30 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:31.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:30 smithi137 ceph-mon[34607]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 966 MiB/s wr, 1.96k op/s 2024-09-21T01:25:31.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:30 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:25:31.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:30 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:31.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:30 smithi144 ceph-mon[34818]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 966 MiB/s wr, 1.96k op/s 2024-09-21T01:25:31.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:30 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:25:31.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:30 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:25:32.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:31 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:32.071 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:31 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:32.071 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:31 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:25:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.729+0000 7f680f638640 1 -- 172.21.15.37:0/2653624559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a5c20 msgr2=0x7f68000a6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.729+0000 7f680f638640 1 --2- 172.21.15.37:0/2653624559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a5c20 0x7f68000a6030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6804009900 tx=0x7f680402a400 comp rx=0 tx=0).stop 2024-09-21T01:25:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.731+0000 7f680f638640 1 -- 172.21.15.37:0/2653624559 shutdown_connections 2024-09-21T01:25:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.731+0000 7f680f638640 1 --2- 172.21.15.37:0/2653624559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68000a65c0 0x7f68000aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.731+0000 7f680f638640 1 --2- 172.21.15.37:0/2653624559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a5c20 0x7f68000a6030 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.731+0000 7f680f638640 1 --2- 172.21.15.37:0/2653624559 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68000a4d30 0x7f68000a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.731+0000 7f680f638640 1 -- 172.21.15.37:0/2653624559 >> 172.21.15.37:0/2653624559 conn(0x7f68000a04c0 msgr2=0x7f68000a2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.737+0000 7f680f638640 1 -- 172.21.15.37:0/2653624559 shutdown_connections 2024-09-21T01:25:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.737+0000 7f680f638640 1 -- 172.21.15.37:0/2653624559 wait complete. 2024-09-21T01:25:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.738+0000 7f680f638640 1 Processor -- start 2024-09-21T01:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 -- start start 2024-09-21T01:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68000a4d30 0x7f68000b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68000a5c20 0x7f68000b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 0x7f68000b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68000ad310 con 0x7f68000a65c0 2024-09-21T01:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68000ad190 con 0x7f68000a5c20 2024-09-21T01:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.740+0000 7f680f638640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f68000ad490 con 0x7f68000a4d30 2024-09-21T01:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.741+0000 7f680dbd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 0x7f68000b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.741+0000 7f680dbd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 0x7f68000b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55890/0 (socket says 172.21.15.37:55890) 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.741+0000 7f680dbd5640 1 -- 172.21.15.37:0/3861525232 learned_addr learned my addr 172.21.15.37:0/3861525232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.742+0000 7f680dbd5640 1 -- 172.21.15.37:0/3861525232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68000a4d30 msgr2=0x7f68000b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.742+0000 7f680dbd5640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68000a4d30 0x7f68000b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.742+0000 7f680dbd5640 1 -- 172.21.15.37:0/3861525232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68000a5c20 msgr2=0x7f68000b4f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.742+0000 7f680dbd5640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68000a5c20 0x7f68000b4f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.742+0000 7f680dbd5640 1 -- 172.21.15.37:0/3861525232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000b59d0 con 0x7f68000a65c0 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.743+0000 7f680dbd5640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 0x7f68000b5490 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009fd0 tx=0x7f67f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.743+0000 7f67fe7fc640 1 -- 172.21.15.37:0/3861525232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8011830 con 0x7f68000a65c0 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.743+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68000b5cc0 con 0x7f68000a65c0 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.743+0000 7f67fe7fc640 1 -- 172.21.15.37:0/3861525232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67f8016070 con 0x7f68000a65c0 2024-09-21T01:25:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.743+0000 7f67fe7fc640 1 -- 172.21.15.37:0/3861525232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8010e50 con 0x7f68000a65c0 2024-09-21T01:25:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.744+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6800154850 con 0x7f68000a65c0 2024-09-21T01:25:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 Processor -- start 2024-09-21T01:25:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 -- start start 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39856040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 0x55eb398566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb3948d4d0 0x55eb39857200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb397c86f0 con 0x55eb394ae1b0 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.751+0000 7f6816685740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb397b7b20 con 0x55eb394852f0 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.752+0000 7f6816685740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55eb397bb930 con 0x55eb3948d4d0 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.752+0000 7f680d3d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 0x55eb398566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.752+0000 7f680d3d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 0x55eb398566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:44122/0 (socket says 172.21.15.37:44122) 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.752+0000 7f680d3d4640 1 -- 172.21.15.37:0/1124154960 learned_addr learned my addr 172.21.15.37:0/1124154960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.752+0000 7f680cbd3640 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb3948d4d0 0x55eb39857200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.754+0000 7f680cbd3640 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39856040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.754+0000 7f680d3d4640 1 -- 172.21.15.37:0/1124154960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb3948d4d0 msgr2=0x55eb39857200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.754+0000 7f680d3d4640 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb3948d4d0 0x55eb39857200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.754+0000 7f680d3d4640 1 -- 172.21.15.37:0/1124154960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 msgr2=0x55eb39856040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.756+0000 7f680d3d4640 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39856040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.756+0000 7f680d3d4640 1 -- 172.21.15.37:0/1124154960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb3977d530 con 0x55eb394852f0 2024-09-21T01:25:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.757+0000 7f680d3d4640 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 0x55eb398566b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6808052860 tx=0x7f68080747e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c137181a0b459c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.757+0000 7f67fe7fc640 1 -- 172.21.15.37:0/3861525232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f67f8010380 con 0x7f68000a65c0 2024-09-21T01:25:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.759+0000 7f67fe7fc640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f67f40b68c0 0x7f67f40b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.759+0000 7f67fe7fc640 1 -- 172.21.15.37:0/3861525232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f67f80e68b0 con 0x7f68000a65c0 2024-09-21T01:25:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.761+0000 7f67f37fe640 1 -- 172.21.15.37:0/1124154960 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680807a070 con 0x55eb394852f0 2024-09-21T01:25:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.762+0000 7f67f37fe640 1 -- 172.21.15.37:0/1124154960 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6808076ae0 con 0x55eb394852f0 2024-09-21T01:25:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.762+0000 7f67f37fe640 1 -- 172.21.15.37:0/1124154960 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808075a70 con 0x55eb394852f0 2024-09-21T01:25:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.764+0000 7f6816685740 1 -- 172.21.15.37:0/1124154960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 msgr2=0x55eb398566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.764+0000 7f6816685740 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 0x55eb398566b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6808052860 tx=0x7f68080747e0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.765+0000 7f680cbd3640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f67f40b68c0 0x7f67f40b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.766+0000 7f680cbd3640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f67f40b68c0 0x7f67f40b8dd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6804009230 tx=0x7f6804005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.766+0000 7f6816685740 1 -- 172.21.15.37:0/1124154960 shutdown_connections 2024-09-21T01:25:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.766+0000 7f6816685740 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb3948d4d0 0x55eb39857200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.767+0000 7f6816685740 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb394852f0 0x55eb398566b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.767+0000 7f6816685740 1 --2- 172.21.15.37:0/1124154960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39856040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.767+0000 7f6816685740 1 -- 172.21.15.37:0/1124154960 >> 172.21.15.37:0/1124154960 conn(0x55eb394a2300 msgr2=0x55eb39851ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.767+0000 7f6816685740 1 -- 172.21.15.37:0/1124154960 shutdown_connections 2024-09-21T01:25:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.771+0000 7f6816685740 1 -- 172.21.15.37:0/1124154960 wait complete. 2024-09-21T01:25:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.772+0000 7f6816685740 1 -- start start 2024-09-21T01:25:32.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.772+0000 7f6816685740 1 Processor -- start 2024-09-21T01:25:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb3985f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb3985fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb398608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb396efab0 con 0x55eb394852f0 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb3975d730 con 0x55eb3948d4d0 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55eb39857d20 con 0x55eb394ae1b0 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.774+0000 7f6816685740 10 client.0 _ll_register_callbacks cb 0x55eb397b16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.775+0000 7f680cbd3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb3985fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.775+0000 7f680d3d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb3985f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.775+0000 7f680d3d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb3985f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55906/0 (socket says 172.21.15.37:55906) 2024-09-21T01:25:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.775+0000 7f680d3d4640 1 -- 172.21.15.37:0/4278516223 learned_addr learned my addr 172.21.15.37:0/4278516223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.776+0000 7f680cbd3640 1 -- 172.21.15.37:0/4278516223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 msgr2=0x55eb398608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.776+0000 7f680cbd3640 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb398608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.776+0000 7f680cbd3640 1 -- 172.21.15.37:0/4278516223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 msgr2=0x55eb3985f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.776+0000 7f680cbd3640 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb3985f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.776+0000 7f680cbd3640 1 -- 172.21.15.37:0/4278516223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb39519790 con 0x55eb3948d4d0 2024-09-21T01:25:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.777+0000 7f680cbd3640 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb3985fd30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6804005f70 tx=0x7f6804009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e3abbae2b1aea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:32.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.777+0000 7f67f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:25:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.777+0000 7f67f0ff9640 1 -- 172.21.15.37:0/4278516223 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68040319b0 con 0x55eb3948d4d0 2024-09-21T01:25:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.778+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6808076ae0 con 0x55eb3948d4d0 2024-09-21T01:25:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.778+0000 7f67f0ff9640 1 -- 172.21.15.37:0/4278516223 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6804031b50 con 0x55eb3948d4d0 2024-09-21T01:25:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.778+0000 7f67f0ff9640 1 -- 172.21.15.37:0/4278516223 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6804059050 con 0x55eb3948d4d0 2024-09-21T01:25:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.779+0000 7f6816685740 10 client.26351 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.779+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb39592620 con 0x55eb3948d4d0 2024-09-21T01:25:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f67f0ff9640 1 -- 172.21.15.37:0/4278516223 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6808076ae0 con 0x55eb3948d4d0 2024-09-21T01:25:32.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f67f0ff9640 1 -- 172.21.15.37:0/4278516223 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f680403a040 con 0x55eb3948d4d0 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f6816685740 10 client.26351 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f6816685740 10 client.26351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f6816685740 20 client.26351 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f6816685740 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb3946cd80 0x55eb3986d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f6816685740 4 client.26351 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.780+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb397ca640 con 0x55eb3946cd80 2024-09-21T01:25:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.781+0000 7f680d3d4640 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb3946cd80 0x55eb3986d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.782+0000 7f67f0ff9640 10 client.26351 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.783+0000 7f680d3d4640 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb3946cd80 0x55eb3986d3a0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0fda09f929ec64 server_cookie=91427c4702d2a211 in_seq=0 out_seq=0 2024-09-21T01:25:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.786+0000 7f67f0ff9640 1 -- 172.21.15.37:0/4278516223 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb397ca640 con 0x55eb3946cd80 2024-09-21T01:25:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.787+0000 7f67f0ff9640 10 client.26351 handle_command_reply: tid=0 2024-09-21T01:25:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.787+0000 7f6816685740 1 client.26351 shutdown 2024-09-21T01:25:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.809+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 msgr2=0x55eb3985fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.809+0000 7f6816685740 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb3985fd30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6804005f70 tx=0x7f6804009260 comp rx=0 tx=0).stop 2024-09-21T01:25:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 shutdown_connections 2024-09-21T01:25:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb3946cd80 0x55eb3986d3a0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb398608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb3985fd30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 --2- 172.21.15.37:0/4278516223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb3985f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 >> 172.21.15.37:0/4278516223 conn(0x55eb394a2300 msgr2=0x55eb398570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f67f0ff9640 0 client.26351 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.811+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 shutdown_connections 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.812+0000 7f6816685740 1 -- 172.21.15.37:0/4278516223 wait complete. 2024-09-21T01:25:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.812+0000 7f6816685740 20 client.26351 trim_cache size 0 max 16384 2024-09-21T01:25:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.881+0000 7f6816685740 1 Processor -- start 2024-09-21T01:25:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.882+0000 7f6816685740 1 -- start start 2024-09-21T01:25:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.883+0000 7f6816685740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb39851410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.883+0000 7f6816685740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb39851950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.883+0000 7f6816685740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb3985e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.883+0000 7f6816685740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec00e510 con 0x55eb394852f0 2024-09-21T01:25:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.883+0000 7f6816685740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec010050 con 0x55eb3948d4d0 2024-09-21T01:25:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.883+0000 7f6816685740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec00ebe0 con 0x55eb394ae1b0 2024-09-21T01:25:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.888+0000 7f680dbd5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb3985e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.889+0000 7f680cbd3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb39851950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.889+0000 7f680dbd5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb3985e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39186/0 (socket says 172.21.15.37:39186) 2024-09-21T01:25:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.889+0000 7f680dbd5640 1 -- 172.21.15.37:0/277729266 learned_addr learned my addr 172.21.15.37:0/277729266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.890+0000 7f680dbd5640 1 -- 172.21.15.37:0/277729266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 msgr2=0x55eb39851950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.890+0000 7f680dbd5640 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb39851950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.890+0000 7f680dbd5640 1 -- 172.21.15.37:0/277729266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 msgr2=0x55eb39851410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.890+0000 7f680dbd5640 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb39851410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.890+0000 7f680dbd5640 1 -- 172.21.15.37:0/277729266 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb3985d7f0 con 0x55eb394ae1b0 2024-09-21T01:25:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.895+0000 7f680dbd5640 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb3985e1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f67f80ac700 tx=0x7f67f8011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=633e78032779e7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.896+0000 7f67f2ffd640 1 -- 172.21.15.37:0/277729266 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f80ac510 con 0x55eb394ae1b0 2024-09-21T01:25:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.906+0000 7f67f2ffd640 1 -- 172.21.15.37:0/277729266 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67f80ad100 con 0x55eb394ae1b0 2024-09-21T01:25:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.908+0000 7f6816685740 1 -- 172.21.15.37:0/277729266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 msgr2=0x55eb3985e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.908+0000 7f6816685740 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb3985e1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f67f80ac700 tx=0x7f67f8011000 comp rx=0 tx=0).stop 2024-09-21T01:25:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.912+0000 7f6816685740 1 -- 172.21.15.37:0/277729266 shutdown_connections 2024-09-21T01:25:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.912+0000 7f6816685740 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394ae1b0 0x55eb3985e1b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.912+0000 7f6816685740 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb39851950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.912+0000 7f6816685740 1 --2- 172.21.15.37:0/277729266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394852f0 0x55eb39851410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.912+0000 7f6816685740 1 -- 172.21.15.37:0/277729266 >> 172.21.15.37:0/277729266 conn(0x55eb394a2300 msgr2=0x55eb39856e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.913+0000 7f6816685740 1 -- 172.21.15.37:0/277729266 shutdown_connections 2024-09-21T01:25:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.913+0000 7f6816685740 1 -- 172.21.15.37:0/277729266 wait complete. 2024-09-21T01:25:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.914+0000 7f6816685740 1 -- start start 2024-09-21T01:25:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.914+0000 7f6816685740 1 Processor -- start 2024-09-21T01:25:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394852f0 0x55eb39861f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb398625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39862fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec00f980 con 0x55eb394ae1b0 2024-09-21T01:25:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec00f2b0 con 0x55eb3948d4d0 2024-09-21T01:25:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec00c4d0 con 0x55eb394852f0 2024-09-21T01:25:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.915+0000 7f6816685740 10 client.0 _ll_register_callbacks cb 0x7f6804009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.916+0000 7f680cbd3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb398625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.916+0000 7f680cbd3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb398625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:44146/0 (socket says 172.21.15.37:44146) 2024-09-21T01:25:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.916+0000 7f680cbd3640 1 -- 172.21.15.37:0/541389489 learned_addr learned my addr 172.21.15.37:0/541389489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680d3d4640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394852f0 0x55eb39861f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680dbd5640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39862fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680cbd3640 1 -- 172.21.15.37:0/541389489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394852f0 msgr2=0x55eb39861f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680cbd3640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394852f0 0x55eb39861f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680cbd3640 1 -- 172.21.15.37:0/541389489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 msgr2=0x55eb39862fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680cbd3640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39862fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:32.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.917+0000 7f680cbd3640 1 -- 172.21.15.37:0/541389489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb39863730 con 0x55eb3948d4d0 2024-09-21T01:25:32.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.918+0000 7f680cbd3640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb398625e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f680404af50 tx=0x7f680403c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71774aecd7d4ac24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:32.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.919+0000 7f67f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:25:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.921+0000 7f67f0ff9640 1 -- 172.21.15.37:0/541389489 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804031bc0 con 0x55eb3948d4d0 2024-09-21T01:25:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.921+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f80ad100 con 0x55eb3948d4d0 2024-09-21T01:25:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.922+0000 7f67f0ff9640 1 -- 172.21.15.37:0/541389489 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f6804031d60 con 0x55eb3948d4d0 2024-09-21T01:25:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.922+0000 7f67f0ff9640 1 -- 172.21.15.37:0/541389489 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f680403c7e0 con 0x55eb3948d4d0 2024-09-21T01:25:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.924+0000 7f6816685740 10 client.26357 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:32.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.924+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb39866ad0 con 0x55eb3948d4d0 2024-09-21T01:25:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.927+0000 7f67f0ff9640 1 -- 172.21.15.37:0/541389489 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67f80ad100 con 0x55eb3948d4d0 2024-09-21T01:25:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.927+0000 7f67f0ff9640 1 -- 172.21.15.37:0/541389489 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6804053430 con 0x55eb3948d4d0 2024-09-21T01:25:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.928+0000 7f6816685740 10 client.26357 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.928+0000 7f6816685740 10 client.26357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.928+0000 7f6816685740 20 client.26357 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.928+0000 7f6816685740 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb394421c0 0x55eb398d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.928+0000 7f6816685740 4 client.26357 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:25:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.928+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb397c60f0 con 0x55eb394421c0 2024-09-21T01:25:32.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.936+0000 7f680d3d4640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb394421c0 0x55eb398d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:32.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.980+0000 7f67f0ff9640 10 client.26357 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:32.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:32.980+0000 7f680d3d4640 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb394421c0 0x55eb398d9db0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9da45230a878d3 server_cookie=c3e1378e5e8b1275 in_seq=0 out_seq=0 2024-09-21T01:25:33.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:32 smithi037 ceph-mon[31105]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 858 MiB/s wr, 1.66k op/s 2024-09-21T01:25:33.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:32 smithi137 ceph-mon[34607]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 858 MiB/s wr, 1.66k op/s 2024-09-21T01:25:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:32 smithi144 ceph-mon[34818]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 858 MiB/s wr, 1.66k op/s 2024-09-21T01:25:33.828 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:25:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:25:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:25:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "e929fe6e-e756-46ca-bb18-0e2677e31537": { 2024-09-21T01:25:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "e929fe6e-e756-46ca-bb18-0e2677e31537", 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "e929fe6e-e756-46ca-bb18-0e2677e31537": { 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:25:28.490664+0000", 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:24:00.417164+0000", 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:25:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:25:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:25:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:25:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:25:33.834 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:25:33.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 -- 172.21.15.37:0/1974359616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84901081b0 msgr2=0x7f84901085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 --2- 172.21.15.37:0/1974359616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84901081b0 0x7f84901085c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8484009900 tx=0x7f848402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 -- 172.21.15.37:0/1974359616 shutdown_connections 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 --2- 172.21.15.37:0/1974359616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490108b00 0x7f849010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 --2- 172.21.15.37:0/1974359616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84901081b0 0x7f84901085c0 secure :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8484009900 tx=0x7f848402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 --2- 172.21.15.37:0/1974359616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8490102870 0x7f8490102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.391+0000 7f848f59e640 1 -- 172.21.15.37:0/1974359616 >> 172.21.15.37:0/1974359616 conn(0x7f84900fe2c0 msgr2=0x7f8490100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.395+0000 7f848f59e640 1 -- 172.21.15.37:0/1974359616 shutdown_connections 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.397+0000 7f848f59e640 1 -- 172.21.15.37:0/1974359616 wait complete. 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.398+0000 7f848f59e640 1 Processor -- start 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.398+0000 7f848f59e640 1 -- start start 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.399+0000 7f848f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 0x7f849006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.399+0000 7f848f59e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8490108b00 0x7f849006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.399+0000 7f848f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490072910 0x7f8490072d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.399+0000 7f848f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111700 con 0x7f8490072910 2024-09-21T01:25:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.399+0000 7f848f59e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111580 con 0x7f8490102870 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.399+0000 7f848f59e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111880 con 0x7f8490108b00 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.402+0000 7f848e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 0x7f849006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.406+0000 7f848e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 0x7f849006d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:44154/0 (socket says 172.21.15.37:44154) 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.406+0000 7f848e59c640 1 -- 172.21.15.37:0/2717278576 learned_addr learned my addr 172.21.15.37:0/2717278576 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.407+0000 7f848e59c640 1 -- 172.21.15.37:0/2717278576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8490108b00 msgr2=0x7f849006d710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.407+0000 7f848e59c640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8490108b00 0x7f849006d710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.407+0000 7f848e59c640 1 -- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490072910 msgr2=0x7f8490072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.407+0000 7f848e59c640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490072910 0x7f8490072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.407+0000 7f848e59c640 1 -- 172.21.15.37:0/2717278576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84900734f0 con 0x7f8490102870 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.407+0000 7f848e59c640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 0x7f849006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f848000d950 tx=0x7f848000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.408+0000 7f847f7fe640 1 -- 172.21.15.37:0/2717278576 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480017070 con 0x7f8490102870 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.408+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8490073a80 con 0x7f8490102870 2024-09-21T01:25:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.408+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8490074010 con 0x7f8490102870 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.408+0000 7f847f7fe640 1 -- 172.21.15.37:0/2717278576 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8480009c30 con 0x7f8490102870 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.408+0000 7f847f7fe640 1 -- 172.21.15.37:0/2717278576 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848000f620 con 0x7f8490102870 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.418+0000 7f847f7fe640 1 -- 172.21.15.37:0/2717278576 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8480010460 con 0x7f8490102870 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.419+0000 7f847f7fe640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84780baa20 0x7f84780bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.420+0000 7f847f7fe640 1 -- 172.21.15.37:0/2717278576 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f84800e6d40 con 0x7f8490102870 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.421+0000 7f848dd9b640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84780baa20 0x7f84780bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.426+0000 7f848dd9b640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84780baa20 0x7f84780bcf30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8484008000 tx=0x7f8484000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.428+0000 7f849b445740 1 Processor -- start 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.428+0000 7f849b445740 1 -- start start 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.429+0000 7f849b445740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 0x5616e60a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.429+0000 7f849b445740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cc71b0 0x5616e60a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.429+0000 7f849b445740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5ccf390 0x5616e60a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.429+0000 7f849b445740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616e600de50 con 0x5616e5cc71b0 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.429+0000 7f849b445740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616e5ffd280 con 0x5616e5cf0070 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.429+0000 7f849b445740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5616e6001090 con 0x5616e5ccf390 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.430+0000 7f848e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 0x5616e60a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.430+0000 7f848e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 0x5616e60a8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:44158/0 (socket says 172.21.15.37:44158) 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.430+0000 7f848e59c640 1 -- 172.21.15.37:0/2604033818 learned_addr learned my addr 172.21.15.37:0/2604033818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.431+0000 7f848ed9d640 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5ccf390 0x5616e60a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.432+0000 7f848dd9b640 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cc71b0 0x5616e60a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.434+0000 7f848e59c640 1 -- 172.21.15.37:0/2604033818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5ccf390 msgr2=0x5616e60a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.434+0000 7f848e59c640 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5ccf390 0x5616e60a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.434+0000 7f848e59c640 1 -- 172.21.15.37:0/2604033818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cc71b0 msgr2=0x5616e60a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.434+0000 7f848e59c640 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cc71b0 0x5616e60a8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.434+0000 7f848e59c640 1 -- 172.21.15.37:0/2604033818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e5d5b650 con 0x5616e5cf0070 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.435+0000 7f848e59c640 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 0x5616e60a8820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84800acb90 tx=0x7f84800ac6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e9cfd328f2c4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.436+0000 7f847cff9640 1 -- 172.21.15.37:0/2604033818 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480020070 con 0x5616e5cf0070 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.436+0000 7f847cff9640 1 -- 172.21.15.37:0/2604033818 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84800ad590 con 0x5616e5cf0070 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 -- 172.21.15.37:0/2604033818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 msgr2=0x5616e60a8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 0x5616e60a8820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84800acb90 tx=0x7f84800ac6c0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 -- 172.21.15.37:0/2604033818 shutdown_connections 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5ccf390 0x5616e60a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cc71b0 0x5616e60a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 --2- 172.21.15.37:0/2604033818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cf0070 0x5616e60a8820 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84800acb90 tx=0x7f84800ac6c0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.438+0000 7f849b445740 1 -- 172.21.15.37:0/2604033818 >> 172.21.15.37:0/2604033818 conn(0x5616e5ce4460 msgr2=0x5616e60a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.445+0000 7f849b445740 1 -- 172.21.15.37:0/2604033818 shutdown_connections 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.446+0000 7f849b445740 1 -- 172.21.15.37:0/2604033818 wait complete. 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.447+0000 7f849b445740 1 -- start start 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.447+0000 7f849b445740 1 Processor -- start 2024-09-21T01:25:33.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5ccf390 0x5616e60b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616e5e5e700 con 0x5616e5cae9f0 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5616e5f98110 con 0x5616e5ccf390 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5616e60b70a0 con 0x5616e5cc71b0 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.448+0000 7f849b445740 10 client.0 _ll_register_callbacks cb 0x5616e5fb1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.449+0000 7f848e59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.450+0000 7f848e59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39236/0 (socket says 172.21.15.37:39236) 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.450+0000 7f848e59c640 1 -- 172.21.15.37:0/1648011722 learned_addr learned my addr 172.21.15.37:0/1648011722 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.451+0000 7f848ed9d640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.454+0000 7f848dd9b640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5ccf390 0x5616e60b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.454+0000 7f848e59c640 1 -- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5ccf390 msgr2=0x5616e60b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.454+0000 7f848e59c640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5ccf390 0x5616e60b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.454+0000 7f848e59c640 1 -- 172.21.15.37:0/1648011722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 msgr2=0x5616e60b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.454+0000 7f848e59c640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.454+0000 7f848e59c640 1 -- 172.21.15.37:0/1648011722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e5fc5c40 con 0x5616e5cc71b0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.455+0000 7f848e59c640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b6600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8480000c00 tx=0x7f848000bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ffaeefa86d5a324 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.455+0000 7f8475ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.455+0000 7f8475ffb640 1 -- 172.21.15.37:0/1648011722 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480098070 con 0x5616e5cc71b0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.456+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616e600fda0 con 0x5616e5cc71b0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.456+0000 7f8475ffb640 1 -- 172.21.15.37:0/1648011722 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f84800a89f0 con 0x5616e5cc71b0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.456+0000 7f8475ffb640 1 -- 172.21.15.37:0/1648011722 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8480020070 con 0x5616e5cc71b0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.464+0000 7f849b445740 10 client.26338 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.464+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616e60c2a50 con 0x5616e5cc71b0 2024-09-21T01:25:33.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.468+0000 7f8475ffb640 1 -- 172.21.15.37:0/1648011722 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5616e600fda0 con 0x5616e5cc71b0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.468+0000 7f8475ffb640 1 -- 172.21.15.37:0/1648011722 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f84800d41b0 con 0x5616e5cc71b0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.470+0000 7f849b445740 10 client.26338 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.470+0000 7f849b445740 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.470+0000 7f849b445740 20 client.26338 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.470+0000 7f849b445740 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e5c83da0 0x5616e60c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.470+0000 7f849b445740 4 client.26338 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.470+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616e600b850 con 0x5616e5c83da0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.471+0000 7f848dd9b640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e5c83da0 0x5616e60c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.474+0000 7f848dd9b640 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e5c83da0 0x5616e60c5f80 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73de071f1bd4ab0e server_cookie=a3561a494659a8d5 in_seq=0 out_seq=0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.474+0000 7f8475ffb640 10 client.26338 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.479+0000 7f8475ffb640 1 -- 172.21.15.37:0/1648011722 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616e600b850 con 0x5616e5c83da0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.479+0000 7f8475ffb640 10 client.26338 handle_command_reply: tid=0 2024-09-21T01:25:33.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.479+0000 7f849b445740 1 client.26338 shutdown 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.480+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 msgr2=0x5616e60b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.480+0000 7f849b445740 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b6600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8480000c00 tx=0x7f848000bf60 comp rx=0 tx=0).stop 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 shutdown_connections 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e5c83da0 0x5616e60c5f80 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5ccf390 0x5616e60b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 --2- 172.21.15.37:0/1648011722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b6600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f8475ffb640 0 client.26338 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 >> 172.21.15.37:0/1648011722 conn(0x5616e5ce4460 msgr2=0x5616e60ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 shutdown_connections 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.486+0000 7f849b445740 1 -- 172.21.15.37:0/1648011722 wait complete. 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.491+0000 7f849b445740 20 client.26338 trim_cache size 0 max 16384 2024-09-21T01:25:33.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.544+0000 7f849b445740 1 Processor -- start 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.550+0000 7f849b445740 1 -- start start 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.550+0000 7f849b445740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cae9f0 0x5616e60c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.550+0000 7f849b445740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cc71b0 0x5616e60a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.550+0000 7f849b445740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 0x5616e60b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.551+0000 7f849b445740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f847000e620 con 0x5616e5ccf390 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.551+0000 7f849b445740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8470010160 con 0x5616e5cc71b0 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.551+0000 7f849b445740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f847000ecf0 con 0x5616e5cae9f0 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.552+0000 7f848ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 0x5616e60b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.552+0000 7f848ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 0x5616e60b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55954/0 (socket says 172.21.15.37:55954) 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.552+0000 7f848ed9d640 1 -- 172.21.15.37:0/3908515983 learned_addr learned my addr 172.21.15.37:0/3908515983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.554+0000 7f848e59c640 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cae9f0 0x5616e60c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.555+0000 7f848dd9b640 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cc71b0 0x5616e60a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.556+0000 7f848ed9d640 1 -- 172.21.15.37:0/3908515983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cae9f0 msgr2=0x5616e60c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.556+0000 7f848ed9d640 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cae9f0 0x5616e60c0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.556+0000 7f848ed9d640 1 -- 172.21.15.37:0/3908515983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cc71b0 msgr2=0x5616e60a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.556+0000 7f848ed9d640 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cc71b0 0x5616e60a6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.556+0000 7f848ed9d640 1 -- 172.21.15.37:0/3908515983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e5cf02a0 con 0x5616e5ccf390 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.561+0000 7f848ed9d640 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 0x5616e60b0cc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f84880124d0 tx=0x7f8488012990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588eb4879fa328c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.561+0000 7f8477fff640 1 -- 172.21.15.37:0/3908515983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84880120d0 con 0x5616e5ccf390 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.562+0000 7f8477fff640 1 -- 172.21.15.37:0/3908515983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8488012270 con 0x5616e5ccf390 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 -- 172.21.15.37:0/3908515983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 msgr2=0x5616e60b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 0x5616e60b0cc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f84880124d0 tx=0x7f8488012990 comp rx=0 tx=0).stop 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 -- 172.21.15.37:0/3908515983 shutdown_connections 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5ccf390 0x5616e60b0cc0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e5cc71b0 0x5616e60a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 --2- 172.21.15.37:0/3908515983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cae9f0 0x5616e60c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.564+0000 7f849b445740 1 -- 172.21.15.37:0/3908515983 >> 172.21.15.37:0/3908515983 conn(0x5616e5ce4460 msgr2=0x5616e60a6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:33.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.565+0000 7f849b445740 1 -- 172.21.15.37:0/3908515983 shutdown_connections 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.565+0000 7f849b445740 1 -- 172.21.15.37:0/3908515983 wait complete. 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.566+0000 7f849b445740 1 -- start start 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.566+0000 7f849b445740 1 Processor -- start 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e6128940 0x5616e6128d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f847000fa90 con 0x5616e5cae9f0 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f847000f3c0 con 0x5616e6128940 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f847000c5e0 con 0x5616e5cc71b0 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.568+0000 7f849b445740 10 client.0 _ll_register_callbacks cb 0x7f84800ac7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.571+0000 7f848dd9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.571+0000 7f848dd9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:39262/0 (socket says 172.21.15.37:39262) 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.571+0000 7f848dd9b640 1 -- 172.21.15.37:0/2947069222 learned_addr learned my addr 172.21.15.37:0/2947069222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.571+0000 7f848ed9d640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e6128940 0x5616e6128d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.572+0000 7f848e59c640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.575+0000 7f848dd9b640 1 -- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e6128940 msgr2=0x5616e6128d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.575+0000 7f848dd9b640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e6128940 0x5616e6128d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.575+0000 7f848dd9b640 1 -- 172.21.15.37:0/2947069222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 msgr2=0x5616e60b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.575+0000 7f848dd9b640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.575+0000 7f848dd9b640 1 -- 172.21.15.37:0/2947069222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e61293c0 con 0x5616e5cc71b0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.576+0000 7f848dd9b640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b81c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f848402a9e0 tx=0x7f848402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52b41c7012c9f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.576+0000 7f8475ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.577+0000 7f8475ffb640 1 -- 172.21.15.37:0/2947069222 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484035040 con 0x5616e5cc71b0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.577+0000 7f8475ffb640 1 -- 172.21.15.37:0/2947069222 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f84840314a0 con 0x5616e5cc71b0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.577+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616e6008c80 con 0x5616e5cc71b0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.578+0000 7f8475ffb640 1 -- 172.21.15.37:0/2947069222 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f848405f050 con 0x5616e5cc71b0 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.581+0000 7f849b445740 10 client.26344 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:33.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.581+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616e61307c0 con 0x5616e5cc71b0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f8475ffb640 1 -- 172.21.15.37:0/2947069222 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5616e6008c80 con 0x5616e5cc71b0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f8475ffb640 1 -- 172.21.15.37:0/2947069222 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8484049530 con 0x5616e5cc71b0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f849b445740 10 client.26344 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f849b445740 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f849b445740 20 client.26344 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f849b445740 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e6130fc0 0x5616e61333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f849b445740 4 client.26344 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.583+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616e5f7ea50 con 0x5616e6130fc0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.585+0000 7f848e59c640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e6130fc0 0x5616e61333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.589+0000 7f848e59c640 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e6130fc0 0x5616e61333e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d099c91efe6a9b3 server_cookie=f61dfca27cf5fd10 in_seq=0 out_seq=0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.589+0000 7f8475ffb640 10 client.26344 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.596+0000 7f8475ffb640 1 -- 172.21.15.37:0/2947069222 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x5616e5f7ea50 con 0x5616e6130fc0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.596+0000 7f8475ffb640 10 client.26344 handle_command_reply: tid=0 2024-09-21T01:25:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.596+0000 7f849b445740 1 client.26344 shutdown 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.596+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 msgr2=0x5616e60b81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.596+0000 7f849b445740 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b81c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f848402a9e0 tx=0x7f848402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 shutdown_connections 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f849b445740 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5616e6130fc0 0x5616e61333e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f849b445740 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5616e6128940 0x5616e6128d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f849b445740 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5616e5cc71b0 0x5616e60b81c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f849b445740 1 --2- 172.21.15.37:0/2947069222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616e5cae9f0 0x5616e60b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 >> 172.21.15.37:0/2947069222 conn(0x5616e5ce4460 msgr2=0x5616e60a9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.600+0000 7f8475ffb640 0 client.26344 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:33.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.601+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 shutdown_connections 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.601+0000 7f849b445740 1 -- 172.21.15.37:0/2947069222 wait complete. 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.611+0000 7f849b445740 20 client.26344 trim_cache size 0 max 16384 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.614+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84780baa20 msgr2=0x7f84780bcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.614+0000 7f848f59e640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84780baa20 0x7f84780bcf30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8484008000 tx=0x7f8484000bc0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.614+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 msgr2=0x7f849006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.614+0000 7f848f59e640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 0x7f849006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f848000d950 tx=0x7f848000de10 comp rx=0 tx=0).stop 2024-09-21T01:25:33.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.615+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 shutdown_connections 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.615+0000 7f848f59e640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f84780baa20 0x7f84780bcf30 secure :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8484008000 tx=0x7f8484000bc0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.615+0000 7f848f59e640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8490072910 0x7f8490072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.615+0000 7f848f59e640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8490108b00 0x7f849006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.615+0000 7f848f59e640 1 --2- 172.21.15.37:0/2717278576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8490102870 0x7f849006d190 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f848000d950 tx=0x7f848000de10 comp rx=0 tx=0).stop 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.615+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 >> 172.21.15.37:0/2717278576 conn(0x7f84900fe2c0 msgr2=0x7f84901006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.620+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 shutdown_connections 2024-09-21T01:25:33.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:25:33.622+0000 7f848f59e640 1 -- 172.21.15.37:0/2717278576 wait complete. 2024-09-21T01:25:35.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:34 smithi137 ceph-mon[34607]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 MiB/s wr, 1.65k op/s 2024-09-21T01:25:35.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:34 smithi144 ceph-mon[34818]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 MiB/s wr, 1.65k op/s 2024-09-21T01:25:35.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:34 smithi037 ceph-mon[31105]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 MiB/s wr, 1.65k op/s 2024-09-21T01:25:36.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:35 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:25:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:35 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:25:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.221+0000 7f67f0ff9640 1 -- 172.21.15.37:0/541389489 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb397c60f0 con 0x55eb394421c0 2024-09-21T01:25:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.221+0000 7f67f0ff9640 10 client.26357 handle_command_reply: tid=0 2024-09-21T01:25:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.221+0000 7f6816685740 1 client.26357 shutdown 2024-09-21T01:25:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 msgr2=0x55eb398625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb398625e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f680404af50 tx=0x7f680403c650 comp rx=0 tx=0).stop 2024-09-21T01:25:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 shutdown_connections 2024-09-21T01:25:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb394421c0 0x55eb398d9db0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb394ae1b0 0x55eb39862fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb3948d4d0 0x55eb398625e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 --2- 172.21.15.37:0/541389489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb394852f0 0x55eb39861f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 >> 172.21.15.37:0/541389489 conn(0x55eb394a2300 msgr2=0x55eb398513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f67f0ff9640 0 client.26357 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.222+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 shutdown_connections 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.223+0000 7f6816685740 1 -- 172.21.15.37:0/541389489 wait complete. 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.223+0000 7f6816685740 20 client.26357 trim_cache size 0 max 16384 2024-09-21T01:25:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:25:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:25:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:25:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:25:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.224+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f67f40b68c0 msgr2=0x7f67f40b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.225+0000 7f680f638640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f67f40b68c0 0x7f67f40b8dd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6804009230 tx=0x7f6804005fd0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.225+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 msgr2=0x7f68000b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.225+0000 7f680f638640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 0x7f68000b5490 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009fd0 tx=0x7f67f800b8e0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.226+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 shutdown_connections 2024-09-21T01:25:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.226+0000 7f680f638640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f67f40b68c0 0x7f67f40b8dd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.226+0000 7f680f638640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68000a65c0 0x7f68000b5490 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.226+0000 7f680f638640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68000a5c20 0x7f68000b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.226+0000 7f680f638640 1 --2- 172.21.15.37:0/3861525232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68000a4d30 0x7f68000b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.226+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 >> 172.21.15.37:0/3861525232 conn(0x7f68000a04c0 msgr2=0x7f68000a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.229+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 shutdown_connections 2024-09-21T01:25:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:36.229+0000 7f680f638640 1 -- 172.21.15.37:0/3861525232 wait complete. 2024-09-21T01:25:36.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:35 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:25:36.678 INFO:tasks.cephfs.filesystem:scrub status for tag:e929fe6e-e756-46ca-bb18-0e2677e31537 - {'path': '/', 'tag': 'e929fe6e-e756-46ca-bb18-0e2677e31537', 'options': 'recursive,force'} 2024-09-21T01:25:37.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:36 smithi137 ceph-mon[34607]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 963 MiB/s wr, 2.08k op/s 2024-09-21T01:25:37.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:36 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:25:37.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:36 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:25:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:36 smithi144 ceph-mon[34818]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 963 MiB/s wr, 2.08k op/s 2024-09-21T01:25:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:36 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:25:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:36 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:25:37.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:36 smithi037 ceph-mon[31105]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 963 MiB/s wr, 2.08k op/s 2024-09-21T01:25:37.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:36 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:25:37.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:36 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:25:38.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:25:38.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:25:38.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:25:38.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:25:38.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:25:38.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:25:38.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:25:38.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:25:38.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:25:39.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:39 smithi137 ceph-mon[34607]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 746 MiB/s wr, 1.53k op/s 2024-09-21T01:25:39.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:39 smithi144 ceph-mon[34818]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 746 MiB/s wr, 1.53k op/s 2024-09-21T01:25:39.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:39 smithi037 ceph-mon[31105]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 746 MiB/s wr, 1.53k op/s 2024-09-21T01:25:41.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:41 smithi137 ceph-mon[34607]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 947 MiB/s wr, 2.17k op/s 2024-09-21T01:25:41.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:41 smithi144 ceph-mon[34818]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 947 MiB/s wr, 2.17k op/s 2024-09-21T01:25:41.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:41 smithi037 ceph-mon[31105]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 947 MiB/s wr, 2.17k op/s 2024-09-21T01:25:43.155 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:43 smithi037 ceph-mon[31105]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 820 MiB/s wr, 2.08k op/s 2024-09-21T01:25:43.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:43 smithi137 ceph-mon[34607]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 820 MiB/s wr, 2.08k op/s 2024-09-21T01:25:43.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:43 smithi144 ceph-mon[34818]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 820 MiB/s wr, 2.08k op/s 2024-09-21T01:25:45.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:45 smithi037 ceph-mon[31105]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 786 MiB/s wr, 2.01k op/s 2024-09-21T01:25:45.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:45 smithi137 ceph-mon[34607]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 786 MiB/s wr, 2.01k op/s 2024-09-21T01:25:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:45 smithi144 ceph-mon[34818]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 786 MiB/s wr, 2.01k op/s 2024-09-21T01:25:47.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:47 smithi037 ceph-mon[31105]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 929 MiB/s wr, 2.13k op/s 2024-09-21T01:25:47.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:47 smithi137 ceph-mon[34607]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 929 MiB/s wr, 2.13k op/s 2024-09-21T01:25:47.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:47 smithi144 ceph-mon[34818]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 929 MiB/s wr, 2.13k op/s 2024-09-21T01:25:49.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:49 smithi037 ceph-mon[31105]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 759 MiB/s wr, 1.62k op/s 2024-09-21T01:25:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.561+0000 7fc929897640 1 -- 172.21.15.37:0/3895692711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 msgr2=0x7fc92410fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:49.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.561+0000 7fc929897640 1 --2- 172.21.15.37:0/3895692711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc92410fd10 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc914009900 tx=0x7fc91402a440 comp rx=0 tx=0).stop 2024-09-21T01:25:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.566+0000 7fc929897640 1 -- 172.21.15.37:0/3895692711 shutdown_connections 2024-09-21T01:25:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.566+0000 7fc929897640 1 --2- 172.21.15.37:0/3895692711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc92410fd10 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.566+0000 7fc929897640 1 --2- 172.21.15.37:0/3895692711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92410cd20 0x7fc92410f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.566+0000 7fc929897640 1 --2- 172.21.15.37:0/3895692711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410a3c0 0x7fc92410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.566+0000 7fc929897640 1 -- 172.21.15.37:0/3895692711 >> 172.21.15.37:0/3895692711 conn(0x7fc924070640 msgr2=0x7fc924072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:49.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.571+0000 7fc929897640 1 -- 172.21.15.37:0/3895692711 shutdown_connections 2024-09-21T01:25:49.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.575+0000 7fc929897640 1 -- 172.21.15.37:0/3895692711 wait complete. 2024-09-21T01:25:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.577+0000 7fc929897640 1 Processor -- start 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.577+0000 7fc929897640 1 -- start start 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.578+0000 7fc929897640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92410a3c0 0x7fc9241a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.578+0000 7fc929897640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410cd20 0x7fc9241a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.578+0000 7fc929897640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc9241a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.578+0000 7fc929897640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc92411df50 con 0x7fc92410f830 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.579+0000 7fc929897640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc92411ddd0 con 0x7fc92410cd20 2024-09-21T01:25:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.579+0000 7fc929897640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc92411e0d0 con 0x7fc92410a3c0 2024-09-21T01:25:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.580+0000 7fc928895640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92410a3c0 0x7fc9241a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.582+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc9241a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.583+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc9241a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36938/0 (socket says 172.21.15.37:36938) 2024-09-21T01:25:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.583+0000 7fc929096640 1 -- 172.21.15.37:0/219492338 learned_addr learned my addr 172.21.15.37:0/219492338 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.584+0000 7fc923fff640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410cd20 0x7fc9241a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.594+0000 7fc923fff640 1 -- 172.21.15.37:0/219492338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92410a3c0 msgr2=0x7fc9241a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.594+0000 7fc923fff640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92410a3c0 0x7fc9241a8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.594+0000 7fc923fff640 1 -- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 msgr2=0x7fc9241a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.594+0000 7fc923fff640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc9241a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.594+0000 7fc923fff640 1 -- 172.21.15.37:0/219492338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9241aa540 con 0x7fc92410cd20 2024-09-21T01:25:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.600+0000 7fc923fff640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410cd20 0x7fc9241a9170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00eb00 tx=0x7fc91c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.604+0000 7fc921ffb640 1 -- 172.21.15.37:0/219492338 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c010430 con 0x7fc92410cd20 2024-09-21T01:25:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.604+0000 7fc921ffb640 1 -- 172.21.15.37:0/219492338 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91c010a80 con 0x7fc92410cd20 2024-09-21T01:25:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.604+0000 7fc921ffb640 1 -- 172.21.15.37:0/219492338 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c017a30 con 0x7fc92410cd20 2024-09-21T01:25:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.607+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9241aa830 con 0x7fc92410cd20 2024-09-21T01:25:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.608+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9241b0f20 con 0x7fc92410cd20 2024-09-21T01:25:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.618+0000 7fc931a67740 1 Processor -- start 2024-09-21T01:25:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.618+0000 7fc931a67740 1 -- start start 2024-09-21T01:25:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.621+0000 7fc931a67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b069040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.621+0000 7fc931a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.622+0000 7fc931a67740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b06a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.622+0000 7fc931a67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56524afdb6f0 con 0x56524acc11b0 2024-09-21T01:25:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.622+0000 7fc931a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56524afcab20 con 0x56524ac982f0 2024-09-21T01:25:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.622+0000 7fc931a67740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56524afce930 con 0x56524aca04d0 2024-09-21T01:25:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.624+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.624+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b069040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36948/0 (socket says 172.21.15.37:36948) 2024-09-21T01:25:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.624+0000 7fc929096640 1 -- 172.21.15.37:0/1733420598 learned_addr learned my addr 172.21.15.37:0/1733420598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.624+0000 7fc928895640 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.625+0000 7fc928895640 1 -- 172.21.15.37:0/1733420598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 msgr2=0x56524b06a200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:25:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.625+0000 7fc928895640 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b06a200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.625+0000 7fc928895640 1 -- 172.21.15.37:0/1733420598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 msgr2=0x56524b069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.625+0000 7fc928895640 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b069040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.625+0000 7fc928895640 1 -- 172.21.15.37:0/1733420598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524af90530 con 0x56524ac982f0 2024-09-21T01:25:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.625+0000 7fc921ffb640 1 -- 172.21.15.37:0/219492338 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc91c017bd0 con 0x7fc92410cd20 2024-09-21T01:25:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.626+0000 7fc928895640 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b0696b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc91000bbf0 tx=0x7fc9100107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece60b4732485ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.626+0000 7fc91affd640 1 -- 172.21.15.37:0/1733420598 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910004030 con 0x56524ac982f0 2024-09-21T01:25:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.627+0000 7fc91affd640 1 -- 172.21.15.37:0/1733420598 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9100035f0 con 0x56524ac982f0 2024-09-21T01:25:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.627+0000 7fc91affd640 1 -- 172.21.15.37:0/1733420598 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910011680 con 0x56524ac982f0 2024-09-21T01:25:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.627+0000 7fc921ffb640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9080b66a0 0x7fc9080b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.628+0000 7fc931a67740 1 -- 172.21.15.37:0/1733420598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 msgr2=0x56524b0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.628+0000 7fc931a67740 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b0696b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc91000bbf0 tx=0x7fc9100107a0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.628+0000 7fc921ffb640 1 -- 172.21.15.37:0/219492338 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc91c0e7fc0 con 0x7fc92410cd20 2024-09-21T01:25:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc929096640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9080b66a0 0x7fc9080b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 -- 172.21.15.37:0/1733420598 shutdown_connections 2024-09-21T01:25:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b06a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b0696b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 --2- 172.21.15.37:0/1733420598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b069040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 -- 172.21.15.37:0/1733420598 >> 172.21.15.37:0/1733420598 conn(0x56524acb5300 msgr2=0x56524b064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 -- 172.21.15.37:0/1733420598 shutdown_connections 2024-09-21T01:25:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.629+0000 7fc931a67740 1 -- 172.21.15.37:0/1733420598 wait complete. 2024-09-21T01:25:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.630+0000 7fc931a67740 1 -- start start 2024-09-21T01:25:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.630+0000 7fc931a67740 1 Processor -- start 2024-09-21T01:25:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.631+0000 7fc931a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.631+0000 7fc931a67740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.631+0000 7fc931a67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.631+0000 7fc931a67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56524af02ab0 con 0x56524acc11b0 2024-09-21T01:25:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.631+0000 7fc931a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56524af70730 con 0x56524ac982f0 2024-09-21T01:25:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.631+0000 7fc931a67740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56524b06ad20 con 0x56524aca04d0 2024-09-21T01:25:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.632+0000 7fc931a67740 10 client.0 _ll_register_callbacks cb 0x56524afc46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.633+0000 7fc928895640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.633+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.633+0000 7fc928895640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60998/0 (socket says 172.21.15.37:60998) 2024-09-21T01:25:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.633+0000 7fc928895640 1 -- 172.21.15.37:0/4021856049 learned_addr learned my addr 172.21.15.37:0/4021856049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.635+0000 7fc929096640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9080b66a0 0x7fc9080b8bb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc914004ba0 tx=0x7fc914004830 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.635+0000 7fc929096640 1 -- 172.21.15.37:0/4021856049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 msgr2=0x56524b072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.635+0000 7fc929096640 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.635+0000 7fc929096640 1 -- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 msgr2=0x56524b072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.635+0000 7fc929096640 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.635+0000 7fc929096640 1 -- 172.21.15.37:0/4021856049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524ad2c790 con 0x56524acc11b0 2024-09-21T01:25:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.644+0000 7fc929096640 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b073a40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc914005f70 tx=0x7fc914046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f905da51fa6ce346 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.645+0000 7fc907fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.646+0000 7fc907fff640 1 -- 172.21.15.37:0/4021856049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91404bd80 con 0x56524acc11b0 2024-09-21T01:25:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.646+0000 7fc907fff640 1 -- 172.21.15.37:0/4021856049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc914004c40 con 0x56524acc11b0 2024-09-21T01:25:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.646+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9100035f0 con 0x56524acc11b0 2024-09-21T01:25:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.650+0000 7fc907fff640 1 -- 172.21.15.37:0/4021856049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc91405b050 con 0x56524acc11b0 2024-09-21T01:25:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.654+0000 7fc931a67740 10 client.16980 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.654+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56524ada5620 con 0x56524acc11b0 2024-09-21T01:25:49.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.656+0000 7fc907fff640 1 -- 172.21.15.37:0/4021856049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9100035f0 con 0x56524acc11b0 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.656+0000 7fc907fff640 1 -- 172.21.15.37:0/4021856049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc914052070 con 0x56524acc11b0 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.657+0000 7fc931a67740 10 client.16980 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.657+0000 7fc931a67740 10 client.16980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.657+0000 7fc931a67740 20 client.16980 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.657+0000 7fc931a67740 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac7fd80 0x56524b080080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.657+0000 7fc931a67740 4 client.16980 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:25:49.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.657+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56524afdd640 con 0x56524ac7fd80 2024-09-21T01:25:49.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.662+0000 7fc928895640 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac7fd80 0x56524b080080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:49 smithi137 ceph-mon[34607]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 759 MiB/s wr, 1.62k op/s 2024-09-21T01:25:49.670 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:49 smithi144 ceph-mon[34818]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 759 MiB/s wr, 1.62k op/s 2024-09-21T01:25:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.673+0000 7fc928895640 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac7fd80 0x56524b080080 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11e5dc0d4c0cd86a server_cookie=c955ddc42350c5aa in_seq=0 out_seq=0 2024-09-21T01:25:49.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.673+0000 7fc907fff640 10 client.16980 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.678+0000 7fc907fff640 1 -- 172.21.15.37:0/4021856049 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56524afdd640 con 0x56524ac7fd80 2024-09-21T01:25:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.678+0000 7fc907fff640 10 client.16980 handle_command_reply: tid=0 2024-09-21T01:25:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.678+0000 7fc931a67740 1 client.16980 shutdown 2024-09-21T01:25:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.679+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 msgr2=0x56524b073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.679+0000 7fc931a67740 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b073a40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc914005f70 tx=0x7fc914046000 comp rx=0 tx=0).stop 2024-09-21T01:25:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 shutdown_connections 2024-09-21T01:25:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc931a67740 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac7fd80 0x56524b080080 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc931a67740 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b073a40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc931a67740 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b072ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc931a67740 1 --2- 172.21.15.37:0/4021856049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524ac982f0 0x56524b072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 >> 172.21.15.37:0/4021856049 conn(0x56524acb5300 msgr2=0x56524b063150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.680+0000 7fc907fff640 0 client.16980 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.681+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 shutdown_connections 2024-09-21T01:25:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.681+0000 7fc931a67740 1 -- 172.21.15.37:0/4021856049 wait complete. 2024-09-21T01:25:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.681+0000 7fc931a67740 20 client.16980 trim_cache size 0 max 16384 2024-09-21T01:25:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.731+0000 7fc931a67740 1 Processor -- start 2024-09-21T01:25:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.732+0000 7fc931a67740 1 -- start start 2024-09-21T01:25:49.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.733+0000 7fc931a67740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524ac982f0 0x56524b05f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.733+0000 7fc931a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524aca04d0 0x56524b064410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.733+0000 7fc931a67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b064f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.735+0000 7fc931a67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241b9ac0 con 0x56524acc11b0 2024-09-21T01:25:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.735+0000 7fc931a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241bb600 con 0x56524aca04d0 2024-09-21T01:25:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.736+0000 7fc931a67740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ba190 con 0x56524ac982f0 2024-09-21T01:25:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.737+0000 7fc928895640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524ac982f0 0x56524b05f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.737+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b064f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.737+0000 7fc923fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524aca04d0 0x56524b064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.737+0000 7fc929096640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b064f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36956/0 (socket says 172.21.15.37:36956) 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.737+0000 7fc929096640 1 -- 172.21.15.37:0/2191775002 learned_addr learned my addr 172.21.15.37:0/2191775002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.738+0000 7fc929096640 1 -- 172.21.15.37:0/2191775002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524ac982f0 msgr2=0x56524b05f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.738+0000 7fc929096640 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524ac982f0 0x56524b05f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.738+0000 7fc929096640 1 -- 172.21.15.37:0/2191775002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524aca04d0 msgr2=0x56524b064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.738+0000 7fc929096640 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524aca04d0 0x56524b064410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.738+0000 7fc929096640 1 -- 172.21.15.37:0/2191775002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524ac7ffb0 con 0x56524acc11b0 2024-09-21T01:25:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.739+0000 7fc929096640 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b064f10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc914004a00 tx=0x7fc914000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef14b501b49fde4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.741+0000 7fc91a7fc640 1 -- 172.21.15.37:0/2191775002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914064070 con 0x56524acc11b0 2024-09-21T01:25:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.741+0000 7fc91a7fc640 1 -- 172.21.15.37:0/2191775002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc914058030 con 0x56524acc11b0 2024-09-21T01:25:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.743+0000 7fc931a67740 1 -- 172.21.15.37:0/2191775002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 msgr2=0x56524b064f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.743+0000 7fc931a67740 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b064f10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc914004a00 tx=0x7fc914000bc0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.745+0000 7fc931a67740 1 -- 172.21.15.37:0/2191775002 shutdown_connections 2024-09-21T01:25:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.745+0000 7fc931a67740 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524acc11b0 0x56524b064f10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.745+0000 7fc931a67740 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524aca04d0 0x56524b064410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.745+0000 7fc931a67740 1 --2- 172.21.15.37:0/2191775002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524ac982f0 0x56524b05f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.745+0000 7fc931a67740 1 -- 172.21.15.37:0/2191775002 >> 172.21.15.37:0/2191775002 conn(0x56524acb5300 msgr2=0x56524b071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.746+0000 7fc931a67740 1 -- 172.21.15.37:0/2191775002 shutdown_connections 2024-09-21T01:25:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.746+0000 7fc931a67740 1 -- 172.21.15.37:0/2191775002 wait complete. 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.747+0000 7fc931a67740 1 -- start start 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.748+0000 7fc931a67740 1 Processor -- start 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.749+0000 7fc931a67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 0x56524b077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.749+0000 7fc931a67740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b078170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.749+0000 7fc931a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524acc11b0 0x56524b078c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.749+0000 7fc931a67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241baf30 con 0x56524ac982f0 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.750+0000 7fc931a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ba860 con 0x56524acc11b0 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.750+0000 7fc931a67740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241b7ad0 con 0x56524aca04d0 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.750+0000 7fc931a67740 10 client.0 _ll_register_callbacks cb 0x7fc914003710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.750+0000 7fc928895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 0x56524b077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.750+0000 7fc928895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 0x56524b077ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36970/0 (socket says 172.21.15.37:36970) 2024-09-21T01:25:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.750+0000 7fc928895640 1 -- 172.21.15.37:0/640838398 learned_addr learned my addr 172.21.15.37:0/640838398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:25:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.751+0000 7fc928895640 1 -- 172.21.15.37:0/640838398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 msgr2=0x56524b078170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.751+0000 7fc928895640 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b078170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.751+0000 7fc928895640 1 -- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524acc11b0 msgr2=0x56524b078c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:25:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.751+0000 7fc928895640 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524acc11b0 0x56524b078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.751+0000 7fc928895640 1 -- 172.21.15.37:0/640838398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524b079360 con 0x56524ac982f0 2024-09-21T01:25:49.755 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.752+0000 7fc928895640 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 0x56524b077ab0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc91000bbc0 tx=0x7fc910005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d37146fc161a868 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:25:49.755 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.753+0000 7fc907fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:25:49.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.754+0000 7fc907fff640 1 -- 172.21.15.37:0/640838398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910033060 con 0x56524ac982f0 2024-09-21T01:25:49.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.755+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc914058030 con 0x56524ac982f0 2024-09-21T01:25:49.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.755+0000 7fc907fff640 1 -- 172.21.15.37:0/640838398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fc910003a20 con 0x56524ac982f0 2024-09-21T01:25:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.757+0000 7fc907fff640 1 -- 172.21.15.37:0/640838398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc9100035f0 con 0x56524ac982f0 2024-09-21T01:25:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.758+0000 7fc931a67740 10 client.16986 fetch_fsmap learned FSMap version 30 2024-09-21T01:25:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.758+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56524b07a6e0 con 0x56524ac982f0 2024-09-21T01:25:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.760+0000 7fc907fff640 1 -- 172.21.15.37:0/640838398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91002e480 con 0x56524ac982f0 2024-09-21T01:25:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.763+0000 7fc907fff640 1 -- 172.21.15.37:0/640838398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc910038070 con 0x56524ac982f0 2024-09-21T01:25:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.763+0000 7fc931a67740 10 client.16986 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:25:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.763+0000 7fc931a67740 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:25:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.763+0000 7fc931a67740 20 client.16986 populate_metadata read hostname 'smithi037' 2024-09-21T01:25:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.764+0000 7fc931a67740 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac551c0 0x56524b0eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:25:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.764+0000 7fc931a67740 4 client.16986 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:25:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.764+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fc914058030 con 0x56524ac551c0 2024-09-21T01:25:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.770+0000 7fc923fff640 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac551c0 0x56524b0eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:25:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.778+0000 7fc923fff640 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac551c0 0x56524b0eccb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4187decff84be04b server_cookie=5d9c5a59916f92a3 in_seq=0 out_seq=0 2024-09-21T01:25:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:49.779+0000 7fc907fff640 10 client.16986 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:51.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:51 smithi037 ceph-mon[31105]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 884 MiB/s wr, 1.91k op/s 2024-09-21T01:25:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:51 smithi137 ceph-mon[34607]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 884 MiB/s wr, 1.91k op/s 2024-09-21T01:25:51.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:51 smithi144 ceph-mon[34818]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 884 MiB/s wr, 1.91k op/s 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc907fff640 1 -- 172.21.15.37:0/640838398 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fc914058030 con 0x56524ac551c0 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc907fff640 10 client.16986 handle_command_reply: tid=0 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 client.16986 shutdown 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 msgr2=0x56524b077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 0x56524b077ab0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc91000bbc0 tx=0x7fc910005c80 comp rx=0 tx=0).stop 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 shutdown_connections 2024-09-21T01:25:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x56524ac551c0 0x56524b0eccb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56524acc11b0 0x56524b078c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56524aca04d0 0x56524b078170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 --2- 172.21.15.37:0/640838398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56524ac982f0 0x56524b077ab0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc907fff640 0 client.16986 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.045+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 >> 172.21.15.37:0/640838398 conn(0x56524acb5300 msgr2=0x56524b071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.046+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 shutdown_connections 2024-09-21T01:25:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.046+0000 7fc931a67740 1 -- 172.21.15.37:0/640838398 wait complete. 2024-09-21T01:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.046+0000 7fc931a67740 20 client.16986 trim_cache size 0 max 16384 2024-09-21T01:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9080b66a0 msgr2=0x7fc9080b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9080b66a0 0x7fc9080b8bb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc914004ba0 tx=0x7fc914004830 comp rx=0 tx=0).stop 2024-09-21T01:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410cd20 msgr2=0x7fc9241a9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410cd20 0x7fc9241a9170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00eb00 tx=0x7fc91c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 shutdown_connections 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc9080b66a0 0x7fc9080b8bb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc92410f830 0x7fc9241a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92410cd20 0x7fc9241a9170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 --2- 172.21.15.37:0/219492338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc92410a3c0 0x7fc9241a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 >> 172.21.15.37:0/219492338 conn(0x7fc924070640 msgr2=0x7fc92410b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 shutdown_connections 2024-09-21T01:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:25:53.049+0000 7fc929897640 1 -- 172.21.15.37:0/219492338 wait complete. 2024-09-21T01:25:53.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:53 smithi037 ceph-mon[31105]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 865 MiB/s wr, 1.68k op/s 2024-09-21T01:25:53.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:53 smithi137 ceph-mon[34607]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 865 MiB/s wr, 1.68k op/s 2024-09-21T01:25:53.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:53 smithi144 ceph-mon[34818]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 865 MiB/s wr, 1.68k op/s 2024-09-21T01:25:54.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:54 smithi037 ceph-mon[31105]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 844 MiB/s wr, 1.58k op/s 2024-09-21T01:25:54.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:54 smithi137 ceph-mon[34607]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 844 MiB/s wr, 1.58k op/s 2024-09-21T01:25:54.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:54 smithi144 ceph-mon[34818]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 844 MiB/s wr, 1.58k op/s 2024-09-21T01:25:56.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:56 smithi137 ceph-mon[34607]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 978 MiB/s wr, 1.85k op/s 2024-09-21T01:25:56.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:56 smithi144 ceph-mon[34818]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 978 MiB/s wr, 1.85k op/s 2024-09-21T01:25:57.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:56 smithi037 ceph-mon[31105]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 978 MiB/s wr, 1.85k op/s 2024-09-21T01:25:58.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:25:58 smithi137 ceph-mon[34607]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 824 MiB/s wr, 1.68k op/s 2024-09-21T01:25:58.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:25:58 smithi144 ceph-mon[34818]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 824 MiB/s wr, 1.68k op/s 2024-09-21T01:25:59.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:25:58 smithi037 ceph-mon[31105]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 824 MiB/s wr, 1.68k op/s 2024-09-21T01:26:00.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:00 smithi137 ceph-mon[34607]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 908 MiB/s wr, 1.85k op/s 2024-09-21T01:26:00.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:00 smithi144 ceph-mon[34818]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 908 MiB/s wr, 1.85k op/s 2024-09-21T01:26:00.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:00 smithi037 ceph-mon[31105]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 908 MiB/s wr, 1.85k op/s 2024-09-21T01:26:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:02 smithi137 ceph-mon[34607]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 962 MiB/s wr, 1.93k op/s 2024-09-21T01:26:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:02 smithi144 ceph-mon[34818]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 962 MiB/s wr, 1.93k op/s 2024-09-21T01:26:03.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:02 smithi037 ceph-mon[31105]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 962 MiB/s wr, 1.93k op/s 2024-09-21T01:26:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:04 smithi137 ceph-mon[34607]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 848 MiB/s wr, 1.64k op/s 2024-09-21T01:26:04.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:04 smithi144 ceph-mon[34818]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 848 MiB/s wr, 1.64k op/s 2024-09-21T01:26:04.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:04 smithi037 ceph-mon[31105]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 848 MiB/s wr, 1.64k op/s 2024-09-21T01:26:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.439+0000 7f3e29839640 1 -- 172.21.15.37:0/2957247769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410a3c0 msgr2=0x7f3e2410c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.439+0000 7f3e29839640 1 --2- 172.21.15.37:0/2957247769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410a3c0 0x7f3e2410c7e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3e1401a910 tx=0x7f3e1403b470 comp rx=0 tx=0).stop 2024-09-21T01:26:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.441+0000 7f3e29839640 1 -- 172.21.15.37:0/2957247769 shutdown_connections 2024-09-21T01:26:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.441+0000 7f3e29839640 1 --2- 172.21.15.37:0/2957247769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2410f830 0x7f3e2410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.441+0000 7f3e29839640 1 --2- 172.21.15.37:0/2957247769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e2410cd20 0x7f3e2410f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.441+0000 7f3e29839640 1 --2- 172.21.15.37:0/2957247769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410a3c0 0x7f3e2410c7e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.441+0000 7f3e29839640 1 -- 172.21.15.37:0/2957247769 >> 172.21.15.37:0/2957247769 conn(0x7f3e24070640 msgr2=0x7f3e24072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.447+0000 7f3e29839640 1 -- 172.21.15.37:0/2957247769 shutdown_connections 2024-09-21T01:26:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.447+0000 7f3e29839640 1 -- 172.21.15.37:0/2957247769 wait complete. 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 Processor -- start 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 -- start start 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e2410a3c0 0x7f3e241a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 0x7f3e241a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2410f830 0x7f3e241a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24113850 con 0x7f3e2410f830 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e241136d0 con 0x7f3e2410a3c0 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.449+0000 7f3e29839640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e241139d0 con 0x7f3e2410cd20 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.450+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 0x7f3e241a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.450+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 0x7f3e241a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45808/0 (socket says 172.21.15.37:45808) 2024-09-21T01:26:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.450+0000 7f3e23fff640 1 -- 172.21.15.37:0/464077749 learned_addr learned my addr 172.21.15.37:0/464077749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.450+0000 7f3e28837640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e2410a3c0 0x7f3e241a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.450+0000 7f3e29038640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2410f830 0x7f3e241a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.451+0000 7f3e23fff640 1 -- 172.21.15.37:0/464077749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e2410a3c0 msgr2=0x7f3e241a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.451+0000 7f3e23fff640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e2410a3c0 0x7f3e241a04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.451+0000 7f3e23fff640 1 -- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2410f830 msgr2=0x7f3e241a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.451+0000 7f3e23fff640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2410f830 0x7f3e241a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.451+0000 7f3e23fff640 1 -- 172.21.15.37:0/464077749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e241a1f10 con 0x7f3e2410cd20 2024-09-21T01:26:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.453+0000 7f3e23fff640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 0x7f3e241a0b40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00ba50 tx=0x7f3e1c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.454+0000 7f3e21ffb640 1 -- 172.21.15.37:0/464077749 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c019070 con 0x7f3e2410cd20 2024-09-21T01:26:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.455+0000 7f3e21ffb640 1 -- 172.21.15.37:0/464077749 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c00cc10 con 0x7f3e2410cd20 2024-09-21T01:26:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.455+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e241a2200 con 0x7f3e2410cd20 2024-09-21T01:26:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.455+0000 7f3e21ffb640 1 -- 172.21.15.37:0/464077749 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0075d0 con 0x7f3e2410cd20 2024-09-21T01:26:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.455+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2407b880 con 0x7f3e2410cd20 2024-09-21T01:26:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.467+0000 7f3e31a13740 1 Processor -- start 2024-09-21T01:26:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.470+0000 7f3e31a13740 1 -- start start 2024-09-21T01:26:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.471+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.472+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f41162f0 0x5588f44e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.472+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44e8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e29038640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e29038640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45818/0 (socket says 172.21.15.37:45818) 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e29038640 1 -- 172.21.15.37:0/1010688196 learned_addr learned my addr 172.21.15.37:0/1010688196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e28837640 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f41162f0 0x5588f44e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5588f44596f0 con 0x5588f411e4d0 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5588f4448b20 con 0x5588f41162f0 2024-09-21T01:26:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.473+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5588f444c930 con 0x5588f413f1b0 2024-09-21T01:26:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.475+0000 7f3e21ffb640 1 -- 172.21.15.37:0/464077749 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3e1c01c070 con 0x7f3e2410cd20 2024-09-21T01:26:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.476+0000 7f3e23fff640 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.482+0000 7f3e21ffb640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e0c0b6720 0x7f3e0c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.483+0000 7f3e21ffb640 1 -- 172.21.15.37:0/464077749 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3e1c0e6b30 con 0x7f3e2410cd20 2024-09-21T01:26:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.484+0000 7f3e29038640 1 -- 172.21.15.37:0/1010688196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f41162f0 msgr2=0x5588f44e76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.484+0000 7f3e29038640 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f41162f0 0x5588f44e76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.485+0000 7f3e29038640 1 -- 172.21.15.37:0/1010688196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 msgr2=0x5588f44e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.485+0000 7f3e29038640 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44e8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.485+0000 7f3e29038640 1 -- 172.21.15.37:0/1010688196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f440e530 con 0x5588f413f1b0 2024-09-21T01:26:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.485+0000 7f3e29038640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e0c0b6720 0x7f3e0c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.486+0000 7f3e29038640 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e7040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009b60 tx=0x7f3e1800e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ed11fe58bc762c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.487+0000 7f3e0affd640 1 -- 172.21.15.37:0/1010688196 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18022070 con 0x5588f413f1b0 2024-09-21T01:26:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.487+0000 7f3e0affd640 1 -- 172.21.15.37:0/1010688196 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e18014d50 con 0x5588f413f1b0 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.489+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 msgr2=0x5588f44e7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.489+0000 7f3e31a13740 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e7040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009b60 tx=0x7f3e1800e5a0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.489+0000 7f3e29038640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e0c0b6720 0x7f3e0c0b8c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3e18017000 tx=0x7f3e18019000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.491+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 shutdown_connections 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.491+0000 7f3e31a13740 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.491+0000 7f3e31a13740 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f41162f0 0x5588f44e76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.491+0000 7f3e31a13740 1 --2- 172.21.15.37:0/1010688196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e7040 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.491+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 >> 172.21.15.37:0/1010688196 conn(0x5588f4133300 msgr2=0x5588f44e2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.492+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 shutdown_connections 2024-09-21T01:26:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.495+0000 7f3e31a13740 1 -- 172.21.15.37:0/1010688196 wait complete. 2024-09-21T01:26:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.496+0000 7f3e31a13740 1 -- start start 2024-09-21T01:26:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.496+0000 7f3e31a13740 1 Processor -- start 2024-09-21T01:26:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.497+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f41162f0 0x5588f44f0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.497+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.498+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f413f1b0 0x5588f44f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.498+0000 7f3e31a13740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5588f4380ab0 con 0x5588f411e4d0 2024-09-21T01:26:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.498+0000 7f3e31a13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5588f43ee730 con 0x5588f413f1b0 2024-09-21T01:26:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.498+0000 7f3e31a13740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5588f44e8d70 con 0x5588f41162f0 2024-09-21T01:26:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.498+0000 7f3e31a13740 10 client.0 _ll_register_callbacks cb 0x5588f44426b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.499+0000 7f3e28837640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f41162f0 0x5588f44f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.499+0000 7f3e28837640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f41162f0 0x5588f44f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45824/0 (socket says 172.21.15.37:45824) 2024-09-21T01:26:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.499+0000 7f3e28837640 1 -- 172.21.15.37:0/3052097552 learned_addr learned my addr 172.21.15.37:0/3052097552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.499+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.500+0000 7f3e29038640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f413f1b0 0x5588f44f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.500+0000 7f3e23fff640 1 -- 172.21.15.37:0/3052097552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f41162f0 msgr2=0x5588f44f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.500+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f41162f0 0x5588f44f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.500+0000 7f3e23fff640 1 -- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f413f1b0 msgr2=0x5588f44f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.500+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f413f1b0 0x5588f44f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.500+0000 7f3e23fff640 1 -- 172.21.15.37:0/3052097552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f41aa790 con 0x5588f411e4d0 2024-09-21T01:26:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.503+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44f0fe0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0e9fd0 tx=0x7f3e1c0a9390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3ae6adb7122858 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.503+0000 7f3e03fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.504+0000 7f3e03fff640 1 -- 172.21.15.37:0/3052097552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0ac660 con 0x5588f411e4d0 2024-09-21T01:26:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.504+0000 7f3e03fff640 1 -- 172.21.15.37:0/3052097552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3e1c0ac150 con 0x5588f411e4d0 2024-09-21T01:26:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.504+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e18014d50 con 0x5588f411e4d0 2024-09-21T01:26:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.507+0000 7f3e03fff640 1 -- 172.21.15.37:0/3052097552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0aca00 con 0x5588f411e4d0 2024-09-21T01:26:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.508+0000 7f3e31a13740 10 client.16995 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.508+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5588f4223620 con 0x5588f411e4d0 2024-09-21T01:26:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.509+0000 7f3e03fff640 1 -- 172.21.15.37:0/3052097552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e18014d50 con 0x5588f411e4d0 2024-09-21T01:26:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.509+0000 7f3e03fff640 1 -- 172.21.15.37:0/3052097552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1c0a8840 con 0x5588f411e4d0 2024-09-21T01:26:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.510+0000 7f3e31a13740 10 client.16995 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.510+0000 7f3e31a13740 10 client.16995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.510+0000 7f3e31a13740 20 client.16995 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.510+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40fdd80 0x5588f44fe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.510+0000 7f3e31a13740 4 client.16995 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.510+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588f445b640 con 0x5588f40fdd80 2024-09-21T01:26:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.511+0000 7f3e28837640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40fdd80 0x5588f44fe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.516+0000 7f3e28837640 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40fdd80 0x5588f44fe030 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d2564df0fc974 server_cookie=84bdffaf18c4c94a in_seq=0 out_seq=0 2024-09-21T01:26:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.516+0000 7f3e03fff640 10 client.16995 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.522+0000 7f3e03fff640 1 -- 172.21.15.37:0/3052097552 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588f445b640 con 0x5588f40fdd80 2024-09-21T01:26:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.522+0000 7f3e03fff640 10 client.16995 handle_command_reply: tid=0 2024-09-21T01:26:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.522+0000 7f3e31a13740 1 client.16995 shutdown 2024-09-21T01:26:06.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 msgr2=0x5588f44f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44f0fe0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0e9fd0 tx=0x7f3e1c0a9390 comp rx=0 tx=0).stop 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 shutdown_connections 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40fdd80 0x5588f44fe030 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f413f1b0 0x5588f44f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f411e4d0 0x5588f44f0fe0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3052097552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f41162f0 0x5588f44f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.525+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 >> 172.21.15.37:0/3052097552 conn(0x5588f4133300 msgr2=0x5588f44e1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:06.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.526+0000 7f3e03fff640 0 client.16995 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.527+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 shutdown_connections 2024-09-21T01:26:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.527+0000 7f3e31a13740 1 -- 172.21.15.37:0/3052097552 wait complete. 2024-09-21T01:26:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.527+0000 7f3e31a13740 20 client.16995 trim_cache size 0 max 16384 2024-09-21T01:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.581+0000 7f3e31a13740 1 Processor -- start 2024-09-21T01:26:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 -- start start 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 0x5588f44ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44fde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1000e590 con 0x5588f41162f0 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100100d0 con 0x5588f411e4d0 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.582+0000 7f3e31a13740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1000ec60 con 0x5588f413f1b0 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.583+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44fde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.583+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44fde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:60338/0 (socket says 172.21.15.37:60338) 2024-09-21T01:26:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.583+0000 7f3e23fff640 1 -- 172.21.15.37:0/3947018329 learned_addr learned my addr 172.21.15.37:0/3947018329 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.583+0000 7f3e29038640 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.584+0000 7f3e23fff640 1 -- 172.21.15.37:0/3947018329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 msgr2=0x5588f44e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.584+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.584+0000 7f3e23fff640 1 -- 172.21.15.37:0/3947018329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 msgr2=0x5588f44ebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.584+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 0x5588f44ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.584+0000 7f3e23fff640 1 -- 172.21.15.37:0/3947018329 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f44dcdf0 con 0x5588f411e4d0 2024-09-21T01:26:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.585+0000 7f3e23fff640 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44fde10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00ba20 tx=0x7f3e1c0e6e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6731fd5c694d043 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.586+0000 7f3e0a7fc640 1 -- 172.21.15.37:0/3947018329 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c098050 con 0x5588f411e4d0 2024-09-21T01:26:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.586+0000 7f3e0a7fc640 1 -- 172.21.15.37:0/3947018329 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c0b1070 con 0x5588f411e4d0 2024-09-21T01:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.587+0000 7f3e31a13740 1 -- 172.21.15.37:0/3947018329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 msgr2=0x5588f44fde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.587+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44fde10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00ba20 tx=0x7f3e1c0e6e40 comp rx=0 tx=0).stop 2024-09-21T01:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.588+0000 7f3e31a13740 1 -- 172.21.15.37:0/3947018329 shutdown_connections 2024-09-21T01:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.588+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.588+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44fde10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.588+0000 7f3e31a13740 1 --2- 172.21.15.37:0/3947018329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 0x5588f44ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.588+0000 7f3e31a13740 1 -- 172.21.15.37:0/3947018329 >> 172.21.15.37:0/3947018329 conn(0x5588f4133300 msgr2=0x5588f44e7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.589+0000 7f3e31a13740 1 -- 172.21.15.37:0/3947018329 shutdown_connections 2024-09-21T01:26:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.591+0000 7f3e31a13740 1 -- 172.21.15.37:0/3947018329 wait complete. 2024-09-21T01:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.591+0000 7f3e31a13740 1 -- start start 2024-09-21T01:26:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 Processor -- start 2024-09-21T01:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 0x5588f44f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1000fa00 con 0x5588f41162f0 2024-09-21T01:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1000f330 con 0x5588f411e4d0 2024-09-21T01:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.592+0000 7f3e31a13740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1000c550 con 0x5588f413f1b0 2024-09-21T01:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.593+0000 7f3e31a13740 10 client.0 _ll_register_callbacks cb 0x7f3e1c0a8d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.593+0000 7f3e29038640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.594+0000 7f3e29038640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45836/0 (socket says 172.21.15.37:45836) 2024-09-21T01:26:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.594+0000 7f3e29038640 1 -- 172.21.15.37:0/367918441 learned_addr learned my addr 172.21.15.37:0/367918441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.594+0000 7f3e23fff640 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.595+0000 7f3e29038640 1 -- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 msgr2=0x5588f44f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.595+0000 7f3e29038640 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.595+0000 7f3e29038640 1 -- 172.21.15.37:0/367918441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 msgr2=0x5588f44f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.595+0000 7f3e29038640 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 0x5588f44f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.595+0000 7f3e29038640 1 -- 172.21.15.37:0/367918441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f44f7700 con 0x5588f413f1b0 2024-09-21T01:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.596+0000 7f3e29038640 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44f6fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e18016010 tx=0x7f3e18006d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535f9c6786ad8889 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:06.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.596+0000 7f3e03fff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:06.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.596+0000 7f3e03fff640 1 -- 172.21.15.37:0/367918441 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18022040 con 0x5588f413f1b0 2024-09-21T01:26:06.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.596+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1c0b1070 con 0x5588f413f1b0 2024-09-21T01:26:06.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.597+0000 7f3e03fff640 1 -- 172.21.15.37:0/367918441 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3e18013920 con 0x5588f413f1b0 2024-09-21T01:26:06.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.597+0000 7f3e03fff640 1 -- 172.21.15.37:0/367918441 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3e18009690 con 0x5588f413f1b0 2024-09-21T01:26:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.599+0000 7f3e31a13740 10 client.26365 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.599+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5588f44f8a20 con 0x5588f413f1b0 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.600+0000 7f3e03fff640 1 -- 172.21.15.37:0/367918441 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c0b1070 con 0x5588f413f1b0 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.600+0000 7f3e03fff640 1 -- 172.21.15.37:0/367918441 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1802f070 con 0x5588f413f1b0 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.601+0000 7f3e31a13740 10 client.26365 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.601+0000 7f3e31a13740 10 client.26365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.601+0000 7f3e31a13740 20 client.26365 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.601+0000 7f3e31a13740 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40d31c0 0x5588f456ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.601+0000 7f3e31a13740 4 client.26365 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:26:06.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.601+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588f44570f0 con 0x5588f40d31c0 2024-09-21T01:26:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.606+0000 7f3e28837640 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40d31c0 0x5588f456ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.613+0000 7f3e03fff640 10 client.26365 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:06.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:06.613+0000 7f3e28837640 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40d31c0 0x5588f456ad20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b6b0e55754ecd1 server_cookie=9c277101d23d1c4c in_seq=0 out_seq=0 2024-09-21T01:26:06.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:26:06.840 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:06 smithi037 ceph-mon[31105]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 968 MiB/s wr, 1.83k op/s 2024-09-21T01:26:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:06 smithi137 ceph-mon[34607]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 968 MiB/s wr, 1.83k op/s 2024-09-21T01:26:06.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:06 smithi144 ceph-mon[34818]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 968 MiB/s wr, 1.83k op/s 2024-09-21T01:26:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:08.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:08 smithi144 ceph-mon[34818]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 815 MiB/s wr, 1.53k op/s 2024-09-21T01:26:08.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:08 smithi137 ceph-mon[34607]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 815 MiB/s wr, 1.53k op/s 2024-09-21T01:26:09.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:08 smithi037 ceph-mon[31105]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 815 MiB/s wr, 1.53k op/s 2024-09-21T01:26:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.309+0000 7f3e03fff640 1 -- 172.21.15.37:0/367918441 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588f44570f0 con 0x5588f40d31c0 2024-09-21T01:26:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.309+0000 7f3e03fff640 10 client.26365 handle_command_reply: tid=0 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.309+0000 7f3e31a13740 1 client.26365 shutdown 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 msgr2=0x5588f44f6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44f6fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e18016010 tx=0x7f3e18006d60 comp rx=0 tx=0).stop 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 shutdown_connections 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5588f40d31c0 0x5588f456ad20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588f413f1b0 0x5588f44f6fa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5588f411e4d0 0x5588f44f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 --2- 172.21.15.37:0/367918441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588f41162f0 0x5588f44f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 >> 172.21.15.37:0/367918441 conn(0x5588f4133300 msgr2=0x5588f44e7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.310+0000 7f3e03fff640 0 client.26365 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.311+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 shutdown_connections 2024-09-21T01:26:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.311+0000 7f3e31a13740 1 -- 172.21.15.37:0/367918441 wait complete. 2024-09-21T01:26:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.311+0000 7f3e31a13740 20 client.26365 trim_cache size 0 max 16384 2024-09-21T01:26:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:26:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:26:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:26:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:26:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.316+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e0c0b6720 msgr2=0x7f3e0c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.316+0000 7f3e29839640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e0c0b6720 0x7f3e0c0b8c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3e18017000 tx=0x7f3e18019000 comp rx=0 tx=0).stop 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.316+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 msgr2=0x7f3e241a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.316+0000 7f3e29839640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 0x7f3e241a0b40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00ba50 tx=0x7f3e1c00bf10 comp rx=0 tx=0).stop 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.317+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 shutdown_connections 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.317+0000 7f3e29839640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e0c0b6720 0x7f3e0c0b8c30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.317+0000 7f3e29839640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2410f830 0x7f3e241a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.317+0000 7f3e29839640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e2410cd20 0x7f3e241a0b40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.317+0000 7f3e29839640 1 --2- 172.21.15.37:0/464077749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e2410a3c0 0x7f3e241a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.317+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 >> 172.21.15.37:0/464077749 conn(0x7f3e24070640 msgr2=0x7f3e24072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.318+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 shutdown_connections 2024-09-21T01:26:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:09.318+0000 7f3e29839640 1 -- 172.21.15.37:0/464077749 wait complete. 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout: "e929fe6e-e756-46ca-bb18-0e2677e31537": { 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:25:28.490664+0000", 2024-09-21T01:26:09.829 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:24:00.417164+0000", 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.830 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:26:09.831 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.832 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:26:09.833 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:26:09.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:26:09.835 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:26:09.835 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:26:09.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:26:09.835 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:26:09.835 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.514+0000 7fa50a287640 1 -- 172.21.15.37:0/1683342285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 msgr2=0x7fa50411f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.514+0000 7fa50a287640 1 --2- 172.21.15.37:0/1683342285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 0x7fa50411f140 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009ca0 tx=0x7fa4fc02a8e0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.520+0000 7fa50a287640 1 -- 172.21.15.37:0/1683342285 shutdown_connections 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.520+0000 7fa50a287640 1 --2- 172.21.15.37:0/1683342285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 0x7fa50411f140 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.520+0000 7fa50a287640 1 --2- 172.21.15.37:0/1683342285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa50410a9e0 0x7fa50410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.520+0000 7fa50a287640 1 --2- 172.21.15.37:0/1683342285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa504111f40 0x7fa50410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.520+0000 7fa50a287640 1 -- 172.21.15.37:0/1683342285 >> 172.21.15.37:0/1683342285 conn(0x7fa504070ec0 msgr2=0x7fa5040712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.523+0000 7fa50a287640 1 -- 172.21.15.37:0/1683342285 shutdown_connections 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.523+0000 7fa50a287640 1 -- 172.21.15.37:0/1683342285 wait complete. 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.524+0000 7fa50a287640 1 Processor -- start 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.531+0000 7fa50a287640 1 -- start start 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.532+0000 7fa50a287640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 0x7fa5041a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.532+0000 7fa50a287640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa504111f40 0x7fa5041a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.532+0000 7fa50a287640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 0x7fa5041ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.532+0000 7fa50a287640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa504122900 con 0x7fa50411cc30 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.532+0000 7fa50a287640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa504122780 con 0x7fa504111f40 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.532+0000 7fa50a287640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa504122a80 con 0x7fa50410a9e0 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.533+0000 7fa503fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 0x7fa5041a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.533+0000 7fa503fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 0x7fa5041a9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45860/0 (socket says 172.21.15.37:45860) 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.533+0000 7fa503fff640 1 -- 172.21.15.37:0/237807636 learned_addr learned my addr 172.21.15.37:0/237807636 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.535+0000 7fa5037fe640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa504111f40 0x7fa5041a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.535+0000 7fa508824640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 0x7fa5041ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.536+0000 7fa503fff640 1 -- 172.21.15.37:0/237807636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa504111f40 msgr2=0x7fa5041a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.536+0000 7fa503fff640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa504111f40 0x7fa5041a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.536+0000 7fa503fff640 1 -- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 msgr2=0x7fa5041ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.536+0000 7fa503fff640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 0x7fa5041ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.536+0000 7fa503fff640 1 -- 172.21.15.37:0/237807636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5041af0e0 con 0x7fa50410a9e0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.539+0000 7fa503fff640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 0x7fa5041a9170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e9f0 tx=0x7fa4f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.540+0000 7fa5017fa640 1 -- 172.21.15.37:0/237807636 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f400cd80 con 0x7fa50410a9e0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.540+0000 7fa5017fa640 1 -- 172.21.15.37:0/237807636 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f40108e0 con 0x7fa50410a9e0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.542+0000 7fa5017fa640 1 -- 172.21.15.37:0/237807636 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4018980 con 0x7fa50410a9e0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.543+0000 7fa50a287640 1 -- 172.21.15.37:0/237807636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5041af3d0 con 0x7fa50410a9e0 2024-09-21T01:26:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.543+0000 7fa50a287640 1 -- 172.21.15.37:0/237807636 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041b5b30 con 0x7fa50410a9e0 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.548+0000 7fa5107fb740 1 Processor -- start 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.549+0000 7fa5107fb740 1 -- start start 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.549+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517c6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.549+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 0x55e0517c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.549+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513fb390 0x55e0517c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.549+0000 7fa5107fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e051739e50 con 0x55e0513f31b0 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.550+0000 7fa5107fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e051729280 con 0x55e0513fb390 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.550+0000 7fa5107fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e05172d090 con 0x55e05141c070 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.551+0000 7fa503fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 0x55e0517c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.551+0000 7fa503fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 0x55e0517c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57712/0 (socket says 172.21.15.37:57712) 2024-09-21T01:26:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.551+0000 7fa503fff640 1 -- 172.21.15.37:0/3002961808 learned_addr learned my addr 172.21.15.37:0/3002961808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.553+0000 7fa508824640 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.553+0000 7fa503fff640 1 -- 172.21.15.37:0/3002961808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 msgr2=0x55e0517c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.553+0000 7fa503fff640 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.553+0000 7fa503fff640 1 -- 172.21.15.37:0/3002961808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513fb390 msgr2=0x55e0517c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.553+0000 7fa503fff640 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513fb390 0x55e0517c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.553+0000 7fa503fff640 1 -- 172.21.15.37:0/3002961808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e051487650 con 0x55e0513f31b0 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.554+0000 7fa503fff640 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 0x55e0517c3960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4018ba0 tx=0x7fa4f4018bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38756494649a527 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.557+0000 7fa5017fa640 1 -- 172.21.15.37:0/237807636 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa4f4005040 con 0x7fa50410a9e0 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.557+0000 7fa50a287640 1 -- 172.21.15.37:0/3002961808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40ea170 con 0x55e0513f31b0 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.557+0000 7fa50a287640 1 -- 172.21.15.37:0/3002961808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f40ea9b0 con 0x55e0513f31b0 2024-09-21T01:26:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.557+0000 7fa50a287640 1 -- 172.21.15.37:0/3002961808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40ebce0 con 0x55e0513f31b0 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.558+0000 7fa5017fa640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4ec0b6580 0x7fa4ec0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.558+0000 7fa5107fb740 1 -- 172.21.15.37:0/3002961808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 msgr2=0x55e0517c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.558+0000 7fa5107fb740 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 0x55e0517c3960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4018ba0 tx=0x7fa4f4018bd0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 -- 172.21.15.37:0/3002961808 shutdown_connections 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513fb390 0x55e0517c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513f31b0 0x55e0517c3960 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 --2- 172.21.15.37:0/3002961808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 -- 172.21.15.37:0/3002961808 >> 172.21.15.37:0/3002961808 conn(0x55e051410460 msgr2=0x55e0517c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa508824640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4ec0b6580 0x7fa4ec0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 -- 172.21.15.37:0/3002961808 shutdown_connections 2024-09-21T01:26:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5107fb740 1 -- 172.21.15.37:0/3002961808 wait complete. 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.559+0000 7fa5017fa640 1 -- 172.21.15.37:0/237807636 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4f40e9c00 con 0x7fa50410a9e0 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.560+0000 7fa5107fb740 1 -- start start 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.560+0000 7fa5107fb740 1 Processor -- start 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 0x55e0517cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e05158a700 con 0x55e0513fb390 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e0516c4110 con 0x55e05141c070 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0517d1e00 con 0x55e0513f31b0 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa508824640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4ec0b6580 0x7fa4ec0b8a90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc031fd0 tx=0x7fa4fc0099c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5107fb740 10 client.0 _ll_register_callbacks cb 0x55e0516dd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57726/0 (socket says 172.21.15.37:57726) 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.561+0000 7fa5037fe640 1 -- 172.21.15.37:0/1921450253 learned_addr learned my addr 172.21.15.37:0/1921450253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa508824640 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa5037fe640 1 -- 172.21.15.37:0/1921450253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 msgr2=0x55e0517cee60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa5037fe640 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 0x55e0517cee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa5037fe640 1 -- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 msgr2=0x55e0517cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa5037fe640 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa5037fe640 1 -- 172.21.15.37:0/1921450253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0516f1c40 con 0x55e0513fb390 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa5037fe640 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517cf3a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8011460 tx=0x7fa4f8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6173bfe766aa59fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.562+0000 7fa4e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.565+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1921450253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8004460 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.565+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1921450253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4f80035f0 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.565+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f40ea9b0 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.565+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1921450253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4f8005020 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 10 client.17007 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e0517eea30 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1921450253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f40ea9b0 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1921450253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa4f80047a0 con 0x55e0513fb390 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 10 client.17007 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 20 client.17007 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513da9f0 0x55e0517f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 4 client.17007 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.566+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e05173bda0 con 0x55e0513da9f0 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.569+0000 7fa503fff640 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513da9f0 0x55e0517f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.582+0000 7fa4e37fe640 10 client.17007 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.582+0000 7fa503fff640 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513da9f0 0x55e0517f1fd0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b134a45b2954d643 server_cookie=6e4aa7ac956376bd in_seq=0 out_seq=0 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.587+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1921450253 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e05173bda0 con 0x55e0513da9f0 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.588+0000 7fa4e37fe640 10 client.17007 handle_command_reply: tid=0 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.588+0000 7fa5107fb740 1 client.17007 shutdown 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.590+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 msgr2=0x55e0517cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.590+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517cf3a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8011460 tx=0x7fa4f8011920 comp rx=0 tx=0).stop 2024-09-21T01:26:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.592+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 shutdown_connections 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513da9f0 0x55e0517f1fd0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517cf3a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1921450253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 0x55e0517cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 >> 172.21.15.37:0/1921450253 conn(0x55e051410460 msgr2=0x55e0517c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa4e37fe640 0 client.17007 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.593+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 shutdown_connections 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.594+0000 7fa5107fb740 1 -- 172.21.15.37:0/1921450253 wait complete. 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.594+0000 7fa5107fb740 20 client.17007 trim_cache size 0 max 16384 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.640+0000 7fa5107fb740 1 Processor -- start 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.640+0000 7fa5107fb740 1 -- start start 2024-09-21T01:26:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.641+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 0x55e0517c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.642+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.642+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.642+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.643+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57736/0 (socket says 172.21.15.37:57736) 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.643+0000 7fa5037fe640 1 -- 172.21.15.37:0/4270448328 learned_addr learned my addr 172.21.15.37:0/4270448328 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.643+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa50411a5a0 con 0x55e0513fb390 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.643+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b7260 con 0x55e05141c070 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.643+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b5df0 con 0x55e0513f31b0 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.644+0000 7fa5037fe640 1 -- 172.21.15.37:0/4270448328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 msgr2=0x55e0517c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.644+0000 7fa5037fe640 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 0x55e0517c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.644+0000 7fa5037fe640 1 -- 172.21.15.37:0/4270448328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 msgr2=0x55e0517cd6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.644+0000 7fa5037fe640 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cd6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.644+0000 7fa5037fe640 1 -- 172.21.15.37:0/4270448328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0517c1d90 con 0x55e0513fb390 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.646+0000 7fa5037fe640 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517c3d90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800a010 tx=0x7fa4f8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aa4f5f0bdbf70a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.647+0000 7fa4e9ffb640 1 -- 172.21.15.37:0/4270448328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80044e0 con 0x55e0513fb390 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.647+0000 7fa4e9ffb640 1 -- 172.21.15.37:0/4270448328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4f8016070 con 0x55e0513fb390 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.649+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 msgr2=0x55e0517c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.649+0000 7fa5107fb740 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517c3d90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800a010 tx=0x7fa4f8005f90 comp rx=0 tx=0).stop 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.650+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 shutdown_connections 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.650+0000 7fa5107fb740 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e05141c070 0x55e0517cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.650+0000 7fa5107fb740 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517c3d90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.650+0000 7fa5107fb740 1 --2- 172.21.15.37:0/4270448328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0513f31b0 0x55e0517c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.650+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 >> 172.21.15.37:0/4270448328 conn(0x55e051410460 msgr2=0x55e0517c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.651+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 shutdown_connections 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.651+0000 7fa5107fb740 1 -- 172.21.15.37:0/4270448328 wait complete. 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.652+0000 7fa5107fb740 1 -- start start 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.652+0000 7fa5107fb740 1 Processor -- start 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513f31b0 0x55e0517d7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b6b90 con 0x55e0513fb390 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041b64c0 con 0x55e0513f31b0 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa50410b5e0 con 0x55e05141c070 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.653+0000 7fa5107fb740 10 client.0 _ll_register_callbacks cb 0x7fa4f8009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.654+0000 7fa508824640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.654+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.654+0000 7fa508824640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:45888/0 (socket says 172.21.15.37:45888) 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.654+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517d2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57750/0 (socket says 172.21.15.37:57750) 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.654+0000 7fa508824640 1 -- 172.21.15.37:0/1135728880 learned_addr learned my addr 172.21.15.37:0/1135728880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.655+0000 7fa503fff640 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513f31b0 0x55e0517d7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.655+0000 7fa5037fe640 1 -- 172.21.15.37:0/1135728880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 msgr2=0x55e0517d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.655+0000 7fa5037fe640 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517d35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.655+0000 7fa5037fe640 1 -- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513f31b0 msgr2=0x55e0517d7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.655+0000 7fa5037fe640 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513f31b0 0x55e0517d7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.655+0000 7fa5037fe640 1 -- 172.21.15.37:0/1135728880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05185b990 con 0x55e0513fb390 2024-09-21T01:26:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.656+0000 7fa5037fe640 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517d2ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8012010 tx=0x7fa4f8004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d721b78670ac4d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.657+0000 7fa4e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.658+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1135728880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8012630 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.658+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1135728880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa4f80042e0 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.661+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e051737850 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.663+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1135728880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa4f803f050 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.664+0000 7fa5107fb740 10 client.17013 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.664+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e05185caf0 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.665+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1135728880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e051737850 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1135728880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa4f80035f0 con 0x55e0513fb390 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa5107fb740 10 client.17013 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa5107fb740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa5107fb740 20 client.17013 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513afda0 0x55e05185f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa5107fb740 4 client.17013 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.669+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e051734c80 con 0x55e0513afda0 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.671+0000 7fa503fff640 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513afda0 0x55e05185f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.673+0000 7fa4e37fe640 10 client.17013 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.673+0000 7fa503fff640 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513afda0 0x55e05185f030 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ddec55ca1a254c server_cookie=f760f8bea1553273 in_seq=0 out_seq=0 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.675+0000 7fa4e37fe640 1 -- 172.21.15.37:0/1135728880 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55e051734c80 con 0x55e0513afda0 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.675+0000 7fa4e37fe640 10 client.17013 handle_command_reply: tid=0 2024-09-21T01:26:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.675+0000 7fa5107fb740 1 client.17013 shutdown 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.677+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 msgr2=0x55e0517d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.677+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517d2ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8012010 tx=0x7fa4f8004e50 comp rx=0 tx=0).stop 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 shutdown_connections 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55e0513afda0 0x55e05185f030 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e05141c070 0x55e0517d35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0513fb390 0x55e0517d2ed0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa5107fb740 1 --2- 172.21.15.37:0/1135728880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e0513f31b0 0x55e0517d7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa4e37fe640 0 client.17013 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.678+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 >> 172.21.15.37:0/1135728880 conn(0x55e051410460 msgr2=0x55e0517cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.679+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 shutdown_connections 2024-09-21T01:26:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.679+0000 7fa5107fb740 1 -- 172.21.15.37:0/1135728880 wait complete. 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.679+0000 7fa5107fb740 20 client.17013 trim_cache size 0 max 16384 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.681+0000 7fa4eaffd640 1 -- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4ec0b6580 msgr2=0x7fa4ec0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.681+0000 7fa4eaffd640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4ec0b6580 0x7fa4ec0b8a90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc031fd0 tx=0x7fa4fc0099c0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.681+0000 7fa4eaffd640 1 -- 172.21.15.37:0/237807636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 msgr2=0x7fa5041a9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.681+0000 7fa4eaffd640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 0x7fa5041a9170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e9f0 tx=0x7fa4f400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 -- 172.21.15.37:0/237807636 shutdown_connections 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa4ec0b6580 0x7fa4ec0b8a90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50411cc30 0x7fa5041ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa504111f40 0x7fa5041a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 --2- 172.21.15.37:0/237807636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50410a9e0 0x7fa5041a9170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 -- 172.21.15.37:0/237807636 >> 172.21.15.37:0/237807636 conn(0x7fa504070ec0 msgr2=0x7fa50411d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 -- 172.21.15.37:0/237807636 shutdown_connections 2024-09-21T01:26:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:09.682+0000 7fa4eaffd640 1 -- 172.21.15.37:0/237807636 wait complete. 2024-09-21T01:26:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:10 smithi137 ceph-mon[34607]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 899 MiB/s wr, 1.66k op/s 2024-09-21T01:26:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:10 smithi144 ceph-mon[34818]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 899 MiB/s wr, 1.66k op/s 2024-09-21T01:26:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:10 smithi037 ceph-mon[31105]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 899 MiB/s wr, 1.66k op/s 2024-09-21T01:26:12.891 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:12 smithi037 ceph-mon[31105]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 938 MiB/s wr, 1.71k op/s 2024-09-21T01:26:12.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:12 smithi137 ceph-mon[34607]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 938 MiB/s wr, 1.71k op/s 2024-09-21T01:26:12.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:12 smithi144 ceph-mon[34818]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 938 MiB/s wr, 1.71k op/s 2024-09-21T01:26:12.979 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:26:12.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:26:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:14.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:14 smithi137 ceph-mon[34607]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 844 MiB/s wr, 1.52k op/s 2024-09-21T01:26:14.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:14 smithi144 ceph-mon[34818]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 844 MiB/s wr, 1.52k op/s 2024-09-21T01:26:14.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:14 smithi037 ceph-mon[31105]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 844 MiB/s wr, 1.52k op/s 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.949+0000 7fdac22dc640 1 -- 172.21.15.37:0/601766051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc10f900 msgr2=0x7fdabc10fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.949+0000 7fdac22dc640 1 --2- 172.21.15.37:0/601766051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc10f900 0x7fdabc10fd10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009900 tx=0x7fdaac02a440 comp rx=0 tx=0).stop 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.950+0000 7fdac22dc640 1 -- 172.21.15.37:0/601766051 shutdown_connections 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.950+0000 7fdac22dc640 1 --2- 172.21.15.37:0/601766051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdabc110250 0x7fdabc116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.950+0000 7fdac22dc640 1 --2- 172.21.15.37:0/601766051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc10f900 0x7fdabc10fd10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.950+0000 7fdac22dc640 1 --2- 172.21.15.37:0/601766051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdabc109fc0 0x7fdabc10a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.950+0000 7fdac22dc640 1 -- 172.21.15.37:0/601766051 >> 172.21.15.37:0/601766051 conn(0x7fdabc0795c0 msgr2=0x7fdabc1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.952+0000 7fdac22dc640 1 -- 172.21.15.37:0/601766051 shutdown_connections 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.952+0000 7fdac22dc640 1 -- 172.21.15.37:0/601766051 wait complete. 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.953+0000 7fdac22dc640 1 Processor -- start 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.953+0000 7fdac22dc640 1 -- start start 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac22dc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdabc109fc0 0x7fdabc083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac22dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdabc10f900 0x7fdabc07cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac22dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 0x7fdabc07d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac22dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc11a040 con 0x7fdabc110250 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac22dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc119ec0 con 0x7fdabc10f900 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac22dc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc11a1c0 con 0x7fdabc109fc0 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac1adb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 0x7fdabc07d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac1adb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 0x7fdabc07d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41694/0 (socket says 172.21.15.37:41694) 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.954+0000 7fdac1adb640 1 -- 172.21.15.37:0/2209800640 learned_addr learned my addr 172.21.15.37:0/2209800640 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.955+0000 7fdac1adb640 1 -- 172.21.15.37:0/2209800640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdabc109fc0 msgr2=0x7fdabc083c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:26:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.955+0000 7fdac1adb640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdabc109fc0 0x7fdabc083c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.955+0000 7fdac1adb640 1 -- 172.21.15.37:0/2209800640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdabc10f900 msgr2=0x7fdabc07cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.955+0000 7fdac1adb640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdabc10f900 0x7fdabc07cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.955+0000 7fdac1adb640 1 -- 172.21.15.37:0/2209800640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc07dc80 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.956+0000 7fdac1adb640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 0x7fdabc07d460 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b990 tx=0x7fdab400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.956+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4019070 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.957+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdab400cba0 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.957+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab40075b0 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.957+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc082920 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.957+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc082e10 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.959+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdabc10a3d0 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.964+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdab401c070 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.965+0000 7fdab27fc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdaa80b6710 0x7fdaa80b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.966+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fdab40e67d0 con 0x7fdabc110250 2024-09-21T01:26:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.966+0000 7fdac12da640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdaa80b6710 0x7fdaa80b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.970+0000 7fdac12da640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdaa80b6710 0x7fdaa80b8c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009670 tx=0x7fdab8006bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:15.979+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdab40ad020 con 0x7fdabc110250 2024-09-21T01:26:16.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.530+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdabc02e640 con 0x7fdabc110250 2024-09-21T01:26:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.535+0000 7fdab27fc640 1 -- 172.21.15.37:0/2209800640 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11976 (secure 0 0 0) 0x7fdab40b1400 con 0x7fdabc110250 2024-09-21T01:26:16.537 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:26:16.537 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-09-21T01:19:26:088830+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:19:25.613490+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24604,24605,24631,24610,24635]},"id":1}]} 2024-09-21T01:26:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-09-21T01:26:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.541+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdaa80b6710 msgr2=0x7fdaa80b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.541+0000 7fdac22dc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdaa80b6710 0x7fdaa80b8c20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009670 tx=0x7fdab8006bd0 comp rx=0 tx=0).stop 2024-09-21T01:26:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.541+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 msgr2=0x7fdabc07d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.541+0000 7fdac22dc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 0x7fdabc07d460 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b990 tx=0x7fdab400be50 comp rx=0 tx=0).stop 2024-09-21T01:26:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.542+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 shutdown_connections 2024-09-21T01:26:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.542+0000 7fdac22dc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fdaa80b6710 0x7fdaa80b8c20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.542+0000 7fdac22dc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdabc110250 0x7fdabc07d460 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.542+0000 7fdac22dc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdabc10f900 0x7fdabc07cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.542+0000 7fdac22dc640 1 --2- 172.21.15.37:0/2209800640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdabc109fc0 0x7fdabc083c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.542+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 >> 172.21.15.37:0/2209800640 conn(0x7fdabc0795c0 msgr2=0x7fdabc10cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.547+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 shutdown_connections 2024-09-21T01:26:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:16.549+0000 7fdac22dc640 1 -- 172.21.15.37:0/2209800640 wait complete. 2024-09-21T01:26:16.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:16 smithi037 ceph-mon[31105]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 966 MiB/s wr, 1.79k op/s 2024-09-21T01:26:16.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:16 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2209800640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:26:16.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:16 smithi144 ceph-mon[34818]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 966 MiB/s wr, 1.79k op/s 2024-09-21T01:26:16.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:16 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2209800640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:26:16.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:16 smithi137 ceph-mon[34607]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 966 MiB/s wr, 1.79k op/s 2024-09-21T01:26:16.921 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:16 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2209800640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:26:18.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:18 smithi037 ceph-mon[31105]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 814 MiB/s wr, 1.54k op/s 2024-09-21T01:26:18.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:26:18.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:18 smithi137 ceph-mon[34607]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 814 MiB/s wr, 1.54k op/s 2024-09-21T01:26:18.920 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:18 smithi144 ceph-mon[34818]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 814 MiB/s wr, 1.54k op/s 2024-09-21T01:26:19.745 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:20.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:20 smithi137 ceph-mon[34607]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 891 MiB/s wr, 1.70k op/s 2024-09-21T01:26:20.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:20 smithi144 ceph-mon[34818]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 891 MiB/s wr, 1.70k op/s 2024-09-21T01:26:20.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:20 smithi037 ceph-mon[31105]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 891 MiB/s wr, 1.70k op/s 2024-09-21T01:26:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.347+0000 7f229ffff640 1 -- 172.21.15.37:0/895468628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0111cd0 msgr2=0x7f22a010d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.347+0000 7f229ffff640 1 --2- 172.21.15.37:0/895468628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0111cd0 0x7f22a010d6b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2294009900 tx=0x7f229402a440 comp rx=0 tx=0).stop 2024-09-21T01:26:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.349+0000 7f229ffff640 1 -- 172.21.15.37:0/895468628 shutdown_connections 2024-09-21T01:26:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.349+0000 7f229ffff640 1 --2- 172.21.15.37:0/895468628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a011cba0 0x7f22a011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.349+0000 7f229ffff640 1 --2- 172.21.15.37:0/895468628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a010dbf0 0x7f22a010e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.349+0000 7f229ffff640 1 --2- 172.21.15.37:0/895468628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0111cd0 0x7f22a010d6b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.349+0000 7f229ffff640 1 -- 172.21.15.37:0/895468628 >> 172.21.15.37:0/895468628 conn(0x7f22a006e9f0 msgr2=0x7f22a006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.353+0000 7f229ffff640 1 -- 172.21.15.37:0/895468628 shutdown_connections 2024-09-21T01:26:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.353+0000 7f229ffff640 1 -- 172.21.15.37:0/895468628 wait complete. 2024-09-21T01:26:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.355+0000 7f229ffff640 1 Processor -- start 2024-09-21T01:26:21.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 -- start start 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a010dbf0 0x7f22a011c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 0x7f22a0115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a011cba0 0x7f22a0115eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01227f0 con 0x7f22a010dbf0 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0122670 con 0x7f22a0111cd0 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.356+0000 7f229ffff640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0122970 con 0x7f22a011cba0 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.357+0000 7f229e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 0x7f22a0115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.357+0000 7f229e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 0x7f22a0115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:57274/0 (socket says 172.21.15.37:57274) 2024-09-21T01:26:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.357+0000 7f229e7fc640 1 -- 172.21.15.37:0/757235308 learned_addr learned my addr 172.21.15.37:0/757235308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.357+0000 7f229f7fe640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a011cba0 0x7f22a0115eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.358+0000 7f229effd640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a010dbf0 0x7f22a011c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.358+0000 7f229e7fc640 1 -- 172.21.15.37:0/757235308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a011cba0 msgr2=0x7f22a0115eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.358+0000 7f229e7fc640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a011cba0 0x7f22a0115eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.358+0000 7f229e7fc640 1 -- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a010dbf0 msgr2=0x7f22a011c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.358+0000 7f229e7fc640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a010dbf0 0x7f22a011c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.358+0000 7f229e7fc640 1 -- 172.21.15.37:0/757235308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a011b1a0 con 0x7f22a0111cd0 2024-09-21T01:26:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.360+0000 7f229e7fc640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 0x7f22a0115800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f229000b450 tx=0x7f229000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.360+0000 7f2287fff640 1 -- 172.21.15.37:0/757235308 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290015020 con 0x7f22a0111cd0 2024-09-21T01:26:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.361+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a011b490 con 0x7f22a0111cd0 2024-09-21T01:26:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.361+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a011b9d0 con 0x7f22a0111cd0 2024-09-21T01:26:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.361+0000 7f2287fff640 1 -- 172.21.15.37:0/757235308 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2290011d40 con 0x7f22a0111cd0 2024-09-21T01:26:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.361+0000 7f2287fff640 1 -- 172.21.15.37:0/757235308 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229000f340 con 0x7f22a0111cd0 2024-09-21T01:26:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.373+0000 7f22abce8740 1 Processor -- start 2024-09-21T01:26:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.373+0000 7f2287fff640 1 -- 172.21.15.37:0/757235308 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2290018020 con 0x7f22a0111cd0 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.374+0000 7f2287fff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f22880b6720 0x7f22880b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f2287fff640 1 -- 172.21.15.37:0/757235308 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f22900e6ab0 con 0x7f22a0111cd0 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 -- start start 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f62814860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f62814da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f628152e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f6278aea0 con 0x558f6246d070 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558f6277a2d0 con 0x558f624441b0 2024-09-21T01:26:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.375+0000 7f22abce8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558f6277e0e0 con 0x558f6244c390 2024-09-21T01:26:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.378+0000 7f229f7fe640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f22880b6720 0x7f22880b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.378+0000 7f229effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f62814860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.378+0000 7f229effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f62814860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41718/0 (socket says 172.21.15.37:41718) 2024-09-21T01:26:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.378+0000 7f229effd640 1 -- 172.21.15.37:0/4158321655 learned_addr learned my addr 172.21.15.37:0/4158321655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.381+0000 7f229effd640 1 -- 172.21.15.37:0/4158321655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 msgr2=0x558f628152e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.381+0000 7f229effd640 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f628152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.381+0000 7f229effd640 1 -- 172.21.15.37:0/4158321655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 msgr2=0x558f62814da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.381+0000 7f229effd640 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f62814da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.381+0000 7f229effd640 1 -- 172.21.15.37:0/4158321655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f624d8650 con 0x558f6246d070 2024-09-21T01:26:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.385+0000 7f229f7fe640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f22880b6720 0x7f22880b8c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2298009f70 tx=0x7f2298009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.386+0000 7f229effd640 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f62814860 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2294006010 tx=0x7f22940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e32689ea61d1298 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.388+0000 7f22857fa640 1 -- 172.21.15.37:0/4158321655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294041070 con 0x558f6246d070 2024-09-21T01:26:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.388+0000 7f22857fa640 1 -- 172.21.15.37:0/4158321655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22940318f0 con 0x558f6246d070 2024-09-21T01:26:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.388+0000 7f22857fa640 1 -- 172.21.15.37:0/4158321655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229403d8b0 con 0x558f6246d070 2024-09-21T01:26:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.390+0000 7f22abce8740 1 -- 172.21.15.37:0/4158321655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 msgr2=0x558f62814860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.390+0000 7f22abce8740 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f62814860 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2294006010 tx=0x7f22940046c0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.391+0000 7f22abce8740 1 -- 172.21.15.37:0/4158321655 shutdown_connections 2024-09-21T01:26:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.391+0000 7f22abce8740 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f628152e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.391+0000 7f22abce8740 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f62814da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.391+0000 7f22abce8740 1 --2- 172.21.15.37:0/4158321655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f62814860 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.391+0000 7f22abce8740 1 -- 172.21.15.37:0/4158321655 >> 172.21.15.37:0/4158321655 conn(0x558f62461460 msgr2=0x558f62812750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.394+0000 7f22abce8740 1 -- 172.21.15.37:0/4158321655 shutdown_connections 2024-09-21T01:26:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.394+0000 7f22abce8740 1 -- 172.21.15.37:0/4158321655 wait complete. 2024-09-21T01:26:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.395+0000 7f22abce8740 1 -- start start 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.396+0000 7f22abce8740 1 Processor -- start 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.397+0000 7f22abce8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f6281ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.397+0000 7f22abce8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f62820510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.397+0000 7f22abce8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f6282c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.398+0000 7f22abce8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f625db700 con 0x558f6246d070 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.398+0000 7f22abce8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558f62715160 con 0x558f624441b0 2024-09-21T01:26:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.398+0000 7f22abce8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558f62822fe0 con 0x558f6244c390 2024-09-21T01:26:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.398+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f6282c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.398+0000 7f22abce8740 10 client.0 _ll_register_callbacks cb 0x558f6272e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.399+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f6282c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41722/0 (socket says 172.21.15.37:41722) 2024-09-21T01:26:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.399+0000 7f229f7fe640 1 -- 172.21.15.37:0/1776341886 learned_addr learned my addr 172.21.15.37:0/1776341886 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:21.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.401+0000 7f229effd640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f6281ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.401+0000 7f229e7fc640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f62820510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.402+0000 7f229f7fe640 1 -- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 msgr2=0x558f62820510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.402+0000 7f229f7fe640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f62820510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.402+0000 7f229f7fe640 1 -- 172.21.15.37:0/1776341886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 msgr2=0x558f6281ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.402+0000 7f229f7fe640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f6281ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.402+0000 7f229f7fe640 1 -- 172.21.15.37:0/1776341886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f62742c90 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.402+0000 7f229f7fe640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f6282c360 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2298017e70 tx=0x7f2298004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44d4b592bea1f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.403+0000 7f2282ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.403+0000 7f2282ff5640 1 -- 172.21.15.37:0/1776341886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298015570 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.403+0000 7f2282ff5640 1 -- 172.21.15.37:0/1776341886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f2298015710 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.403+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22940318f0 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.404+0000 7f2282ff5640 1 -- 172.21.15.37:0/1776341886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2298015910 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.404+0000 7f22abce8740 10 client.17031 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.404+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558f6282ee10 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.405+0000 7f2282ff5640 1 -- 172.21.15.37:0/1776341886 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22980233f0 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f2282ff5640 1 -- 172.21.15.37:0/1776341886 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2298017070 con 0x558f6246d070 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f22abce8740 10 client.17031 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f22abce8740 10 client.17031 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f22abce8740 20 client.17031 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f22abce8740 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6242b9f0 0x558f628327b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f22abce8740 4 client.17031 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:21.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.406+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f22940318f0 con 0x558f6242b9f0 2024-09-21T01:26:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.409+0000 7f229effd640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6242b9f0 0x558f628327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.412+0000 7f229effd640 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6242b9f0 0x558f628327b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=43eacd9dc918544a server_cookie=34b28ec09aaa7e7f in_seq=0 out_seq=0 2024-09-21T01:26:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.412+0000 7f2282ff5640 10 client.17031 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:26:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.414+0000 7f2282ff5640 1 -- 172.21.15.37:0/1776341886 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f22940318f0 con 0x558f6242b9f0 2024-09-21T01:26:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.414+0000 7f2282ff5640 10 client.17031 handle_command_reply: tid=0 2024-09-21T01:26:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.414+0000 7f22abce8740 1 client.17031 shutdown 2024-09-21T01:26:21.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.419+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 msgr2=0x558f6282c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.419+0000 7f22abce8740 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f6282c360 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2298017e70 tx=0x7f2298004b50 comp rx=0 tx=0).stop 2024-09-21T01:26:21.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 shutdown_connections 2024-09-21T01:26:21.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f22abce8740 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6242b9f0 0x558f628327b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f22abce8740 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6246d070 0x558f6282c360 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f22abce8740 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6244c390 0x558f62820510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f2282ff5640 0 client.17031 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:26:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f22abce8740 1 --2- 172.21.15.37:0/1776341886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f624441b0 0x558f6281ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.421+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 >> 172.21.15.37:0/1776341886 conn(0x558f62461460 msgr2=0x558f628179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.422+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 shutdown_connections 2024-09-21T01:26:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.422+0000 7f22abce8740 1 -- 172.21.15.37:0/1776341886 wait complete. 2024-09-21T01:26:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.422+0000 7f22abce8740 20 client.17031 trim_cache size 0 max 16384 2024-09-21T01:26:21.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.465+0000 7f22abce8740 1 Processor -- start 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.465+0000 7f22abce8740 1 -- start start 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.465+0000 7f22abce8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6242b9f0 0x558f628127c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.465+0000 7f22abce8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f624441b0 0x558f6282c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.465+0000 7f22abce8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f62817960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.465+0000 7f22abce8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00e430 con 0x558f624441b0 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.466+0000 7f22abce8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00ff70 con 0x558f6244c390 2024-09-21T01:26:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.466+0000 7f22abce8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00eb00 con 0x558f6242b9f0 2024-09-21T01:26:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.467+0000 7f229e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f624441b0 0x558f6282c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.467+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f62817960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.467+0000 7f229effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6242b9f0 0x558f628127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.467+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f62817960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:57308/0 (socket says 172.21.15.37:57308) 2024-09-21T01:26:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.467+0000 7f229f7fe640 1 -- 172.21.15.37:0/2377562921 learned_addr learned my addr 172.21.15.37:0/2377562921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.470+0000 7f229e7fc640 1 -- 172.21.15.37:0/2377562921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6242b9f0 msgr2=0x558f628127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.470+0000 7f229e7fc640 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6242b9f0 0x558f628127c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.470+0000 7f229e7fc640 1 -- 172.21.15.37:0/2377562921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 msgr2=0x558f62817960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.470+0000 7f229e7fc640 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f62817960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.470+0000 7f229e7fc640 1 -- 172.21.15.37:0/2377562921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f62821290 con 0x558f624441b0 2024-09-21T01:26:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.470+0000 7f229f7fe640 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f62817960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:26:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.471+0000 7f229e7fc640 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f624441b0 0x558f6282c260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x558f628134e0 tx=0x7f2290010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26071ce4a23172 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.472+0000 7f2284ff9640 1 -- 172.21.15.37:0/2377562921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22900b16e0 con 0x558f624441b0 2024-09-21T01:26:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.472+0000 7f2284ff9640 1 -- 172.21.15.37:0/2377562921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22900b6620 con 0x558f624441b0 2024-09-21T01:26:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.472+0000 7f2284ff9640 1 -- 172.21.15.37:0/2377562921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22900b16e0 con 0x558f624441b0 2024-09-21T01:26:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.473+0000 7f22abce8740 1 -- 172.21.15.37:0/2377562921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f624441b0 msgr2=0x558f6282c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f624441b0 0x558f6282c260 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x558f628134e0 tx=0x7f2290010ed0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 -- 172.21.15.37:0/2377562921 shutdown_connections 2024-09-21T01:26:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f62817960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f624441b0 0x558f6282c260 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 --2- 172.21.15.37:0/2377562921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f6242b9f0 0x558f628127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 -- 172.21.15.37:0/2377562921 >> 172.21.15.37:0/2377562921 conn(0x558f62461460 msgr2=0x558f628120b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 -- 172.21.15.37:0/2377562921 shutdown_connections 2024-09-21T01:26:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.474+0000 7f22abce8740 1 -- 172.21.15.37:0/2377562921 wait complete. 2024-09-21T01:26:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.475+0000 7f22abce8740 1 -- start start 2024-09-21T01:26:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.475+0000 7f22abce8740 1 Processor -- start 2024-09-21T01:26:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6242b9f0 0x558f62824550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f624441b0 0x558f62824a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f6289c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00f8a0 con 0x558f6242b9f0 2024-09-21T01:26:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00f1d0 con 0x558f6244c390 2024-09-21T01:26:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f228c00c4c0 con 0x558f624441b0 2024-09-21T01:26:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.476+0000 7f22abce8740 10 client.0 _ll_register_callbacks cb 0x7f2298017390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.477+0000 7f229f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f6289c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.477+0000 7f229e7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f624441b0 0x558f62824a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.477+0000 7f229e7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f624441b0 0x558f62824a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43132/0 (socket says 172.21.15.37:43132) 2024-09-21T01:26:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.477+0000 7f229e7fc640 1 -- 172.21.15.37:0/3065613233 learned_addr learned my addr 172.21.15.37:0/3065613233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.478+0000 7f229effd640 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6242b9f0 0x558f62824550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.479+0000 7f229effd640 1 -- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f624441b0 msgr2=0x558f62824a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.479+0000 7f229effd640 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f624441b0 0x558f62824a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.479+0000 7f229effd640 1 -- 172.21.15.37:0/3065613233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 msgr2=0x558f6289c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.479+0000 7f229effd640 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f6289c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.479+0000 7f229effd640 1 -- 172.21.15.37:0/3065613233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f62825330 con 0x558f6242b9f0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.480+0000 7f229effd640 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6242b9f0 0x558f62824550 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2294033040 tx=0x7f22940058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3efeec30ac294c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.480+0000 7f2282ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.480+0000 7f2282ff5640 1 -- 172.21.15.37:0/3065613233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294041040 con 0x558f6242b9f0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.481+0000 7f2282ff5640 1 -- 172.21.15.37:0/3065613233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f229403d910 con 0x558f6242b9f0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.481+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22900b6620 con 0x558f6242b9f0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.481+0000 7f2282ff5640 1 -- 172.21.15.37:0/3065613233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f229403db10 con 0x558f6242b9f0 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.482+0000 7f22abce8740 10 client.17037 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.482+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558f6289d6e0 con 0x558f6242b9f0 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.482+0000 7f2282ff5640 1 -- 172.21.15.37:0/3065613233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22900b6620 con 0x558f6242b9f0 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f2282ff5640 1 -- 172.21.15.37:0/3065613233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2294062450 con 0x558f6242b9f0 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f22abce8740 10 client.17037 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f22abce8740 10 client.17037 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f22abce8740 20 client.17037 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f22abce8740 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6246d070 0x558f6289f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f22abce8740 4 client.17037 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:26:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.483+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f6278cdf0 con 0x558f6246d070 2024-09-21T01:26:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.487+0000 7f229e7fc640 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6246d070 0x558f6289f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:21.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.496+0000 7f229e7fc640 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6246d070 0x558f6289f970 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ce735857b38fb40c server_cookie=27690d87264aa9bf in_seq=0 out_seq=0 2024-09-21T01:26:21.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.496+0000 7f2282ff5640 10 client.17037 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:26:21.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f2282ff5640 1 -- 172.21.15.37:0/3065613233 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f6278cdf0 con 0x558f6246d070 2024-09-21T01:26:21.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f2282ff5640 10 client.17037 handle_command_reply: tid=0 2024-09-21T01:26:21.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 client.17037 shutdown 2024-09-21T01:26:21.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6242b9f0 msgr2=0x558f62824550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6242b9f0 0x558f62824550 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2294033040 tx=0x7f22940058f0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 shutdown_connections 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x558f6246d070 0x558f6289f970 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f6244c390 0x558f6289c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f624441b0 0x558f62824a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 --2- 172.21.15.37:0/3065613233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f6242b9f0 0x558f62824550 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 >> 172.21.15.37:0/3065613233 conn(0x558f62461460 msgr2=0x558f62817960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.497+0000 7f2282ff5640 0 client.17037 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.498+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 shutdown_connections 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.498+0000 7f22abce8740 1 -- 172.21.15.37:0/3065613233 wait complete. 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.498+0000 7f22abce8740 20 client.17037 trim_cache size 0 max 16384 2024-09-21T01:26:21.500 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f22880b6720 msgr2=0x7f22880b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f22880b6720 0x7f22880b8c30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2298009f70 tx=0x7f2298009650 comp rx=0 tx=0).stop 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 msgr2=0x7f22a0115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 0x7f22a0115800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f229000b450 tx=0x7f229000b910 comp rx=0 tx=0).stop 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 shutdown_connections 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f22880b6720 0x7f22880b8c30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a011cba0 0x7f22a0115eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22a0111cd0 0x7f22a0115800 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 --2- 172.21.15.37:0/757235308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a010dbf0 0x7f22a011c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:21.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.500+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 >> 172.21.15.37:0/757235308 conn(0x7f22a006e9f0 msgr2=0x7f22a010f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:21.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.504+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 shutdown_connections 2024-09-21T01:26:21.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:21.505+0000 7f229ffff640 1 -- 172.21.15.37:0/757235308 wait complete. 2024-09-21T01:26:22.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.622+0000 7f12e73c5640 1 -- 172.21.15.37:0/4113180892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e0109af0 msgr2=0x7f12e0109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.622+0000 7f12e73c5640 1 --2- 172.21.15.37:0/4113180892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e0109af0 0x7f12e0109f60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009900 tx=0x7f12d002a410 comp rx=0 tx=0).stop 2024-09-21T01:26:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.622+0000 7f12e73c5640 1 -- 172.21.15.37:0/4113180892 shutdown_connections 2024-09-21T01:26:22.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.622+0000 7f12e73c5640 1 --2- 172.21.15.37:0/4113180892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e010b510 0x7f12e0111eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.622+0000 7f12e73c5640 1 --2- 172.21.15.37:0/4113180892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e010ab70 0x7f12e010af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.623+0000 7f12e73c5640 1 --2- 172.21.15.37:0/4113180892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e0109af0 0x7f12e0109f60 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.623+0000 7f12e73c5640 1 -- 172.21.15.37:0/4113180892 >> 172.21.15.37:0/4113180892 conn(0x7f12e0078e30 msgr2=0x7f12e007b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.625+0000 7f12e73c5640 1 -- 172.21.15.37:0/4113180892 shutdown_connections 2024-09-21T01:26:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.628+0000 7f12e73c5640 1 -- 172.21.15.37:0/4113180892 wait complete. 2024-09-21T01:26:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.631+0000 7f12e73c5640 1 Processor -- start 2024-09-21T01:26:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.631+0000 7f12e73c5640 1 -- start start 2024-09-21T01:26:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.632+0000 7f12e73c5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 0x7f12e01a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.632+0000 7f12e73c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e010ab70 0x7f12e01a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.632+0000 7f12e73c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e010b510 0x7f12e01a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.633+0000 7f12e73c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0115860 con 0x7f12e010ab70 2024-09-21T01:26:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.633+0000 7f12e73c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01156e0 con 0x7f12e010b510 2024-09-21T01:26:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.633+0000 7f12e73c5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01159e0 con 0x7f12e0109af0 2024-09-21T01:26:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.633+0000 7f12e63c3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 0x7f12e01a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e63c3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 0x7f12e01a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43144/0 (socket says 172.21.15.37:43144) 2024-09-21T01:26:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e63c3640 1 -- 172.21.15.37:0/1888278513 learned_addr learned my addr 172.21.15.37:0/1888278513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e010b510 0x7f12e01a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e63c3640 1 -- 172.21.15.37:0/1888278513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e010b510 msgr2=0x7f12e01a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e63c3640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e010b510 0x7f12e01a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e63c3640 1 -- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e010ab70 msgr2=0x7f12e01a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.634+0000 7f12e63c3640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e010ab70 0x7f12e01a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.635+0000 7f12e63c3640 1 -- 172.21.15.37:0/1888278513 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e01a1ef0 con 0x7f12e0109af0 2024-09-21T01:26:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.635+0000 7f12e63c3640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 0x7f12e01a04b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f12d002aa00 tx=0x7f12d0003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.641+0000 7f12d77fe640 1 -- 172.21.15.37:0/1888278513 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d003f070 con 0x7f12e0109af0 2024-09-21T01:26:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.641+0000 7f12d77fe640 1 -- 172.21.15.37:0/1888278513 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d003b460 con 0x7f12e0109af0 2024-09-21T01:26:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.641+0000 7f12d77fe640 1 -- 172.21.15.37:0/1888278513 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0035030 con 0x7f12e0109af0 2024-09-21T01:26:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.641+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e01a2180 con 0x7f12e0109af0 2024-09-21T01:26:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.642+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e01a8770 con 0x7f12e0109af0 2024-09-21T01:26:22.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.652+0000 7f12ef66d740 1 Processor -- start 2024-09-21T01:26:22.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.653+0000 7f12ef66d740 1 -- start start 2024-09-21T01:26:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.653+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 0x5647d35d9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.653+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35d96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.653+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32104d0 0x5647d35da200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.654+0000 7f12ef66d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647d354b6f0 con 0x5647d32104d0 2024-09-21T01:26:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.654+0000 7f12ef66d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5647d353ab20 con 0x5647d32311b0 2024-09-21T01:26:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.654+0000 7f12ef66d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5647d353e930 con 0x5647d32082f0 2024-09-21T01:26:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.654+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 0x5647d35d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.654+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 0x5647d35d9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:57344/0 (socket says 172.21.15.37:57344) 2024-09-21T01:26:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.654+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3056497389 learned_addr learned my addr 172.21.15.37:0/3056497389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.655+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3056497389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 msgr2=0x5647d35d96b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:26:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.655+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35d96b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.655+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3056497389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32104d0 msgr2=0x5647d35da200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:26:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.655+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32104d0 0x5647d35da200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.655+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3056497389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d3500530 con 0x5647d32311b0 2024-09-21T01:26:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.656+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 0x5647d35d9040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009f20 tx=0x7f12d800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c897cb78290296ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:22.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.657+0000 7f12d77fe640 1 -- 172.21.15.37:0/1888278513 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f12d0042070 con 0x7f12e0109af0 2024-09-21T01:26:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.658+0000 7f12d77fe640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12cc0b6660 0x7f12cc0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.658+0000 7f12d77fe640 1 -- 172.21.15.37:0/1888278513 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f12d0107bc0 con 0x7f12e0109af0 2024-09-21T01:26:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.659+0000 7f12d4bfe640 1 -- 172.21.15.37:0/3056497389 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d801a070 con 0x5647d32311b0 2024-09-21T01:26:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.659+0000 7f12d4bfe640 1 -- 172.21.15.37:0/3056497389 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d80158c0 con 0x5647d32311b0 2024-09-21T01:26:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.660+0000 7f12e63c3640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12cc0b6660 0x7f12cc0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.660+0000 7f12ef66d740 1 -- 172.21.15.37:0/3056497389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 msgr2=0x5647d35d9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:22.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.660+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 0x5647d35d9040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009f20 tx=0x7f12d800c8b0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.666+0000 7f12ef66d740 1 -- 172.21.15.37:0/3056497389 shutdown_connections 2024-09-21T01:26:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.666+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32104d0 0x5647d35da200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.666+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35d96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.666+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3056497389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32311b0 0x5647d35d9040 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.666+0000 7f12ef66d740 1 -- 172.21.15.37:0/3056497389 >> 172.21.15.37:0/3056497389 conn(0x5647d3225300 msgr2=0x5647d35d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.668+0000 7f12ef66d740 1 -- 172.21.15.37:0/3056497389 shutdown_connections 2024-09-21T01:26:22.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.668+0000 7f12ef66d740 1 -- 172.21.15.37:0/3056497389 wait complete. 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 -- start start 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 Processor -- start 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35e2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647d3472ab0 con 0x5647d32311b0 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.669+0000 7f12ef66d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5647d34e0730 con 0x5647d32104d0 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.670+0000 7f12ef66d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5647d35dad70 con 0x5647d32082f0 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.670+0000 7f12ef66d740 10 client.0 _ll_register_callbacks cb 0x5647d35346b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:22.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.671+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.671+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35e2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43150/0 (socket says 172.21.15.37:43150) 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.671+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3532895368 learned_addr learned my addr 172.21.15.37:0/3532895368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.671+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.672+0000 7f12e63c3640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12cc0b6660 0x7f12cc0b8b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f12d00cdca0 tx=0x7f12d002a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.672+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 msgr2=0x5647d35e2f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.672+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35e2f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.672+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3532895368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 msgr2=0x5647d35e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:22.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.672+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.672+0000 7f12e6bc4640 1 -- 172.21.15.37:0/3532895368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d329c790 con 0x5647d32082f0 2024-09-21T01:26:22.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.675+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35e2890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009d30 tx=0x7f12d800a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c136f470fbbb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:22.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.675+0000 7f12c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.679+0000 7f12c9ffb640 1 -- 172.21.15.37:0/3532895368 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8027060 con 0x5647d32082f0 2024-09-21T01:26:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.679+0000 7f12c9ffb640 1 -- 172.21.15.37:0/3532895368 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f12d8015a70 con 0x5647d32082f0 2024-09-21T01:26:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.681+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12d80158c0 con 0x5647d32082f0 2024-09-21T01:26:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.688+0000 7f12c9ffb640 1 -- 172.21.15.37:0/3532895368 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12d801a040 con 0x5647d32082f0 2024-09-21T01:26:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.688+0000 7f12ef66d740 10 client.26395 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.688+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5647d3315620 con 0x5647d32082f0 2024-09-21T01:26:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.692+0000 7f12c9ffb640 1 -- 172.21.15.37:0/3532895368 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d80158c0 con 0x5647d32082f0 2024-09-21T01:26:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.692+0000 7f12c9ffb640 1 -- 172.21.15.37:0/3532895368 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f12d8020070 con 0x5647d32082f0 2024-09-21T01:26:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.693+0000 7f12ef66d740 10 client.26395 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.693+0000 7f12ef66d740 10 client.26395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.693+0000 7f12ef66d740 20 client.26395 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.693+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d31efd80 0x5647d3600d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.693+0000 7f12ef66d740 4 client.26395 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.693+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647d354d640 con 0x5647d31efd80 2024-09-21T01:26:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.699+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d31efd80 0x5647d3600d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.707+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d31efd80 0x5647d3600d00 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=969c9ea42e766f16 server_cookie=e75e43629dbea16f in_seq=0 out_seq=0 2024-09-21T01:26:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.713+0000 7f12c9ffb640 10 client.26395 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.713+0000 7f12c9ffb640 1 -- 172.21.15.37:0/3532895368 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5647d354d640 con 0x5647d31efd80 2024-09-21T01:26:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.713+0000 7f12c9ffb640 10 client.26395 handle_command_reply: tid=0 2024-09-21T01:26:22.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.713+0000 7f12ef66d740 1 client.26395 shutdown 2024-09-21T01:26:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.722+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 msgr2=0x5647d35e2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.722+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35e2890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009d30 tx=0x7f12d800a400 comp rx=0 tx=0).stop 2024-09-21T01:26:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.723+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 shutdown_connections 2024-09-21T01:26:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.723+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d31efd80 0x5647d3600d00 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.723+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.723+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.723+0000 7f12ef66d740 1 --2- 172.21.15.37:0/3532895368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35e2890 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.723+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 >> 172.21.15.37:0/3532895368 conn(0x5647d3225300 msgr2=0x5647d35d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.728+0000 7f12c9ffb640 0 client.26395 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.728+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 shutdown_connections 2024-09-21T01:26:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.730+0000 7f12ef66d740 1 -- 172.21.15.37:0/3532895368 wait complete. 2024-09-21T01:26:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.730+0000 7f12ef66d740 20 client.26395 trim_cache size 0 max 16384 2024-09-21T01:26:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.784+0000 7f12ef66d740 1 Processor -- start 2024-09-21T01:26:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.785+0000 7f12ef66d740 1 -- start start 2024-09-21T01:26:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.786+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35ddb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.786+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.786+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.786+0000 7f12ef66d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12c400e5e0 con 0x5647d32311b0 2024-09-21T01:26:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.786+0000 7f12ef66d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4010120 con 0x5647d32104d0 2024-09-21T01:26:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.786+0000 7f12ef66d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12c400ecb0 con 0x5647d32082f0 2024-09-21T01:26:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.788+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35ddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.788+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35ddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:43158/0 (socket says 172.21.15.37:43158) 2024-09-21T01:26:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.788+0000 7f12e6bc4640 1 -- 172.21.15.37:0/1710597841 learned_addr learned my addr 172.21.15.37:0/1710597841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.788+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.788+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.791+0000 7f12e5bc2640 1 -- 172.21.15.37:0/1710597841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 msgr2=0x5647d35ddb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.791+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35ddb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.791+0000 7f12e5bc2640 1 -- 172.21.15.37:0/1710597841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 msgr2=0x5647d35d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.791+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35d4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.791+0000 7f12e5bc2640 1 -- 172.21.15.37:0/1710597841 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d31effb0 con 0x5647d32104d0 2024-09-21T01:26:22.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.792+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35d9ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5647d36012e0 tx=0x7f12dc009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33800d3de9cb460c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.796+0000 7f12cbfff640 1 -- 172.21.15.37:0/1710597841 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0127f0 con 0x5647d32104d0 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.796+0000 7f12cbfff640 1 -- 172.21.15.37:0/1710597841 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12dc020070 con 0x5647d32104d0 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.797+0000 7f12ef66d740 1 -- 172.21.15.37:0/1710597841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 msgr2=0x5647d35d9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.797+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35d9ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5647d36012e0 tx=0x7f12dc009c80 comp rx=0 tx=0).stop 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.799+0000 7f12ef66d740 1 -- 172.21.15.37:0/1710597841 shutdown_connections 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.799+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.799+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32104d0 0x5647d35d9ed0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5647d36012e0 tx=0x7f12dc009c80 comp rx=0 tx=0).stop 2024-09-21T01:26:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.799+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1710597841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d32082f0 0x5647d35ddb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.799+0000 7f12ef66d740 1 -- 172.21.15.37:0/1710597841 >> 172.21.15.37:0/1710597841 conn(0x5647d3225300 msgr2=0x5647d35d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.803+0000 7f12ef66d740 1 -- 172.21.15.37:0/1710597841 shutdown_connections 2024-09-21T01:26:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.806+0000 7f12ef66d740 1 -- 172.21.15.37:0/1710597841 wait complete. 2024-09-21T01:26:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.806+0000 7f12ef66d740 1 -- start start 2024-09-21T01:26:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.806+0000 7f12ef66d740 1 Processor -- start 2024-09-21T01:26:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.807+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32082f0 0x5647d35e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.807+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.808+0000 7f12ef66d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d31c51c0 0x5647d35e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.808+0000 7f12ef66d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12c400fa50 con 0x5647d32311b0 2024-09-21T01:26:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.808+0000 7f12ef66d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12c400f380 con 0x5647d32082f0 2024-09-21T01:26:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.808+0000 7f12ef66d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12c400c5a0 con 0x5647d31c51c0 2024-09-21T01:26:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.808+0000 7f12ef66d740 10 client.0 _ll_register_callbacks cb 0x7f12d8018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.809+0000 7f12e5bc2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.809+0000 7f12e6bc4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32082f0 0x5647d35e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.809+0000 7f12e5bc2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41788/0 (socket says 172.21.15.37:41788) 2024-09-21T01:26:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.809+0000 7f12e5bc2640 1 -- 172.21.15.37:0/1856662342 learned_addr learned my addr 172.21.15.37:0/1856662342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.809+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d31c51c0 0x5647d35e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12e6bc4640 1 -- 172.21.15.37:0/1856662342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d31c51c0 msgr2=0x5647d35e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d31c51c0 0x5647d35e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12e6bc4640 1 -- 172.21.15.37:0/1856662342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 msgr2=0x5647d35e8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12e6bc4640 1 -- 172.21.15.37:0/1856662342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d35e9630 con 0x5647d32082f0 2024-09-21T01:26:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12e6bc4640 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32082f0 0x5647d35e9ef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5647d354d7c0 tx=0x7f12d8024040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce511e25a5e34b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:26:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.810+0000 7f12c9ffb640 1 -- 172.21.15.37:0/1856662342 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8027070 con 0x5647d32082f0 2024-09-21T01:26:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.811+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5647d35490f0 con 0x5647d32082f0 2024-09-21T01:26:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.811+0000 7f12c9ffb640 1 -- 172.21.15.37:0/1856662342 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f12d8002030 con 0x5647d32082f0 2024-09-21T01:26:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.811+0000 7f12c9ffb640 1 -- 172.21.15.37:0/1856662342 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12d803d050 con 0x5647d32082f0 2024-09-21T01:26:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.815+0000 7f12ef66d740 10 client.26435 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.815+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5647d35e8470 con 0x5647d32082f0 2024-09-21T01:26:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.815+0000 7f12c9ffb640 1 -- 172.21.15.37:0/1856662342 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5647d35490f0 con 0x5647d32082f0 2024-09-21T01:26:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.815+0000 7f12c9ffb640 1 -- 172.21.15.37:0/1856662342 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f12d8020070 con 0x5647d32082f0 2024-09-21T01:26:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.821+0000 7f12ef66d740 10 client.26435 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.821+0000 7f12ef66d740 10 client.26435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.821+0000 7f12ef66d740 20 client.26435 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.821+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d366bc10 0x5647d366e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.821+0000 7f12ef66d740 4 client.26435 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:26:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.821+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647d3546520 con 0x5647d366bc10 2024-09-21T01:26:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.828+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d366bc10 0x5647d366e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.831+0000 7f12c9ffb640 10 client.26435 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:22.832+0000 7f12e5bc2640 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d366bc10 0x5647d366e030 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f647ef3a00400cc server_cookie=925bb6e5bd1cf228 in_seq=0 out_seq=0 2024-09-21T01:26:23.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:22 smithi037 ceph-mon[31105]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 923 MiB/s wr, 1.99k op/s 2024-09-21T01:26:23.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:22 smithi137 ceph-mon[34607]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 923 MiB/s wr, 1.99k op/s 2024-09-21T01:26:23.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:22 smithi144 ceph-mon[34818]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 923 MiB/s wr, 1.99k op/s 2024-09-21T01:26:24.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:26:24.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:24 smithi037 ceph-mon[31105]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.04k op/s 2024-09-21T01:26:25.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:24 smithi137 ceph-mon[34607]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.04k op/s 2024-09-21T01:26:25.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:24 smithi144 ceph-mon[34818]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.04k op/s 2024-09-21T01:26:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.883+0000 7f12c9ffb640 1 -- 172.21.15.37:0/1856662342 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5647d3546520 con 0x5647d366bc10 2024-09-21T01:26:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.883+0000 7f12c9ffb640 10 client.26435 handle_command_reply: tid=0 2024-09-21T01:26:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.885+0000 7f12ef66d740 1 client.26435 shutdown 2024-09-21T01:26:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.885+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32082f0 msgr2=0x5647d35e9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.885+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32082f0 0x5647d35e9ef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5647d354d7c0 tx=0x7f12d8024040 comp rx=0 tx=0).stop 2024-09-21T01:26:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 shutdown_connections 2024-09-21T01:26:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5647d366bc10 0x5647d366e030 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647d31c51c0 0x5647d35e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d32311b0 0x5647d35e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12ef66d740 1 --2- 172.21.15.37:0/1856662342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5647d32082f0 0x5647d35e9ef0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 >> 172.21.15.37:0/1856662342 conn(0x5647d3225300 msgr2=0x5647d35d9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.886+0000 7f12c9ffb640 0 client.26435 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.887+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 shutdown_connections 2024-09-21T01:26:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.888+0000 7f12ef66d740 1 -- 172.21.15.37:0/1856662342 wait complete. 2024-09-21T01:26:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.888+0000 7f12ef66d740 20 client.26435 trim_cache size 0 max 16384 2024-09-21T01:26:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:26:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:26:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:26:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:26:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.902+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12cc0b6660 msgr2=0x7f12cc0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.902+0000 7f12e73c5640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12cc0b6660 0x7f12cc0b8b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f12d00cdca0 tx=0x7f12d002a410 comp rx=0 tx=0).stop 2024-09-21T01:26:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 msgr2=0x7f12e01a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 0x7f12e01a04b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f12d002aa00 tx=0x7f12d0003c80 comp rx=0 tx=0).stop 2024-09-21T01:26:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 shutdown_connections 2024-09-21T01:26:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f12cc0b6660 0x7f12cc0b8b70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e010b510 0x7f12e01a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e010ab70 0x7f12e01a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 --2- 172.21.15.37:0/1888278513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e0109af0 0x7f12e01a04b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.903+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 >> 172.21.15.37:0/1888278513 conn(0x7f12e0078e30 msgr2=0x7f12e010de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.907+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 shutdown_connections 2024-09-21T01:26:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:25.907+0000 7f12e73c5640 1 -- 172.21.15.37:0/1888278513 wait complete. 2024-09-21T01:26:27.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:26 smithi037 ceph-mon[31105]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 893 MiB/s wr, 2.35k op/s 2024-09-21T01:26:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:26 smithi137 ceph-mon[34607]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 893 MiB/s wr, 2.35k op/s 2024-09-21T01:26:27.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:26 smithi144 ceph-mon[34818]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 893 MiB/s wr, 2.35k op/s 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.722+0000 7f011d7d0640 1 -- 172.21.15.37:0/352174476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 msgr2=0x7f0118105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.722+0000 7f011d7d0640 1 --2- 172.21.15.37:0/352174476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118105580 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f010c009900 tx=0x7f010c02a410 comp rx=0 tx=0).stop 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 -- 172.21.15.37:0/352174476 shutdown_connections 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 --2- 172.21.15.37:0/352174476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0118105ac0 0x7f0118101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 --2- 172.21.15.37:0/352174476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118105580 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 --2- 172.21.15.37:0/352174476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0118103080 0x7f0118103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 -- 172.21.15.37:0/352174476 >> 172.21.15.37:0/352174476 conn(0x7f0118077c60 msgr2=0x7f01180780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 -- 172.21.15.37:0/352174476 shutdown_connections 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.723+0000 7f011d7d0640 1 -- 172.21.15.37:0/352174476 wait complete. 2024-09-21T01:26:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.724+0000 7f011d7d0640 1 Processor -- start 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.724+0000 7f011d7d0640 1 -- start start 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.725+0000 7f011d7d0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0118103080 0x7f0118112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.725+0000 7f011d7d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.725+0000 7f011d7d0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0118105ac0 0x7f01181134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.725+0000 7f011d7d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0118115cd0 con 0x7f0118105170 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.725+0000 7f011d7d0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0118115b50 con 0x7f0118105ac0 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.725+0000 7f011d7d0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0118115e50 con 0x7f0118103080 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.726+0000 7f01167fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.726+0000 7f01167fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47732/0 (socket says 172.21.15.37:47732) 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.726+0000 7f01167fc640 1 -- 172.21.15.37:0/3449715807 learned_addr learned my addr 172.21.15.37:0/3449715807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.726+0000 7f01177fe640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0118105ac0 0x7f01181134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.726+0000 7f0116ffd640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0118103080 0x7f0118112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.727+0000 7f01167fc640 1 -- 172.21.15.37:0/3449715807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0118103080 msgr2=0x7f0118112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.727+0000 7f01167fc640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0118103080 0x7f0118112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.727+0000 7f01167fc640 1 -- 172.21.15.37:0/3449715807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0118105ac0 msgr2=0x7f01181134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.727+0000 7f01167fc640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0118105ac0 0x7f01181134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.727+0000 7f01167fc640 1 -- 172.21.15.37:0/3449715807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01181a2340 con 0x7f0118105170 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.728+0000 7f01167fc640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118112f80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f010c02a930 tx=0x7f010c031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.730+0000 7f00fffff640 1 -- 172.21.15.37:0/3449715807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c040070 con 0x7f0118105170 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.730+0000 7f00fffff640 1 -- 172.21.15.37:0/3449715807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010c004c60 con 0x7f0118105170 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.730+0000 7f00fffff640 1 -- 172.21.15.37:0/3449715807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c035020 con 0x7f0118105170 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.730+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01181a25d0 con 0x7f0118105170 2024-09-21T01:26:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.731+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181a2a60 con 0x7f0118105170 2024-09-21T01:26:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.735+0000 7f00fffff640 1 -- 172.21.15.37:0/3449715807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f010c043070 con 0x7f0118105170 2024-09-21T01:26:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.736+0000 7f0123d44740 1 Processor -- start 2024-09-21T01:26:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.736+0000 7f0123d44740 1 -- start start 2024-09-21T01:26:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f0123d44740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x5596033252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f0123d44740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f551b0 0x559603325800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f0123d44740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f5d390 0x559603325d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f0123d44740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55960329bea0 con 0x559602f5d390 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f0123d44740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55960328b2d0 con 0x559602f7e070 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f0123d44740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55960328f0e0 con 0x559602f551b0 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.737+0000 7f01177fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x5596033252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.738+0000 7f01177fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x5596033252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47868/0 (socket says 172.21.15.37:47868) 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.738+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f551b0 0x559603325800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.738+0000 7f01177fe640 1 -- 172.21.15.37:0/1562250 learned_addr learned my addr 172.21.15.37:0/1562250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.738+0000 7f00fffff640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01000b6590 0x7f01000b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.738+0000 7f01167fc640 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f5d390 0x559603325d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.738+0000 7f01177fe640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01000b6590 0x7f01000b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.739+0000 7f00fffff640 1 -- 172.21.15.37:0/3449715807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f010c107d60 con 0x7f0118105170 2024-09-21T01:26:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.739+0000 7f01167fc640 1 -- 172.21.15.37:0/1562250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f551b0 msgr2=0x559603325800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.739+0000 7f01167fc640 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f551b0 0x559603325800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.739+0000 7f01167fc640 1 -- 172.21.15.37:0/1562250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 msgr2=0x5596033252c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.739+0000 7f01167fc640 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x5596033252c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.739+0000 7f01167fc640 1 -- 172.21.15.37:0/1562250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559602fe9650 con 0x559602f5d390 2024-09-21T01:26:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.740+0000 7f01177fe640 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x5596033252c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:26:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.740+0000 7f01167fc640 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f5d390 0x559603325d40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f010c0cb160 tx=0x7f010c09b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70cd6689b70d05f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.741+0000 7f00fd7fa640 1 -- 172.21.15.37:0/1562250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c04a070 con 0x559602f5d390 2024-09-21T01:26:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.741+0000 7f00fd7fa640 1 -- 172.21.15.37:0/1562250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010c004e10 con 0x559602f5d390 2024-09-21T01:26:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.741+0000 7f00fd7fa640 1 -- 172.21.15.37:0/1562250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c092300 con 0x559602f5d390 2024-09-21T01:26:27.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.742+0000 7f0123d44740 1 -- 172.21.15.37:0/1562250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f5d390 msgr2=0x559603325d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.742+0000 7f0123d44740 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f5d390 0x559603325d40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f010c0cb160 tx=0x7f010c09b220 comp rx=0 tx=0).stop 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f01177fe640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01000b6590 0x7f01000b8aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0110009fd0 tx=0x7f0110004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f0123d44740 1 -- 172.21.15.37:0/1562250 shutdown_connections 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f0123d44740 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f5d390 0x559603325d40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f0123d44740 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f551b0 0x559603325800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f0123d44740 1 --2- 172.21.15.37:0/1562250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x5596033252c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f0123d44740 1 -- 172.21.15.37:0/1562250 >> 172.21.15.37:0/1562250 conn(0x559602f72460 msgr2=0x5596033231b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.743+0000 7f0123d44740 1 -- 172.21.15.37:0/1562250 shutdown_connections 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.744+0000 7f0123d44740 1 -- 172.21.15.37:0/1562250 wait complete. 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.744+0000 7f0123d44740 1 -- start start 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.744+0000 7f0123d44740 1 Processor -- start 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x559603330ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x559603331080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x55960333cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5596030ec700 con 0x559602f551b0 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559603226160 con 0x559602f7e070 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559603333860 con 0x559602f3c9f0 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x559603330ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0123d44740 10 client.0 _ll_register_callbacks cb 0x55960323f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x559603330ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47750/0 (socket says 172.21.15.37:47750) 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.745+0000 7f0116ffd640 1 -- 172.21.15.37:0/3514512855 learned_addr learned my addr 172.21.15.37:0/3514512855 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.746+0000 7f0116ffd640 1 -- 172.21.15.37:0/3514512855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 msgr2=0x55960333cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.746+0000 7f0116ffd640 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x55960333cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.746+0000 7f0116ffd640 1 -- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 msgr2=0x559603331080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.746+0000 7f0116ffd640 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x559603331080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.746+0000 7f0116ffd640 1 -- 172.21.15.37:0/3514512855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559603253c90 con 0x559602f551b0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.747+0000 7f0116ffd640 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x559603330ae0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f010800b960 tx=0x7f010800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67da1ec3a2cca1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.747+0000 7f00faff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.747+0000 7f00faff5640 1 -- 172.21.15.37:0/3514512855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108003e20 con 0x559602f551b0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.747+0000 7f00faff5640 1 -- 172.21.15.37:0/3514512855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0108011440 con 0x559602f551b0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.748+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55960329ddf0 con 0x559602f551b0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.748+0000 7f00faff5640 1 -- 172.21.15.37:0/3514512855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0108011640 con 0x559602f551b0 2024-09-21T01:26:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.748+0000 7f0123d44740 10 client.17058 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.748+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55960333f710 con 0x559602f551b0 2024-09-21T01:26:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.750+0000 7f00faff5640 1 -- 172.21.15.37:0/3514512855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55960329ddf0 con 0x559602f551b0 2024-09-21T01:26:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.751+0000 7f00faff5640 1 -- 172.21.15.37:0/3514512855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f01080259f0 con 0x559602f551b0 2024-09-21T01:26:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.751+0000 7f0123d44740 10 client.17058 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.751+0000 7f0123d44740 10 client.17058 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:26:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.751+0000 7f0123d44740 20 client.17058 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.751+0000 7f0123d44740 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f11da0 0x559603342c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.752+0000 7f01167fc640 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f11da0 0x559603342c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.753+0000 7f0123d44740 4 client.17058 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:27.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.754+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596032998a0 con 0x559602f11da0 2024-09-21T01:26:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.770+0000 7f01167fc640 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f11da0 0x559603342c50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ccecc4e06534756 server_cookie=19ad9873413187e1 in_seq=0 out_seq=0 2024-09-21T01:26:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.770+0000 7f00faff5640 10 client.17058 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:26:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.776+0000 7f00faff5640 1 -- 172.21.15.37:0/3514512855 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596032998a0 con 0x559602f11da0 2024-09-21T01:26:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.776+0000 7f00faff5640 10 client.17058 handle_command_reply: tid=0 2024-09-21T01:26:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.776+0000 7f0123d44740 1 client.17058 shutdown 2024-09-21T01:26:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 msgr2=0x559603330ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x559603330ae0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f010800b960 tx=0x7f010800be20 comp rx=0 tx=0).stop 2024-09-21T01:26:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 shutdown_connections 2024-09-21T01:26:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f11da0 0x559603342c50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x55960333cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f00faff5640 0 client.17058 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f7e070 0x559603331080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 --2- 172.21.15.37:0/3514512855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x559603330ae0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.777+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 >> 172.21.15.37:0/3514512855 conn(0x559602f72460 msgr2=0x5596033284a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.778+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 shutdown_connections 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.778+0000 7f0123d44740 1 -- 172.21.15.37:0/3514512855 wait complete. 2024-09-21T01:26:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.778+0000 7f0123d44740 20 client.17058 trim_cache size 0 max 16384 2024-09-21T01:26:27.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.822+0000 7f0123d44740 1 Processor -- start 2024-09-21T01:26:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.825+0000 7f0123d44740 1 -- start start 2024-09-21T01:26:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.826+0000 7f0123d44740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 0x559603326a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.826+0000 7f0123d44740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f3c9f0 0x55960333c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.826+0000 7f0123d44740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x55960333cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.826+0000 7f0123d44740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01181be360 con 0x559602f551b0 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.826+0000 7f0123d44740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01181bfea0 con 0x559602f3c9f0 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.826+0000 7f0123d44740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01181bea30 con 0x559602f11da0 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.827+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 0x559603326a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.827+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 0x559603326a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:60350/0 (socket says 172.21.15.37:60350) 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.827+0000 7f0116ffd640 1 -- 172.21.15.37:0/1919947302 learned_addr learned my addr 172.21.15.37:0/1919947302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.827+0000 7f01177fe640 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x55960333cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f01167fc640 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f3c9f0 0x55960333c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f0116ffd640 1 -- 172.21.15.37:0/1919947302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f3c9f0 msgr2=0x55960333c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f0116ffd640 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f3c9f0 0x55960333c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f0116ffd640 1 -- 172.21.15.37:0/1919947302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 msgr2=0x55960333cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f0116ffd640 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x55960333cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f0116ffd640 1 -- 172.21.15.37:0/1919947302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55960331d460 con 0x559602f11da0 2024-09-21T01:26:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.828+0000 7f01177fe640 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x55960333cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:26:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.833+0000 7f0116ffd640 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 0x559603326a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f010801b790 tx=0x7f01080115d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fded21dfc15947 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.836+0000 7f00fcff9640 1 -- 172.21.15.37:0/1919947302 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108005020 con 0x559602f11da0 2024-09-21T01:26:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.836+0000 7f00fcff9640 1 -- 172.21.15.37:0/1919947302 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010801b810 con 0x559602f11da0 2024-09-21T01:26:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.838+0000 7f0123d44740 1 -- 172.21.15.37:0/1919947302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 msgr2=0x559603326a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.838+0000 7f0123d44740 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 0x559603326a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f010801b790 tx=0x7f01080115d0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 -- 172.21.15.37:0/1919947302 shutdown_connections 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x55960333cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f3c9f0 0x55960333c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 --2- 172.21.15.37:0/1919947302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f11da0 0x559603326a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 -- 172.21.15.37:0/1919947302 >> 172.21.15.37:0/1919947302 conn(0x559602f72460 msgr2=0x5596033262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 -- 172.21.15.37:0/1919947302 shutdown_connections 2024-09-21T01:26:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.842+0000 7f0123d44740 1 -- 172.21.15.37:0/1919947302 wait complete. 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.843+0000 7f0123d44740 1 -- start start 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.843+0000 7f0123d44740 1 Processor -- start 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.843+0000 7f0123d44740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f11da0 0x5596033a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.844+0000 7f0123d44740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x5596033a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.844+0000 7f0123d44740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x5596033a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.844+0000 7f0123d44740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01181bf7d0 con 0x559602f551b0 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.844+0000 7f0123d44740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01181bf100 con 0x559602f11da0 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.844+0000 7f0123d44740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01181bc320 con 0x559602f3c9f0 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.844+0000 7f0123d44740 10 client.0 _ll_register_callbacks cb 0x7f0108004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.845+0000 7f01167fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x5596033a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.845+0000 7f01167fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x5596033a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:60362/0 (socket says 172.21.15.37:60362) 2024-09-21T01:26:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.845+0000 7f01167fc640 1 -- 172.21.15.37:0/888062277 learned_addr learned my addr 172.21.15.37:0/888062277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.845+0000 7f0116ffd640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f11da0 0x5596033a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.850+0000 7f01177fe640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x5596033a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.850+0000 7f01167fc640 1 -- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f11da0 msgr2=0x5596033a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.850+0000 7f01167fc640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f11da0 0x5596033a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.851+0000 7f01167fc640 1 -- 172.21.15.37:0/888062277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 msgr2=0x5596033a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.851+0000 7f01167fc640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x5596033a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.851+0000 7f01167fc640 1 -- 172.21.15.37:0/888062277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559603323b20 con 0x559602f3c9f0 2024-09-21T01:26:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.852+0000 7f01167fc640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x5596033a65a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f010c005ab0 tx=0x7f010c0cd940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2f62973927cff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.853+0000 7f00faff5640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.853+0000 7f00faff5640 1 -- 172.21.15.37:0/888062277 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c04a040 con 0x559602f3c9f0 2024-09-21T01:26:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.853+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010801b810 con 0x559602f3c9f0 2024-09-21T01:26:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.853+0000 7f00faff5640 1 -- 172.21.15.37:0/888062277 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f010c07d230 con 0x559602f3c9f0 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.855+0000 7f00faff5640 1 -- 172.21.15.37:0/888062277 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f010c07d430 con 0x559602f3c9f0 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.855+0000 7f0123d44740 10 client.26416 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.855+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5596033be5d0 con 0x559602f3c9f0 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.857+0000 7f00faff5640 1 -- 172.21.15.37:0/888062277 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f010801b810 con 0x559602f3c9f0 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f00faff5640 1 -- 172.21.15.37:0/888062277 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f010c03a040 con 0x559602f3c9f0 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f0123d44740 10 client.26416 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f0123d44740 10 client.26416 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:26:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f0123d44740 20 client.26416 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f0123d44740 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f7e070 0x5596033c0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f0123d44740 4 client.26416 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:26:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.859+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559603296cd0 con 0x559602f7e070 2024-09-21T01:26:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.860+0000 7f0116ffd640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f7e070 0x5596033c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.862+0000 7f0116ffd640 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f7e070 0x5596033c0890 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=847be3d9316a3b2a server_cookie=e8823a6e598eee6d in_seq=0 out_seq=0 2024-09-21T01:26:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.862+0000 7f00faff5640 10 client.26416 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:26:27.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.863+0000 7f00faff5640 1 -- 172.21.15.37:0/888062277 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559603296cd0 con 0x559602f7e070 2024-09-21T01:26:27.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.863+0000 7f00faff5640 10 client.26416 handle_command_reply: tid=0 2024-09-21T01:26:27.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.863+0000 7f0123d44740 1 client.26416 shutdown 2024-09-21T01:26:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 msgr2=0x5596033a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x5596033a65a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f010c005ab0 tx=0x7f010c0cd940 comp rx=0 tx=0).stop 2024-09-21T01:26:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 shutdown_connections 2024-09-21T01:26:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x559602f7e070 0x5596033c0890 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559602f551b0 0x5596033a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559602f3c9f0 0x5596033a65a0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f010c005ab0 tx=0x7f010c0cd940 comp rx=0 tx=0).stop 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 --2- 172.21.15.37:0/888062277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559602f11da0 0x5596033a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 >> 172.21.15.37:0/888062277 conn(0x559602f72460 msgr2=0x559603332900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.866+0000 7f00faff5640 0 client.26416 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.868+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 shutdown_connections 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.869+0000 7f0123d44740 1 -- 172.21.15.37:0/888062277 wait complete. 2024-09-21T01:26:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.869+0000 7f0123d44740 20 client.26416 trim_cache size 0 max 16384 2024-09-21T01:26:27.873 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:26:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.878+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01000b6590 msgr2=0x7f01000b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.878+0000 7f011d7d0640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01000b6590 0x7f01000b8aa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0110009fd0 tx=0x7f0110004ab0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.878+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 msgr2=0x7f0118112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.878+0000 7f011d7d0640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118112f80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f010c02a930 tx=0x7f010c031470 comp rx=0 tx=0).stop 2024-09-21T01:26:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.881+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 shutdown_connections 2024-09-21T01:26:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.881+0000 7f011d7d0640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f01000b6590 0x7f01000b8aa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.881+0000 7f011d7d0640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0118105ac0 0x7f01181134c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.881+0000 7f011d7d0640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0118105170 0x7f0118112f80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.881+0000 7f011d7d0640 1 --2- 172.21.15.37:0/3449715807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0118103080 0x7f0118112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.881+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 >> 172.21.15.37:0/3449715807 conn(0x7f0118077c60 msgr2=0x7f01181061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.885+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 shutdown_connections 2024-09-21T01:26:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:27.885+0000 7f011d7d0640 1 -- 172.21.15.37:0/3449715807 wait complete. 2024-09-21T01:26:29.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:28 smithi037 ceph-mon[31105]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 779 MiB/s wr, 2.26k op/s 2024-09-21T01:26:29.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:28 smithi137 ceph-mon[34607]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 779 MiB/s wr, 2.26k op/s 2024-09-21T01:26:29.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:28 smithi144 ceph-mon[34818]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 779 MiB/s wr, 2.26k op/s 2024-09-21T01:26:30.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:26:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:31.004 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:30 smithi037 ceph-mon[31105]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 849 MiB/s wr, 2.44k op/s 2024-09-21T01:26:31.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:30 smithi137 ceph-mon[34607]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 849 MiB/s wr, 2.44k op/s 2024-09-21T01:26:31.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:30 smithi144 ceph-mon[34818]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 849 MiB/s wr, 2.44k op/s 2024-09-21T01:26:32.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:32 smithi037 ceph-mon[31105]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 886 MiB/s wr, 2.57k op/s 2024-09-21T01:26:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:32 smithi144 ceph-mon[34818]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 886 MiB/s wr, 2.57k op/s 2024-09-21T01:26:33.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:32 smithi137 ceph-mon[34607]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 886 MiB/s wr, 2.57k op/s 2024-09-21T01:26:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 -- 172.21.15.37:0/2287535985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8102870 msgr2=0x7faee8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 --2- 172.21.15.37:0/2287535985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8102870 0x7faee8102c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faedc009860 tx=0x7faedc032b90 comp rx=0 tx=0).stop 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 -- 172.21.15.37:0/2287535985 shutdown_connections 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 --2- 172.21.15.37:0/2287535985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8108b00 0x7faee806ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 --2- 172.21.15.37:0/2287535985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee81081b0 0x7faee81085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 --2- 172.21.15.37:0/2287535985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee8102870 0x7faee8102c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.848+0000 7faeecdf1640 1 -- 172.21.15.37:0/2287535985 >> 172.21.15.37:0/2287535985 conn(0x7faee80fe2c0 msgr2=0x7faee8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.849+0000 7faeecdf1640 1 -- 172.21.15.37:0/2287535985 shutdown_connections 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.849+0000 7faeecdf1640 1 -- 172.21.15.37:0/2287535985 wait complete. 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.850+0000 7faeecdf1640 1 Processor -- start 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.850+0000 7faeecdf1640 1 -- start start 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.851+0000 7faeecdf1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 0x7faee8074ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.851+0000 7faeecdf1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee81081b0 0x7faee806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.851+0000 7faeecdf1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee8108b00 0x7faee806e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.851+0000 7faeecdf1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faee8111710 con 0x7faee8102870 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.851+0000 7faeecdf1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faee8111590 con 0x7faee81081b0 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.851+0000 7faeecdf1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faee8111890 con 0x7faee8108b00 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 0x7faee8074ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 0x7faee8074ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47790/0 (socket says 172.21.15.37:47790) 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee77fe640 1 -- 172.21.15.37:0/1003834900 learned_addr learned my addr 172.21.15.37:0/1003834900 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee7fff640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee8108b00 0x7faee806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee6ffd640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee81081b0 0x7faee806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee77fe640 1 -- 172.21.15.37:0/1003834900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee8108b00 msgr2=0x7faee806e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.853+0000 7faee77fe640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee8108b00 0x7faee806e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.854+0000 7faee77fe640 1 -- 172.21.15.37:0/1003834900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee81081b0 msgr2=0x7faee806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.854+0000 7faee77fe640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee81081b0 0x7faee806e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.854+0000 7faee77fe640 1 -- 172.21.15.37:0/1003834900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee806efb0 con 0x7faee8102870 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.854+0000 7faee77fe640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 0x7faee8074ed0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faedc03e040 tx=0x7faedc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.856+0000 7faee4ff9640 1 -- 172.21.15.37:0/1003834900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc04a070 con 0x7faee8102870 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.857+0000 7faee4ff9640 1 -- 172.21.15.37:0/1003834900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faedc005500 con 0x7faee8102870 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.857+0000 7faee4ff9640 1 -- 172.21.15.37:0/1003834900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc004920 con 0x7faee8102870 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.858+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee8073c00 con 0x7faee8102870 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.858+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee80740c0 con 0x7faee8102870 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.864+0000 7faef45c7740 1 Processor -- start 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.865+0000 7faef45c7740 1 -- start start 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.866+0000 7faef45c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 0x55cc63b70870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.866+0000 7faef45c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a01b0 0x55cc63b70db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.866+0000 7faef45c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.866+0000 7faef45c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc63ae6ea0 con 0x55cc637a01b0 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.866+0000 7faef45c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc63ad62d0 con 0x55cc637a8390 2024-09-21T01:26:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.866+0000 7faef45c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc63ada0e0 con 0x55cc637c9070 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.868+0000 7faee7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 0x55cc63b70870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.870+0000 7faee7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 0x55cc63b70870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:60390/0 (socket says 172.21.15.37:60390) 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.870+0000 7faee7fff640 1 -- 172.21.15.37:0/589253387 learned_addr learned my addr 172.21.15.37:0/589253387 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.871+0000 7faee4ff9640 1 -- 172.21.15.37:0/1003834900 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7faedc04d070 con 0x7faee8102870 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.873+0000 7faee6ffd640 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.873+0000 7faee7fff640 1 -- 172.21.15.37:0/589253387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 msgr2=0x55cc63b712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.873+0000 7faee7fff640 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.873+0000 7faee7fff640 1 -- 172.21.15.37:0/589253387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a01b0 msgr2=0x55cc63b70db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.874+0000 7faee77fe640 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a01b0 0x55cc63b70db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.874+0000 7faee7fff640 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a01b0 0x55cc63b70db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.874+0000 7faee7fff640 1 -- 172.21.15.37:0/589253387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc63834650 con 0x55cc637c9070 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.876+0000 7faee4ff9640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7faed00b66e0 0x7faed00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.877+0000 7faee4ff9640 1 -- 172.21.15.37:0/1003834900 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7faedc1102f0 con 0x7faee8102870 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.878+0000 7faee77fe640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7faed00b66e0 0x7faed00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.879+0000 7faee77fe640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7faed00b66e0 0x7faed00b8bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faedc0d2aa0 tx=0x7faedc035fe0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.879+0000 7faee7fff640 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 0x55cc63b70870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faed8009b90 tx=0x7faed80117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb488c6842ed39a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.880+0000 7faecdffb640 1 -- 172.21.15.37:0/589253387 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8012450 con 0x55cc637c9070 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.880+0000 7faecdffb640 1 -- 172.21.15.37:0/589253387 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed8012aa0 con 0x55cc637c9070 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.882+0000 7faef45c7740 1 -- 172.21.15.37:0/589253387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 msgr2=0x55cc63b70870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.882+0000 7faef45c7740 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 0x55cc63b70870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faed8009b90 tx=0x7faed80117b0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.884+0000 7faef45c7740 1 -- 172.21.15.37:0/589253387 shutdown_connections 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.884+0000 7faef45c7740 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.884+0000 7faef45c7740 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a01b0 0x55cc63b70db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.884+0000 7faef45c7740 1 --2- 172.21.15.37:0/589253387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637c9070 0x55cc63b70870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.884+0000 7faef45c7740 1 -- 172.21.15.37:0/589253387 >> 172.21.15.37:0/589253387 conn(0x55cc637bd460 msgr2=0x55cc63b6e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.885+0000 7faef45c7740 1 -- 172.21.15.37:0/589253387 shutdown_connections 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.886+0000 7faef45c7740 1 -- 172.21.15.37:0/589253387 wait complete. 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.886+0000 7faef45c7740 1 -- start start 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.887+0000 7faef45c7740 1 Processor -- start 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.888+0000 7faef45c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a01b0 0x55cc63b7bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.889+0000 7faef45c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 0x55cc63b7c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.889+0000 7faef45c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 0x55cc63b7c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.889+0000 7faef45c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc63937700 con 0x55cc637c9070 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.889+0000 7faef45c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cc63a71160 con 0x55cc637a01b0 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.890+0000 7faef45c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc63b7f0a0 con 0x55cc637a8390 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.890+0000 7faee6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 0x55cc63b7c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.890+0000 7faee6ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 0x55cc63b7c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:60394/0 (socket says 172.21.15.37:60394) 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.890+0000 7faee6ffd640 1 -- 172.21.15.37:0/9813522 learned_addr learned my addr 172.21.15.37:0/9813522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.890+0000 7faef45c7740 10 client.0 _ll_register_callbacks cb 0x55cc63a8a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:33.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.891+0000 7faee6ffd640 1 -- 172.21.15.37:0/9813522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a01b0 msgr2=0x55cc63b7bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.891+0000 7faee6ffd640 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a01b0 0x55cc63b7bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.891+0000 7faee6ffd640 1 -- 172.21.15.37:0/9813522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 msgr2=0x55cc63b7c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.891+0000 7faee6ffd640 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 0x55cc63b7c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.891+0000 7faee6ffd640 1 -- 172.21.15.37:0/9813522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc63a9ec90 con 0x55cc637a8390 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.893+0000 7faee6ffd640 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 0x55cc63b7c450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faee0010b00 tx=0x7faee000d3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40e59613be2aa54d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.893+0000 7faec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.894+0000 7faec6ffd640 1 -- 172.21.15.37:0/9813522 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee000db30 con 0x55cc637a8390 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.894+0000 7faec6ffd640 1 -- 172.21.15.37:0/9813522 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7faee000dcd0 con 0x55cc637a8390 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.894+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed8012aa0 con 0x55cc637a8390 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.896+0000 7faec6ffd640 1 -- 172.21.15.37:0/9813522 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faee0003970 con 0x55cc637a8390 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.896+0000 7faef45c7740 10 client.26428 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.896+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cc63b8ae30 con 0x55cc637a8390 2024-09-21T01:26:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.897+0000 7faec6ffd640 1 -- 172.21.15.37:0/9813522 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faee0004020 con 0x55cc637a8390 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faec6ffd640 1 -- 172.21.15.37:0/9813522 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7faee000b040 con 0x55cc637a8390 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faef45c7740 10 client.26428 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faef45c7740 10 client.26428 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faef45c7740 20 client.26428 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faef45c7740 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc637879f0 0x55cc63b8e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faef45c7740 4 client.26428 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.898+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faed8012aa0 con 0x55cc637879f0 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.899+0000 7faee7fff640 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc637879f0 0x55cc63b8e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.900+0000 7faee7fff640 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc637879f0 0x55cc63b8e3c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10fff28463163ae4 server_cookie=874dbb9be37ba72 in_seq=0 out_seq=0 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.900+0000 7faec6ffd640 10 client.26428 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.900+0000 7faec6ffd640 1 -- 172.21.15.37:0/9813522 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7faed8012aa0 con 0x55cc637879f0 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faec6ffd640 10 client.26428 handle_command_reply: tid=0 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 client.26428 shutdown 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 msgr2=0x55cc63b7c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 0x55cc63b7c450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faee0010b00 tx=0x7faee000d3e0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 shutdown_connections 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc637879f0 0x55cc63b8e3c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 0x55cc63b7c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a8390 0x55cc63b7c450 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 --2- 172.21.15.37:0/9813522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a01b0 0x55cc63b7bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 >> 172.21.15.37:0/9813522 conn(0x55cc637bd460 msgr2=0x55cc63b73a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faec6ffd640 0 client.26428 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 shutdown_connections 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 1 -- 172.21.15.37:0/9813522 wait complete. 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.901+0000 7faef45c7740 20 client.26428 trim_cache size 0 max 16384 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.942+0000 7faef45c7740 1 Processor -- start 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.942+0000 7faef45c7740 1 -- start start 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.943+0000 7faef45c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 0x55cc63b7c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.943+0000 7faef45c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b6df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.943+0000 7faef45c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 0x55cc63b6e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.943+0000 7faef45c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faee811faf0 con 0x55cc637c9070 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.943+0000 7faef45c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faee8121630 con 0x55cc637a8390 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.944+0000 7faee7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 0x55cc63b7c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.944+0000 7faee7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 0x55cc63b7c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:60410/0 (socket says 172.21.15.37:60410) 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.944+0000 7faee7fff640 1 -- 172.21.15.37:0/1877337808 learned_addr learned my addr 172.21.15.37:0/1877337808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.944+0000 7faef45c7740 1 -- 172.21.15.37:0/1877337808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faee81201c0 con 0x55cc637a01b0 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.945+0000 7faee6ffd640 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b6df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.945+0000 7faee7fff640 1 -- 172.21.15.37:0/1877337808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 msgr2=0x55cc63b6df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.945+0000 7faee7fff640 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b6df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.945+0000 7faee7fff640 1 -- 172.21.15.37:0/1877337808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 msgr2=0x55cc63b6e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.945+0000 7faee7fff640 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 0x55cc63b6e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.945+0000 7faee7fff640 1 -- 172.21.15.37:0/1877337808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc63b7d1d0 con 0x55cc637a01b0 2024-09-21T01:26:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.946+0000 7faee7fff640 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 0x55cc63b7c3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faed800f680 tx=0x7faed8005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb519ffd6a79c51c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.947+0000 7faecd7fa640 1 -- 172.21.15.37:0/1877337808 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8033070 con 0x55cc637a01b0 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.947+0000 7faecd7fa640 1 -- 172.21.15.37:0/1877337808 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed8009e60 con 0x55cc637a01b0 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.948+0000 7faef45c7740 1 -- 172.21.15.37:0/1877337808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 msgr2=0x55cc63b7c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.948+0000 7faef45c7740 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 0x55cc63b7c3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faed800f680 tx=0x7faed8005d30 comp rx=0 tx=0).stop 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.950+0000 7faef45c7740 1 -- 172.21.15.37:0/1877337808 shutdown_connections 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.950+0000 7faef45c7740 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637c9070 0x55cc63b6e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.950+0000 7faef45c7740 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637a8390 0x55cc63b6df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.950+0000 7faef45c7740 1 --2- 172.21.15.37:0/1877337808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc637a01b0 0x55cc63b7c3d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.950+0000 7faef45c7740 1 -- 172.21.15.37:0/1877337808 >> 172.21.15.37:0/1877337808 conn(0x55cc637bd460 msgr2=0x55cc63b7bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.950+0000 7faef45c7740 1 -- 172.21.15.37:0/1877337808 shutdown_connections 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.951+0000 7faef45c7740 1 -- 172.21.15.37:0/1877337808 wait complete. 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.951+0000 7faef45c7740 1 -- start start 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 Processor -- start 2024-09-21T01:26:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a8390 0x55cc63b80540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637c9070 0x55cc63b80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc6375cda0 0x55cc63b80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faee8120f60 con 0x55cc637a8390 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faee8120890 con 0x55cc637c9070 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faee811dab0 con 0x55cc6375cda0 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.952+0000 7faef45c7740 10 client.0 _ll_register_callbacks cb 0x7faee0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.953+0000 7faee6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637c9070 0x55cc63b80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.953+0000 7faee6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637c9070 0x55cc63b80a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47950/0 (socket says 172.21.15.37:47950) 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.953+0000 7faee6ffd640 1 -- 172.21.15.37:0/3708069060 learned_addr learned my addr 172.21.15.37:0/3708069060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.954+0000 7faee7fff640 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc6375cda0 0x55cc63b80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.955+0000 7faee7fff640 1 -- 172.21.15.37:0/3708069060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637c9070 msgr2=0x55cc63b80a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.955+0000 7faee7fff640 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637c9070 0x55cc63b80a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.955+0000 7faee7fff640 1 -- 172.21.15.37:0/3708069060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a8390 msgr2=0x55cc63b80540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.955+0000 7faee7fff640 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a8390 0x55cc63b80540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.955+0000 7faee7fff640 1 -- 172.21.15.37:0/3708069060 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc63c08f90 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.955+0000 7faee7fff640 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc6375cda0 0x55cc63b80fc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faed8005e00 tx=0x7faed80035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad132b2656a1eb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.956+0000 7faec6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.956+0000 7faec6ffd640 1 -- 172.21.15.37:0/3708069060 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8033040 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.956+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc63ae8df0 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.956+0000 7faec6ffd640 1 -- 172.21.15.37:0/3708069060 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7faed8003bd0 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.957+0000 7faec6ffd640 1 -- 172.21.15.37:0/3708069060 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faed8009830 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.957+0000 7faef45c7740 10 client.26434 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.957+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cc63c0a2a0 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faec6ffd640 1 -- 172.21.15.37:0/3708069060 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cc63ae8df0 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faec6ffd640 1 -- 172.21.15.37:0/3708069060 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7faed8038470 con 0x55cc6375cda0 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faef45c7740 10 client.26434 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faef45c7740 10 client.26434 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:26:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faef45c7740 20 client.26434 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faef45c7740 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc63c0a790 0x55cc63c0cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faef45c7740 4 client.26434 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.960+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc63ae48a0 con 0x55cc63c0a790 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.961+0000 7faee6ffd640 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc63c0a790 0x55cc63c0cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.963+0000 7faee6ffd640 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc63c0a790 0x55cc63c0cbb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be2246c300210d96 server_cookie=8f84e805ff28827e in_seq=0 out_seq=0 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.963+0000 7faec6ffd640 10 client.26434 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.964+0000 7faec6ffd640 1 -- 172.21.15.37:0/3708069060 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc63ae48a0 con 0x55cc63c0a790 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.964+0000 7faec6ffd640 10 client.26434 handle_command_reply: tid=0 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.964+0000 7faef45c7740 1 client.26434 shutdown 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc6375cda0 msgr2=0x55cc63b80fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc6375cda0 0x55cc63b80fc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faed8005e00 tx=0x7faed80035f0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 shutdown_connections 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x55cc63c0a790 0x55cc63c0cbb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc6375cda0 0x55cc63b80fc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cc637c9070 0x55cc63b80a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 --2- 172.21.15.37:0/3708069060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc637a8390 0x55cc63b80540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 >> 172.21.15.37:0/3708069060 conn(0x55cc637bd460 msgr2=0x55cc63b73970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.967+0000 7faec6ffd640 0 client.26434 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:26:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.968+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 shutdown_connections 2024-09-21T01:26:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.968+0000 7faef45c7740 1 -- 172.21.15.37:0/3708069060 wait complete. 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.969+0000 7faef45c7740 20 client.26434 trim_cache size 0 max 16384 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.984+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7faed00b66e0 msgr2=0x7faed00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.984+0000 7faeecdf1640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7faed00b66e0 0x7faed00b8bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faedc0d2aa0 tx=0x7faedc035fe0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.984+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 msgr2=0x7faee8074ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.984+0000 7faeecdf1640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 0x7faee8074ed0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7faedc03e040 tx=0x7faedc004600 comp rx=0 tx=0).stop 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.990+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 shutdown_connections 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.990+0000 7faeecdf1640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7faed00b66e0 0x7faed00b8bf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.990+0000 7faeecdf1640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee8108b00 0x7faee806e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.990+0000 7faeecdf1640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faee81081b0 0x7faee806e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.990+0000 7faeecdf1640 1 --2- 172.21.15.37:0/1003834900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee8102870 0x7faee8074ed0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.990+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 >> 172.21.15.37:0/1003834900 conn(0x7faee80fe2c0 msgr2=0x7faee8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.992+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 shutdown_connections 2024-09-21T01:26:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:32.992+0000 7faeecdf1640 1 -- 172.21.15.37:0/1003834900 wait complete. 2024-09-21T01:26:34.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:34 smithi037 ceph-mon[31105]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 802 MiB/s wr, 2.24k op/s 2024-09-21T01:26:35.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:34 smithi144 ceph-mon[34818]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 802 MiB/s wr, 2.24k op/s 2024-09-21T01:26:35.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:34 smithi137 ceph-mon[34607]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 802 MiB/s wr, 2.24k op/s 2024-09-21T01:26:35.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:26:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:37.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:36 smithi037 ceph-mon[31105]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 881 MiB/s wr, 2.33k op/s 2024-09-21T01:26:37.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:36 smithi137 ceph-mon[34607]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 881 MiB/s wr, 2.33k op/s 2024-09-21T01:26:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:36 smithi144 ceph-mon[34818]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 881 MiB/s wr, 2.33k op/s 2024-09-21T01:26:38.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:37 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:26:38.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:37 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:26:38.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:37 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:26:38.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:38 smithi037 ceph-mon[31105]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 824 MiB/s wr, 2.05k op/s 2024-09-21T01:26:39.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:38 smithi144 ceph-mon[34818]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 824 MiB/s wr, 2.05k op/s 2024-09-21T01:26:39.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:38 smithi137 ceph-mon[34607]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 824 MiB/s wr, 2.05k op/s 2024-09-21T01:26:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.254+0000 7fef2759e640 1 -- 172.21.15.37:0/3819970145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 msgr2=0x7fef2810f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.254+0000 7fef2759e640 1 --2- 172.21.15.37:0/3819970145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2810f140 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fef18009860 tx=0x7fef1802a360 comp rx=0 tx=0).stop 2024-09-21T01:26:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.258+0000 7fef2759e640 1 -- 172.21.15.37:0/3819970145 shutdown_connections 2024-09-21T01:26:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.258+0000 7fef2759e640 1 --2- 172.21.15.37:0/3819970145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef2810f830 0x7fef2810fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.258+0000 7fef2759e640 1 --2- 172.21.15.37:0/3819970145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2810f140 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.258+0000 7fef2759e640 1 --2- 172.21.15.37:0/3819970145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2810c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.258+0000 7fef2759e640 1 -- 172.21.15.37:0/3819970145 >> 172.21.15.37:0/3819970145 conn(0x7fef28070640 msgr2=0x7fef28072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.260+0000 7fef2759e640 1 -- 172.21.15.37:0/3819970145 shutdown_connections 2024-09-21T01:26:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.263+0000 7fef2759e640 1 -- 172.21.15.37:0/3819970145 wait complete. 2024-09-21T01:26:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.264+0000 7fef2759e640 1 Processor -- start 2024-09-21T01:26:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.265+0000 7fef2759e640 1 -- start start 2024-09-21T01:26:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.265+0000 7fef2759e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2811b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.269+0000 7fef2659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2811b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.269+0000 7fef2759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2811bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.269+0000 7fef2759e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef2810f830 0x7fef2811a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.270+0000 7fef2759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef28112390 con 0x7fef2810cd20 2024-09-21T01:26:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.270+0000 7fef2759e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef28112210 con 0x7fef2810a3c0 2024-09-21T01:26:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.270+0000 7fef2759e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef28112510 con 0x7fef2810f830 2024-09-21T01:26:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.271+0000 7fef2659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2811b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39374/0 (socket says 172.21.15.37:39374) 2024-09-21T01:26:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.271+0000 7fef2659c640 1 -- 172.21.15.37:0/2358898359 learned_addr learned my addr 172.21.15.37:0/2358898359 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.271+0000 7fef26d9d640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef2810f830 0x7fef2811a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef25d9b640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2811bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef2659c640 1 -- 172.21.15.37:0/2358898359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef2810f830 msgr2=0x7fef2811a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef2659c640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef2810f830 0x7fef2811a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef2659c640 1 -- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 msgr2=0x7fef2811bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef2659c640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2811bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef2659c640 1 -- 172.21.15.37:0/2358898359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2811aa60 con 0x7fef2810a3c0 2024-09-21T01:26:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.272+0000 7fef25d9b640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2811bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:26:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.277+0000 7fef2659c640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2811b750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef2000ed80 tx=0x7fef2000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.282+0000 7fef177fe640 1 -- 172.21.15.37:0/2358898359 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2001c070 con 0x7fef2810a3c0 2024-09-21T01:26:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.282+0000 7fef177fe640 1 -- 172.21.15.37:0/2358898359 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef20017af0 con 0x7fef2810a3c0 2024-09-21T01:26:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.282+0000 7fef177fe640 1 -- 172.21.15.37:0/2358898359 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2000fb70 con 0x7fef2810a3c0 2024-09-21T01:26:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.282+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2811ad50 con 0x7fef2810a3c0 2024-09-21T01:26:39.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.282+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef281b9680 con 0x7fef2810a3c0 2024-09-21T01:26:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.289+0000 7fef337f9740 1 Processor -- start 2024-09-21T01:26:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.290+0000 7fef337f9740 1 -- start start 2024-09-21T01:26:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.292+0000 7fef337f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 0x55a007bce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.292+0000 7fef337f9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.294+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 0x55a007bce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.294+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 0x55a007bce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39378/0 (socket says 172.21.15.37:39378) 2024-09-21T01:26:39.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.294+0000 7fef26d9d640 1 -- 172.21.15.37:0/2227133913 learned_addr learned my addr 172.21.15.37:0/2227133913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.296+0000 7fef177fe640 1 -- 172.21.15.37:0/2358898359 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fef2001f070 con 0x7fef2810a3c0 2024-09-21T01:26:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.296+0000 7fef2659c640 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.296+0000 7fef337f9740 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078054d0 0x55a007bcf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.297+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a007b406f0 con 0x55a0078054d0 2024-09-21T01:26:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.297+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a007b2fb20 con 0x55a0078261b0 2024-09-21T01:26:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.297+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a007b33930 con 0x55a0077fd2f0 2024-09-21T01:26:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.298+0000 7fef25d9b640 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078054d0 0x55a007bcf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.299+0000 7fef177fe640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef100b66a0 0x7fef100b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.299+0000 7fef25d9b640 1 -- 172.21.15.37:0/2227133913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 msgr2=0x55a007bce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.299+0000 7fef25d9b640 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.299+0000 7fef25d9b640 1 -- 172.21.15.37:0/2227133913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 msgr2=0x55a007bce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.299+0000 7fef25d9b640 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 0x55a007bce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.299+0000 7fef25d9b640 1 -- 172.21.15.37:0/2227133913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a007af5530 con 0x55a0078054d0 2024-09-21T01:26:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.300+0000 7fef177fe640 1 -- 172.21.15.37:0/2358898359 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fef200e7300 con 0x7fef2810a3c0 2024-09-21T01:26:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.300+0000 7fef26d9d640 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 0x55a007bce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:26:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.302+0000 7fef25d9b640 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078054d0 0x55a007bcf200 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fef18009780 tx=0x7fef180094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822a6a4ed4ab3740 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.316+0000 7fef26d9d640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef100b66a0 0x7fef100b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.317+0000 7fef26d9d640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef100b66a0 0x7fef100b8bb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d50 tx=0x7fef1c0046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.319+0000 7fef14ff9640 1 -- 172.21.15.37:0/2227133913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18040020 con 0x55a0078054d0 2024-09-21T01:26:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.319+0000 7fef14ff9640 1 -- 172.21.15.37:0/2227133913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef18038040 con 0x55a0078054d0 2024-09-21T01:26:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.320+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078054d0 msgr2=0x55a007bcf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.320+0000 7fef337f9740 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078054d0 0x55a007bcf200 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fef18009780 tx=0x7fef180094b0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 shutdown_connections 2024-09-21T01:26:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078054d0 0x55a007bcf200 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 --2- 172.21.15.37:0/2227133913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0078261b0 0x55a007bce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 >> 172.21.15.37:0/2227133913 conn(0x55a00781a300 msgr2=0x55a007bc9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 shutdown_connections 2024-09-21T01:26:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.321+0000 7fef337f9740 1 -- 172.21.15.37:0/2227133913 wait complete. 2024-09-21T01:26:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.322+0000 7fef337f9740 1 -- start start 2024-09-21T01:26:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.322+0000 7fef337f9740 1 Processor -- start 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0077fd2f0 0x55a007bd75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0078261b0 0x55a007bd7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bd87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a007a67ab0 con 0x55a0077fd2f0 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a007ad5730 con 0x55a0077e4d80 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a007bcfd10 con 0x55a0078261b0 2024-09-21T01:26:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.323+0000 7fef337f9740 10 client.0 _ll_register_callbacks cb 0x55a007b296b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.324+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bd87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.324+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bd87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39394/0 (socket says 172.21.15.37:39394) 2024-09-21T01:26:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.324+0000 7fef26d9d640 1 -- 172.21.15.37:0/3704206512 learned_addr learned my addr 172.21.15.37:0/3704206512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.324+0000 7fef25d9b640 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0078261b0 0x55a007bd7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.325+0000 7fef26d9d640 1 -- 172.21.15.37:0/3704206512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0078261b0 msgr2=0x55a007bd7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.325+0000 7fef26d9d640 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0078261b0 0x55a007bd7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.325+0000 7fef26d9d640 1 -- 172.21.15.37:0/3704206512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0077fd2f0 msgr2=0x55a007bd75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.325+0000 7fef26d9d640 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0077fd2f0 0x55a007bd75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.325+0000 7fef26d9d640 1 -- 172.21.15.37:0/3704206512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a007891790 con 0x55a0077e4d80 2024-09-21T01:26:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.325+0000 7fef26d9d640 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bd87e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef1c01dbe0 tx=0x7fef1c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90b3429b0ee8f1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.331+0000 7fef0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:26:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.331+0000 7fef0dffb640 1 -- 172.21.15.37:0/3704206512 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c02a060 con 0x55a0077e4d80 2024-09-21T01:26:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.331+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a007b42640 con 0x55a0077e4d80 2024-09-21T01:26:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.332+0000 7fef0dffb640 1 -- 172.21.15.37:0/3704206512 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fef1c017070 con 0x55a0077e4d80 2024-09-21T01:26:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.332+0000 7fef0dffb640 1 -- 172.21.15.37:0/3704206512 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fef1c01b480 con 0x55a0077e4d80 2024-09-21T01:26:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.335+0000 7fef337f9740 10 client.26474 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.335+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a00790a620 con 0x55a0077e4d80 2024-09-21T01:26:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.335+0000 7fef0dffb640 1 -- 172.21.15.37:0/3704206512 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a007b42640 con 0x55a0077e4d80 2024-09-21T01:26:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef0dffb640 1 -- 172.21.15.37:0/3704206512 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fef1c02f070 con 0x55a0077e4d80 2024-09-21T01:26:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef337f9740 10 client.26474 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef337f9740 10 client.26474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef337f9740 20 client.26474 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef337f9740 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a0077ba1c0 0x55a007be4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef337f9740 4 client.26474 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.337+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a007b3e0f0 con 0x55a0077ba1c0 2024-09-21T01:26:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.894+0000 7f0467176640 1 -- 172.21.15.37:0/2742317976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046010af90 msgr2=0x7f0460115fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.894+0000 7f0467176640 1 --2- 172.21.15.37:0/2742317976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046010af90 0x7f0460115fd0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0450009860 tx=0x7f045002a380 comp rx=0 tx=0).stop 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.896+0000 7f0467176640 1 -- 172.21.15.37:0/2742317976 shutdown_connections 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.896+0000 7f0467176640 1 --2- 172.21.15.37:0/2742317976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0460116510 0x7f0460118990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.896+0000 7f0467176640 1 --2- 172.21.15.37:0/2742317976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046010af90 0x7f0460115fd0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.896+0000 7f0467176640 1 --2- 172.21.15.37:0/2742317976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.896+0000 7f0467176640 1 -- 172.21.15.37:0/2742317976 >> 172.21.15.37:0/2742317976 conn(0x7f046006e9f0 msgr2=0x7f046006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.897+0000 7f0467176640 1 -- 172.21.15.37:0/2742317976 shutdown_connections 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.898+0000 7f0467176640 1 -- 172.21.15.37:0/2742317976 wait complete. 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.899+0000 7f0467176640 1 Processor -- start 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 -- start start 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046010af90 0x7f046010be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0460116510 0x7f046010c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f046011c070 con 0x7f0460116510 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f046011bef0 con 0x7f046010af90 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.900+0000 7f0467176640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f046011c1f0 con 0x7f046010a640 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.903+0000 7f0466174640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.903+0000 7f0466174640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56540/0 (socket says 172.21.15.37:56540) 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.904+0000 7f0466174640 1 -- 172.21.15.37:0/1828751992 learned_addr learned my addr 172.21.15.37:0/1828751992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.906+0000 7f0466975640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0460116510 0x7f046010c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.909+0000 7f0465973640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046010af90 0x7f046010be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.910+0000 7f0466174640 1 -- 172.21.15.37:0/1828751992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046010af90 msgr2=0x7f046010be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.910+0000 7f0466174640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046010af90 0x7f046010be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.910+0000 7f0466174640 1 -- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0460116510 msgr2=0x7f046010c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.910+0000 7f0466174640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0460116510 0x7f046010c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.910+0000 7f0466174640 1 -- 172.21.15.37:0/1828751992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046010cbe0 con 0x7f046010a640 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.916+0000 7f0466174640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010d890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f045800efb0 tx=0x7f045800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.917+0000 7f04577fe640 1 -- 172.21.15.37:0/1828751992 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045801b070 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.917+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04601a6c60 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.917+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04601a71a0 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.917+0000 7f04577fe640 1 -- 172.21.15.37:0/1828751992 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f045800ba20 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.918+0000 7f04577fe640 1 -- 172.21.15.37:0/1828751992 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458016b30 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.934+0000 7f04577fe640 1 -- 172.21.15.37:0/1828751992 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f045801e070 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.945+0000 7f046e94c740 1 Processor -- start 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.945+0000 7f04577fe640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f044c0b6660 0x7f044c0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.946+0000 7f04577fe640 1 -- 172.21.15.37:0/1828751992 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f04580e7030 con 0x7f046010a640 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.948+0000 7f046e94c740 1 -- start start 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.949+0000 7f046e94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa64597860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.950+0000 7f046e94c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 0x55fa64597da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.951+0000 7f046e94c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641cf390 0x55fa645982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.951+0000 7f046e94c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa6450dea0 con 0x55fa641c71b0 2024-09-21T01:26:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.951+0000 7f046e94c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fa644fd2d0 con 0x55fa641cf390 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.951+0000 7f046e94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fa645010e0 con 0x55fa641f0070 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.953+0000 7f0466975640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f044c0b6660 0x7f044c0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.955+0000 7f0465973640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 0x55fa64597da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.955+0000 7f0465973640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 0x55fa64597da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57232/0 (socket says 172.21.15.37:57232) 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.955+0000 7f0465973640 1 -- 172.21.15.37:0/2241831932 learned_addr learned my addr 172.21.15.37:0/2241831932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.955+0000 7f0466975640 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641cf390 0x55fa645982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.956+0000 7f0465973640 1 -- 172.21.15.37:0/2241831932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 msgr2=0x55fa64597860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.956+0000 7f0465973640 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa64597860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.956+0000 7f0465973640 1 -- 172.21.15.37:0/2241831932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641cf390 msgr2=0x55fa645982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.956+0000 7f0465973640 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641cf390 0x55fa645982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.956+0000 7f0465973640 1 -- 172.21.15.37:0/2241831932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6425b650 con 0x55fa641c71b0 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.959+0000 7f0465973640 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 0x55fa64597da0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0450035040 tx=0x7f0450009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db84707439d790d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.970+0000 7f0454d9a640 1 -- 172.21.15.37:0/2241831932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450037070 con 0x55fa641c71b0 2024-09-21T01:26:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.970+0000 7f0454d9a640 1 -- 172.21.15.37:0/2241831932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0450038040 con 0x55fa641c71b0 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.970+0000 7f0454d9a640 1 -- 172.21.15.37:0/2241831932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500052a0 con 0x55fa641c71b0 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.970+0000 7f0466975640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f044c0b6660 0x7f044c0b8b70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f046010df40 tx=0x7f045c00b4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.972+0000 7f046e94c740 1 -- 172.21.15.37:0/2241831932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 msgr2=0x55fa64597da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.972+0000 7f046e94c740 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 0x55fa64597da0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0450035040 tx=0x7f0450009480 comp rx=0 tx=0).stop 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.976+0000 7f046e94c740 1 -- 172.21.15.37:0/2241831932 shutdown_connections 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.976+0000 7f046e94c740 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641cf390 0x55fa645982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.976+0000 7f046e94c740 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641c71b0 0x55fa64597da0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.976+0000 7f046e94c740 1 --2- 172.21.15.37:0/2241831932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa64597860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.976+0000 7f046e94c740 1 -- 172.21.15.37:0/2241831932 >> 172.21.15.37:0/2241831932 conn(0x55fa641e4460 msgr2=0x55fa64595750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.976+0000 7f046e94c740 1 -- 172.21.15.37:0/2241831932 shutdown_connections 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.977+0000 7f046e94c740 1 -- 172.21.15.37:0/2241831932 wait complete. 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.978+0000 7f046e94c740 1 -- start start 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.978+0000 7f046e94c740 1 Processor -- start 2024-09-21T01:26:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.980+0000 7f046e94c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 0x55fa645a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.981+0000 7f046e94c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.981+0000 7f046e94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa645af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.981+0000 7f046e94c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa6435e700 con 0x55fa641cf390 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.981+0000 7f046e94c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fa64498160 con 0x55fa641c71b0 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.981+0000 7f046e94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fa645a5fe0 con 0x55fa641f0070 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.982+0000 7f046e94c740 10 client.0 _ll_register_callbacks cb 0x55fa644b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.984+0000 7f0466975640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa645af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.984+0000 7f0465973640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.984+0000 7f0465973640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645a34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57234/0 (socket says 172.21.15.37:57234) 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.984+0000 7f0465973640 1 -- 172.21.15.37:0/190034121 learned_addr learned my addr 172.21.15.37:0/190034121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.985+0000 7f0465973640 1 -- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 msgr2=0x55fa645af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.985+0000 7f0465973640 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa645af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.985+0000 7f0465973640 1 -- 172.21.15.37:0/190034121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 msgr2=0x55fa645a2f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.985+0000 7f0465973640 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 0x55fa645a2f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.985+0000 7f0465973640 1 -- 172.21.15.37:0/190034121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa644c5c90 con 0x55fa641cf390 2024-09-21T01:26:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.991+0000 7f0465973640 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645a34c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f045002a8a0 tx=0x7f0450030df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4290fe97706d22b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:38.991+0000 7f0449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.012+0000 7f0449ffb640 1 -- 172.21.15.37:0/190034121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045004b020 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.012+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0450038040 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.012+0000 7f0449ffb640 1 -- 172.21.15.37:0/190034121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0450030890 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.013+0000 7f0449ffb640 1 -- 172.21.15.37:0/190034121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0450037040 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.013+0000 7f046e94c740 10 client.17082 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.013+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fa645b1d80 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.013+0000 7f0449ffb640 1 -- 172.21.15.37:0/190034121 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0450038040 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f0449ffb640 1 -- 172.21.15.37:0/190034121 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0450004c70 con 0x55fa641cf390 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f046e94c740 10 client.17082 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f046e94c740 10 client.17082 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f046e94c740 20 client.17082 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f046e94c740 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa641ae9f0 0x55fa645b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f046e94c740 4 client.17082 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa6450fdf0 con 0x55fa641ae9f0 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.014+0000 7f0466174640 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa641ae9f0 0x55fa645b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.016+0000 7f0449ffb640 10 client.17082 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.017+0000 7f0466174640 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa641ae9f0 0x55fa645b5520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f53bf216904cc90 server_cookie=a634eea5216e225f in_seq=0 out_seq=0 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.021+0000 7f0449ffb640 1 -- 172.21.15.37:0/190034121 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa6450fdf0 con 0x55fa641ae9f0 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.021+0000 7f0449ffb640 10 client.17082 handle_command_reply: tid=0 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.021+0000 7f046e94c740 1 client.17082 shutdown 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.022+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 msgr2=0x55fa645a34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.022+0000 7f046e94c740 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645a34c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f045002a8a0 tx=0x7f0450030df0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.023+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 shutdown_connections 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.023+0000 7f046e94c740 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa641ae9f0 0x55fa645b5520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.023+0000 7f046e94c740 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641f0070 0x55fa645af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.023+0000 7f046e94c740 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645a34c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.023+0000 7f046e94c740 1 --2- 172.21.15.37:0/190034121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 0x55fa645a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.023+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 >> 172.21.15.37:0/190034121 conn(0x55fa641e4460 msgr2=0x55fa6459a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.024+0000 7f0449ffb640 0 client.17082 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.030+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 shutdown_connections 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.031+0000 7f046e94c740 1 -- 172.21.15.37:0/190034121 wait complete. 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.031+0000 7f046e94c740 20 client.17082 trim_cache size 0 max 16384 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.066+0000 7f046e94c740 1 Processor -- start 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.068+0000 7f046e94c740 1 -- start start 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f046e94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 0x55fa645a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f046e94c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645af260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f046e94c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641f0070 0x55fa64594d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f046e94c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f044400e5e0 con 0x55fa641cf390 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f046e94c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0444010120 con 0x55fa641f0070 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f046e94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f044400ecb0 con 0x55fa641c71b0 2024-09-21T01:26:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f0466174640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 0x55fa645a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f0466174640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 0x55fa645a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56560/0 (socket says 172.21.15.37:56560) 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f0466174640 1 -- 172.21.15.37:0/4008709176 learned_addr learned my addr 172.21.15.37:0/4008709176 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f0466174640 1 -- 172.21.15.37:0/4008709176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641f0070 msgr2=0x55fa64594d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f0466174640 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641f0070 0x55fa64594d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.069+0000 7f0466174640 1 -- 172.21.15.37:0/4008709176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 msgr2=0x55fa645af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.070+0000 7f0466174640 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.070+0000 7f0466174640 1 -- 172.21.15.37:0/4008709176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6459a6c0 con 0x55fa641c71b0 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.071+0000 7f0466174640 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 0x55fa645a3440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04580e4b30 tx=0x7f04580ad0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7850ddbc290b118 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.074+0000 7f044bfff640 1 -- 172.21.15.37:0/4008709176 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580e4c40 con 0x55fa641c71b0 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.074+0000 7f044bfff640 1 -- 172.21.15.37:0/4008709176 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0458016410 con 0x55fa641c71b0 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.076+0000 7f046e94c740 1 -- 172.21.15.37:0/4008709176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 msgr2=0x55fa645a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.076+0000 7f046e94c740 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 0x55fa645a3440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04580e4b30 tx=0x7f04580ad0b0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.077+0000 7f046e94c740 1 -- 172.21.15.37:0/4008709176 shutdown_connections 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.077+0000 7f046e94c740 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641f0070 0x55fa64594d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.078+0000 7f046e94c740 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641cf390 0x55fa645af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.078+0000 7f046e94c740 1 --2- 172.21.15.37:0/4008709176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641c71b0 0x55fa645a3440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.078+0000 7f046e94c740 1 -- 172.21.15.37:0/4008709176 >> 172.21.15.37:0/4008709176 conn(0x55fa641e4460 msgr2=0x55fa645a2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.080+0000 7f046e94c740 1 -- 172.21.15.37:0/4008709176 shutdown_connections 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.081+0000 7f046e94c740 1 -- 172.21.15.37:0/4008709176 wait complete. 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.081+0000 7f046e94c740 1 -- start start 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.081+0000 7f046e94c740 1 Processor -- start 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 0x55fa645a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641cf390 0x55fa645a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 0x55fa645ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f044400fa50 con 0x55fa641f0070 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f044400f380 con 0x55fa641c71b0 2024-09-21T01:26:39.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f044400c5a0 con 0x55fa641cf390 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.082+0000 7f046e94c740 10 client.0 _ll_register_callbacks cb 0x7f0458009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.083+0000 7f0466975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 0x55fa645ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.083+0000 7f0466975640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 0x55fa645ab1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57248/0 (socket says 172.21.15.37:57248) 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.083+0000 7f0466975640 1 -- 172.21.15.37:0/3162864560 learned_addr learned my addr 172.21.15.37:0/3162864560 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.084+0000 7f0465973640 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641cf390 0x55fa645a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.085+0000 7f0466975640 1 -- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641cf390 msgr2=0x55fa645a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.085+0000 7f0466975640 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641cf390 0x55fa645a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.085+0000 7f0466975640 1 -- 172.21.15.37:0/3162864560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 msgr2=0x55fa645a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.085+0000 7f0466975640 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 0x55fa645a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.085+0000 7f0466975640 1 -- 172.21.15.37:0/3162864560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa645ab840 con 0x55fa641f0070 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.095+0000 7f0466975640 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 0x55fa645ab1d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f045c0105d0 tx=0x7f045c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cdc92e6f6ff13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.095+0000 7f0449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.102+0000 7f0449ffb640 1 -- 172.21.15.37:0/3162864560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c023070 con 0x55fa641f0070 2024-09-21T01:26:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.102+0000 7f0449ffb640 1 -- 172.21.15.37:0/3162864560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f045c01e8a0 con 0x55fa641f0070 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.102+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0458016410 con 0x55fa641f0070 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.103+0000 7f0449ffb640 1 -- 172.21.15.37:0/3162864560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f045c017040 con 0x55fa641f0070 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.104+0000 7f046e94c740 10 client.17085 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.104+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fa6461fa50 con 0x55fa641f0070 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.106+0000 7f0449ffb640 1 -- 172.21.15.37:0/3162864560 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0458016410 con 0x55fa641f0070 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f0449ffb640 1 -- 172.21.15.37:0/3162864560 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f045c030020 con 0x55fa641f0070 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f046e94c740 10 client.17085 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f046e94c740 10 client.17085 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f046e94c740 20 client.17085 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f046e94c740 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa64183da0 0x55fa64622270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f046e94c740 4 client.17085 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.107+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa6450b8a0 con 0x55fa64183da0 2024-09-21T01:26:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.109+0000 7f0466174640 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa64183da0 0x55fa64622270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.141+0000 7f0449ffb640 10 client.17085 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.141+0000 7f0466174640 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa64183da0 0x55fa64622270 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=22c135da6a68c5f6 server_cookie=ab9d0c5978ba1b98 in_seq=0 out_seq=0 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.141+0000 7f0449ffb640 1 -- 172.21.15.37:0/3162864560 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa6450b8a0 con 0x55fa64183da0 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.141+0000 7f0449ffb640 10 client.17085 handle_command_reply: tid=0 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.142+0000 7f046e94c740 1 client.17085 shutdown 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 msgr2=0x55fa645ab1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 0x55fa645ab1d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f045c0105d0 tx=0x7f045c005f30 comp rx=0 tx=0).stop 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 shutdown_connections 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55fa64183da0 0x55fa64622270 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa641f0070 0x55fa645ab1d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa641cf390 0x55fa645a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 --2- 172.21.15.37:0/3162864560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fa641c71b0 0x55fa645a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 >> 172.21.15.37:0/3162864560 conn(0x55fa641e4460 msgr2=0x55fa645a13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.143+0000 7f0449ffb640 0 client.17085 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:26:39.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.147+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 shutdown_connections 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.147+0000 7f046e94c740 1 -- 172.21.15.37:0/3162864560 wait complete. 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.147+0000 7f046e94c740 20 client.17085 trim_cache size 0 max 16384 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f044c0b6660 msgr2=0x7f044c0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f044c0b6660 0x7f044c0b8b70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f046010df40 tx=0x7f045c00b4c0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 msgr2=0x7f046010d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010d890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f045800efb0 tx=0x7f045800c800 comp rx=0 tx=0).stop 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 shutdown_connections 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f044c0b6660 0x7f044c0b8b70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0460116510 0x7f046010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f046010af90 0x7f046010be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.158+0000 7f0467176640 1 --2- 172.21.15.37:0/1828751992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046010a640 0x7f046010d890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.159+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 >> 172.21.15.37:0/1828751992 conn(0x7f046006e9f0 msgr2=0x7f0460072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.162+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 shutdown_connections 2024-09-21T01:26:39.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:39.162+0000 7f0467176640 1 -- 172.21.15.37:0/1828751992 wait complete. 2024-09-21T01:26:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.384+0000 7fef2659c640 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a0077ba1c0 0x55a007be4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.397+0000 7fef0dffb640 10 client.26474 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.397+0000 7fef2659c640 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a0077ba1c0 0x55a007be4dd0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5744c6fa6bb51406 server_cookie=ae243bdae11d1e1f in_seq=0 out_seq=0 2024-09-21T01:26:39.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.404+0000 7fef0dffb640 1 -- 172.21.15.37:0/3704206512 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a007b3e0f0 con 0x55a0077ba1c0 2024-09-21T01:26:39.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.404+0000 7fef0dffb640 10 client.26474 handle_command_reply: tid=0 2024-09-21T01:26:39.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.404+0000 7fef337f9740 1 client.26474 shutdown 2024-09-21T01:26:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 msgr2=0x55a007bd87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bd87e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef1c01dbe0 tx=0x7fef1c004730 comp rx=0 tx=0).stop 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 shutdown_connections 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a0077ba1c0 0x55a007be4dd0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bd87e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0078261b0 0x55a007bd7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 --2- 172.21.15.37:0/3704206512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0077fd2f0 0x55a007bd75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef0dffb640 0 client.26474 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.416+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 >> 172.21.15.37:0/3704206512 conn(0x55a00781a300 msgr2=0x55a007bc8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.426+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 shutdown_connections 2024-09-21T01:26:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.426+0000 7fef337f9740 1 -- 172.21.15.37:0/3704206512 wait complete. 2024-09-21T01:26:39.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.435+0000 7fef337f9740 20 client.26474 trim_cache size 0 max 16384 2024-09-21T01:26:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.518+0000 7fef337f9740 1 Processor -- start 2024-09-21T01:26:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.519+0000 7fef337f9740 1 -- start start 2024-09-21T01:26:39.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.520+0000 7fef337f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef337f9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bdf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef337f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bcad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef337f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef281c2300 con 0x55a0078261b0 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef337f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef281c3e40 con 0x55a0077e4d80 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef337f9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef281c29d0 con 0x55a0077fd2f0 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bcad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef26d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bcad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57294/0 (socket says 172.21.15.37:57294) 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.521+0000 7fef26d9d640 1 -- 172.21.15.37:0/951481890 learned_addr learned my addr 172.21.15.37:0/951481890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.522+0000 7fef2659c640 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.522+0000 7fef25d9b640 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bdf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.523+0000 7fef2659c640 1 -- 172.21.15.37:0/951481890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 msgr2=0x55a007bdf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.524+0000 7fef2659c640 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bdf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.524+0000 7fef2659c640 1 -- 172.21.15.37:0/951481890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 msgr2=0x55a007bcad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.524+0000 7fef2659c640 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bcad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.524+0000 7fef2659c640 1 -- 172.21.15.37:0/951481890 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a007bd5730 con 0x55a0077e4d80 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.524+0000 7fef2659c640 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bceed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef2000cbe0 tx=0x7fef200e4cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a35322b4c0e2634 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.525+0000 7fef0ffff640 1 -- 172.21.15.37:0/951481890 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200d4070 con 0x55a0077e4d80 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.525+0000 7fef0ffff640 1 -- 172.21.15.37:0/951481890 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef200b1f70 con 0x55a0077e4d80 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.526+0000 7fef337f9740 1 -- 172.21.15.37:0/951481890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 msgr2=0x55a007bceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.526+0000 7fef337f9740 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bceed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef2000cbe0 tx=0x7fef200e4cd0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.527+0000 7fef337f9740 1 -- 172.21.15.37:0/951481890 shutdown_connections 2024-09-21T01:26:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.527+0000 7fef337f9740 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bcad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.527+0000 7fef337f9740 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077fd2f0 0x55a007bdf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.527+0000 7fef337f9740 1 --2- 172.21.15.37:0/951481890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077e4d80 0x55a007bceed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.527+0000 7fef337f9740 1 -- 172.21.15.37:0/951481890 >> 172.21.15.37:0/951481890 conn(0x55a00781a300 msgr2=0x55a007bca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:39.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.529+0000 7fef337f9740 1 -- 172.21.15.37:0/951481890 shutdown_connections 2024-09-21T01:26:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.530+0000 7fef337f9740 1 -- 172.21.15.37:0/951481890 wait complete. 2024-09-21T01:26:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.530+0000 7fef337f9740 1 -- start start 2024-09-21T01:26:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 Processor -- start 2024-09-21T01:26:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 0x55a007bdf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077fd2f0 0x55a007bdde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bde3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef281c3770 con 0x55a0078261b0 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef281c30a0 con 0x55a0077fd2f0 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef281c0390 con 0x55a0077e4d80 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.531+0000 7fef337f9740 10 client.0 _ll_register_callbacks cb 0x7fef1c009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.532+0000 7fef2659c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 0x55a007bdf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.532+0000 7fef2659c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 0x55a007bdf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:56616/0 (socket says 172.21.15.37:56616) 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.532+0000 7fef2659c640 1 -- 172.21.15.37:0/3317816112 learned_addr learned my addr 172.21.15.37:0/3317816112 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.532+0000 7fef25d9b640 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077fd2f0 0x55a007bdde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.533+0000 7fef2659c640 1 -- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077fd2f0 msgr2=0x55a007bdde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.533+0000 7fef2659c640 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077fd2f0 0x55a007bdde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.533+0000 7fef2659c640 1 -- 172.21.15.37:0/3317816112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 msgr2=0x55a007bde3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.533+0000 7fef2659c640 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bde3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.533+0000 7fef2659c640 1 -- 172.21.15.37:0/3317816112 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a007bde910 con 0x55a0077e4d80 2024-09-21T01:26:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.534+0000 7fef2659c640 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 0x55a007bdf1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f80 tx=0x7fef200ad0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c87c0a8bed440e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.542+0000 7fef0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.542+0000 7fef0dffb640 1 -- 172.21.15.37:0/3317816112 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200c7070 con 0x55a0077e4d80 2024-09-21T01:26:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.542+0000 7fef0dffb640 1 -- 172.21.15.37:0/3317816112 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fef20017640 con 0x55a0077e4d80 2024-09-21T01:26:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.545+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef200b1f70 con 0x55a0077e4d80 2024-09-21T01:26:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.552+0000 7fef0dffb640 1 -- 172.21.15.37:0/3317816112 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fef200d4070 con 0x55a0077e4d80 2024-09-21T01:26:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.552+0000 7fef337f9740 10 client.26461 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.552+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a007bdd7a0 con 0x55a0077e4d80 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef0dffb640 1 -- 172.21.15.37:0/3317816112 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef200b1f70 con 0x55a0077e4d80 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef0dffb640 1 -- 172.21.15.37:0/3317816112 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fef200b6040 con 0x55a0077e4d80 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef337f9740 10 client.26461 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef337f9740 10 client.26461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef337f9740 20 client.26461 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef337f9740 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a007c4fe30 0x55a007c52250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef337f9740 4 client.26461 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:26:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.553+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a007b3b520 con 0x55a007c4fe30 2024-09-21T01:26:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.587+0000 7fef25d9b640 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a007c4fe30 0x55a007c52250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.588+0000 7fef0dffb640 10 client.26461 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:39.588+0000 7fef25d9b640 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a007c4fe30 0x55a007c52250 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d97e0913dd174b5d server_cookie=e3a8b38da2a90b0f in_seq=0 out_seq=0 2024-09-21T01:26:40.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:39 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:40.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:39 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:40.332 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:39 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:40.332 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:39 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:40.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:39 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:40.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:39 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:41.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:41 smithi037 ceph-mon[31105]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 860 MiB/s wr, 2.05k op/s 2024-09-21T01:26:41.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:41.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:41 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:41.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:41 smithi137 ceph-mon[34607]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 860 MiB/s wr, 2.05k op/s 2024-09-21T01:26:41.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:41.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:41 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:41 smithi144 ceph-mon[34818]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 860 MiB/s wr, 2.05k op/s 2024-09-21T01:26:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:41.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:41 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.322+0000 7fef0dffb640 1 -- 172.21.15.37:0/3317816112 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a007b3b520 con 0x55a007c4fe30 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.322+0000 7fef0dffb640 10 client.26461 handle_command_reply: tid=0 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.322+0000 7fef337f9740 1 client.26461 shutdown 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 msgr2=0x55a007bdf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 0x55a007bdf1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f80 tx=0x7fef200ad0e0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 shutdown_connections 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a007c4fe30 0x55a007c52250 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0078261b0 0x55a007bde3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a0077fd2f0 0x55a007bdde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 --2- 172.21.15.37:0/3317816112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a0077e4d80 0x55a007bdf1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 >> 172.21.15.37:0/3317816112 conn(0x55a00781a300 msgr2=0x55a007bcaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef0dffb640 0 client.26461 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 shutdown_connections 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 1 -- 172.21.15.37:0/3317816112 wait complete. 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.323+0000 7fef337f9740 20 client.26461 trim_cache size 0 max 16384 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:26:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:26:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:26:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:26:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef100b66a0 msgr2=0x7fef100b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef100b66a0 0x7fef100b8bb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d50 tx=0x7fef1c0046c0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 msgr2=0x7fef2811b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2811b750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef2000ed80 tx=0x7fef2000c6e0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 shutdown_connections 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fef100b66a0 0x7fef100b8bb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef2810f830 0x7fef2811a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef2810cd20 0x7fef2811bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 --2- 172.21.15.37:0/2358898359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef2810a3c0 0x7fef2811b750 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.324+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 >> 172.21.15.37:0/2358898359 conn(0x7fef28070640 msgr2=0x7fef28072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.325+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 shutdown_connections 2024-09-21T01:26:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:43.325+0000 7fef2759e640 1 -- 172.21.15.37:0/2358898359 wait complete. 2024-09-21T01:26:43.505 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:43 smithi037 ceph-mon[31105]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 904 MiB/s wr, 2.26k op/s 2024-09-21T01:26:43.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:43 smithi137 ceph-mon[34607]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 904 MiB/s wr, 2.26k op/s 2024-09-21T01:26:43.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:43 smithi144 ceph-mon[34818]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 904 MiB/s wr, 2.26k op/s 2024-09-21T01:26:44.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:26:45.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:45 smithi037 ceph-mon[31105]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 816 MiB/s wr, 2.14k op/s 2024-09-21T01:26:45.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:45 smithi137 ceph-mon[34607]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 816 MiB/s wr, 2.14k op/s 2024-09-21T01:26:45.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:45 smithi144 ceph-mon[34818]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 816 MiB/s wr, 2.14k op/s 2024-09-21T01:26:47.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:47 smithi037 ceph-mon[31105]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 847 MiB/s wr, 2.26k op/s 2024-09-21T01:26:47.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:47 smithi137 ceph-mon[34607]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 847 MiB/s wr, 2.26k op/s 2024-09-21T01:26:47.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:47 smithi144 ceph-mon[34818]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 847 MiB/s wr, 2.26k op/s 2024-09-21T01:26:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:49.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:49 smithi037 ceph-mon[31105]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 811 MiB/s wr, 2.18k op/s 2024-09-21T01:26:49.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:49.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:49 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:49.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:49 smithi137 ceph-mon[34607]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 811 MiB/s wr, 2.18k op/s 2024-09-21T01:26:49.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:49 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:49.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:49 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:49.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:49 smithi144 ceph-mon[34818]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 811 MiB/s wr, 2.18k op/s 2024-09-21T01:26:49.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:49 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:49.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:49 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e6b7fe640 1 -- 172.21.15.37:0/1662481050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e640318a0 con 0x7f3e6c110230 2024-09-21T01:26:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 -- 172.21.15.37:0/1662481050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c110230 msgr2=0x7f3e6c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 --2- 172.21.15.37:0/1662481050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c110230 0x7f3e6c110640 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009900 tx=0x7f3e6402a440 comp rx=0 tx=0).stop 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 -- 172.21.15.37:0/1662481050 shutdown_connections 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 --2- 172.21.15.37:0/1662481050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c110230 0x7f3e6c110640 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 --2- 172.21.15.37:0/1662481050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c10fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 --2- 172.21.15.37:0/1662481050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e6c10a3c0 0x7f3e6c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.553+0000 7f3e71b30640 1 -- 172.21.15.37:0/1662481050 >> 172.21.15.37:0/1662481050 conn(0x7f3e6c06ee50 msgr2=0x7f3e6c06f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.555+0000 7f3e71b30640 1 -- 172.21.15.37:0/1662481050 shutdown_connections 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.555+0000 7f3e71b30640 1 -- 172.21.15.37:0/1662481050 wait complete. 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.556+0000 7f3e71b30640 1 Processor -- start 2024-09-21T01:26:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.556+0000 7f3e71b30640 1 -- start start 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.556+0000 7f3e71b30640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e6c10a3c0 0x7f3e6c1aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.556+0000 7f3e71b30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c1ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e71b30640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e6c110230 0x7f3e6c11d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e71b30640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c113fc0 con 0x7f3e6c10ad10 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e71b30640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c113e40 con 0x7f3e6c110230 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e71b30640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c11e5c0 con 0x7f3e6c10a3c0 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c1ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c1ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49048/0 (socket says 172.21.15.37:49048) 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.557+0000 7f3e6bfff640 1 -- 172.21.15.37:0/4020806487 learned_addr learned my addr 172.21.15.37:0/4020806487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.558+0000 7f3e6bfff640 1 -- 172.21.15.37:0/4020806487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e6c10a3c0 msgr2=0x7f3e6c1aae50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.558+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e6c10a3c0 0x7f3e6c1aae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.558+0000 7f3e6bfff640 1 -- 172.21.15.37:0/4020806487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e6c110230 msgr2=0x7f3e6c11d8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:26:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.558+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e6c110230 0x7f3e6c11d8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.558+0000 7f3e6bfff640 1 -- 172.21.15.37:0/4020806487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c11df90 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.559+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c1ab3d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00b9b0 tx=0x7f3e5c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.559+0000 7f3e69ffb640 1 -- 172.21.15.37:0/4020806487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c019070 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.559+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c11e280 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.560+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c1178f0 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.560+0000 7f3e69ffb640 1 -- 172.21.15.37:0/4020806487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5c00cba0 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.560+0000 7f3e69ffb640 1 -- 172.21.15.37:0/4020806487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0125a0 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.567+0000 7f3e79306740 1 Processor -- start 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.568+0000 7f3e69ffb640 1 -- 172.21.15.37:0/4020806487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3e5c01c070 con 0x7f3e6c10ad10 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.568+0000 7f3e79306740 1 -- start start 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.569+0000 7f3e79306740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d826860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.569+0000 7f3e79306740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d4561b0 0x55eb0d826da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.569+0000 7f3e79306740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d8272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.569+0000 7f3e79306740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb0d79cea0 con 0x55eb0d45e390 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.569+0000 7f3e79306740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb0d78c2d0 con 0x55eb0d4561b0 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.569+0000 7f3e79306740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55eb0d7900e0 con 0x55eb0d47f070 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.570+0000 7f3e69ffb640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e540b66e0 0x7f3e540b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.570+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d8272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.570+0000 7f3e7132f640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e540b66e0 0x7f3e540b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.571+0000 7f3e7132f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d826860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.571+0000 7f3e7132f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d826860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:38730/0 (socket says 172.21.15.37:38730) 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.571+0000 7f3e7132f640 1 -- 172.21.15.37:0/3905025277 learned_addr learned my addr 172.21.15.37:0/3905025277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.572+0000 7f3e6bfff640 1 -- 172.21.15.37:0/3905025277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 msgr2=0x55eb0d826860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.572+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d826860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.572+0000 7f3e6bfff640 1 -- 172.21.15.37:0/3905025277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d4561b0 msgr2=0x55eb0d826da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.572+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d4561b0 0x55eb0d826da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.572+0000 7f3e6bfff640 1 -- 172.21.15.37:0/3905025277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb0d4ea650 con 0x55eb0d45e390 2024-09-21T01:26:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.572+0000 7f3e69ffb640 1 -- 172.21.15.37:0/4020806487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3e5c0e6570 con 0x7f3e6c10ad10 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.573+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d8272e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0e3fd0 tx=0x7f3e5c0a8dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d078d86799aeeabf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.573+0000 7f3e7132f640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e540b66e0 0x7f3e540b8bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3e64033000 tx=0x7f3e64005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.573+0000 7f3e52ffd640 1 -- 172.21.15.37:0/3905025277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0ac490 con 0x55eb0d45e390 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.573+0000 7f3e52ffd640 1 -- 172.21.15.37:0/3905025277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5c0ac1d0 con 0x55eb0d45e390 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.573+0000 7f3e52ffd640 1 -- 172.21.15.37:0/3905025277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0abe30 con 0x55eb0d45e390 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 -- 172.21.15.37:0/3905025277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 msgr2=0x55eb0d8272e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d8272e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0e3fd0 tx=0x7f3e5c0a8dd0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 -- 172.21.15.37:0/3905025277 shutdown_connections 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d8272e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d4561b0 0x55eb0d826da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 --2- 172.21.15.37:0/3905025277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d826860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.575+0000 7f3e79306740 1 -- 172.21.15.37:0/3905025277 >> 172.21.15.37:0/3905025277 conn(0x55eb0d473460 msgr2=0x55eb0d824750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.578+0000 7f3e79306740 1 -- 172.21.15.37:0/3905025277 shutdown_connections 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.578+0000 7f3e79306740 1 -- 172.21.15.37:0/3905025277 wait complete. 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.579+0000 7f3e79306740 1 -- start start 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.579+0000 7f3e79306740 1 Processor -- start 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d4561b0 0x55eb0d831f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d832480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d47f070 0x55eb0d83e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb0d5ed700 con 0x55eb0d45e390 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb0d727160 con 0x55eb0d47f070 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55eb0d834f80 con 0x55eb0d4561b0 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.580+0000 7f3e79306740 10 client.0 _ll_register_callbacks cb 0x55eb0d7409e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.586+0000 7f3e70b2e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d4561b0 0x55eb0d831f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.587+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d832480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.587+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d832480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49062/0 (socket says 172.21.15.37:49062) 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.587+0000 7f3e6bfff640 1 -- 172.21.15.37:0/2878740299 learned_addr learned my addr 172.21.15.37:0/2878740299 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.587+0000 7f3e7132f640 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d47f070 0x55eb0d83e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.591+0000 7f3e6bfff640 1 -- 172.21.15.37:0/2878740299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d4561b0 msgr2=0x55eb0d831f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.591+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d4561b0 0x55eb0d831f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.591+0000 7f3e6bfff640 1 -- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d47f070 msgr2=0x55eb0d83e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.591+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d47f070 0x55eb0d83e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.591+0000 7f3e6bfff640 1 -- 172.21.15.37:0/2878740299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb0d754c90 con 0x55eb0d45e390 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.591+0000 7f3e6bfff640 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d832480 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009fd0 tx=0x7f3e5c014e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e61312e647b7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.592+0000 7f3e4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.593+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2878740299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0ac010 con 0x55eb0d45e390 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.593+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e5c0ac1d0 con 0x55eb0d45e390 2024-09-21T01:26:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.593+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2878740299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3e5c0b5e50 con 0x55eb0d45e390 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.594+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2878740299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3e5c0abe30 con 0x55eb0d45e390 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.594+0000 7f3e79306740 10 client.17106 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.594+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb0d840ce0 con 0x55eb0d45e390 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.595+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2878740299 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5c0ac1d0 con 0x55eb0d45e390 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2878740299 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3e5c0e61e0 con 0x55eb0d45e390 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e79306740 10 client.17106 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e79306740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e79306740 20 client.17106 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e79306740 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d43d9f0 0x55eb0d844220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e79306740 4 client.17106 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.597+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb0d79edf0 con 0x55eb0d43d9f0 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.598+0000 7f3e70b2e640 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d43d9f0 0x55eb0d844220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.608+0000 7f3e70b2e640 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d43d9f0 0x55eb0d844220 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688f10f76f0e556 server_cookie=d87651fd1e2bda4e in_seq=0 out_seq=0 2024-09-21T01:26:50.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.608+0000 7f3e4bfff640 10 client.17106 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.613+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2878740299 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb0d79edf0 con 0x55eb0d43d9f0 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.613+0000 7f3e4bfff640 10 client.17106 handle_command_reply: tid=0 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.613+0000 7f3e79306740 1 client.17106 shutdown 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.616+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 msgr2=0x55eb0d832480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.616+0000 7f3e79306740 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d832480 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009fd0 tx=0x7f3e5c014e40 comp rx=0 tx=0).stop 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 shutdown_connections 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e79306740 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d43d9f0 0x55eb0d844220 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e79306740 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d47f070 0x55eb0d83e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e79306740 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d45e390 0x55eb0d832480 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e79306740 1 --2- 172.21.15.37:0/2878740299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d4561b0 0x55eb0d831f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 >> 172.21.15.37:0/2878740299 conn(0x55eb0d473460 msgr2=0x55eb0d8299f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.617+0000 7f3e4bfff640 0 client.17106 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.620+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 shutdown_connections 2024-09-21T01:26:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.624+0000 7f3e79306740 1 -- 172.21.15.37:0/2878740299 wait complete. 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.624+0000 7f3e79306740 20 client.17106 trim_cache size 0 max 16384 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.666+0000 7f3e79306740 1 Processor -- start 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.666+0000 7f3e79306740 1 -- start start 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.667+0000 7f3e79306740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d833b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.667+0000 7f3e79306740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d83e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.667+0000 7f3e79306740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d82f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.667+0000 7f3e79306740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5800e3f0 con 0x55eb0d4561b0 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.667+0000 7f3e79306740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5800ff30 con 0x55eb0d45e390 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.667+0000 7f3e79306740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5800eac0 con 0x55eb0d47f070 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.674+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d83e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.674+0000 7f3e70b2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d833b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.674+0000 7f3e70b2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d833b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49070/0 (socket says 172.21.15.37:49070) 2024-09-21T01:26:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.674+0000 7f3e70b2e640 1 -- 172.21.15.37:0/165751126 learned_addr learned my addr 172.21.15.37:0/165751126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.679+0000 7f3e7132f640 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d82f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.681+0000 7f3e7132f640 1 -- 172.21.15.37:0/165751126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 msgr2=0x55eb0d83e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.681+0000 7f3e7132f640 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d83e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.681+0000 7f3e7132f640 1 -- 172.21.15.37:0/165751126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 msgr2=0x55eb0d833b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.681+0000 7f3e7132f640 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d833b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.681+0000 7f3e7132f640 1 -- 172.21.15.37:0/165751126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb0d43dc20 con 0x55eb0d47f070 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.682+0000 7f3e7132f640 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d82f130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009900 tx=0x7f3e64032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b5b48977e9e9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.690+0000 7f3e527fc640 1 -- 172.21.15.37:0/165751126 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64004840 con 0x55eb0d47f070 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.690+0000 7f3e527fc640 1 -- 172.21.15.37:0/165751126 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e64049430 con 0x55eb0d47f070 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.690+0000 7f3e527fc640 1 -- 172.21.15.37:0/165751126 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6403c6a0 con 0x55eb0d47f070 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 -- 172.21.15.37:0/165751126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 msgr2=0x55eb0d82f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d82f130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009900 tx=0x7f3e64032000 comp rx=0 tx=0).stop 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 -- 172.21.15.37:0/165751126 shutdown_connections 2024-09-21T01:26:50.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d82f130 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d83e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 --2- 172.21.15.37:0/165751126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d833b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.694+0000 7f3e79306740 1 -- 172.21.15.37:0/165751126 >> 172.21.15.37:0/165751126 conn(0x55eb0d473460 msgr2=0x55eb0d833460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.698+0000 7f3e79306740 1 -- 172.21.15.37:0/165751126 shutdown_connections 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.701+0000 7f3e79306740 1 -- 172.21.15.37:0/165751126 wait complete. 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.701+0000 7f3e79306740 1 -- start start 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.702+0000 7f3e79306740 1 Processor -- start 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d835c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d836230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d8a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5800f860 con 0x55eb0d4561b0 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5800f190 con 0x55eb0d45e390 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5800c480 con 0x55eb0d47f070 2024-09-21T01:26:50.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.703+0000 7f3e79306740 10 client.0 _ll_register_callbacks cb 0x7f3e64009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.706+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d836230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.707+0000 7f3e7132f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d8a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.707+0000 7f3e6bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d836230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:34518/0 (socket says 172.21.15.37:34518) 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.707+0000 7f3e6bfff640 1 -- 172.21.15.37:0/2978441803 learned_addr learned my addr 172.21.15.37:0/2978441803 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.708+0000 7f3e7132f640 1 -- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 msgr2=0x55eb0d836230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.708+0000 7f3e7132f640 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d836230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.708+0000 7f3e7132f640 1 -- 172.21.15.37:0/2978441803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 msgr2=0x55eb0d835c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.708+0000 7f3e7132f640 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d835c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.708+0000 7f3e7132f640 1 -- 172.21.15.37:0/2978441803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb0d8a7280 con 0x55eb0d47f070 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.713+0000 7f3e7132f640 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d8a6c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e6402a960 tx=0x7f3e64031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f98520c140424e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.713+0000 7f3e4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.717+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2978441803 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64049b20 con 0x55eb0d47f070 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.717+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e64049430 con 0x55eb0d47f070 2024-09-21T01:26:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.717+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2978441803 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f3e64004840 con 0x55eb0d47f070 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.719+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2978441803 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3e64004a40 con 0x55eb0d47f070 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.729+0000 7f3e79306740 10 client.26473 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.730+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb0d8ae670 con 0x55eb0d47f070 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2978441803 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e64049430 con 0x55eb0d47f070 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2978441803 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3e64062050 con 0x55eb0d47f070 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e79306740 10 client.26473 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e79306740 10 client.26473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e79306740 20 client.26473 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e79306740 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d412da0 0x55eb0d8b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e79306740 4 client.26473 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.732+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eb0d79a8a0 con 0x55eb0d412da0 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.734+0000 7f3e70b2e640 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d412da0 0x55eb0d8b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.740+0000 7f3e70b2e640 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d412da0 0x55eb0d8b0e00 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a01242cd1d78e7a4 server_cookie=eebe0d11c3a38295 in_seq=0 out_seq=0 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.740+0000 7f3e4bfff640 10 client.26473 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.742+0000 7f3e4bfff640 1 -- 172.21.15.37:0/2978441803 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eb0d79a8a0 con 0x55eb0d412da0 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.742+0000 7f3e4bfff640 10 client.26473 handle_command_reply: tid=0 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.743+0000 7f3e79306740 1 client.26473 shutdown 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.746+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 msgr2=0x55eb0d8a6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.746+0000 7f3e79306740 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d8a6c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e6402a960 tx=0x7f3e64031400 comp rx=0 tx=0).stop 2024-09-21T01:26:50.879 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 shutdown_connections 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e79306740 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55eb0d412da0 0x55eb0d8b0e00 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e79306740 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eb0d47f070 0x55eb0d8a6c10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e79306740 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb0d45e390 0x55eb0d836230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e79306740 1 --2- 172.21.15.37:0/2978441803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb0d4561b0 0x55eb0d835c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e4bfff640 0 client.26473 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.748+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 >> 172.21.15.37:0/2978441803 conn(0x55eb0d473460 msgr2=0x55eb0d832480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.754+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 shutdown_connections 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.754+0000 7f3e79306740 1 -- 172.21.15.37:0/2978441803 wait complete. 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.754+0000 7f3e79306740 20 client.26473 trim_cache size 0 max 16384 2024-09-21T01:26:50.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e540b66e0 msgr2=0x7f3e540b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e540b66e0 0x7f3e540b8bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3e64033000 tx=0x7f3e64005ec0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 msgr2=0x7f3e6c1ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c1ab3d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00b9b0 tx=0x7f3e5c00be70 comp rx=0 tx=0).stop 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 shutdown_connections 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f3e540b66e0 0x7f3e540b8bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e6c110230 0x7f3e6c11d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e6c10ad10 0x7f3e6c1ab3d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 --2- 172.21.15.37:0/4020806487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e6c10a3c0 0x7f3e6c1aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.756+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 >> 172.21.15.37:0/4020806487 conn(0x7f3e6c06ee50 msgr2=0x7f3e6c10db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.757+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 shutdown_connections 2024-09-21T01:26:50.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:50.757+0000 7f3e71b30640 1 -- 172.21.15.37:0/4020806487 wait complete. 2024-09-21T01:26:51.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:51 smithi037 ceph-mon[31105]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 831 MiB/s wr, 2.33k op/s 2024-09-21T01:26:51.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:51 smithi137 ceph-mon[34607]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 831 MiB/s wr, 2.33k op/s 2024-09-21T01:26:51.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:51 smithi144 ceph-mon[34818]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 831 MiB/s wr, 2.33k op/s 2024-09-21T01:26:53.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:53 smithi137 ceph-mon[34607]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 828 MiB/s wr, 2.29k op/s 2024-09-21T01:26:53.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:53 smithi144 ceph-mon[34818]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 828 MiB/s wr, 2.29k op/s 2024-09-21T01:26:53.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:53 smithi037 ceph-mon[31105]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 828 MiB/s wr, 2.29k op/s 2024-09-21T01:26:55.106 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T01:26:55.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T01:26:55.504 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:55 smithi037 ceph-mon[31105]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 801 MiB/s wr, 1.98k op/s 2024-09-21T01:26:55.505 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:55 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:55.505 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:55 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:55.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:55 smithi137 ceph-mon[34607]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 801 MiB/s wr, 1.98k op/s 2024-09-21T01:26:55.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:55 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:55.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:55 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:55.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:55 smithi144 ceph-mon[34818]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 801 MiB/s wr, 1.98k op/s 2024-09-21T01:26:55.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:55 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:55.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:55 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:56.024 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:26:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.647+0000 7fbde07c6640 1 -- 172.21.15.37:0/923525269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810a3c0 msgr2=0x7fbdd810c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.647+0000 7fbde07c6640 1 --2- 172.21.15.37:0/923525269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810a3c0 0x7fbdd810c7e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009900 tx=0x7fbdc802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.650+0000 7fbde07c6640 1 -- 172.21.15.37:0/923525269 shutdown_connections 2024-09-21T01:26:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.650+0000 7fbde07c6640 1 --2- 172.21.15.37:0/923525269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 0x7fbdd810fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.650+0000 7fbde07c6640 1 --2- 172.21.15.37:0/923525269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810cd20 0x7fbdd810f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.650+0000 7fbde07c6640 1 --2- 172.21.15.37:0/923525269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810a3c0 0x7fbdd810c7e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.650+0000 7fbde07c6640 1 -- 172.21.15.37:0/923525269 >> 172.21.15.37:0/923525269 conn(0x7fbdd8070670 msgr2=0x7fbdd8072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.657+0000 7fbde07c6640 1 -- 172.21.15.37:0/923525269 shutdown_connections 2024-09-21T01:26:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.657+0000 7fbde07c6640 1 -- 172.21.15.37:0/923525269 wait complete. 2024-09-21T01:26:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.659+0000 7fbde07c6640 1 Processor -- start 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.659+0000 7fbde07c6640 1 -- start start 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.659+0000 7fbde07c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810a3c0 0x7fbdd81a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.659+0000 7fbde07c6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810cd20 0x7fbdd81a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbde07c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 0x7fbdd81a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbde07c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd811dfb0 con 0x7fbdd810f830 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbde07c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd811de30 con 0x7fbdd810a3c0 2024-09-21T01:26:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbde07c6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd811e130 con 0x7fbdd810cd20 2024-09-21T01:26:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbdded63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 0x7fbdd81a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbdded63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 0x7fbdd81a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47830/0 (socket says 172.21.15.37:47830) 2024-09-21T01:26:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.660+0000 7fbdded63640 1 -- 172.21.15.37:0/2533871725 learned_addr learned my addr 172.21.15.37:0/2533871725 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.661+0000 7fbdde562640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810a3c0 0x7fbdd81a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.663+0000 7fbdde562640 1 -- 172.21.15.37:0/2533871725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810cd20 msgr2=0x7fbdd81a9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.663+0000 7fbdde562640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810cd20 0x7fbdd81a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.663+0000 7fbdde562640 1 -- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 msgr2=0x7fbdd81a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.663+0000 7fbdde562640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 0x7fbdd81a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.663+0000 7fbdde562640 1 -- 172.21.15.37:0/2533871725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd81aa570 con 0x7fbdd810a3c0 2024-09-21T01:26:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.664+0000 7fbdde562640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810a3c0 0x7fbdd81a8bc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdc802a9e0 tx=0x7fbdc8003cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.665+0000 7fbdcf7fe640 1 -- 172.21.15.37:0/2533871725 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc803f070 con 0x7fbdd810a3c0 2024-09-21T01:26:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.665+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd81aa800 con 0x7fbdd810a3c0 2024-09-21T01:26:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.665+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd8111af0 con 0x7fbdd810a3c0 2024-09-21T01:26:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.669+0000 7fbdcf7fe640 1 -- 172.21.15.37:0/2533871725 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdc8031c50 con 0x7fbdd810a3c0 2024-09-21T01:26:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.669+0000 7fbdcf7fe640 1 -- 172.21.15.37:0/2533871725 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8035030 con 0x7fbdd810a3c0 2024-09-21T01:26:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:26:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:26:56.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:56.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:26:56.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:26:56.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.674+0000 7fbde781a740 1 Processor -- start 2024-09-21T01:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.679+0000 7fbde781a740 1 -- start start 2024-09-21T01:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.679+0000 7fbde781a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420a11b0 0x564e42449040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.679+0000 7fbde781a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 0x564e424496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.679+0000 7fbde781a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e4244a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.680+0000 7fbde781a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e423bb6f0 con 0x564e420782f0 2024-09-21T01:26:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.680+0000 7fbde781a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564e423aab20 con 0x564e420a11b0 2024-09-21T01:26:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.680+0000 7fbde781a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564e423ae930 con 0x564e420804d0 2024-09-21T01:26:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.683+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e4244a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.683+0000 7fbdded63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420a11b0 0x564e42449040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.686+0000 7fbdde562640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 0x564e424496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.686+0000 7fbdde562640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 0x564e424496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47834/0 (socket says 172.21.15.37:47834) 2024-09-21T01:26:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.686+0000 7fbdde562640 1 -- 172.21.15.37:0/757050489 learned_addr learned my addr 172.21.15.37:0/757050489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.686+0000 7fbdcf7fe640 1 -- 172.21.15.37:0/2533871725 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fbdc8042070 con 0x7fbdd810a3c0 2024-09-21T01:26:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.687+0000 7fbdcf7fe640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbdc40b6720 0x7fbdc40b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.688+0000 7fbdcf7fe640 1 -- 172.21.15.37:0/2533871725 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbdc8109f30 con 0x7fbdd810a3c0 2024-09-21T01:26:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.693+0000 7fbdded63640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbdc40b6720 0x7fbdc40b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.694+0000 7fbdde562640 1 -- 172.21.15.37:0/757050489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 msgr2=0x564e4244a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.694+0000 7fbdde562640 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e4244a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.694+0000 7fbdde562640 1 -- 172.21.15.37:0/757050489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420a11b0 msgr2=0x564e42449040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.694+0000 7fbdde562640 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420a11b0 0x564e42449040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.694+0000 7fbdde562640 1 -- 172.21.15.37:0/757050489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e42370530 con 0x564e420782f0 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.696+0000 7fbdde562640 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 0x564e424496b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80cfd80 tx=0x7fbdc802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876767210dac08f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.698+0000 7fbdccff9640 1 -- 172.21.15.37:0/757050489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8049070 con 0x564e420782f0 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.698+0000 7fbdccff9640 1 -- 172.21.15.37:0/757050489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdc8031e00 con 0x564e420782f0 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.698+0000 7fbdccff9640 1 -- 172.21.15.37:0/757050489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80d9aa0 con 0x564e420782f0 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 -- 172.21.15.37:0/757050489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 msgr2=0x564e424496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 0x564e424496b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80cfd80 tx=0x7fbdc802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 -- 172.21.15.37:0/757050489 shutdown_connections 2024-09-21T01:26:56.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e4244a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420782f0 0x564e424496b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 --2- 172.21.15.37:0/757050489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420a11b0 0x564e42449040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 -- 172.21.15.37:0/757050489 >> 172.21.15.37:0/757050489 conn(0x564e42095300 msgr2=0x564e42444ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 -- 172.21.15.37:0/757050489 shutdown_connections 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.700+0000 7fbde781a740 1 -- 172.21.15.37:0/757050489 wait complete. 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.701+0000 7fbde781a740 1 -- start start 2024-09-21T01:26:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.701+0000 7fbde781a740 1 Processor -- start 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e42452540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42452c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42453700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e422e2ab0 con 0x564e420a11b0 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564e42350730 con 0x564e420804d0 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564e4244aae0 con 0x564e420782f0 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbde781a740 10 client.0 _ll_register_callbacks cb 0x564e423a46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.703+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42452c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.703+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42452c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47296/0 (socket says 172.21.15.37:47296) 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.703+0000 7fbdddd61640 1 -- 172.21.15.37:0/316843646 learned_addr learned my addr 172.21.15.37:0/316843646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.702+0000 7fbdded63640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbdc40b6720 0x7fbdc40b8c30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4013980 tx=0x7fbdd4004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.703+0000 7fbdded63640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42453700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.703+0000 7fbdddd61640 1 -- 172.21.15.37:0/316843646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 msgr2=0x564e42452540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.703+0000 7fbdddd61640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e42452540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.704+0000 7fbdddd61640 1 -- 172.21.15.37:0/316843646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 msgr2=0x564e42453700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.704+0000 7fbdddd61640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42453700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.704+0000 7fbdddd61640 1 -- 172.21.15.37:0/316843646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4210c790 con 0x564e420804d0 2024-09-21T01:26:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.704+0000 7fbdded63640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42453700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:26:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.705+0000 7fbdddd61640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42452c00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000f9e0 tx=0x7fbdd000fea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c771cc0ee2f512 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.705+0000 7fbdc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:26:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.707+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/316843646 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000dd40 con 0x564e420804d0 2024-09-21T01:26:56.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.707+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e423bd640 con 0x564e420804d0 2024-09-21T01:26:56.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.707+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/316843646 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbdd0010430 con 0x564e420804d0 2024-09-21T01:26:56.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.708+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/316843646 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdd0004b60 con 0x564e420804d0 2024-09-21T01:26:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.708+0000 7fbde781a740 10 client.26498 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.708+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e42185620 con 0x564e420804d0 2024-09-21T01:26:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.710+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/316843646 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564e423bd640 con 0x564e420804d0 2024-09-21T01:26:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.710+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/316843646 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbdd0021020 con 0x564e420804d0 2024-09-21T01:26:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.711+0000 7fbde781a740 10 client.26498 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.711+0000 7fbde781a740 10 client.26498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.711+0000 7fbde781a740 20 client.26498 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.711+0000 7fbde781a740 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e4205fd80 0x564e4245fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.711+0000 7fbde781a740 4 client.26498 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.711+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e423b90f0 con 0x564e4205fd80 2024-09-21T01:26:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.712+0000 7fbdde562640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e4205fd80 0x564e4245fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.713+0000 7fbdc1ffb640 10 client.26498 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.714+0000 7fbdde562640 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e4205fd80 0x564e4245fd60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8a7fc13d6bc419 server_cookie=7fbaac68f2315c9d in_seq=0 out_seq=0 2024-09-21T01:26:56.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.716+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/316843646 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e423b90f0 con 0x564e4205fd80 2024-09-21T01:26:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.716+0000 7fbdc1ffb640 10 client.26498 handle_command_reply: tid=0 2024-09-21T01:26:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.716+0000 7fbde781a740 1 client.26498 shutdown 2024-09-21T01:26:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 msgr2=0x564e42452c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42452c00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000f9e0 tx=0x7fbdd000fea0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 shutdown_connections 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e4205fd80 0x564e4245fd60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42453700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42452c00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 --2- 172.21.15.37:0/316843646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e42452540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 >> 172.21.15.37:0/316843646 conn(0x564e42095300 msgr2=0x564e42443150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbdc1ffb640 0 client.26498 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.717+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 shutdown_connections 2024-09-21T01:26:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.718+0000 7fbde781a740 1 -- 172.21.15.37:0/316843646 wait complete. 2024-09-21T01:26:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.718+0000 7fbde781a740 20 client.26498 trim_cache size 0 max 16384 2024-09-21T01:26:56.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:26:56.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:26:56.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:26:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.775+0000 7fbde781a740 1 Processor -- start 2024-09-21T01:26:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.775+0000 7fbde781a740 1 -- start start 2024-09-21T01:26:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.776+0000 7fbde781a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e4243f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.777+0000 7fbde781a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42451740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.778+0000 7fbde781a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42452540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.778+0000 7fbde781a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc00e5f0 con 0x564e420a11b0 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.778+0000 7fbde781a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc010130 con 0x564e420804d0 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.778+0000 7fbde781a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc00ecc0 con 0x564e420782f0 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.778+0000 7fbdde562640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e4243f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.779+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42451740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.779+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42451740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47310/0 (socket says 172.21.15.37:47310) 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.779+0000 7fbdddd61640 1 -- 172.21.15.37:0/1380412243 learned_addr learned my addr 172.21.15.37:0/1380412243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.779+0000 7fbdded63640 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42452540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.780+0000 7fbdded63640 1 -- 172.21.15.37:0/1380412243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 msgr2=0x564e4243f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.780+0000 7fbdded63640 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e4243f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.780+0000 7fbdded63640 1 -- 172.21.15.37:0/1380412243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 msgr2=0x564e42451740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.780+0000 7fbdded63640 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42451740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.780+0000 7fbdded63640 1 -- 172.21.15.37:0/1380412243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4244a660 con 0x564e420a11b0 2024-09-21T01:26:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.782+0000 7fbdded63640 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42452540 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4010740 tx=0x7fbdd400c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53137d46fce9790 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:56.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.782+0000 7fbdc3fff640 1 -- 172.21.15.37:0/1380412243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4005220 con 0x564e420a11b0 2024-09-21T01:26:56.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.783+0000 7fbdc3fff640 1 -- 172.21.15.37:0/1380412243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd4004c50 con 0x564e420a11b0 2024-09-21T01:26:56.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.783+0000 7fbdc3fff640 1 -- 172.21.15.37:0/1380412243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd401f910 con 0x564e420a11b0 2024-09-21T01:26:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.785+0000 7fbde781a740 1 -- 172.21.15.37:0/1380412243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 msgr2=0x564e42452540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.786+0000 7fbde781a740 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42452540 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4010740 tx=0x7fbdd400c3b0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.788+0000 7fbde781a740 1 -- 172.21.15.37:0/1380412243 shutdown_connections 2024-09-21T01:26:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.789+0000 7fbde781a740 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e42452540 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.789+0000 7fbde781a740 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420804d0 0x564e42451740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.789+0000 7fbde781a740 1 --2- 172.21.15.37:0/1380412243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420782f0 0x564e4243f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.789+0000 7fbde781a740 1 -- 172.21.15.37:0/1380412243 >> 172.21.15.37:0/1380412243 conn(0x564e42095300 msgr2=0x564e42449f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.792+0000 7fbde781a740 1 -- 172.21.15.37:0/1380412243 shutdown_connections 2024-09-21T01:26:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.794+0000 7fbde781a740 1 -- 172.21.15.37:0/1380412243 wait complete. 2024-09-21T01:26:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.795+0000 7fbde781a740 1 -- start start 2024-09-21T01:26:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.795+0000 7fbde781a740 1 Processor -- start 2024-09-21T01:26:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.796+0000 7fbde781a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420782f0 0x564e424570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.796+0000 7fbde781a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e42457770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.796+0000 7fbde781a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e424582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.796+0000 7fbde781a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc00fa60 con 0x564e420a11b0 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.796+0000 7fbde781a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc00f390 con 0x564e420782f0 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.797+0000 7fbde781a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc00c5b0 con 0x564e420804d0 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.797+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e42457770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.797+0000 7fbdddd61640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e42457770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47862/0 (socket says 172.21.15.37:47862) 2024-09-21T01:26:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.797+0000 7fbdddd61640 1 -- 172.21.15.37:0/3985637074 learned_addr learned my addr 172.21.15.37:0/3985637074 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.797+0000 7fbde781a740 10 client.0 _ll_register_callbacks cb 0x7fbdd0007860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.797+0000 7fbdde562640 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420782f0 0x564e424570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.798+0000 7fbdddd61640 1 -- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420782f0 msgr2=0x564e424570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.798+0000 7fbdddd61640 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420782f0 0x564e424570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.798+0000 7fbdddd61640 1 -- 172.21.15.37:0/3985637074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 msgr2=0x564e424582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.798+0000 7fbdddd61640 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e424582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.798+0000 7fbdddd61640 1 -- 172.21.15.37:0/3985637074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e42458a40 con 0x564e420804d0 2024-09-21T01:26:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.798+0000 7fbdddd61640 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e42457770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0023530 tx=0x7fbdd0024960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3ff6ec1bda8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.804+0000 7fbdc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.804+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/3985637074 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0031020 con 0x564e420804d0 2024-09-21T01:26:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.804+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/3985637074 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fbdd0024d50 con 0x564e420804d0 2024-09-21T01:26:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.804+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdd4004c50 con 0x564e420804d0 2024-09-21T01:26:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.805+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/3985637074 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbdd0029040 con 0x564e420804d0 2024-09-21T01:26:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.805+0000 7fbde781a740 10 client.26485 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.805+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e42459e00 con 0x564e420804d0 2024-09-21T01:26:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.810+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/3985637074 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd4004c50 con 0x564e420804d0 2024-09-21T01:26:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.810+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/3985637074 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbdd0036070 con 0x564e420804d0 2024-09-21T01:26:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.812+0000 7fbde781a740 10 client.26485 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.812+0000 7fbde781a740 10 client.26485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.812+0000 7fbde781a740 20 client.26485 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.812+0000 7fbde781a740 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e420351c0 0x564e424cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.812+0000 7fbde781a740 4 client.26485 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:26:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.812+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e423b6520 con 0x564e420351c0 2024-09-21T01:26:56.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.815+0000 7fbdde562640 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e420351c0 0x564e424cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:56.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.818+0000 7fbdde562640 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e420351c0 0x564e424cc770 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1283ae12bc5e121 server_cookie=e0acaf3e4f9b1a84 in_seq=0 out_seq=0 2024-09-21T01:26:56.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:56.818+0000 7fbdc1ffb640 10 client.26485 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:57.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:57 smithi037 ceph-mon[31105]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 828 MiB/s wr, 1.93k op/s 2024-09-21T01:26:57.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:57 smithi144 ceph-mon[34818]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 828 MiB/s wr, 1.93k op/s 2024-09-21T01:26:57.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:57 smithi137 ceph-mon[34607]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 828 MiB/s wr, 1.93k op/s 2024-09-21T01:26:57.840 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:26:57.841 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-09-21T01:26:57.841 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "04dc3c8b-74d6-49df-969d-99bdea3021c8", 2024-09-21T01:26:57.841 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-09-21T01:26:57.841 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:26:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 -- 172.21.15.37:0/3344432466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 msgr2=0x7f5b08116e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 --2- 172.21.15.37:0/3344432466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b08116e90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5b00005fd0 tx=0x7f5b0002b410 comp rx=0 tx=0).stop 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 -- 172.21.15.37:0/3344432466 shutdown_connections 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 --2- 172.21.15.37:0/3344432466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b08116e90 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 --2- 172.21.15.37:0/3344432466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b08110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 --2- 172.21.15.37:0/3344432466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 0x7f5b0810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.202+0000 7f5b0759e640 1 -- 172.21.15.37:0/3344432466 >> 172.21.15.37:0/3344432466 conn(0x7f5b0806ee50 msgr2=0x7f5b0806f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.203+0000 7f5b0759e640 1 -- 172.21.15.37:0/3344432466 shutdown_connections 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.203+0000 7f5b0759e640 1 -- 172.21.15.37:0/3344432466 wait complete. 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.204+0000 7f5b0759e640 1 Processor -- start 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.205+0000 7f5b0759e640 1 -- start start 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.205+0000 7f5b0759e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 0x7f5b081a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.205+0000 7f5b0759e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b081a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5b0759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b081a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5b0759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08119f50 con 0x7f5b08110640 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5b0759e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08119dd0 con 0x7f5b0810fcf0 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5b0759e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0811a0d0 con 0x7f5b0810a650 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5afffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b081a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5afffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b081a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47332/0 (socket says 172.21.15.37:47332) 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.206+0000 7f5afffff640 1 -- 172.21.15.37:0/2022445034 learned_addr learned my addr 172.21.15.37:0/2022445034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.207+0000 7f5b0659c640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 0x7f5b081a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.208+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b081a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.208+0000 7f5afffff640 1 -- 172.21.15.37:0/2022445034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 msgr2=0x7f5b081a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.208+0000 7f5afffff640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 0x7f5b081a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.208+0000 7f5afffff640 1 -- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 msgr2=0x7f5b081a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.208+0000 7f5afffff640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b081a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.208+0000 7f5afffff640 1 -- 172.21.15.37:0/2022445034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b081a1540 con 0x7f5b0810fcf0 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.209+0000 7f5b0659c640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 0x7f5b081a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.209+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b081a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.215+0000 7f5afffff640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b081a0780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d740 tx=0x7f5af000dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.217+0000 7f5aff7fe640 1 -- 172.21.15.37:0/2022445034 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0017070 con 0x7f5b0810fcf0 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.218+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b081a61e0 con 0x7f5b0810fcf0 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.218+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b081a6720 con 0x7f5b0810fcf0 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.222+0000 7f5b13094740 1 Processor -- start 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.223+0000 7f5b13094740 1 -- start start 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.227+0000 7f5b13094740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 0x55764a217610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.231+0000 7f5b13094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a217b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.231+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 0x55764a217610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.231+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 0x55764a217610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47892/0 (socket says 172.21.15.37:47892) 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.231+0000 7f5b13094740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e4f670 0x55764a218090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.232+0000 7f5b06d9d640 1 -- 172.21.15.37:0/2868844056 learned_addr learned my addr 172.21.15.37:0/2868844056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.232+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55764a18de60 con 0x557649e47490 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.232+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55764a17d290 con 0x557649e4f670 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.232+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55764a1810a0 con 0x557649e70350 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.232+0000 7f5aff7fe640 1 -- 172.21.15.37:0/2022445034 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af000de50 con 0x7f5b0810fcf0 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.232+0000 7f5b0659c640 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a217b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.234+0000 7f5afffff640 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e4f670 0x55764a218090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.234+0000 7f5aff7fe640 1 -- 172.21.15.37:0/2022445034 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af000f620 con 0x7f5b0810fcf0 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.234+0000 7f5aff7fe640 1 -- 172.21.15.37:0/2022445034 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5af001a070 con 0x7f5b0810fcf0 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.235+0000 7f5b06d9d640 1 -- 172.21.15.37:0/2868844056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e4f670 msgr2=0x55764a218090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.235+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e4f670 0x55764a218090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.235+0000 7f5b06d9d640 1 -- 172.21.15.37:0/2868844056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 msgr2=0x55764a217b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.235+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a217b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.235+0000 7f5b06d9d640 1 -- 172.21.15.37:0/2868844056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557649edb930 con 0x557649e70350 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.236+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 0x55764a217610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b00007780 tx=0x7f5b0000aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1022ec3e88fd1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.237+0000 7f5aff7fe640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5af40b6630 0x7f5af40b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.237+0000 7f5aff7fe640 1 -- 172.21.15.37:0/2022445034 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5af00e7cf0 con 0x7f5b0810fcf0 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.239+0000 7f5afcff9640 1 -- 172.21.15.37:0/2868844056 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00037040 con 0x557649e70350 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.239+0000 7f5afcff9640 1 -- 172.21.15.37:0/2868844056 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b00042070 con 0x557649e70350 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.239+0000 7f5afcff9640 1 -- 172.21.15.37:0/2868844056 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b000042a0 con 0x557649e70350 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.239+0000 7f5b0659c640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5af40b6630 0x7f5af40b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 msgr2=0x55764a217610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 0x55764a217610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b00007780 tx=0x7f5b0000aca0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 shutdown_connections 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e4f670 0x55764a218090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a217b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 --2- 172.21.15.37:0/2868844056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e70350 0x55764a217610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.240+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 >> 172.21.15.37:0/2868844056 conn(0x557649e64740 msgr2=0x55764a215500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.248+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 shutdown_connections 2024-09-21T01:26:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.250+0000 7f5b13094740 1 -- 172.21.15.37:0/2868844056 wait complete. 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.250+0000 7f5b13094740 1 -- start start 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.251+0000 7f5b13094740 1 Processor -- start 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.252+0000 7f5b13094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a223230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.253+0000 7f5b13094740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a223770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.253+0000 7f5b13094740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a22f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.253+0000 7f5b13094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557649fde890 con 0x557649e47490 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.253+0000 7f5b13094740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55764a117d40 con 0x557649e70350 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.254+0000 7f5b13094740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55764a225d90 con 0x557649e4f670 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.254+0000 7f5b13094740 10 client.0 _ll_register_callbacks cb 0x55764a17bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.256+0000 7f5b0659c640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5af40b6630 0x7f5af40b8b40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55764a216290 tx=0x7f5af8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.256+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a22f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.256+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a22f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47356/0 (socket says 172.21.15.37:47356) 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.256+0000 7f5b06d9d640 1 -- 172.21.15.37:0/4054955178 learned_addr learned my addr 172.21.15.37:0/4054955178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.256+0000 7f5afffff640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a223770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.257+0000 7f5b0659c640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a223230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.258+0000 7f5afffff640 1 -- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 msgr2=0x55764a22f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.258+0000 7f5afffff640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a22f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.258+0000 7f5afffff640 1 -- 172.21.15.37:0/4054955178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 msgr2=0x55764a223230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.258+0000 7f5afffff640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a223230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.258+0000 7f5afffff640 1 -- 172.21.15.37:0/4054955178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55764a22f700 con 0x557649e4f670 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.259+0000 7f5afffff640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a223770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5af0005d00 tx=0x7f5af00e5b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cc19341de52ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.259+0000 7f5aedffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.263+0000 7f5aedffb640 1 -- 172.21.15.37:0/4054955178 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0021050 con 0x557649e4f670 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.264+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b00042070 con 0x557649e4f670 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.264+0000 7f5aedffb640 1 -- 172.21.15.37:0/4054955178 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5af00acb90 con 0x557649e4f670 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.280+0000 7f5aedffb640 1 -- 172.21.15.37:0/4054955178 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5af0009cf0 con 0x557649e4f670 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.282+0000 7f5b13094740 10 client.26491 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.282+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55764a232010 con 0x557649e4f670 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.283+0000 7f5aedffb640 1 -- 172.21.15.37:0/4054955178 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b00042070 con 0x557649e4f670 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.283+0000 7f5aedffb640 1 -- 172.21.15.37:0/4054955178 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5af00acd90 con 0x557649e4f670 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.286+0000 7f5b13094740 10 client.26491 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.286+0000 7f5b13094740 10 client.26491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.286+0000 7f5b13094740 20 client.26491 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.286+0000 7f5b13094740 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e2ecd0 0x55764a235440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.286+0000 7f5b13094740 4 client.26491 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.286+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55764a18fdb0 con 0x557649e2ecd0 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.287+0000 7f5b0659c640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e2ecd0 0x55764a235440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.288+0000 7f5b0659c640 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e2ecd0 0x55764a235440 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1938a30d45cf65ed server_cookie=5b3bb31d6beb4335 in_seq=0 out_seq=0 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.288+0000 7f5aedffb640 10 client.26491 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.290+0000 7f5aedffb640 1 -- 172.21.15.37:0/4054955178 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55764a18fdb0 con 0x557649e2ecd0 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.290+0000 7f5aedffb640 10 client.26491 handle_command_reply: tid=0 2024-09-21T01:26:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.290+0000 7f5b13094740 1 client.26491 shutdown 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.290+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 msgr2=0x55764a223770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.290+0000 7f5b13094740 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a223770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5af0005d00 tx=0x7f5af00e5b70 comp rx=0 tx=0).stop 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 shutdown_connections 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5b13094740 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e2ecd0 0x55764a235440 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5b13094740 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a22f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5b13094740 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a223770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5b13094740 1 --2- 172.21.15.37:0/4054955178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a223230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 >> 172.21.15.37:0/4054955178 conn(0x557649e64740 msgr2=0x55764a21a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.291+0000 7f5aedffb640 0 client.26491 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.292+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 shutdown_connections 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.292+0000 7f5b13094740 1 -- 172.21.15.37:0/4054955178 wait complete. 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.292+0000 7f5b13094740 20 client.26491 trim_cache size 0 max 16384 2024-09-21T01:26:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.330+0000 7f5b13094740 1 Processor -- start 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.331+0000 7f5b13094740 1 -- start start 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.331+0000 7f5b13094740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e47490 0x55764a21c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.332+0000 7f5b13094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e4f670 0x55764a21cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.332+0000 7f5b13094740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a214b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.332+0000 7f5b13094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae800e550 con 0x557649e4f670 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.332+0000 7f5b13094740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae8010090 con 0x557649e70350 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.332+0000 7f5b13094740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae800ec20 con 0x557649e47490 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.333+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a214b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.333+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a214b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47364/0 (socket says 172.21.15.37:47364) 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.333+0000 7f5b06d9d640 1 -- 172.21.15.37:0/1437575280 learned_addr learned my addr 172.21.15.37:0/1437575280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.333+0000 7f5afffff640 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e4f670 0x55764a21cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.333+0000 7f5b0659c640 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e47490 0x55764a21c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.334+0000 7f5b06d9d640 1 -- 172.21.15.37:0/1437575280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e47490 msgr2=0x55764a21c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.334+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e47490 0x55764a21c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.334+0000 7f5b06d9d640 1 -- 172.21.15.37:0/1437575280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e4f670 msgr2=0x55764a21cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.334+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e4f670 0x55764a21cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.334+0000 7f5b06d9d640 1 -- 172.21.15.37:0/1437575280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764a2240d0 con 0x557649e70350 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.336+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a214b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b0002b9d0 tx=0x7f5b0000aec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e39b3ab63a7999 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.338+0000 7f5aeffff640 1 -- 172.21.15.37:0/1437575280 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00037040 con 0x557649e70350 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.338+0000 7f5aeffff640 1 -- 172.21.15.37:0/1437575280 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b00042040 con 0x557649e70350 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.338+0000 7f5aeffff640 1 -- 172.21.15.37:0/1437575280 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00004290 con 0x557649e70350 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 -- 172.21.15.37:0/1437575280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 msgr2=0x55764a214b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a214b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b0002b9d0 tx=0x7f5b0000aec0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 -- 172.21.15.37:0/1437575280 shutdown_connections 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a214b10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e4f670 0x55764a21cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 --2- 172.21.15.37:0/1437575280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e47490 0x55764a21c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 -- 172.21.15.37:0/1437575280 >> 172.21.15.37:0/1437575280 conn(0x557649e64740 msgr2=0x55764a2218b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.340+0000 7f5b13094740 1 -- 172.21.15.37:0/1437575280 shutdown_connections 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.341+0000 7f5b13094740 1 -- 172.21.15.37:0/1437575280 wait complete. 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.341+0000 7f5b13094740 1 -- start start 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.342+0000 7f5b13094740 1 Processor -- start 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.343+0000 7f5b13094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a22b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.343+0000 7f5b13094740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a22b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.343+0000 7f5b13094740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a226030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5b13094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae800f9c0 con 0x557649e47490 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5b13094740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae800f2f0 con 0x557649e70350 2024-09-21T01:26:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5b13094740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae800c510 con 0x557649e4f670 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5afffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a22b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5afffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a22b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47912/0 (socket says 172.21.15.37:47912) 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5afffff640 1 -- 172.21.15.37:0/4012379473 learned_addr learned my addr 172.21.15.37:0/4012379473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.344+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a226030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.345+0000 7f5b13094740 10 client.0 _ll_register_callbacks cb 0x7f5af00adc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.345+0000 7f5b06d9d640 1 -- 172.21.15.37:0/4012379473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 msgr2=0x55764a22b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.345+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a22b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.345+0000 7f5b06d9d640 1 -- 172.21.15.37:0/4012379473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 msgr2=0x55764a22b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.345+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a22b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.345+0000 7f5b06d9d640 1 -- 172.21.15.37:0/4012379473 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55764a226570 con 0x557649e70350 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.350+0000 7f5b06d9d640 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a226030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b0002b930 tx=0x7f5b00032970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21ead093f69c6b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.350+0000 7f5aedffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.351+0000 7f5aedffb640 1 -- 172.21.15.37:0/4012379473 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00057030 con 0x557649e70350 2024-09-21T01:26:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.351+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b00042040 con 0x557649e70350 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.352+0000 7f5aedffb640 1 -- 172.21.15.37:0/4012379473 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f5b00032e00 con 0x557649e70350 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.353+0000 7f5aedffb640 1 -- 172.21.15.37:0/4012379473 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b00037070 con 0x557649e70350 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.353+0000 7f5b13094740 10 client.26522 fetch_fsmap learned FSMap version 30 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.353+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55764a2a03c0 con 0x557649e70350 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.354+0000 7f5aedffb640 1 -- 172.21.15.37:0/4012379473 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b00042040 con 0x557649e70350 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5aedffb640 1 -- 172.21.15.37:0/4012379473 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f5b0003a030 con 0x557649e70350 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5b13094740 10 client.26522 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5b13094740 10 client.26522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5b13094740 20 client.26522 populate_metadata read hostname 'smithi037' 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5b13094740 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e04080 0x55764a2a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5b13094740 4 client.26522 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.356+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55764a18b860 con 0x557649e04080 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.357+0000 7f5b0659c640 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e04080 0x55764a2a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.365+0000 7f5aedffb640 10 client.26522 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.365+0000 7f5b0659c640 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e04080 0x55764a2a29f0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10a04a2fd44c5495 server_cookie=d268309222fc2884 in_seq=0 out_seq=0 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5aedffb640 1 -- 172.21.15.37:0/4012379473 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55764a18b860 con 0x557649e04080 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5aedffb640 10 client.26522 handle_command_reply: tid=0 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 client.26522 shutdown 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 msgr2=0x55764a226030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a226030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b0002b930 tx=0x7f5b00032970 comp rx=0 tx=0).stop 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 shutdown_connections 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557649e04080 0x55764a2a29f0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557649e70350 0x55764a226030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557649e4f670 0x55764a22b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 --2- 172.21.15.37:0/4012379473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557649e47490 0x55764a22b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 >> 172.21.15.37:0/4012379473 conn(0x557649e64740 msgr2=0x55764a218640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5aedffb640 0 client.26522 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 shutdown_connections 2024-09-21T01:26:57.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.516+0000 7f5b13094740 1 -- 172.21.15.37:0/4012379473 wait complete. 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.517+0000 7f5b13094740 20 client.26522 trim_cache size 0 max 16384 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5af40b6630 msgr2=0x7f5af40b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5af40b6630 0x7f5af40b8b40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55764a216290 tx=0x7f5af8008040 comp rx=0 tx=0).stop 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 msgr2=0x7f5b081a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b081a0780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d740 tx=0x7f5af000dc00 comp rx=0 tx=0).stop 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 shutdown_connections 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5af40b6630 0x7f5af40b8b40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b08110640 0x7f5b081a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5b0810fcf0 0x7f5b081a0780 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 --2- 172.21.15.37:0/2022445034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b0810a650 0x7f5b081a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:57.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.518+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 >> 172.21.15.37:0/2022445034 conn(0x7f5b0806ee50 msgr2=0x7f5b0810db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:57.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.519+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 shutdown_connections 2024-09-21T01:26:57.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:26:57.519+0000 7f5b0759e640 1 -- 172.21.15.37:0/2022445034 wait complete. 2024-09-21T01:26:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbdc1ffb640 1 -- 172.21.15.37:0/3985637074 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e423b6520 con 0x564e420351c0 2024-09-21T01:26:58.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbdc1ffb640 10 client.26485 handle_command_reply: tid=0 2024-09-21T01:26:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 client.26485 shutdown 2024-09-21T01:26:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 msgr2=0x564e42457770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e42457770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0023530 tx=0x7fbdd0024960 comp rx=0 tx=0).stop 2024-09-21T01:26:58.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 shutdown_connections 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x564e420351c0 0x564e424cc770 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e420a11b0 0x564e424582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e420804d0 0x564e42457770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 --2- 172.21.15.37:0/3985637074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564e420782f0 0x564e424570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 >> 172.21.15.37:0/3985637074 conn(0x564e42095300 msgr2=0x564e42449f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.627+0000 7fbdc1ffb640 0 client.26485 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.628+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 shutdown_connections 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.628+0000 7fbde781a740 1 -- 172.21.15.37:0/3985637074 wait complete. 2024-09-21T01:26:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.628+0000 7fbde781a740 20 client.26485 trim_cache size 0 max 16384 2024-09-21T01:26:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:26:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:26:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:26:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:26:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.641+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbdc40b6720 msgr2=0x7fbdc40b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.641+0000 7fbde07c6640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbdc40b6720 0x7fbdc40b8c30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4013980 tx=0x7fbdd4004730 comp rx=0 tx=0).stop 2024-09-21T01:26:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.641+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810a3c0 msgr2=0x7fbdd81a8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:26:58.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.641+0000 7fbde07c6640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810a3c0 0x7fbdd81a8bc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdc802a9e0 tx=0x7fbdc8003cf0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 shutdown_connections 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fbdc40b6720 0x7fbdc40b8c30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd810f830 0x7fbdd81a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd810cd20 0x7fbdd81a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 --2- 172.21.15.37:0/2533871725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbdd810a3c0 0x7fbdd81a8bc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 >> 172.21.15.37:0/2533871725 conn(0x7fbdd8070670 msgr2=0x7fbdd810b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 shutdown_connections 2024-09-21T01:26:58.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:26:58.643+0000 7fbde07c6640 1 -- 172.21.15.37:0/2533871725 wait complete. 2024-09-21T01:26:58.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:58 smithi137 ceph-mon[34607]: scrub queued for path: / 2024-09-21T01:26:58.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:58 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:58.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:58 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:26:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:58 smithi144 ceph-mon[34818]: scrub queued for path: / 2024-09-21T01:26:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:58 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:58.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:58 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:26:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:58 smithi037 ceph-mon[31105]: scrub queued for path: / 2024-09-21T01:26:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:58 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:58.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:58 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:26:59.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:59 smithi137 ceph-mon[34607]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 849 MiB/s wr, 1.93k op/s 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:59 smithi137 ceph-mon[34607]: scrub summary: active paths [/] 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:59 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:26:59 smithi137 ceph-mon[34607]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:59 smithi144 ceph-mon[34818]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 849 MiB/s wr, 1.93k op/s 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:59 smithi144 ceph-mon[34818]: scrub summary: active paths [/] 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:59 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:59.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:26:59 smithi144 ceph-mon[34818]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:59.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:59 smithi037 ceph-mon[31105]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 849 MiB/s wr, 1.93k op/s 2024-09-21T01:26:59.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:59 smithi037 ceph-mon[31105]: scrub summary: active paths [/] 2024-09-21T01:26:59.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:59 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:26:59.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:26:59 smithi037 ceph-mon[31105]: scrub summary: idle+waiting paths [/] 2024-09-21T01:27:00.670 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:00 smithi137 ceph-mon[34607]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 860 MiB/s wr, 1.88k op/s 2024-09-21T01:27:00.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:00 smithi144 ceph-mon[34818]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 860 MiB/s wr, 1.88k op/s 2024-09-21T01:27:00.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:00 smithi037 ceph-mon[31105]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 860 MiB/s wr, 1.88k op/s 2024-09-21T01:27:01.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:27:02.369 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:02.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:02 smithi137 ceph-mon[34607]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 867 MiB/s wr, 1.92k op/s 2024-09-21T01:27:02.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:02 smithi144 ceph-mon[34818]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 867 MiB/s wr, 1.92k op/s 2024-09-21T01:27:02.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:02 smithi037 ceph-mon[31105]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 867 MiB/s wr, 1.92k op/s 2024-09-21T01:27:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.535+0000 7ff0097d5640 1 -- 172.21.15.37:0/2180424448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0041081b0 msgr2=0x7ff0041085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.535+0000 7ff0097d5640 1 --2- 172.21.15.37:0/2180424448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0041081b0 0x7ff0041085c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec02a410 comp rx=0 tx=0).stop 2024-09-21T01:27:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.536+0000 7ff0097d5640 1 -- 172.21.15.37:0/2180424448 shutdown_connections 2024-09-21T01:27:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.536+0000 7ff0097d5640 1 --2- 172.21.15.37:0/2180424448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff004108b00 0x7ff00410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.536+0000 7ff0097d5640 1 --2- 172.21.15.37:0/2180424448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0041081b0 0x7ff0041085c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.536+0000 7ff0097d5640 1 --2- 172.21.15.37:0/2180424448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004102870 0x7ff004102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.536+0000 7ff0097d5640 1 -- 172.21.15.37:0/2180424448 >> 172.21.15.37:0/2180424448 conn(0x7ff0040fe2c0 msgr2=0x7ff004100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.538+0000 7ff0097d5640 1 -- 172.21.15.37:0/2180424448 shutdown_connections 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.538+0000 7ff0097d5640 1 -- 172.21.15.37:0/2180424448 wait complete. 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.542+0000 7ff0097d5640 1 Processor -- start 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.543+0000 7ff0097d5640 1 -- start start 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.544+0000 7ff0097d5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004102870 0x7ff004198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.544+0000 7ff0097d5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0041081b0 0x7ff0041993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.544+0000 7ff0097d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 0x7ff004199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.544+0000 7ff0097d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0041127e0 con 0x7ff004108b00 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.544+0000 7ff0097d5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff004112660 con 0x7ff0041081b0 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.544+0000 7ff0097d5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff004112960 con 0x7ff004102870 2024-09-21T01:27:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.545+0000 7ff008fd4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 0x7ff004199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.545+0000 7ff008fd4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 0x7ff004199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47960/0 (socket says 172.21.15.37:47960) 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.545+0000 7ff008fd4640 1 -- 172.21.15.37:0/1755661001 learned_addr learned my addr 172.21.15.37:0/1755661001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.545+0000 7ff003fff640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004102870 0x7ff004198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.546+0000 7ff008fd4640 1 -- 172.21.15.37:0/1755661001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004102870 msgr2=0x7ff004198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.547+0000 7ff008fd4640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004102870 0x7ff004198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.547+0000 7ff008fd4640 1 -- 172.21.15.37:0/1755661001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0041081b0 msgr2=0x7ff0041993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.547+0000 7ff008fd4640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0041081b0 0x7ff0041993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.547+0000 7ff008fd4640 1 -- 172.21.15.37:0/1755661001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00419e180 con 0x7ff004108b00 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.548+0000 7ff008fd4640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 0x7ff004199920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7feffc00e970 tx=0x7feffc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.548+0000 7ff0017fa640 1 -- 172.21.15.37:0/1755661001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc00ccc0 con 0x7ff004108b00 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.548+0000 7ff0017fa640 1 -- 172.21.15.37:0/1755661001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feffc00ce60 con 0x7ff004108b00 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.548+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00419e470 con 0x7ff004108b00 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.549+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00419e9b0 con 0x7ff004108b00 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.549+0000 7ff0017fa640 1 -- 172.21.15.37:0/1755661001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc010430 con 0x7ff004108b00 2024-09-21T01:27:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.555+0000 7ff010fab740 1 Processor -- start 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.557+0000 7ff0017fa640 1 -- 172.21.15.37:0/1755661001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7feffc0046c0 con 0x7ff004108b00 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.557+0000 7ff010fab740 1 -- start start 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.558+0000 7ff0017fa640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7feff00b6660 0x7feff00b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.558+0000 7ff010fab740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 0x5578649b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.558+0000 7ff0017fa640 1 -- 172.21.15.37:0/1755661001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7feffc0e7590 con 0x7ff004108b00 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.558+0000 7ff0037fe640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7feff00b6660 0x7feff00b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.559+0000 7ff010fab740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 0x5578649b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.559+0000 7ff010fab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645ef390 0x5578649b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.559+0000 7ff010fab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55786492de50 con 0x5578645ef390 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.560+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 0x5578649b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.560+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 0x5578649b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47400/0 (socket says 172.21.15.37:47400) 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.560+0000 7ff0037fe640 1 -- 172.21.15.37:0/330249572 learned_addr learned my addr 172.21.15.37:0/330249572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.560+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55786491d280 con 0x5578645e71b0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.560+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557864921090 con 0x557864610070 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.560+0000 7ff0037fe640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7feff00b6660 0x7feff00b8b70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fefec009230 tx=0x7fefec000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.561+0000 7ff008fd4640 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645ef390 0x5578649b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.561+0000 7ff0037fe640 1 -- 172.21.15.37:0/330249572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 msgr2=0x5578649b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.561+0000 7ff0037fe640 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 0x5578649b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.561+0000 7ff0037fe640 1 -- 172.21.15.37:0/330249572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645ef390 msgr2=0x5578649b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.561+0000 7ff0037fe640 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645ef390 0x5578649b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.561+0000 7ff0037fe640 1 -- 172.21.15.37:0/330249572 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786467b650 con 0x5578645e71b0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.562+0000 7ff008fd4640 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645ef390 0x5578649b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.563+0000 7ff0037fe640 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 0x5578649b7d50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefec033000 tx=0x7fefec03f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452a0c7b828c1bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.564+0000 7feffa7fc640 1 -- 172.21.15.37:0/330249572 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec035040 con 0x5578645e71b0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.565+0000 7feffa7fc640 1 -- 172.21.15.37:0/330249572 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefec04c070 con 0x5578645e71b0 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.566+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 msgr2=0x5578649b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 0x5578649b7d50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fefec033000 tx=0x7fefec03f000 comp rx=0 tx=0).stop 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 shutdown_connections 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645ef390 0x5578649b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645e71b0 0x5578649b7d50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 --2- 172.21.15.37:0/330249572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 0x5578649b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 >> 172.21.15.37:0/330249572 conn(0x557864604460 msgr2=0x5578649b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 shutdown_connections 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.567+0000 7ff010fab740 1 -- 172.21.15.37:0/330249572 wait complete. 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.569+0000 7ff010fab740 1 -- start start 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.570+0000 7ff010fab740 1 Processor -- start 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.571+0000 7ff010fab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.575+0000 7ff010fab740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.575+0000 7ff010fab740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 0x5578649c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.575+0000 7ff010fab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55786477e700 con 0x5578645e71b0 2024-09-21T01:27:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.575+0000 7ff010fab740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5578648b8110 con 0x5578645ef390 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.575+0000 7ff010fab740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5578649c6030 con 0x557864610070 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.575+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.576+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47408/0 (socket says 172.21.15.37:47408) 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.576+0000 7ff0037fe640 1 -- 172.21.15.37:0/3775616189 learned_addr learned my addr 172.21.15.37:0/3775616189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.577+0000 7ff003fff640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff0037fe640 1 -- 172.21.15.37:0/3775616189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 msgr2=0x5578649c37c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff0037fe640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 0x5578649c37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff0037fe640 1 -- 172.21.15.37:0/3775616189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 msgr2=0x5578649c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff0037fe640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff0037fe640 1 -- 172.21.15.37:0/3775616189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578648e5c40 con 0x5578645ef390 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff003fff640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.579+0000 7ff010fab740 10 client.0 _ll_register_callbacks cb 0x5578648d1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.580+0000 7ff0037fe640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649c3280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d636f8f40d4bbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.580+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefec04c070 con 0x5578645ef390 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.580+0000 7fefe37fe640 10 client.26531 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.582+0000 7fefe37fe640 1 -- 172.21.15.37:0/3775616189 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec060050 con 0x5578645ef390 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.582+0000 7fefe37fe640 1 -- 172.21.15.37:0/3775616189 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fefec047450 con 0x5578645ef390 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.583+0000 7fefe37fe640 1 -- 172.21.15.37:0/3775616189 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fefec047690 con 0x5578645ef390 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.583+0000 7ff010fab740 10 client.26531 fetch_fsmap learned FSMap version 30 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.583+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5578649d1930 con 0x5578645ef390 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.584+0000 7fefe37fe640 1 -- 172.21.15.37:0/3775616189 <== mon.2 v2:172.21.15.137:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fefec063020 con 0x5578645ef390 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.585+0000 7ff010fab740 10 client.26531 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.585+0000 7ff010fab740 10 client.26531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.585+0000 7ff010fab740 20 client.26531 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.585+0000 7ff010fab740 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5578645ce9f0 0x5578649d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.585+0000 7ff010fab740 4 client.26531 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.585+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fefec04c070 con 0x5578645ce9f0 2024-09-21T01:27:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.586+0000 7ff003fff640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5578645ce9f0 0x5578649d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.589+0000 7ff003fff640 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5578645ce9f0 0x5578649d4c90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f803b240154c1709 server_cookie=7a98c2161b7b6401 in_seq=0 out_seq=0 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.589+0000 7fefe37fe640 10 client.26531 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.600+0000 7fefe37fe640 1 -- 172.21.15.37:0/3775616189 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fefec04c070 con 0x5578645ce9f0 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.600+0000 7fefe37fe640 10 client.26531 handle_command_reply: tid=0 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.600+0000 7ff010fab740 1 client.26531 shutdown 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.600+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 msgr2=0x5578649c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.600+0000 7ff010fab740 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649c3280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec009260 comp rx=0 tx=0).stop 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.601+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 shutdown_connections 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.601+0000 7ff010fab740 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x5578645ce9f0 0x5578649d4c90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.601+0000 7ff010fab740 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557864610070 0x5578649c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.601+0000 7ff010fab740 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649c3280 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.601+0000 7ff010fab740 1 --2- 172.21.15.37:0/3775616189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.601+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 >> 172.21.15.37:0/3775616189 conn(0x557864604460 msgr2=0x5578649ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.603+0000 7fefe37fe640 0 client.26531 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.603+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 shutdown_connections 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.603+0000 7ff010fab740 1 -- 172.21.15.37:0/3775616189 wait complete. 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.606+0000 7ff010fab740 20 client.26531 trim_cache size 0 max 16384 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.658+0000 7ff010fab740 1 Processor -- start 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.658+0000 7ff010fab740 1 -- start start 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.659+0000 7ff010fab740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645e71b0 0x5578649c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.659+0000 7ff010fab740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff010fab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557864610070 0x5578649b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff010fab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefe400e5c0 con 0x557864610070 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff003fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645e71b0 0x5578649c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff003fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645e71b0 0x5578649c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:47932/0 (socket says 172.21.15.37:47932) 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff003fff640 1 -- 172.21.15.37:0/1470792689 learned_addr learned my addr 172.21.15.37:0/1470792689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff0037fe640 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefe4010100 con 0x5578645ef390 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.660+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fefe400ec90 con 0x5578645e71b0 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.661+0000 7ff008fd4640 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557864610070 0x5578649b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.662+0000 7ff0037fe640 1 -- 172.21.15.37:0/1470792689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645e71b0 msgr2=0x5578649c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.662+0000 7ff0037fe640 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645e71b0 0x5578649c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.662+0000 7ff0037fe640 1 -- 172.21.15.37:0/1470792689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557864610070 msgr2=0x5578649b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.662+0000 7ff0037fe640 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557864610070 0x5578649b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.662+0000 7ff0037fe640 1 -- 172.21.15.37:0/1470792689 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578649b5750 con 0x5578645ef390 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.664+0000 7ff0037fe640 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649b4cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fefec004520 tx=0x7fefec053070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4fad309aa81a413 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.664+0000 7feff9ffb640 1 -- 172.21.15.37:0/1470792689 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec060070 con 0x5578645ef390 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.665+0000 7feff9ffb640 1 -- 172.21.15.37:0/1470792689 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefec04c040 con 0x5578645ef390 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.666+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 msgr2=0x5578649b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.666+0000 7ff010fab740 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649b4cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fefec004520 tx=0x7fefec053070 comp rx=0 tx=0).stop 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.667+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 shutdown_connections 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.667+0000 7ff010fab740 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557864610070 0x5578649b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.667+0000 7ff010fab740 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5578645ef390 0x5578649b4cd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.667+0000 7ff010fab740 1 --2- 172.21.15.37:0/1470792689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645e71b0 0x5578649c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.667+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 >> 172.21.15.37:0/1470792689 conn(0x557864604460 msgr2=0x5578649c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.667+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 shutdown_connections 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.668+0000 7ff010fab740 1 -- 172.21.15.37:0/1470792689 wait complete. 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.668+0000 7ff010fab740 1 -- start start 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.669+0000 7ff010fab740 1 Processor -- start 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.669+0000 7ff010fab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.670+0000 7ff010fab740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557864610070 0x5578649d5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.670+0000 7ff010fab740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645a3da0 0x5578649d5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.670+0000 7ff010fab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefe400fa30 con 0x5578645e71b0 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.670+0000 7ff010fab740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefe400f360 con 0x557864610070 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.670+0000 7ff010fab740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fefe400c580 con 0x5578645a3da0 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.671+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557864610070 0x5578649d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.671+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557864610070 0x5578649d5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47424/0 (socket says 172.21.15.37:47424) 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.671+0000 7ff0037fe640 1 -- 172.21.15.37:0/852279128 learned_addr learned my addr 172.21.15.37:0/852279128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.671+0000 7ff008fd4640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645a3da0 0x5578649d5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.671+0000 7ff010fab740 10 client.0 _ll_register_callbacks cb 0x7fefec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.673+0000 7ff003fff640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.673+0000 7ff008fd4640 1 -- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557864610070 msgr2=0x5578649d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.673+0000 7ff008fd4640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557864610070 0x5578649d5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.673+0000 7ff008fd4640 1 -- 172.21.15.37:0/852279128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 msgr2=0x5578649d83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.673+0000 7ff008fd4640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649d83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.673+0000 7ff008fd4640 1 -- 172.21.15.37:0/852279128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578649d6500 con 0x5578645a3da0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.676+0000 7ff008fd4640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645a3da0 0x5578649d5e40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feffc0e5050 tx=0x7feffc0b7030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=247d4ea92b79e094 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.676+0000 7fefe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.677+0000 7fefe37fe640 1 -- 172.21.15.37:0/852279128 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0ad1f0 con 0x5578645a3da0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.677+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55786492fda0 con 0x5578645a3da0 2024-09-21T01:27:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.677+0000 7fefe37fe640 1 -- 172.21.15.37:0/852279128 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7feffc0a9030 con 0x5578645a3da0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.678+0000 7fefe37fe640 1 -- 172.21.15.37:0/852279128 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7feffc0adde0 con 0x5578645a3da0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.678+0000 7ff010fab740 10 client.26509 fetch_fsmap learned FSMap version 30 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.678+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557864a3f3b0 con 0x5578645a3da0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.680+0000 7fefe37fe640 1 -- 172.21.15.37:0/852279128 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55786492fda0 con 0x5578645a3da0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.680+0000 7fefe37fe640 1 -- 172.21.15.37:0/852279128 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7feffc0b3350 con 0x5578645a3da0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.680+0000 7ff010fab740 10 client.26509 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.680+0000 7ff010fab740 10 client.26509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.680+0000 7ff010fab740 20 client.26509 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.680+0000 7ff010fab740 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557864a3fb60 0x557864a41f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.681+0000 7ff010fab740 4 client.26509 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.681+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55786492b850 con 0x557864a3fb60 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.687+0000 7ff003fff640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557864a3fb60 0x557864a41f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.689+0000 7ff003fff640 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557864a3fb60 0x557864a41f80 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a18c5ad588a05d server_cookie=ca66d0b09e86049f in_seq=0 out_seq=0 2024-09-21T01:27:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.689+0000 7fefe37fe640 10 client.26509 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.692+0000 7fefe37fe640 1 -- 172.21.15.37:0/852279128 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55786492b850 con 0x557864a3fb60 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.692+0000 7fefe37fe640 10 client.26509 handle_command_reply: tid=0 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.692+0000 7ff010fab740 1 client.26509 shutdown 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645a3da0 msgr2=0x5578649d5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645a3da0 0x5578649d5e40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feffc0e5050 tx=0x7feffc0b7030 comp rx=0 tx=0).stop 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 shutdown_connections 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x557864a3fb60 0x557864a41f80 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578645a3da0 0x5578649d5e40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557864610070 0x5578649d5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 --2- 172.21.15.37:0/852279128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578645e71b0 0x5578649d83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.695+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 >> 172.21.15.37:0/852279128 conn(0x557864604460 msgr2=0x5578649c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.696+0000 7fefe37fe640 0 client.26509 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.696+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 shutdown_connections 2024-09-21T01:27:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.696+0000 7ff010fab740 1 -- 172.21.15.37:0/852279128 wait complete. 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.696+0000 7ff010fab740 20 client.26509 trim_cache size 0 max 16384 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout: "04dc3c8b-74d6-49df-969d-99bdea3021c8": { 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "04dc3c8b-74d6-49df-969d-99bdea3021c8", 2024-09-21T01:27:04.713 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "04dc3c8b-74d6-49df-969d-99bdea3021c8": { 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:26:57.514198+0000", 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "e929fe6e-e756-46ca-bb18-0e2677e31537": { 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:25:28.490664+0000", 2024-09-21T01:27:04.714 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:24:00.417164+0000", 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.715 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.717 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:04.718 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.699+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7feff00b6660 msgr2=0x7feff00b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.699+0000 7ff0097d5640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7feff00b6660 0x7feff00b8b70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fefec009230 tx=0x7fefec000bc0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.699+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 msgr2=0x7ff004199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.699+0000 7ff0097d5640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 0x7ff004199920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7feffc00e970 tx=0x7feffc00ed70 comp rx=0 tx=0).stop 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.700+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 shutdown_connections 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.700+0000 7ff0097d5640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7feff00b6660 0x7feff00b8b70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.700+0000 7ff0097d5640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff004108b00 0x7ff004199920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.700+0000 7ff0097d5640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0041081b0 0x7ff0041993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.700+0000 7ff0097d5640 1 --2- 172.21.15.37:0/1755661001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff004102870 0x7ff004198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.700+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 >> 172.21.15.37:0/1755661001 conn(0x7ff0040fe2c0 msgr2=0x7ff0041006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.702+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 shutdown_connections 2024-09-21T01:27:04.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:04.702+0000 7ff0097d5640 1 -- 172.21.15.37:0/1755661001 wait complete. 2024-09-21T01:27:04.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:04 smithi137 ceph-mon[34607]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 890 MiB/s wr, 2.22k op/s 2024-09-21T01:27:04.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:04 smithi144 ceph-mon[34818]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 890 MiB/s wr, 2.22k op/s 2024-09-21T01:27:05.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:04 smithi037 ceph-mon[31105]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 890 MiB/s wr, 2.22k op/s 2024-09-21T01:27:06.909 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:06 smithi144 ceph-mon[34818]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 2.49k op/s 2024-09-21T01:27:06.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:06 smithi137 ceph-mon[34607]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 2.49k op/s 2024-09-21T01:27:07.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:06 smithi037 ceph-mon[31105]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 861 MiB/s wr, 2.49k op/s 2024-09-21T01:27:07.657 INFO:tasks.cephfs.filesystem:scrub status for tag:04dc3c8b-74d6-49df-969d-99bdea3021c8 - {'path': '/', 'tag': '04dc3c8b-74d6-49df-969d-99bdea3021c8', 'options': 'recursive,force'} 2024-09-21T01:27:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:07 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:27:07.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:07 smithi137 ceph-mon[34607]: scrub summary: idle 2024-09-21T01:27:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:07 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:27:07.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:07 smithi144 ceph-mon[34818]: scrub summary: idle 2024-09-21T01:27:08.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:07 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:27:08.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:07 smithi037 ceph-mon[31105]: scrub summary: idle 2024-09-21T01:27:08.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:08 smithi137 ceph-mon[34607]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 MiB/s wr, 2.61k op/s 2024-09-21T01:27:08.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:08 smithi144 ceph-mon[34818]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 MiB/s wr, 2.61k op/s 2024-09-21T01:27:09.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:08 smithi037 ceph-mon[31105]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 MiB/s wr, 2.61k op/s 2024-09-21T01:27:10.920 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:10 smithi137 ceph-mon[34607]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 883 MiB/s wr, 2.44k op/s 2024-09-21T01:27:10.921 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:10 smithi144 ceph-mon[34818]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 883 MiB/s wr, 2.44k op/s 2024-09-21T01:27:11.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:10 smithi037 ceph-mon[31105]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 883 MiB/s wr, 2.44k op/s 2024-09-21T01:27:11.636 INFO:tasks.workunit.client.0.smithi037.stdout:stopping iogen 2024-09-21T01:27:11.637 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'stopping iogen' 2024-09-21T01:27:11.637 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./iogen -k 2024-09-21T01:27:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.856+0000 7f1eb97a8640 1 -- 172.21.15.37:0/2835283689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb410e2b0 msgr2=0x7f1eb41106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:11.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.856+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/2835283689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb410e2b0 0x7f1eb41106d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009900 tx=0x7f1ea402a410 comp rx=0 tx=0).stop 2024-09-21T01:27:11.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.857+0000 7f1eb97a8640 1 -- 172.21.15.37:0/2835283689 shutdown_connections 2024-09-21T01:27:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.857+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/2835283689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1eb4110c10 0x7f1eb4113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.857+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/2835283689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb410e2b0 0x7f1eb41106d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.857+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/2835283689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eb410a3c0 0x7f1eb410dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.857+0000 7f1eb97a8640 1 -- 172.21.15.37:0/2835283689 >> 172.21.15.37:0/2835283689 conn(0x7f1eb4070810 msgr2=0x7f1eb4072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:11.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.859+0000 7f1eb97a8640 1 -- 172.21.15.37:0/2835283689 shutdown_connections 2024-09-21T01:27:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.860+0000 7f1eb97a8640 1 -- 172.21.15.37:0/2835283689 wait complete. 2024-09-21T01:27:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.861+0000 7f1eb97a8640 1 Processor -- start 2024-09-21T01:27:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.861+0000 7f1eb97a8640 1 -- start start 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.861+0000 7f1eb97a8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1eb410a3c0 0x7f1eb41a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb97a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 0x7f1eb41a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb97a8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eb41a1860 0x7f1eb41a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb97a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4115980 con 0x7f1eb4110c10 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb97a8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4115800 con 0x7f1eb410a3c0 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb97a8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4115b00 con 0x7f1eb41a1860 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 0x7f1eb41a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 0x7f1eb41a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44206/0 (socket says 172.21.15.37:44206) 2024-09-21T01:27:11.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.862+0000 7f1eb27fc640 1 -- 172.21.15.37:0/15220418 learned_addr learned my addr 172.21.15.37:0/15220418 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1eb410a3c0 0x7f1eb41a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb27fc640 1 -- 172.21.15.37:0/15220418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eb41a1860 msgr2=0x7f1eb41a1d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:27:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eb41a1860 0x7f1eb41a1d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb27fc640 1 -- 172.21.15.37:0/15220418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1eb410a3c0 msgr2=0x7f1eb41a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1eb410a3c0 0x7f1eb41a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb27fc640 1 -- 172.21.15.37:0/15220418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb41a2580 con 0x7f1eb4110c10 2024-09-21T01:27:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.863+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 0x7f1eb41a0da0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1ea402a980 tx=0x7f1ea4003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.865+0000 7f1e9bfff640 1 -- 172.21.15.37:0/15220418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea403f020 con 0x7f1eb4110c10 2024-09-21T01:27:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.865+0000 7f1e9bfff640 1 -- 172.21.15.37:0/15220418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ea4031bc0 con 0x7f1eb4110c10 2024-09-21T01:27:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.865+0000 7f1e9bfff640 1 -- 172.21.15.37:0/15220418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4035070 con 0x7f1eb4110c10 2024-09-21T01:27:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.866+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb41a68a0 con 0x7f1eb4110c10 2024-09-21T01:27:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.866+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb41a6cb0 con 0x7f1eb4110c10 2024-09-21T01:27:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.889+0000 7f1ec07ee740 1 Processor -- start 2024-09-21T01:27:11.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.890+0000 7f1ec07ee740 1 -- start start 2024-09-21T01:27:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.890+0000 7f1e9bfff640 1 -- 172.21.15.37:0/15220418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1ea4042020 con 0x7f1eb4110c10 2024-09-21T01:27:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.892+0000 7f1e9bfff640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e9c0b66d0 0x7f1e9c0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.893+0000 7f1e9bfff640 1 -- 172.21.15.37:0/15220418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1ea4107c20 con 0x7f1eb4110c10 2024-09-21T01:27:11.899 INFO:tasks.workunit.client.0.smithi037.stdout:OK 2024-09-21T01:27:11.899 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo OK 2024-09-21T01:27:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.902+0000 7f1eb37fe640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e9c0b66d0 0x7f1e9c0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.902+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 0x556f27eb0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eb14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27ae84d0 0x556f27eb2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 0x556f27eb0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 0x556f27eb0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:58418/0 (socket says 172.21.15.37:58418) 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/1811306131 learned_addr learned my addr 172.21.15.37:0/1811306131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f27e236f0 con 0x556f27ae84d0 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556f27e12b20 con 0x556f27ae02f0 2024-09-21T01:27:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f27e16930 con 0x556f27b091b0 2024-09-21T01:27:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.903+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eb14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.905+0000 7f1eb37fe640 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27ae84d0 0x556f27eb2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.907+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/1811306131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 msgr2=0x556f27eb14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.907+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eb14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.907+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/1811306131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27ae84d0 msgr2=0x556f27eb2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.907+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27ae84d0 0x556f27eb2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.908+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/1811306131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f27dd8530 con 0x556f27b091b0 2024-09-21T01:27:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.909+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 0x556f27eb0e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800bc30 tx=0x7f1ea800a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113d22a4c466c608 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:11.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.913+0000 7f1e997fa640 1 -- 172.21.15.37:0/1811306131 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80155f0 con 0x556f27b091b0 2024-09-21T01:27:11.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.913+0000 7f1e997fa640 1 -- 172.21.15.37:0/1811306131 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ea801a070 con 0x556f27b091b0 2024-09-21T01:27:11.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.913+0000 7f1e997fa640 1 -- 172.21.15.37:0/1811306131 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8014940 con 0x556f27b091b0 2024-09-21T01:27:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.914+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 msgr2=0x556f27eb0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:11.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.914+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 0x556f27eb0e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800bc30 tx=0x7f1ea800a680 comp rx=0 tx=0).stop 2024-09-21T01:27:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 shutdown_connections 2024-09-21T01:27:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27ae84d0 0x556f27eb2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eb14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/1811306131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27b091b0 0x556f27eb0e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 >> 172.21.15.37:0/1811306131 conn(0x556f27afd300 msgr2=0x556f27eac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 shutdown_connections 2024-09-21T01:27:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.924+0000 7f1ec07ee740 1 -- 172.21.15.37:0/1811306131 wait complete. 2024-09-21T01:27:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.925+0000 7f1ec07ee740 1 -- start start 2024-09-21T01:27:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.925+0000 7f1ec07ee740 1 Processor -- start 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ebad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ebb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f27d4aab0 con 0x556f27b091b0 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x556f27db8730 con 0x556f27ae02f0 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f27eb2b30 con 0x556f27ae84d0 2024-09-21T01:27:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.926+0000 7f1ec07ee740 10 client.0 _ll_register_callbacks cb 0x556f27e0c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.928+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.928+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eba660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:38908/0 (socket says 172.21.15.37:38908) 2024-09-21T01:27:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.928+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/2425839524 learned_addr learned my addr 172.21.15.37:0/2425839524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.928+0000 7f1eb37fe640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e9c0b66d0 0x7f1e9c0b8be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0116a0 tx=0x7f1eac00a500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.928+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ebad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.932+0000 7f1eb37fe640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ebb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.939+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/2425839524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 msgr2=0x556f27ebad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.939+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ebad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.939+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/2425839524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 msgr2=0x556f27ebb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.939+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ebb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.939+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/2425839524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f27b74790 con 0x556f27ae02f0 2024-09-21T01:27:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.940+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eba660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800b710 tx=0x7f1ea80048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74eb4c3134031afc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.953+0000 7f1e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:27:11.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.953+0000 7f1e96ff5640 1 -- 172.21.15.37:0/2425839524 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8023070 con 0x556f27ae02f0 2024-09-21T01:27:11.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.953+0000 7f1e96ff5640 1 -- 172.21.15.37:0/2425839524 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1ea8014640 con 0x556f27ae02f0 2024-09-21T01:27:11.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.957+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea801a070 con 0x556f27ae02f0 2024-09-21T01:27:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.961+0000 7f1e96ff5640 1 -- 172.21.15.37:0/2425839524 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1ea802d050 con 0x556f27ae02f0 2024-09-21T01:27:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.965+0000 7f1ec07ee740 10 client.26546 fetch_fsmap learned FSMap version 30 2024-09-21T01:27:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.965+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f27bed620 con 0x556f27ae02f0 2024-09-21T01:27:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.970+0000 7f1e96ff5640 1 -- 172.21.15.37:0/2425839524 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ea801a070 con 0x556f27ae02f0 2024-09-21T01:27:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.970+0000 7f1e96ff5640 1 -- 172.21.15.37:0/2425839524 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1ea8028440 con 0x556f27ae02f0 2024-09-21T01:27:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.975+0000 7f1ec07ee740 10 client.26546 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:27:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.975+0000 7f1ec07ee740 10 client.26546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.975+0000 7f1ec07ee740 20 client.26546 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.975+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27ac7d80 0x556f27ec7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.975+0000 7f1ec07ee740 4 client.26546 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.975+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f27e25640 con 0x556f27ac7d80 2024-09-21T01:27:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.978+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27ac7d80 0x556f27ec7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.983+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27ac7d80 0x556f27ec7a90 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76fc06d05c586c10 server_cookie=ee8b225629b2a in_seq=0 out_seq=0 2024-09-21T01:27:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.984+0000 7f1e96ff5640 10 client.26546 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.987+0000 7f1e96ff5640 1 -- 172.21.15.37:0/2425839524 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f27e25640 con 0x556f27ac7d80 2024-09-21T01:27:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.987+0000 7f1e96ff5640 10 client.26546 handle_command_reply: tid=0 2024-09-21T01:27:11.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.987+0000 7f1ec07ee740 1 client.26546 shutdown 2024-09-21T01:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.989+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 msgr2=0x556f27eba660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.991+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eba660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800b710 tx=0x7f1ea80048f0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 shutdown_connections 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27ac7d80 0x556f27ec7a90 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ebb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ebad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/2425839524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27eba660 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1e96ff5640 0 client.26546 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.992+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 >> 172.21.15.37:0/2425839524 conn(0x556f27afd300 msgr2=0x556f27eaaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.993+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 shutdown_connections 2024-09-21T01:27:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.993+0000 7f1ec07ee740 1 -- 172.21.15.37:0/2425839524 wait complete. 2024-09-21T01:27:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:11.994+0000 7f1ec07ee740 20 client.26546 trim_cache size 0 max 16384 2024-09-21T01:27:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.045+0000 7f1ec07ee740 1 Processor -- start 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 -- start start 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 0x556f27eb8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae84d0 0x556f27eb90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27eacdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41c2cc0 con 0x556f27b091b0 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41c4800 con 0x556f27ae84d0 2024-09-21T01:27:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.048+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41c3390 con 0x556f27ae02f0 2024-09-21T01:27:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.050+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 0x556f27eb8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.050+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 0x556f27eb8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:58428/0 (socket says 172.21.15.37:58428) 2024-09-21T01:27:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.050+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/3370288375 learned_addr learned my addr 172.21.15.37:0/3370288375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.055+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae84d0 0x556f27eb90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.055+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/3370288375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae84d0 msgr2=0x556f27eb90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.055+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae84d0 0x556f27eb90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.055+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/3370288375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 msgr2=0x556f27eacdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.055+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27eacdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.055+0000 7f1eb2ffd640 1 -- 172.21.15.37:0/3370288375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f27ebbc00 con 0x556f27ae02f0 2024-09-21T01:27:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.058+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 0x556f27eb8bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8028810 tx=0x7f1ea8004960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b906bcdcee9a79dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.060+0000 7f1e98ff9640 1 -- 172.21.15.37:0/3370288375 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8023040 con 0x556f27ae02f0 2024-09-21T01:27:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.060+0000 7f1e98ff9640 1 -- 172.21.15.37:0/3370288375 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ea8037070 con 0x556f27ae02f0 2024-09-21T01:27:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.060+0000 7f1e98ff9640 1 -- 172.21.15.37:0/3370288375 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8004c20 con 0x556f27ae02f0 2024-09-21T01:27:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.064+0000 7f1ec07ee740 1 -- 172.21.15.37:0/3370288375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 msgr2=0x556f27eb8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.064+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 0x556f27eb8bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8028810 tx=0x7f1ea8004960 comp rx=0 tx=0).stop 2024-09-21T01:27:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.074+0000 7f1ec07ee740 1 -- 172.21.15.37:0/3370288375 shutdown_connections 2024-09-21T01:27:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.074+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27eacdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.074+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae84d0 0x556f27eb90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.074+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/3370288375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae02f0 0x556f27eb8bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.074+0000 7f1ec07ee740 1 -- 172.21.15.37:0/3370288375 >> 172.21.15.37:0/3370288375 conn(0x556f27afd300 msgr2=0x556f27eab650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.082+0000 7f1ec07ee740 1 -- 172.21.15.37:0/3370288375 shutdown_connections 2024-09-21T01:27:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.085+0000 7f1ec07ee740 1 -- 172.21.15.37:0/3370288375 wait complete. 2024-09-21T01:27:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.086+0000 7f1ec07ee740 1 -- start start 2024-09-21T01:27:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.087+0000 7f1ec07ee740 1 Processor -- start 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27ec1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ec0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ec0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41c4130 con 0x556f27b091b0 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41c3a60 con 0x556f27ae02f0 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb41c0c80 con 0x556f27ae84d0 2024-09-21T01:27:12.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.088+0000 7f1ec07ee740 10 client.0 _ll_register_callbacks cb 0x7f1ea4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.090+0000 7f1eb27fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ec0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.091+0000 7f1eb27fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ec0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:58438/0 (socket says 172.21.15.37:58438) 2024-09-21T01:27:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.091+0000 7f1eb27fc640 1 -- 172.21.15.37:0/317763455 learned_addr learned my addr 172.21.15.37:0/317763455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.091+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27ec1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.091+0000 7f1eb37fe640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ec0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.094+0000 7f1eb27fc640 1 -- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 msgr2=0x556f27ec1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.094+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27ec1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.094+0000 7f1eb27fc640 1 -- 172.21.15.37:0/317763455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 msgr2=0x556f27ec0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.094+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ec0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:12.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.094+0000 7f1eb27fc640 1 -- 172.21.15.37:0/317763455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f27ec1460 con 0x556f27ae84d0 2024-09-21T01:27:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.095+0000 7f1eb27fc640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ec0960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40cdd40 tx=0x7f1ea403b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b4837e6d7b7fed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.095+0000 7f1e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T01:27:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.096+0000 7f1e96ff5640 1 -- 172.21.15.37:0/317763455 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40b9170 con 0x556f27ae84d0 2024-09-21T01:27:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.096+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea8037070 con 0x556f27ae84d0 2024-09-21T01:27:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.096+0000 7f1e96ff5640 1 -- 172.21.15.37:0/317763455 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1ea4039db0 con 0x556f27ae84d0 2024-09-21T01:27:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.096+0000 7f1e96ff5640 1 -- 172.21.15.37:0/317763455 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1ea40d77d0 con 0x556f27ae84d0 2024-09-21T01:27:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.096+0000 7f1ec07ee740 10 client.26524 fetch_fsmap learned FSMap version 30 2024-09-21T01:27:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.096+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556f27f32370 con 0x556f27ae84d0 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.097+0000 7f1e96ff5640 1 -- 172.21.15.37:0/317763455 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ea8037070 con 0x556f27ae84d0 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.097+0000 7f1e96ff5640 1 -- 172.21.15.37:0/317763455 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1ea40f51e0 con 0x556f27ae84d0 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.097+0000 7f1ec07ee740 10 client.26524 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.097+0000 7f1ec07ee740 10 client.26524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.097+0000 7f1ec07ee740 20 client.26524 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.097+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27a9d1c0 0x556f27f34b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.098+0000 7f1ec07ee740 4 client.26524 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T01:27:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.098+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556f27eab440 con 0x556f27a9d1c0 2024-09-21T01:27:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.100+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27a9d1c0 0x556f27f34b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.104+0000 7f1eb2ffd640 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27a9d1c0 0x556f27f34b80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7be48ba74388dc3f server_cookie=989ff13476abfec6 in_seq=0 out_seq=0 2024-09-21T01:27:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:12.104+0000 7f1e96ff5640 10 client.26524 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:13.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:12 smithi037 ceph-mon[31105]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 MiB/s wr, 2.38k op/s 2024-09-21T01:27:13.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:12 smithi137 ceph-mon[34607]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 MiB/s wr, 2.38k op/s 2024-09-21T01:27:13.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:12 smithi144 ceph-mon[34818]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 MiB/s wr, 2.38k op/s 2024-09-21T01:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1e96ff5640 1 -- 172.21.15.37:0/317763455 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556f27eab440 con 0x556f27a9d1c0 2024-09-21T01:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1e96ff5640 10 client.26524 handle_command_reply: tid=0 2024-09-21T01:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 client.26524 shutdown 2024-09-21T01:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 msgr2=0x556f27ec0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ec0960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40cdd40 tx=0x7f1ea403b6b0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 shutdown_connections 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x556f27a9d1c0 0x556f27f34b80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f27b091b0 0x556f27ec0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f27ae84d0 0x556f27ec0960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 --2- 172.21.15.37:0/317763455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556f27ae02f0 0x556f27ec1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1e96ff5640 0 client.26524 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.255+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 >> 172.21.15.37:0/317763455 conn(0x556f27afd300 msgr2=0x556f27eb8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.256+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 shutdown_connections 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.256+0000 7f1ec07ee740 1 -- 172.21.15.37:0/317763455 wait complete. 2024-09-21T01:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.256+0000 7f1ec07ee740 20 client.26524 trim_cache size 0 max 16384 2024-09-21T01:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-09-21T01:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-09-21T01:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-09-21T01:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.256+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e9c0b66d0 msgr2=0x7f1e9c0b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e9c0b66d0 0x7f1e9c0b8be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0116a0 tx=0x7f1eac00a500 comp rx=0 tx=0).stop 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 msgr2=0x7f1eb41a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 0x7f1eb41a0da0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1ea402a980 tx=0x7f1ea4003be0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 shutdown_connections 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f1e9c0b66d0 0x7f1e9c0b8be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eb41a1860 0x7f1eb41a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eb4110c10 0x7f1eb41a0da0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 --2- 172.21.15.37:0/15220418 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1eb410a3c0 0x7f1eb41a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 >> 172.21.15.37:0/15220418 conn(0x7f1eb4070810 msgr2=0x7f1eb410f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 shutdown_connections 2024-09-21T01:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-09-21T01:27:14.257+0000 7f1eb97a8640 1 -- 172.21.15.37:0/15220418 wait complete. 2024-09-21T01:27:14.456 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:27:14.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:27:14.650 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-21T01:27:14.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T01:27:14.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:14 smithi037 ceph-mon[31105]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 883 MiB/s wr, 2.27k op/s 2024-09-21T01:27:14.954 DEBUG:teuthology.parallel:result is None 2024-09-21T01:27:14.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:27:14.991 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:27:14.991 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T01:27:15.003 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:27:15.039 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T01:27:15.050 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T01:27:15.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:14 smithi137 ceph-mon[34607]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 883 MiB/s wr, 2.27k op/s 2024-09-21T01:27:15.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:14 smithi144 ceph-mon[34818]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 883 MiB/s wr, 2.27k op/s 2024-09-21T01:27:17.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:16 smithi037 ceph-mon[31105]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 871 MiB/s wr, 2.00k op/s 2024-09-21T01:27:17.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:16 smithi137 ceph-mon[34607]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 871 MiB/s wr, 2.00k op/s 2024-09-21T01:27:17.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:16 smithi144 ceph-mon[34818]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 871 MiB/s wr, 2.00k op/s 2024-09-21T01:27:17.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:17 smithi037 ceph-mon[31105]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:27:18.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:17 smithi137 ceph-mon[34607]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:27:18.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:17 smithi144 ceph-mon[34818]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T01:27:18.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:18 smithi037 ceph-mon[31105]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 834 MiB/s wr, 1.68k op/s 2024-09-21T01:27:19.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:18 smithi137 ceph-mon[34607]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 834 MiB/s wr, 1.68k op/s 2024-09-21T01:27:19.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:18 smithi144 ceph-mon[34818]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 834 MiB/s wr, 1.68k op/s 2024-09-21T01:27:20.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:20 smithi037 ceph-mon[31105]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 728 MiB/s wr, 1.41k op/s 2024-09-21T01:27:21.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:20 smithi137 ceph-mon[34607]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 728 MiB/s wr, 1.41k op/s 2024-09-21T01:27:21.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:20 smithi144 ceph-mon[34818]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 728 MiB/s wr, 1.41k op/s 2024-09-21T01:27:22.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:22 smithi037 ceph-mon[31105]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 589 MiB/s wr, 1.25k op/s 2024-09-21T01:27:23.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:22 smithi137 ceph-mon[34607]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 589 MiB/s wr, 1.25k op/s 2024-09-21T01:27:23.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:22 smithi144 ceph-mon[34818]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 589 MiB/s wr, 1.25k op/s 2024-09-21T01:27:24.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:24 smithi037 ceph-mon[31105]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 452 MiB/s wr, 969 op/s 2024-09-21T01:27:25.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:24 smithi137 ceph-mon[34607]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 452 MiB/s wr, 969 op/s 2024-09-21T01:27:25.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:24 smithi144 ceph-mon[34818]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 452 MiB/s wr, 969 op/s 2024-09-21T01:27:27.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:26 smithi037 ceph-mon[31105]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 318 MiB/s wr, 640 op/s 2024-09-21T01:27:27.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:26 smithi137 ceph-mon[34607]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 318 MiB/s wr, 640 op/s 2024-09-21T01:27:27.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:26 smithi144 ceph-mon[34818]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 318 MiB/s wr, 640 op/s 2024-09-21T01:27:29.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:28 smithi037 ceph-mon[31105]: pgmap v701: 97 pgs: 97 active+clean; 9.7 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 188 MiB/s wr, 358 op/s 2024-09-21T01:27:29.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:28 smithi137 ceph-mon[34607]: pgmap v701: 97 pgs: 97 active+clean; 9.7 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 188 MiB/s wr, 358 op/s 2024-09-21T01:27:29.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:28 smithi144 ceph-mon[34818]: pgmap v701: 97 pgs: 97 active+clean; 9.7 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 188 MiB/s wr, 358 op/s 2024-09-21T01:27:31.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:30 smithi037 ceph-mon[31105]: pgmap v702: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 124 MiB/s wr, 299 op/s 2024-09-21T01:27:31.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:30 smithi137 ceph-mon[34607]: pgmap v702: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 124 MiB/s wr, 299 op/s 2024-09-21T01:27:31.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:30 smithi144 ceph-mon[34818]: pgmap v702: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 124 MiB/s wr, 299 op/s 2024-09-21T01:27:33.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:32 smithi037 ceph-mon[31105]: pgmap v703: 97 pgs: 97 active+clean; 8.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 90 MiB/s wr, 278 op/s 2024-09-21T01:27:33.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:32 smithi137 ceph-mon[34607]: pgmap v703: 97 pgs: 97 active+clean; 8.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 90 MiB/s wr, 278 op/s 2024-09-21T01:27:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:32 smithi144 ceph-mon[34818]: pgmap v703: 97 pgs: 97 active+clean; 8.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 90 MiB/s wr, 278 op/s 2024-09-21T01:27:35.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:34 smithi037 ceph-mon[31105]: pgmap v704: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 89 MiB/s wr, 295 op/s 2024-09-21T01:27:35.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:34 smithi137 ceph-mon[34607]: pgmap v704: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 89 MiB/s wr, 295 op/s 2024-09-21T01:27:35.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:34 smithi144 ceph-mon[34818]: pgmap v704: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 89 MiB/s wr, 295 op/s 2024-09-21T01:27:36.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:36 smithi037 ceph-mon[31105]: pgmap v705: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 93 MiB/s wr, 337 op/s 2024-09-21T01:27:37.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:36 smithi137 ceph-mon[34607]: pgmap v705: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 93 MiB/s wr, 337 op/s 2024-09-21T01:27:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:36 smithi144 ceph-mon[34818]: pgmap v705: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 93 MiB/s wr, 337 op/s 2024-09-21T01:27:37.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T01:27:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 -- 172.21.15.37:0/3502736810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0109e10 msgr2=0x7f10b0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 --2- 172.21.15.37:0/3502736810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0109e10 0x7f10b0110640 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009ca0 tx=0x7f10a802a8e0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 -- 172.21.15.37:0/3502736810 shutdown_connections 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 --2- 172.21.15.37:0/3502736810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0109e10 0x7f10b0110640 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 --2- 172.21.15.37:0/3502736810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b01094c0 0x7f10b01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 --2- 172.21.15.37:0/3502736810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b0103b80 0x7f10b0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 -- 172.21.15.37:0/3502736810 >> 172.21.15.37:0/3502736810 conn(0x7f10b00ff610 msgr2=0x7f10b0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 -- 172.21.15.37:0/3502736810 shutdown_connections 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.491+0000 7f10b590f640 1 -- 172.21.15.37:0/3502736810 wait complete. 2024-09-21T01:27:38.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.492+0000 7f10b590f640 1 Processor -- start 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.492+0000 7f10b590f640 1 -- start start 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10b590f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 0x7f10b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10b590f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b01094c0 0x7f10b0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10b590f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b0109e10 0x7f10b0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10b590f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0113b10 con 0x7f10b0103b80 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10b590f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0113990 con 0x7f10b01094c0 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10b590f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0113c90 con 0x7f10b0109e10 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 0x7f10b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 0x7f10b0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44700/0 (socket says 172.21.15.37:44700) 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 -- 172.21.15.37:0/1181917130 learned_addr learned my addr 172.21.15.37:0/1181917130 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b01094c0 0x7f10b0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10af7fe640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b0109e10 0x7f10b0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 -- 172.21.15.37:0/1181917130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b0109e10 msgr2=0x7f10b0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b0109e10 0x7f10b0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 -- 172.21.15.37:0/1181917130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b01094c0 msgr2=0x7f10b0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b01094c0 0x7f10b0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 -- 172.21.15.37:0/1181917130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b01a87e0 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10af7fe640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b0109e10 0x7f10b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b01094c0 0x7f10b0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.493+0000 7f10aeffd640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 0x7f10b0075710 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f10a000d950 tx=0x7f10a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.494+0000 7f10b490d640 1 -- 172.21.15.37:0/1181917130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0017070 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.494+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b01a8ad0 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.494+0000 7f10b490d640 1 -- 172.21.15.37:0/1181917130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a0009c30 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.494+0000 7f10b490d640 1 -- 172.21.15.37:0/1181917130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a000f620 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.494+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a9010 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10b490d640 1 -- 172.21.15.37:0/1181917130 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f10a000f7c0 con 0x7f10b0103b80 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 Processor -- start 2024-09-21T01:27:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 -- start start 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 0x555d9ccb2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8e21b0 0x555d9ccb27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8ea390 0x555d9ccb2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d9cc28e50 con 0x555d9c90b070 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555d9cc18280 con 0x555d9c8e21b0 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10bbe83740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555d9cc1c090 con 0x555d9c8ea390 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 0x555d9ccb2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 0x555d9ccb2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44710/0 (socket says 172.21.15.37:44710) 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10af7fe640 1 -- 172.21.15.37:0/4256370852 learned_addr learned my addr 172.21.15.37:0/4256370852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10aeffd640 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8e21b0 0x555d9ccb27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.497+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8ea390 0x555d9ccb2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10b490d640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10980b6510 0x7f10980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 -- 172.21.15.37:0/4256370852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8ea390 msgr2=0x555d9ccb2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8ea390 0x555d9ccb2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 -- 172.21.15.37:0/4256370852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8e21b0 msgr2=0x555d9ccb27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8e21b0 0x555d9ccb27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 -- 172.21.15.37:0/4256370852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d9c976650 con 0x555d9c90b070 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10aeffd640 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8e21b0 0x555d9ccb27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10b490d640 1 -- 172.21.15.37:0/1181917130 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f10a00e6fb0 con 0x7f10b0103b80 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10980b6510 0x7f10980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f10af7fe640 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 0x555d9ccb2270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f10a8031620 tx=0x7f10a8031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27ba9a27f908874 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f1095ffb640 1 -- 172.21.15.37:0/4256370852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a804d070 con 0x555d9c90b070 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f1095ffb640 1 -- 172.21.15.37:0/4256370852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a8036040 con 0x555d9c90b070 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.498+0000 7f1095ffb640 1 -- 172.21.15.37:0/4256370852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8030d20 con 0x555d9c90b070 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 -- 172.21.15.37:0/4256370852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 msgr2=0x555d9ccb2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 0x555d9ccb2270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f10a8031620 tx=0x7f10a8031650 comp rx=0 tx=0).stop 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10af7fe640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10980b6510 0x7f10980b8a20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10a804a000 tx=0x7f10a804b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 -- 172.21.15.37:0/4256370852 shutdown_connections 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8ea390 0x555d9ccb2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8e21b0 0x555d9ccb27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 --2- 172.21.15.37:0/4256370852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c90b070 0x555d9ccb2270 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 -- 172.21.15.37:0/4256370852 >> 172.21.15.37:0/4256370852 conn(0x555d9c8ff460 msgr2=0x555d9ccb0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 -- 172.21.15.37:0/4256370852 shutdown_connections 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.499+0000 7f10bbe83740 1 -- 172.21.15.37:0/4256370852 wait complete. 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.500+0000 7f10bbe83740 1 -- start start 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.500+0000 7f10bbe83740 1 Processor -- start 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.500+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8e21b0 0x555d9ccbd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.500+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 0x555d9ccbdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c90b070 0x555d9ccc9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10bbe83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d9ca79700 con 0x555d9c8ea390 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10bbe83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555d9cbb3110 con 0x555d9c90b070 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10bbe83740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555d9ccc0a50 con 0x555d9c8e21b0 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10bbe83740 10 client.0 _ll_register_callbacks cb 0x555d9cbcc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 0x555d9ccbdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 0x555d9ccbdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44724/0 (socket says 172.21.15.37:44724) 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 -- 172.21.15.37:0/2018085349 learned_addr learned my addr 172.21.15.37:0/2018085349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10aeffd640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8e21b0 0x555d9ccbd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10af7fe640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c90b070 0x555d9ccc9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 -- 172.21.15.37:0/2018085349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8e21b0 msgr2=0x555d9ccbd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8e21b0 0x555d9ccbd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 -- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c90b070 msgr2=0x555d9ccc9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c90b070 0x555d9ccc9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 -- 172.21.15.37:0/2018085349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9cbe0c40 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10af7fe640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c90b070 0x555d9ccc9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 0x555d9ccbdea0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f10a4010500 tx=0x7f10a40109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4398ed60cbd91ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f108effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.501+0000 7f108effd640 1 -- 172.21.15.37:0/2018085349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4018070 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f108effd640 1 -- 172.21.15.37:0/2018085349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f10a4014700 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a8036040 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f108effd640 1 -- 172.21.15.37:0/2018085349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10a4024050 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 10 client.17169 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555d9cccc810 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f108effd640 1 -- 172.21.15.37:0/2018085349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a8036040 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f108effd640 1 -- 172.21.15.37:0/2018085349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f10a4012990 con 0x555d9c8ea390 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 10 client.17169 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 20 client.17169 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c8c99f0 0x555d9cccfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 4 client.17169 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.502+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d9cc2ada0 con 0x555d9c8c99f0 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.503+0000 7f10aeffd640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c8c99f0 0x555d9cccfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.503+0000 7f108effd640 10 client.17169 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.503+0000 7f10aeffd640 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c8c99f0 0x555d9cccfd00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=318f294395802e25 server_cookie=b8001021b848d9c2 in_seq=0 out_seq=0 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f108effd640 1 -- 172.21.15.37:0/2018085349 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d9cc2ada0 con 0x555d9c8c99f0 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f108effd640 10 client.17169 handle_command_reply: tid=0 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 client.17169 shutdown 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 msgr2=0x555d9ccbdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 0x555d9ccbdea0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f10a4010500 tx=0x7f10a40109c0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 shutdown_connections 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c8c99f0 0x555d9cccfd00 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c90b070 0x555d9ccc9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8ea390 0x555d9ccbdea0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 --2- 172.21.15.37:0/2018085349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c8e21b0 0x555d9ccbd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 >> 172.21.15.37:0/2018085349 conn(0x555d9c8ff460 msgr2=0x555d9ccb5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f108effd640 0 client.17169 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 shutdown_connections 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 1 -- 172.21.15.37:0/2018085349 wait complete. 2024-09-21T01:27:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.504+0000 7f10bbe83740 20 client.17169 trim_cache size 0 max 16384 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 Processor -- start 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 -- start start 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccb39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccbab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01b16a0 con 0x555d9c8e21b0 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01b3210 con 0x555d9c8ea390 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccb39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10bbe83740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01b1d70 con 0x555d9c90b070 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccb39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44738/0 (socket says 172.21.15.37:44738) 2024-09-21T01:27:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10aeffd640 1 -- 172.21.15.37:0/393352230 learned_addr learned my addr 172.21.15.37:0/393352230 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.522+0000 7f10af7fe640 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccbab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10aeffd640 1 -- 172.21.15.37:0/393352230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 msgr2=0x555d9ccbab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10aeffd640 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccbab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10aeffd640 1 -- 172.21.15.37:0/393352230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 msgr2=0x555d9ccc9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10aeffd640 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10aeffd640 1 -- 172.21.15.37:0/393352230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d9ccb4880 con 0x555d9c8e21b0 2024-09-21T01:27:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10aeffd640 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccb39b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f10a00acee0 tx=0x7f10a00b6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8369b82b15cf8fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10957fa640 1 -- 172.21.15.37:0/393352230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0020040 con 0x555d9c8e21b0 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10957fa640 1 -- 172.21.15.37:0/393352230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a00accf0 con 0x555d9c8e21b0 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.523+0000 7f10957fa640 1 -- 172.21.15.37:0/393352230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00eacb0 con 0x555d9c8e21b0 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 -- 172.21.15.37:0/393352230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 msgr2=0x555d9ccb39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccb39b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f10a00acee0 tx=0x7f10a00b6040 comp rx=0 tx=0).stop 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 -- 172.21.15.37:0/393352230 shutdown_connections 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccbab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 --2- 172.21.15.37:0/393352230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccb39b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 -- 172.21.15.37:0/393352230 >> 172.21.15.37:0/393352230 conn(0x555d9c8ff460 msgr2=0x555d9ccb32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 -- 172.21.15.37:0/393352230 shutdown_connections 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.524+0000 7f10bbe83740 1 -- 172.21.15.37:0/393352230 wait complete. 2024-09-21T01:27:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 -- start start 2024-09-21T01:27:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 Processor -- start 2024-09-21T01:27:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccc6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccc21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01b2b40 con 0x555d9c8e21b0 2024-09-21T01:27:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01b2440 con 0x555d9c8ea390 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01af660 con 0x555d9c90b070 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10bbe83740 10 client.0 _ll_register_callbacks cb 0x7f10a4007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccc6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.525+0000 7f10aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccc6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44748/0 (socket says 172.21.15.37:44748) 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 -- 172.21.15.37:0/1518825428 learned_addr learned my addr 172.21.15.37:0/1518825428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10af7fe640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccc21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 -- 172.21.15.37:0/1518825428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 msgr2=0x555d9ccc21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccc21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 -- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 msgr2=0x555d9ccc1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 -- 172.21.15.37:0/1518825428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9ccc2940 con 0x555d9c8e21b0 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10af7fe640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccc21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10aeffd640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccc6610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f10a00e4ba0 tx=0x7f10a00ea8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54ca72921b61a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f108effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f108effd640 1 -- 172.21.15.37:0/1518825428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00e92c0 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f108effd640 1 -- 172.21.15.37:0/1518825428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f10a00d0b60 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a00accf0 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f108effd640 1 -- 172.21.15.37:0/1518825428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10a00b6c00 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10bbe83740 10 client.17175 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.526+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555d9cd3a7b0 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f108effd640 1 -- 172.21.15.37:0/1518825428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a00accf0 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f108effd640 1 -- 172.21.15.37:0/1518825428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f10a00ac070 con 0x555d9c8e21b0 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10bbe83740 10 client.17175 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10bbe83740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10bbe83740 20 client.17175 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10bbe83740 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c89eda0 0x555d9cd3cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10bbe83740 4 client.17175 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555d9cc26850 con 0x555d9c89eda0 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.527+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c89eda0 0x555d9cd3cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10ae7fc640 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c89eda0 0x555d9cd3cf50 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292f7c4d345602cd server_cookie=ce0ddb1ca7238ab in_seq=0 out_seq=0 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f108effd640 10 client.17175 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f108effd640 1 -- 172.21.15.37:0/1518825428 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x555d9cc26850 con 0x555d9c89eda0 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f108effd640 10 client.17175 handle_command_reply: tid=0 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 client.17175 shutdown 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 msgr2=0x555d9ccc6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccc6610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f10a00e4ba0 tx=0x7f10a00ea8d0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 shutdown_connections 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x555d9c89eda0 0x555d9cd3cf50 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d9c90b070 0x555d9ccc21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d9c8ea390 0x555d9ccc1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 --2- 172.21.15.37:0/1518825428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d9c8e21b0 0x555d9ccc6610 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 >> 172.21.15.37:0/1518825428 conn(0x555d9c8ff460 msgr2=0x555d9ccb32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f108effd640 0 client.17175 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 shutdown_connections 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.528+0000 7f10bbe83740 1 -- 172.21.15.37:0/1518825428 wait complete. 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10bbe83740 20 client.17175 trim_cache size 0 max 16384 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-09-21T01:27:38.534 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "04dc3c8b-74d6-49df-969d-99bdea3021c8": { 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:26:57.514198+0000", 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "e929fe6e-e756-46ca-bb18-0e2677e31537": { 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:25:28.490664+0000", 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.535 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "656f7af4-6b4c-4346-a643-f4e121674f9d": { 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:24:00.417164+0000", 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "efb52bc3-bca1-4107-a2ee-fa49909bfab3": { 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:22:27.488788+0000", 2024-09-21T01:27:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "9cca879a-4b6e-483b-a540-0b1516951102": { 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:19:31.559880+0000", 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "1dd64a11-a2d7-4948-b0a6-aa898fa3066f": { 2024-09-21T01:27:38.537 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:18:09.978322+0000", 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "5a2712c0-9041-4bb0-9189-f394a9406090": { 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:20:53.466437+0000", 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.538 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "5071e53c-b22f-4e9a-949f-ea3087632abb": { 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:51.140715+0000", 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "5136e175-0609-4bc5-a7ad-e169b15fc747": { 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-09-21T01:16:04.781533+0000", 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-09-21T01:27:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-09-21T01:27:38.540 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-09-21T01:27:38.540 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:38.540 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:38.540 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:27:38.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10980b6510 msgr2=0x7f10980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10980b6510 0x7f10980b8a20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f10a804a000 tx=0x7f10a804b000 comp rx=0 tx=0).stop 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 msgr2=0x7f10b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 0x7f10b0075710 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f10a000d950 tx=0x7f10a000de10 comp rx=0 tx=0).stop 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 shutdown_connections 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10980b6510 0x7f10980b8a20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b0109e10 0x7f10b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10b01094c0 0x7f10b0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 --2- 172.21.15.37:0/1181917130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b0103b80 0x7f10b0075710 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 >> 172.21.15.37:0/1181917130 conn(0x7f10b00ff610 msgr2=0x7f10b0108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 shutdown_connections 2024-09-21T01:27:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:38.529+0000 7f10b590f640 1 -- 172.21.15.37:0/1181917130 wait complete. 2024-09-21T01:27:39.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:38 smithi037 ceph-mon[31105]: pgmap v706: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 95 MiB/s wr, 361 op/s 2024-09-21T01:27:39.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:38 smithi137 ceph-mon[34607]: pgmap v706: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 95 MiB/s wr, 361 op/s 2024-09-21T01:27:39.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:38 smithi144 ceph-mon[34818]: pgmap v706: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 95 MiB/s wr, 361 op/s 2024-09-21T01:27:39.370 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T01:27:39.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:27:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.273+0000 7f601717d640 1 -- 172.21.15.37:0/3118770505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601010f710 msgr2=0x7f601010a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.273+0000 7f601717d640 1 --2- 172.21.15.37:0/3118770505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601010f710 0x7f601010a3c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ca0 tx=0x7f600802c7b0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.274+0000 7f601717d640 1 -- 172.21.15.37:0/3118770505 shutdown_connections 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.274+0000 7f601717d640 1 --2- 172.21.15.37:0/3118770505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010a900 0x7f601010ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.274+0000 7f601717d640 1 --2- 172.21.15.37:0/3118770505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601010f710 0x7f601010a3c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.274+0000 7f601717d640 1 --2- 172.21.15.37:0/3118770505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601006af90 0x7f601010f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.274+0000 7f601717d640 1 -- 172.21.15.37:0/3118770505 >> 172.21.15.37:0/3118770505 conn(0x7f60100712f0 msgr2=0x7f6010073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.275+0000 7f601717d640 1 -- 172.21.15.37:0/3118770505 shutdown_connections 2024-09-21T01:27:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.275+0000 7f601717d640 1 -- 172.21.15.37:0/3118770505 wait complete. 2024-09-21T01:27:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.277+0000 7f601717d640 1 Processor -- start 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.279+0000 7f601717d640 1 -- start start 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.279+0000 7f601717d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601006af90 0x7f60101a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.279+0000 7f601717d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 0x7f60101a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.279+0000 7f601717d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010f710 0x7f60101a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.279+0000 7f601717d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f601011a1a0 con 0x7f601006af90 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.279+0000 7f601717d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f601011a020 con 0x7f601010a900 2024-09-21T01:27:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.280+0000 7f601717d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f601011a320 con 0x7f601010f710 2024-09-21T01:27:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.280+0000 7f600ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 0x7f60101a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.280+0000 7f600ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 0x7f60101a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:39462/0 (socket says 172.21.15.37:39462) 2024-09-21T01:27:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.280+0000 7f600ffff640 1 -- 172.21.15.37:0/2562391088 learned_addr learned my addr 172.21.15.37:0/2562391088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.281+0000 7f6014f19640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601006af90 0x7f60101a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f601571a640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010f710 0x7f60101a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f600ffff640 1 -- 172.21.15.37:0/2562391088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010f710 msgr2=0x7f60101a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f600ffff640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010f710 0x7f60101a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f600ffff640 1 -- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601006af90 msgr2=0x7f60101a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f600ffff640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601006af90 0x7f60101a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f600ffff640 1 -- 172.21.15.37:0/2562391088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60101a6b40 con 0x7f601010a900 2024-09-21T01:27:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.282+0000 7f601571a640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010f710 0x7f60101a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.287+0000 7f600ffff640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 0x7f60101a1170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f600802d010 tx=0x7f6008003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.288+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008042070 con 0x7f601010a900 2024-09-21T01:27:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.288+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60080319c0 con 0x7f601010a900 2024-09-21T01:27:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.288+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60080047e0 con 0x7f601010a900 2024-09-21T01:27:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.288+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60101a6dd0 con 0x7f601010a900 2024-09-21T01:27:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.288+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60101ad590 con 0x7f601010a900 2024-09-21T01:27:40.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.291+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601010ad50 con 0x7f601010a900 2024-09-21T01:27:40.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.292+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f600803b040 con 0x7f601010a900 2024-09-21T01:27:40.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.293+0000 7f600dffb640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5ff80b6590 0x7f5ff80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:40.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.293+0000 7f6014f19640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5ff80b6590 0x7f5ff80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:40.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.294+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f600810a700 con 0x7f601010a900 2024-09-21T01:27:40.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.294+0000 7f6014f19640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5ff80b6590 0x7f5ff80b8aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6000009990 tx=0x7f6000009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.298+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60080d0f90 con 0x7f601010a900 2024-09-21T01:27:40.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.593+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60101ad7f0 con 0x7f601010a900 2024-09-21T01:27:40.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.594+0000 7f600dffb640 1 -- 172.21.15.37:0/2562391088 <== mon.2 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11977 (secure 0 0 0) 0x7f60080d5370 con 0x7f601010a900 2024-09-21T01:27:40.596 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:27:40.596 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"btime":"2024-09-21T01:27:16:685003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:27:16.608200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:27:40.596 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5ff80b6590 msgr2=0x7f5ff80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5ff80b6590 0x7f5ff80b8aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6000009990 tx=0x7f6000009110 comp rx=0 tx=0).stop 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 msgr2=0x7f60101a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 0x7f60101a1170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f600802d010 tx=0x7f6008003f80 comp rx=0 tx=0).stop 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 shutdown_connections 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f5ff80b6590 0x7f5ff80b8aa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f601010f710 0x7f60101a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f601010a900 0x7f60101a1170 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 --2- 172.21.15.37:0/2562391088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601006af90 0x7f60101a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 >> 172.21.15.37:0/2562391088 conn(0x7f60100712f0 msgr2=0x7f601010bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 shutdown_connections 2024-09-21T01:27:40.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:40.597+0000 7f601717d640 1 -- 172.21.15.37:0/2562391088 wait complete. 2024-09-21T01:27:40.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:40 smithi037 ceph-mon[31105]: pgmap v707: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 95 MiB/s wr, 360 op/s 2024-09-21T01:27:41.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:40 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2562391088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:27:41.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:40 smithi137 ceph-mon[34607]: pgmap v707: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 95 MiB/s wr, 360 op/s 2024-09-21T01:27:41.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:40 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2562391088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:27:41.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:40 smithi144 ceph-mon[34818]: pgmap v707: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 95 MiB/s wr, 360 op/s 2024-09-21T01:27:41.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:40 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2562391088' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:27:41.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:4 damage ls 2024-09-21T01:27:41.764 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 -- 172.21.15.37:0/4113531971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0141100c0 msgr2=0x7fd014112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 --2- 172.21.15.37:0/4113531971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0141100c0 0x7fd014112500 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009ca0 tx=0x7fd00c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 -- 172.21.15.37:0/4113531971 shutdown_connections 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 --2- 172.21.15.37:0/4113531971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0141100c0 0x7fd014112500 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 --2- 172.21.15.37:0/4113531971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd014076100 0x7fd01410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 --2- 172.21.15.37:0/4113531971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 0x7fd014075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 -- 172.21.15.37:0/4113531971 >> 172.21.15.37:0/4113531971 conn(0x7fd01407b850 msgr2=0x7fd01407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 -- 172.21.15.37:0/4113531971 shutdown_connections 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.266+0000 7fd01b384640 1 -- 172.21.15.37:0/4113531971 wait complete. 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 Processor -- start 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 -- start start 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 0x7fd01419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 0x7fd01419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0141100c0 0x7fd0141a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd014115c70 con 0x7fd014076100 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd014115af0 con 0x7fd0141100c0 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.267+0000 7fd01b384640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd014115df0 con 0x7fd0140757b0 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 0x7fd01419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 0x7fd01419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44792/0 (socket says 172.21.15.37:44792) 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 -- 172.21.15.37:0/721266283 learned_addr learned my addr 172.21.15.37:0/721266283 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd019921640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0141100c0 0x7fd0141a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd019120640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 0x7fd01419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 -- 172.21.15.37:0/721266283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 msgr2=0x7fd01419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 0x7fd01419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 -- 172.21.15.37:0/721266283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0141100c0 msgr2=0x7fd0141a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0141100c0 0x7fd0141a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 -- 172.21.15.37:0/721266283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0141a2550 con 0x7fd014076100 2024-09-21T01:27:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd019120640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 0x7fd01419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01891f640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 0x7fd01419cb80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd00400e9c0 tx=0x7fd00400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd00a7fc640 1 -- 172.21.15.37:0/721266283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cd80 con 0x7fd014076100 2024-09-21T01:27:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd00a7fc640 1 -- 172.21.15.37:0/721266283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0040035f0 con 0x7fd014076100 2024-09-21T01:27:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd00a7fc640 1 -- 172.21.15.37:0/721266283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004010690 con 0x7fd014076100 2024-09-21T01:27:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0141a2840 con 0x7fd014076100 2024-09-21T01:27:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.268+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0141a8fa0 con 0x7fd014076100 2024-09-21T01:27:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.271+0000 7fd0218f8740 1 Processor -- start 2024-09-21T01:27:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd00a7fc640 1 -- 172.21.15.37:0/721266283 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd0040037a0 con 0x7fd014076100 2024-09-21T01:27:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 -- start start 2024-09-21T01:27:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb246a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb24be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb25120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555cbfa9aea0 con 0x555cbf77d070 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555cbfa8a2d0 con 0x555cbf75c390 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd0218f8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555cbfa8e0e0 con 0x555cbf7541b0 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb246a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44798/0 (socket says 172.21.15.37:44798) 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 -- 172.21.15.37:0/3345510459 learned_addr learned my addr 172.21.15.37:0/3345510459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd01891f640 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb25120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019120640 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb24be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 -- 172.21.15.37:0/3345510459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 msgr2=0x555cbfb24be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb24be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 -- 172.21.15.37:0/3345510459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 msgr2=0x555cbfb25120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb25120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd019921640 1 -- 172.21.15.37:0/3345510459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cbf7e8650 con 0x555cbf77d070 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.272+0000 7fd01891f640 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb25120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fd019921640 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb246a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd00c02f4c0 tx=0x7fd00c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3098c00e397866 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fcfff7fe640 1 -- 172.21.15.37:0/3345510459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c031cf0 con 0x555cbf77d070 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fd00a7fc640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0000b6590 0x7fd0000b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fcfff7fe640 1 -- 172.21.15.37:0/3345510459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd00c036030 con 0x555cbf77d070 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fcfff7fe640 1 -- 172.21.15.37:0/3345510459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0042a0 con 0x555cbf77d070 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fd019120640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0000b6590 0x7fd0000b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.273+0000 7fd00a7fc640 1 -- 172.21.15.37:0/721266283 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd0040e76d0 con 0x7fd014076100 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 -- 172.21.15.37:0/3345510459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 msgr2=0x555cbfb246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd019120640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0000b6590 0x7fd0000b8aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x555cbfb23320 tx=0x7fd01000b6f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb246a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd00c02f4c0 tx=0x7fd00c009800 comp rx=0 tx=0).stop 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 -- 172.21.15.37:0/3345510459 shutdown_connections 2024-09-21T01:27:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb25120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb24be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3345510459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb246a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 -- 172.21.15.37:0/3345510459 >> 172.21.15.37:0/3345510459 conn(0x555cbf771460 msgr2=0x555cbfb22590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 -- 172.21.15.37:0/3345510459 shutdown_connections 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 -- 172.21.15.37:0/3345510459 wait complete. 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 -- start start 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.274+0000 7fd0218f8740 1 Processor -- start 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf7541b0 0x555cbfb2fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 0x555cbfb30210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb30750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555cbf8eb700 con 0x555cbf75c390 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555cbfa25160 con 0x555cbf7541b0 2024-09-21T01:27:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555cbfb32ca0 con 0x555cbf77d070 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd0218f8740 10 client.0 _ll_register_callbacks cb 0x555cbfa3e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd01891f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 0x555cbfb30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd01891f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 0x555cbfb30210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44812/0 (socket says 172.21.15.37:44812) 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd01891f640 1 -- 172.21.15.37:0/3797476633 learned_addr learned my addr 172.21.15.37:0/3797476633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd019120640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf7541b0 0x555cbfb2fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.275+0000 7fd019921640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb30750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd01891f640 1 -- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 msgr2=0x555cbfb30750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd01891f640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb30750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd01891f640 1 -- 172.21.15.37:0/3797476633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf7541b0 msgr2=0x555cbfb2fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd01891f640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf7541b0 0x555cbfb2fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd01891f640 1 -- 172.21.15.37:0/3797476633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cbfa52c90 con 0x555cbf75c390 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd01891f640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 0x555cbfb30210 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd0040ad560 tx=0x7fd004003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cda755ac137427 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fcffcff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fcffcff9640 1 -- 172.21.15.37:0/3797476633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0040ad370 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fcffcff9640 1 -- 172.21.15.37:0/3797476633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd0040b20a0 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd00c036030 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fcffcff9640 1 -- 172.21.15.37:0/3797476633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd0040adf60 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd0218f8740 10 client.17193 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555cbfb3e990 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.276+0000 7fcffcff9640 1 -- 172.21.15.37:0/3797476633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd00c036030 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fcffcff9640 1 -- 172.21.15.37:0/3797476633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fd0040a91b0 con 0x555cbf75c390 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd0218f8740 10 client.17193 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd0218f8740 10 client.17193 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd0218f8740 20 client.17193 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf73b9f0 0x555cbfb41f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd0218f8740 4 client.17193 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cbfa9cdf0 con 0x555cbf73b9f0 2024-09-21T01:27:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.277+0000 7fd019120640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf73b9f0 0x555cbfb41f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fd019120640 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf73b9f0 0x555cbfb41f70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=82f377ecf0c101ba server_cookie=680c34f4d2a21f25 in_seq=0 out_seq=0 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fcffcff9640 10 client.17193 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fcffcff9640 1 -- 172.21.15.37:0/3797476633 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cbfa9cdf0 con 0x555cbf73b9f0 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fcffcff9640 10 client.17193 handle_command_reply: tid=0 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fd0218f8740 1 client.17193 shutdown 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 msgr2=0x555cbfb30210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.278+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 0x555cbfb30210 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd0040ad560 tx=0x7fd004003cf0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 shutdown_connections 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf73b9f0 0x555cbfb41f70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb30750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf75c390 0x555cbfb30210 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 --2- 172.21.15.37:0/3797476633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf7541b0 0x555cbfb2fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 >> 172.21.15.37:0/3797476633 conn(0x555cbf771460 msgr2=0x555cbfb27880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fcffcff9640 0 client.17193 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:27:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 shutdown_connections 2024-09-21T01:27:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 1 -- 172.21.15.37:0/3797476633 wait complete. 2024-09-21T01:27:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.279+0000 7fd0218f8740 20 client.17193 trim_cache size 0 max 16384 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.292+0000 7fd0218f8740 1 Processor -- start 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.292+0000 7fd0218f8740 1 -- start start 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.292+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 0x555cbfb261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.292+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb31bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb3b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd0218f8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141b1540 con 0x555cbf7541b0 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd0218f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141b30b0 con 0x555cbf75c390 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd0218f8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141b1c10 con 0x555cbf77d070 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 0x555cbfb261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 0x555cbfb261a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44818/0 (socket says 172.21.15.37:44818) 2024-09-21T01:27:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 -- 172.21.15.37:0/1109900498 learned_addr learned my addr 172.21.15.37:0/1109900498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd01891f640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb31bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019921640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb3b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 -- 172.21.15.37:0/1109900498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 msgr2=0x555cbfb3b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb3b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 -- 172.21.15.37:0/1109900498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 msgr2=0x555cbfb31bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb31bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 -- 172.21.15.37:0/1109900498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cbf73bc20 con 0x555cbf7541b0 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019921640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb3b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd01891f640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb31bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fd019120640 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 0x555cbfb261a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd010005fd0 tx=0x7fd010014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea458f8d50973a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fcffeffd640 1 -- 172.21.15.37:0/1109900498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0100211d0 con 0x555cbf7541b0 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fcffeffd640 1 -- 172.21.15.37:0/1109900498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0100035f0 con 0x555cbf7541b0 2024-09-21T01:27:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.293+0000 7fcffeffd640 1 -- 172.21.15.37:0/1109900498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010021760 con 0x555cbf7541b0 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 -- 172.21.15.37:0/1109900498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 msgr2=0x555cbfb261a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 0x555cbfb261a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd010005fd0 tx=0x7fd010014000 comp rx=0 tx=0).stop 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 -- 172.21.15.37:0/1109900498 shutdown_connections 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf77d070 0x555cbfb3b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb31bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 --2- 172.21.15.37:0/1109900498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf7541b0 0x555cbfb261a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 -- 172.21.15.37:0/1109900498 >> 172.21.15.37:0/1109900498 conn(0x555cbf771460 msgr2=0x555cbfb3aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 -- 172.21.15.37:0/1109900498 shutdown_connections 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.294+0000 7fd0218f8740 1 -- 172.21.15.37:0/1109900498 wait complete. 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 -- start start 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 Processor -- start 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb33f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb34460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141b29e0 con 0x555cbf77d070 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141b22e0 con 0x555cbf75c390 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0141af500 con 0x555cbf7541b0 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.295+0000 7fd0218f8740 10 client.0 _ll_register_callbacks cb 0x7fd004003d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019120640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb33f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb349a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44828/0 (socket says 172.21.15.37:44828) 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 -- 172.21.15.37:0/2424298302 learned_addr learned my addr 172.21.15.37:0/2424298302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd01891f640 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb34460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 -- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 msgr2=0x555cbfb33f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb33f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 -- 172.21.15.37:0/2424298302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 msgr2=0x555cbfb34460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb34460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 -- 172.21.15.37:0/2424298302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cbfbab930 con 0x555cbf77d070 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd019921640 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb349a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd00c02f4c0 tx=0x7fd00c031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac16718fba9bffb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fcffcff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fcffcff9640 1 -- 172.21.15.37:0/2424298302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c04a040 con 0x555cbf77d070 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fcffcff9640 1 -- 172.21.15.37:0/2424298302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd00c003970 con 0x555cbf77d070 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.296+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0100035f0 con 0x555cbf77d070 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fcffcff9640 1 -- 172.21.15.37:0/2424298302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd00c009360 con 0x555cbf77d070 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 10 client.17199 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:42.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555cbfbaca60 con 0x555cbf77d070 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fcffcff9640 1 -- 172.21.15.37:0/2424298302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0100035f0 con 0x555cbf77d070 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fcffcff9640 1 -- 172.21.15.37:0/2424298302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fd00c058030 con 0x555cbf77d070 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 10 client.17199 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 10 client.17199 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 20 client.17199 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf710da0 0x555cbfbaf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 4 client.17199 mds_command: new command op to 24604 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 --> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555cbfa988a0 con 0x555cbf710da0 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.297+0000 7fd019120640 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf710da0 0x555cbfbaf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fcffcff9640 10 client.17199 ms_handle_connect on v2:172.21.15.144:6834/3565351680 2024-09-21T01:27:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd019120640 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf710da0 0x555cbfbaf040 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=80512bfc20fafa02 server_cookie=2765c97979861555 in_seq=0 out_seq=0 2024-09-21T01:27:42.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fcffcff9640 1 -- 172.21.15.37:0/2424298302 <== mds.4 v2:172.21.15.144:6834/3565351680 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555cbfa988a0 con 0x555cbf710da0 2024-09-21T01:27:42.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fcffcff9640 10 client.17199 handle_command_reply: tid=0 2024-09-21T01:27:42.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 client.17199 shutdown 2024-09-21T01:27:42.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 msgr2=0x555cbfb349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb349a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd00c02f4c0 tx=0x7fd00c031680 comp rx=0 tx=0).stop 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 shutdown_connections 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:6834/3565351680,v1:172.21.15.144:6835/3565351680] conn(0x555cbf710da0 0x555cbfbaf040 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cbf77d070 0x555cbfb349a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555cbf75c390 0x555cbfb34460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fcffcff9640 0 client.17199 ms_handle_reset on v2:172.21.15.144:6834/3565351680 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 --2- 172.21.15.37:0/2424298302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555cbf7541b0 0x555cbfb33f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.298+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 >> 172.21.15.37:0/2424298302 conn(0x555cbf771460 msgr2=0x555cbfb3aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 shutdown_connections 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd0218f8740 1 -- 172.21.15.37:0/2424298302 wait complete. 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd0218f8740 20 client.17199 trim_cache size 0 max 16384 2024-09-21T01:27:42.304 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0000b6590 msgr2=0x7fd0000b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0000b6590 0x7fd0000b8aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x555cbfb23320 tx=0x7fd01000b6f0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 msgr2=0x7fd01419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 0x7fd01419cb80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd00400e9c0 tx=0x7fd00400ee80 comp rx=0 tx=0).stop 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 shutdown_connections 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd0000b6590 0x7fd0000b8aa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0141100c0 0x7fd0141a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd014076100 0x7fd01419cb80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 --2- 172.21.15.37:0/721266283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0140757b0 0x7fd01419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:42.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 >> 172.21.15.37:0/721266283 conn(0x7fd01407b850 msgr2=0x7fd014109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:42.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.299+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 shutdown_connections 2024-09-21T01:27:42.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:42.300+0000 7fd01b384640 1 -- 172.21.15.37:0/721266283 wait complete. 2024-09-21T01:27:42.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:42 smithi037 ceph-mon[31105]: pgmap v708: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 MiB/s wr, 350 op/s 2024-09-21T01:27:43.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:3 damage ls 2024-09-21T01:27:43.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:42 smithi137 ceph-mon[34607]: pgmap v708: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 MiB/s wr, 350 op/s 2024-09-21T01:27:43.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:42 smithi144 ceph-mon[34818]: pgmap v708: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 MiB/s wr, 350 op/s 2024-09-21T01:27:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 -- 172.21.15.37:0/2593089583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 msgr2=0x7ff92c10d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 --2- 172.21.15.37:0/2593089583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c10d8b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff914009900 tx=0x7ff91402a410 comp rx=0 tx=0).stop 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 -- 172.21.15.37:0/2593089583 shutdown_connections 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 --2- 172.21.15.37:0/2593089583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff92c10ddf0 0x7ff92c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 --2- 172.21.15.37:0/2593089583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c10d8b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 --2- 172.21.15.37:0/2593089583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92c104840 0x7ff92c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 -- 172.21.15.37:0/2593089583 >> 172.21.15.37:0/2593089583 conn(0x7ff92c079730 msgr2=0x7ff92c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 -- 172.21.15.37:0/2593089583 shutdown_connections 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.951+0000 7ff93234d640 1 -- 172.21.15.37:0/2593089583 wait complete. 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 Processor -- start 2024-09-21T01:27:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 -- start start 2024-09-21T01:27:43.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92c104840 0x7ff92c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff92c10ddf0 0x7ff92c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c113a70 con 0x7ff92c105270 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1138f0 con 0x7ff92c104840 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.952+0000 7ff93234d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c113bf0 con 0x7ff92c10ddf0 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44852/0 (socket says 172.21.15.37:44852) 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 -- 172.21.15.37:0/1141689954 learned_addr learned my addr 172.21.15.37:0/1141689954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff92bfff640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92c104840 0x7ff92c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff9308ea640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff92c10ddf0 0x7ff92c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 -- 172.21.15.37:0/1141689954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff92c10ddf0 msgr2=0x7ff92c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff92c10ddf0 0x7ff92c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 -- 172.21.15.37:0/1141689954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92c104840 msgr2=0x7ff92c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92c104840 0x7ff92c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 -- 172.21.15.37:0/1141689954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c1a0470 con 0x7ff92c105270 2024-09-21T01:27:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff923fff640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c19aaa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff914006010 tx=0x7ff914004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff929ffb640 1 -- 172.21.15.37:0/1141689954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91403f030 con 0x7ff92c105270 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff929ffb640 1 -- 172.21.15.37:0/1141689954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff914003aa0 con 0x7ff92c105270 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff929ffb640 1 -- 172.21.15.37:0/1141689954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914035070 con 0x7ff92c105270 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.953+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c1a0700 con 0x7ff92c105270 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.954+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92c1a6ec0 con 0x7ff92c105270 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.956+0000 7ff9388c1740 1 Processor -- start 2024-09-21T01:27:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.956+0000 7ff929ffb640 1 -- 172.21.15.37:0/1141689954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff914042030 con 0x7ff92c105270 2024-09-21T01:27:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.956+0000 7ff9388c1740 1 -- start start 2024-09-21T01:27:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 0x564db2c186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c18be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c19120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9388c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564db2b8eea0 con 0x564db2871070 2024-09-21T01:27:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9388c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564db2b7e2d0 con 0x564db2850390 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9388c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564db2b820e0 con 0x564db28481b0 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 0x564db2c186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 0x564db2c186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44868/0 (socket says 172.21.15.37:44868) 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 -- 172.21.15.37:0/1919065948 learned_addr learned my addr 172.21.15.37:0/1919065948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff923fff640 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c19120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff92bfff640 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c18be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 -- 172.21.15.37:0/1919065948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 msgr2=0x564db2c18be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c18be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 -- 172.21.15.37:0/1919065948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 msgr2=0x564db2c19120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c19120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 -- 172.21.15.37:0/1919065948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564db28dc650 con 0x564db2871070 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff923fff640 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c19120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff9308ea640 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 0x564db2c186a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff924009f50 tx=0x7ff9240118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57912b469948d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.957+0000 7ff929ffb640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff9180b6510 0x7ff9180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.958+0000 7ff92bfff640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff9180b6510 0x7ff9180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.958+0000 7ff9227fc640 1 -- 172.21.15.37:0/1919065948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924004d20 con 0x564db2871070 2024-09-21T01:27:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.958+0000 7ff929ffb640 1 -- 172.21.15.37:0/1141689954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff914107380 con 0x7ff92c105270 2024-09-21T01:27:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.958+0000 7ff9227fc640 1 -- 172.21.15.37:0/1919065948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff924004050 con 0x564db2871070 2024-09-21T01:27:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.958+0000 7ff9227fc640 1 -- 172.21.15.37:0/1919065948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924005280 con 0x564db2871070 2024-09-21T01:27:43.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 -- 172.21.15.37:0/1919065948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 msgr2=0x564db2c186a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 0x564db2c186a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff924009f50 tx=0x7ff9240118d0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff92bfff640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff9180b6510 0x7ff9180b8a20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x564db2c17320 tx=0x7ff91c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 -- 172.21.15.37:0/1919065948 shutdown_connections 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c19120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c18be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 --2- 172.21.15.37:0/1919065948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2871070 0x564db2c186a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 -- 172.21.15.37:0/1919065948 >> 172.21.15.37:0/1919065948 conn(0x564db2865460 msgr2=0x564db2c16590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 -- 172.21.15.37:0/1919065948 shutdown_connections 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 -- 172.21.15.37:0/1919065948 wait complete. 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 -- start start 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.959+0000 7ff9388c1740 1 Processor -- start 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c23dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 0x564db2c24300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c30170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564db29df700 con 0x564db2850390 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564db2b19160 con 0x564db2871070 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564db2c26e80 con 0x564db28481b0 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9388c1740 10 client.0 _ll_register_callbacks cb 0x564db2b329e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 0x564db2c24300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 0x564db2c24300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44878/0 (socket says 172.21.15.37:44878) 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 -- 172.21.15.37:0/3474579255 learned_addr learned my addr 172.21.15.37:0/3474579255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff9308ea640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c30170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff92bfff640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c23dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 -- 172.21.15.37:0/3474579255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 msgr2=0x564db2c23dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c23dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 -- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 msgr2=0x564db2c30170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c30170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 -- 172.21.15.37:0/3474579255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564db2b46c90 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff923fff640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 0x564db2c24300 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff914031440 tx=0x7ff91402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7001688b1920ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.960+0000 7ff90b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3474579255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914049040 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3474579255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff9140d6ca0 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff924004050 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3474579255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff9140c9460 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 10 client.17211 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564db2c32bf0 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3474579255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff924004050 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3474579255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7ff9140cc920 con 0x564db2850390 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 10 client.17211 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:43.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 10 client.17211 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 20 client.17211 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db282f9f0 0x564db2c36180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 4 client.17211 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.961+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564db2b90df0 con 0x564db282f9f0 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.962+0000 7ff92bfff640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db282f9f0 0x564db2c36180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.962+0000 7ff90b7fe640 10 client.17211 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:27:43.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.962+0000 7ff92bfff640 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db282f9f0 0x564db2c36180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e2fded718debf5a server_cookie=5de8f5e55b2cebc4 in_seq=0 out_seq=0 2024-09-21T01:27:43.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3474579255 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564db2b90df0 con 0x564db282f9f0 2024-09-21T01:27:43.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff90b7fe640 10 client.17211 handle_command_reply: tid=0 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 client.17211 shutdown 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 msgr2=0x564db2c24300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 0x564db2c24300 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff914031440 tx=0x7ff91402a410 comp rx=0 tx=0).stop 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 shutdown_connections 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db282f9f0 0x564db2c36180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c30170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db2850390 0x564db2c24300 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff90b7fe640 0 client.17211 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3474579255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db28481b0 0x564db2c23dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.963+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 >> 172.21.15.37:0/3474579255 conn(0x564db2865460 msgr2=0x564db2c1b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.964+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 shutdown_connections 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.964+0000 7ff9388c1740 1 -- 172.21.15.37:0/3474579255 wait complete. 2024-09-21T01:27:43.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.964+0000 7ff9388c1740 20 client.17211 trim_cache size 0 max 16384 2024-09-21T01:27:43.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 Processor -- start 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 -- start start 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c24280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c30070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2871070 0x564db2c20fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1af4d0 con 0x564db28481b0 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1b1040 con 0x564db2850390 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff9388c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1afba0 con 0x564db2871070 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c24280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c24280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44884/0 (socket says 172.21.15.37:44884) 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.977+0000 7ff92bfff640 1 -- 172.21.15.37:0/2576202021 learned_addr learned my addr 172.21.15.37:0/2576202021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff923fff640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c30070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff9308ea640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2871070 0x564db2c20fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff92bfff640 1 -- 172.21.15.37:0/2576202021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2871070 msgr2=0x564db2c20fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff92bfff640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2871070 0x564db2c20fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff92bfff640 1 -- 172.21.15.37:0/2576202021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 msgr2=0x564db2c30070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff92bfff640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c30070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff92bfff640 1 -- 172.21.15.37:0/2576202021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564db2c1a990 con 0x564db28481b0 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff923fff640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c30070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff9308ea640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2871070 0x564db2c20fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff92bfff640 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c24280 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff91c005fd0 tx=0x7ff91c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dff382e2592667 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff921ffb640 1 -- 172.21.15.37:0/2576202021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c005020 con 0x564db28481b0 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff921ffb640 1 -- 172.21.15.37:0/2576202021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff91c0047a0 con 0x564db28481b0 2024-09-21T01:27:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.978+0000 7ff921ffb640 1 -- 172.21.15.37:0/2576202021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c028630 con 0x564db28481b0 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 -- 172.21.15.37:0/2576202021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 msgr2=0x564db2c24280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c24280 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff91c005fd0 tx=0x7ff91c015000 comp rx=0 tx=0).stop 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 -- 172.21.15.37:0/2576202021 shutdown_connections 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2871070 0x564db2c20fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2850390 0x564db2c30070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 --2- 172.21.15.37:0/2576202021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c24280 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 -- 172.21.15.37:0/2576202021 >> 172.21.15.37:0/2576202021 conn(0x564db2865460 msgr2=0x564db2c23b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 -- 172.21.15.37:0/2576202021 shutdown_connections 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 -- 172.21.15.37:0/2576202021 wait complete. 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.979+0000 7ff9388c1740 1 -- start start 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 Processor -- start 2024-09-21T01:27:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2850390 0x564db2c285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c28b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1b0970 con 0x564db28481b0 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1b0270 con 0x564db2871070 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c1ad490 con 0x564db2850390 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff9388c1740 10 client.0 _ll_register_callbacks cb 0x7ff914005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c280a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44890/0 (socket says 172.21.15.37:44890) 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff92bfff640 1 -- 172.21.15.37:0/3973671092 learned_addr learned my addr 172.21.15.37:0/3973671092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.980+0000 7ff923fff640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2850390 0x564db2c285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff92bfff640 1 -- 172.21.15.37:0/3973671092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2850390 msgr2=0x564db2c285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff92bfff640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2850390 0x564db2c285e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff9308ea640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c28b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff92bfff640 1 -- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 msgr2=0x564db2c28b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff92bfff640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c28b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff92bfff640 1 -- 172.21.15.37:0/3973671092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564db2c9fb20 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff9308ea640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c28b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff92bfff640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c280a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0049a0 tx=0x7ff91c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bc555812207240 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff90b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3973671092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c005200 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3973671092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff91c0053a0 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff91c0047a0 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3973671092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff91c004e00 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff9388c1740 10 client.17217 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564db2ca0d40 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.981+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3973671092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff91c0047a0 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3973671092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7ff91c019040 con 0x564db28481b0 2024-09-21T01:27:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff9388c1740 10 client.17217 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff9388c1740 10 client.17217 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff9388c1740 20 client.17217 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db2804da0 0x564db2ca3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff9388c1740 4 client.17217 mds_command: new command op to 24605 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 --> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564db2b8c8a0 con 0x564db2804da0 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff923fff640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db2804da0 0x564db2ca3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff90b7fe640 10 client.17217 ms_handle_connect on v2:172.21.15.137:6836/234673492 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.982+0000 7ff923fff640 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db2804da0 0x564db2ca3520 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=10311bbdcf64912f server_cookie=3f21f587a076555f in_seq=0 out_seq=0 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff90b7fe640 1 -- 172.21.15.37:0/3973671092 <== mds.3 v2:172.21.15.137:6836/234673492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564db2b8c8a0 con 0x564db2804da0 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff90b7fe640 10 client.17217 handle_command_reply: tid=0 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 client.17217 shutdown 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 msgr2=0x564db2c280a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c280a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0049a0 tx=0x7ff91c0049d0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 shutdown_connections 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:6836/234673492,v1:172.21.15.137:6837/234673492] conn(0x564db2804da0 0x564db2ca3520 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564db2871070 0x564db2c28b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564db2850390 0x564db2c285e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff90b7fe640 0 client.17217 ms_handle_reset on v2:172.21.15.137:6836/234673492 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 --2- 172.21.15.37:0/3973671092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564db28481b0 0x564db2c280a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 >> 172.21.15.37:0/3973671092 conn(0x564db2865460 msgr2=0x564db2c25270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 shutdown_connections 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 1 -- 172.21.15.37:0/3973671092 wait complete. 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.983+0000 7ff9388c1740 20 client.17217 trim_cache size 0 max 16384 2024-09-21T01:27:43.989 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff9180b6510 msgr2=0x7ff9180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff9180b6510 0x7ff9180b8a20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x564db2c17320 tx=0x7ff91c00b410 comp rx=0 tx=0).stop 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 msgr2=0x7ff92c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c19aaa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff914006010 tx=0x7ff914004060 comp rx=0 tx=0).stop 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 shutdown_connections 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff9180b6510 0x7ff9180b8a20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff92c10ddf0 0x7ff92c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff92c105270 0x7ff92c19aaa0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 --2- 172.21.15.37:0/1141689954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff92c104840 0x7ff92c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 >> 172.21.15.37:0/1141689954 conn(0x7ff92c079730 msgr2=0x7ff92c0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 shutdown_connections 2024-09-21T01:27:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:43.984+0000 7ff93234d640 1 -- 172.21.15.37:0/1141689954 wait complete. 2024-09-21T01:27:44.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T01:27:44.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:44 smithi037 ceph-mon[31105]: pgmap v709: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 MiB/s wr, 391 op/s 2024-09-21T01:27:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:45.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:44 smithi137 ceph-mon[34607]: pgmap v709: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 MiB/s wr, 391 op/s 2024-09-21T01:27:45.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:44 smithi144 ceph-mon[34818]: pgmap v709: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 MiB/s wr, 391 op/s 2024-09-21T01:27:45.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4006874437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b4102a70 msgr2=0x7f02b4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4006874437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b4102a70 0x7f02b4102e80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009900 tx=0x7f02a402a410 comp rx=0 tx=0).stop 2024-09-21T01:27:45.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4006874437 shutdown_connections 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4006874437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b4108d00 0x7f02b410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4006874437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b41083b0 0x7f02b41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4006874437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b4102a70 0x7f02b4102e80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4006874437 >> 172.21.15.37:0/4006874437 conn(0x7f02b4079730 msgr2=0x7f02b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4006874437 shutdown_connections 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.549+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4006874437 wait complete. 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.550+0000 7f02b9fc3640 1 Processor -- start 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.550+0000 7f02b9fc3640 1 -- start start 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b9fc3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b4102a70 0x7f02b410ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b9fc3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 0x7f02b4110500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b9fc3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b4108d00 0x7f02b4110a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b9fc3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4113a90 con 0x7f02b41083b0 2024-09-21T01:27:45.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b9fc3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4113910 con 0x7f02b4102a70 2024-09-21T01:27:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b9fc3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4113c10 con 0x7f02b4108d00 2024-09-21T01:27:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 0x7f02b4110500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 0x7f02b4110500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44916/0 (socket says 172.21.15.37:44916) 2024-09-21T01:27:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 -- 172.21.15.37:0/4170426310 learned_addr learned my addr 172.21.15.37:0/4170426310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b3fff640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b4108d00 0x7f02b4110a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b37fe640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b4102a70 0x7f02b410ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 -- 172.21.15.37:0/4170426310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b4108d00 msgr2=0x7f02b4110a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b4108d00 0x7f02b4110a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 -- 172.21.15.37:0/4170426310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b4102a70 msgr2=0x7f02b410ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b4102a70 0x7f02b410ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 -- 172.21.15.37:0/4170426310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b41a8720 con 0x7f02b41083b0 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b3fff640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b4108d00 0x7f02b4110a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.551+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 0x7f02b4110500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f02a8005fd0 tx=0x7f02a800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.552+0000 7f02b0ff9640 1 -- 172.21.15.37:0/4170426310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8017070 con 0x7f02b41083b0 2024-09-21T01:27:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.552+0000 7f02b0ff9640 1 -- 172.21.15.37:0/4170426310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a8009c30 con 0x7f02b41083b0 2024-09-21T01:27:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.552+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b41a8a10 con 0x7f02b41083b0 2024-09-21T01:27:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.552+0000 7f02b0ff9640 1 -- 172.21.15.37:0/4170426310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8003d30 con 0x7f02b41083b0 2024-09-21T01:27:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.552+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b41a8f50 con 0x7f02b41083b0 2024-09-21T01:27:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.555+0000 7f02c0537740 1 Processor -- start 2024-09-21T01:27:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.555+0000 7f02c0537740 1 -- start start 2024-09-21T01:27:45.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02c0537740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02c0537740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02c0537740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02c0537740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f7d42cea0 con 0x558f7d0ee390 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02c0537740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558f7d41c2d0 con 0x558f7d0e61b0 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02c0537740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558f7d4200e0 con 0x558f7d10f070 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b0ff9640 1 -- 172.21.15.37:0/4170426310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f02a8010460 con 0x7f02b41083b0 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59422/0 (socket says 172.21.15.37:59422) 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.37:47514/0 (socket says 172.21.15.37:47514) 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 -- 172.21.15.37:0/490632727 learned_addr learned my addr 172.21.15.37:0/490632727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 -- 172.21.15.37:0/490632727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 msgr2=0x558f7d4b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 -- 172.21.15.37:0/490632727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 msgr2=0x558f7d4b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b3fff640 1 -- 172.21.15.37:0/490632727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7d17a650 con 0x558f7d10f070 2024-09-21T01:27:45.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.556+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f02b3fff640 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4b62c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f02ac010710 tx=0x7f02ac010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35bbec94b2635c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f0299ffb640 1 -- 172.21.15.37:0/490632727 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00e8d0 con 0x558f7d10f070 2024-09-21T01:27:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f02b0ff9640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f029c0b6510 0x7f029c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f0299ffb640 1 -- 172.21.15.37:0/490632727 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ac012450 con 0x558f7d10f070 2024-09-21T01:27:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f0299ffb640 1 -- 172.21.15.37:0/490632727 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac01c670 con 0x558f7d10f070 2024-09-21T01:27:45.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f02b37fe640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f029c0b6510 0x7f029c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.557+0000 7f02b0ff9640 1 -- 172.21.15.37:0/4170426310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f02a80e6f90 con 0x7f02b41083b0 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 -- 172.21.15.37:0/490632727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 msgr2=0x558f7d4b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4b62c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f02ac010710 tx=0x7f02ac010bd0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02b37fe640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f029c0b6510 0x7f029c0b8a20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f02a4000c00 tx=0x7f02a4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 -- 172.21.15.37:0/490632727 shutdown_connections 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 --2- 172.21.15.37:0/490632727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4b62c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 -- 172.21.15.37:0/490632727 >> 172.21.15.37:0/490632727 conn(0x558f7d103460 msgr2=0x558f7d4b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.558+0000 7f02c0537740 1 -- 172.21.15.37:0/490632727 shutdown_connections 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.559+0000 7f02c0537740 1 -- 172.21.15.37:0/490632727 wait complete. 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.559+0000 7f02c0537740 1 -- start start 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.559+0000 7f02c0537740 1 Processor -- start 2024-09-21T01:27:45.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.559+0000 7f02c0537740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4c1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.559+0000 7f02c0537740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.559+0000 7f02c0537740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02c0537740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f7d27d700 con 0x558f7d0ee390 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54140/0 (socket says 172.21.15.37:54140) 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b2ffd640 1 -- 172.21.15.37:0/2620180526 learned_addr learned my addr 172.21.15.37:0/2620180526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558f7d3b7160 con 0x558f7d0e61b0 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558f7d4c4aa0 con 0x558f7d10f070 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b3fff640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02c0537740 10 client.0 _ll_register_callbacks cb 0x558f7d3d09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b37fe640 1 -- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 msgr2=0x558f7d4cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b37fe640 1 -- 172.21.15.37:0/2620180526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 msgr2=0x558f7d4c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b37fe640 1 -- 172.21.15.37:0/2620180526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7d3e4c90 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.560+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4c1950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f02b4111a10 tx=0x7f02a4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16bc43f8e93469f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f0292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f0292ffd640 1 -- 172.21.15.37:0/2620180526 <== mon.2 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a404c070 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02ac012450 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f0292ffd640 1 -- 172.21.15.37:0/2620180526 <== mon.2 v2:172.21.15.137:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f02a4005030 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f0292ffd640 1 -- 172.21.15.37:0/2620180526 <== mon.2 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f02a4058050 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f02c0537740 10 client.26615 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558f7d4d07d0 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f0292ffd640 1 -- 172.21.15.37:0/2620180526 <== mon.2 v2:172.21.15.137:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ac012450 con 0x558f7d0e61b0 2024-09-21T01:27:45.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.561+0000 7f0292ffd640 1 -- 172.21.15.37:0/2620180526 <== mon.2 v2:172.21.15.137:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f02a40035f0 con 0x558f7d0e61b0 2024-09-21T01:27:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02c0537740 10 client.26615 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02c0537740 10 client.26615 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:27:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02c0537740 20 client.26615 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02c0537740 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0cd9f0 0x558f7d4d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02c0537740 4 client.26615 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:45.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f7d42edf0 con 0x558f7d0cd9f0 2024-09-21T01:27:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0cd9f0 0x558f7d4d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f0292ffd640 10 client.26615 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:27:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.562+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0cd9f0 0x558f7d4d3c30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d900a5240eb4977c server_cookie=8ecb31e2c145b0fc in_seq=0 out_seq=0 2024-09-21T01:27:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f0292ffd640 1 -- 172.21.15.37:0/2620180526 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f7d42edf0 con 0x558f7d0cd9f0 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f0292ffd640 10 client.26615 handle_command_reply: tid=0 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 client.26615 shutdown 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 msgr2=0x558f7d4c1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4c1950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f02b4111a10 tx=0x7f02a4009260 comp rx=0 tx=0).stop 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 shutdown_connections 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0cd9f0 0x558f7d4d3c30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0ee390 0x558f7d4c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 --2- 172.21.15.37:0/2620180526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0e61b0 0x558f7d4c1950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 >> 172.21.15.37:0/2620180526 conn(0x558f7d103460 msgr2=0x558f7d4b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.563+0000 7f0292ffd640 0 client.26615 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.564+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 shutdown_connections 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.564+0000 7f02c0537740 1 -- 172.21.15.37:0/2620180526 wait complete. 2024-09-21T01:27:45.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.564+0000 7f02c0537740 20 client.26615 trim_cache size 0 max 16384 2024-09-21T01:27:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 Processor -- start 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 -- start start 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d0ee390 0x558f7d4b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d10f070 0x558f7d4b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b1640 con 0x558f7d0e61b0 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b31b0 con 0x558f7d10f070 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02c0537740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b1d10 con 0x558f7d0ee390 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54142/0 (socket says 172.21.15.37:54142) 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02b37fe640 1 -- 172.21.15.37:0/2353742010 learned_addr learned my addr 172.21.15.37:0/2353742010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.589+0000 7f02b3fff640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d10f070 0x558f7d4b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d0ee390 0x558f7d4b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b37fe640 1 -- 172.21.15.37:0/2353742010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d0ee390 msgr2=0x558f7d4b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d0ee390 0x558f7d4b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b37fe640 1 -- 172.21.15.37:0/2353742010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d10f070 msgr2=0x558f7d4b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d10f070 0x558f7d4b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b37fe640 1 -- 172.21.15.37:0/2353742010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7d4bc5f0 con 0x558f7d0e61b0 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b3fff640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d10f070 0x558f7d4b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d0ee390 0x558f7d4b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02b37fe640 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4c3580 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009900 tx=0x7f02a40318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcde34fe4d6034c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02997fa640 1 -- 172.21.15.37:0/2353742010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a404c070 con 0x558f7d0e61b0 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02997fa640 1 -- 172.21.15.37:0/2353742010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a40054e0 con 0x558f7d0e61b0 2024-09-21T01:27:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.590+0000 7f02997fa640 1 -- 172.21.15.37:0/2353742010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4035040 con 0x558f7d0e61b0 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 -- 172.21.15.37:0/2353742010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 msgr2=0x558f7d4c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4c3580 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009900 tx=0x7f02a40318c0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 -- 172.21.15.37:0/2353742010 shutdown_connections 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d10f070 0x558f7d4b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d0ee390 0x558f7d4b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 --2- 172.21.15.37:0/2353742010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4c3580 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.591+0000 7f02c0537740 1 -- 172.21.15.37:0/2353742010 >> 172.21.15.37:0/2353742010 conn(0x558f7d103460 msgr2=0x558f7d4c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.592+0000 7f02c0537740 1 -- 172.21.15.37:0/2353742010 shutdown_connections 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.592+0000 7f02c0537740 1 -- 172.21.15.37:0/2353742010 wait complete. 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.592+0000 7f02c0537740 1 -- start start 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.592+0000 7f02c0537740 1 Processor -- start 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0ee390 0x558f7d4c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b2ae0 con 0x558f7d0e61b0 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b23e0 con 0x558f7d0ee390 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41af600 con 0x558f7d10f070 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02c0537740 10 client.0 _ll_register_callbacks cb 0x7f02a4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54148/0 (socket says 172.21.15.37:54148) 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 -- 172.21.15.37:0/1065055870 learned_addr learned my addr 172.21.15.37:0/1065055870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0ee390 0x558f7d4c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b3fff640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 -- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 msgr2=0x558f7d4c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 -- 172.21.15.37:0/1065055870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0ee390 msgr2=0x558f7d4c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0ee390 0x558f7d4c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 -- 172.21.15.37:0/1065055870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7d4b8b00 con 0x558f7d0e61b0 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f02b37fe640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4ca710 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f02a4032da0 tx=0x7f02a4003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6249f202406cb65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.593+0000 7f0292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f0292ffd640 1 -- 172.21.15.37:0/1065055870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4068020 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f0292ffd640 1 -- 172.21.15.37:0/1065055870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f02a4051440 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02a40054e0 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f0292ffd640 1 -- 172.21.15.37:0/1065055870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f02a404c040 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 10 client.17235 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558f7d53e550 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f0292ffd640 1 -- 172.21.15.37:0/1065055870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a40054e0 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f0292ffd640 1 -- 172.21.15.37:0/1065055870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f02a4048710 con 0x558f7d0e61b0 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 10 client.17235 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 10 client.17235 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 20 client.17235 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.594+0000 7f02c0537740 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0a2da0 0x558f7d540b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.595+0000 7f02c0537740 4 client.17235 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:27:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.595+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 --> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f7d4bd500 con 0x558f7d0a2da0 2024-09-21T01:27:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.595+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0a2da0 0x558f7d540b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.595+0000 7f0292ffd640 10 client.17235 ms_handle_connect on v2:172.21.15.144:6836/3444337683 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.595+0000 7f02b2ffd640 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0a2da0 0x558f7d540b70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f9fb5145dd644b4 server_cookie=a71320b2954583aa in_seq=0 out_seq=0 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f0292ffd640 1 -- 172.21.15.37:0/1065055870 <== mds.2 v2:172.21.15.144:6836/3444337683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f7d4bd500 con 0x558f7d0a2da0 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f0292ffd640 10 client.17235 handle_command_reply: tid=0 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 client.17235 shutdown 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 msgr2=0x558f7d4ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4ca710 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f02a4032da0 tx=0x7f02a4003660 comp rx=0 tx=0).stop 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 shutdown_connections 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:6836/3444337683,v1:172.21.15.144:6837/3444337683] conn(0x558f7d0a2da0 0x558f7d540b70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f7d10f070 0x558f7d4c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f7d0ee390 0x558f7d4c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f0292ffd640 0 client.17235 ms_handle_reset on v2:172.21.15.144:6836/3444337683 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 --2- 172.21.15.37:0/1065055870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f7d0e61b0 0x558f7d4ca710 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 >> 172.21.15.37:0/1065055870 conn(0x558f7d103460 msgr2=0x558f7d4c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 shutdown_connections 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 1 -- 172.21.15.37:0/1065055870 wait complete. 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.596+0000 7f02c0537740 20 client.17235 trim_cache size 0 max 16384 2024-09-21T01:27:45.601 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f029c0b6510 msgr2=0x7f029c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f029c0b6510 0x7f029c0b8a20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f02a4000c00 tx=0x7f02a4031400 comp rx=0 tx=0).stop 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 msgr2=0x7f02b4110500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 0x7f02b4110500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f02a8005fd0 tx=0x7f02a800dde0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 shutdown_connections 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f029c0b6510 0x7f029c0b8a20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02b4108d00 0x7f02b4110a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b41083b0 0x7f02b4110500 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 --2- 172.21.15.37:0/4170426310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02b4102a70 0x7f02b410ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 >> 172.21.15.37:0/4170426310 conn(0x7f02b4079730 msgr2=0x7f02b4101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 shutdown_connections 2024-09-21T01:27:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:45.597+0000 7f02b9fc3640 1 -- 172.21.15.37:0/4170426310 wait complete. 2024-09-21T01:27:46.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T01:27:46.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:46 smithi037 ceph-mon[31105]: pgmap v710: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 88 MiB/s wr, 474 op/s 2024-09-21T01:27:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:47.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:46 smithi137 ceph-mon[34607]: pgmap v710: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 88 MiB/s wr, 474 op/s 2024-09-21T01:27:47.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:46 smithi144 ceph-mon[34818]: pgmap v710: 97 pgs: 97 active+clean; 8.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 88 MiB/s wr, 474 op/s 2024-09-21T01:27:47.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 -- 172.21.15.37:0/4102836803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 msgr2=0x7f10a01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/4102836803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a01087e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1094009900 tx=0x7f109402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 -- 172.21.15.37:0/4102836803 shutdown_connections 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/4102836803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 0x7f10a010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/4102836803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a01087e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/4102836803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a0102ae0 0x7f10a0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 -- 172.21.15.37:0/4102836803 >> 172.21.15.37:0/4102836803 conn(0x7f10a0079760 msgr2=0x7f10a0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 -- 172.21.15.37:0/4102836803 shutdown_connections 2024-09-21T01:27:47.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.571+0000 7f10a5ff2640 1 -- 172.21.15.37:0/4102836803 wait complete. 2024-09-21T01:27:47.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.572+0000 7f10a5ff2640 1 Processor -- start 2024-09-21T01:27:47.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.572+0000 7f10a5ff2640 1 -- start start 2024-09-21T01:27:47.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f10a5ff2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a0102ae0 0x7f10a019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f10a5ff2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f10a5ff2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 0x7f10a019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f10a5ff2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0112990 con 0x7f10a01083d0 2024-09-21T01:27:47.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f10a5ff2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0112810 con 0x7f10a0108d20 2024-09-21T01:27:47.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f10a5ff2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0112b10 con 0x7f10a0102ae0 2024-09-21T01:27:47.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a019b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54170/0 (socket says 172.21.15.37:54170) 2024-09-21T01:27:47.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 -- 172.21.15.37:0/858161291 learned_addr learned my addr 172.21.15.37:0/858161291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:47.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109f7fe640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a0102ae0 0x7f10a019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109ffff640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 0x7f10a019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 -- 172.21.15.37:0/858161291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a0102ae0 msgr2=0x7f10a019b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a0102ae0 0x7f10a019b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 -- 172.21.15.37:0/858161291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 msgr2=0x7f10a019bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 0x7f10a019bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109effd640 1 -- 172.21.15.37:0/858161291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a01a64c0 con 0x7f10a01083d0 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.573+0000 7f109ffff640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 0x7f10a019bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.574+0000 7f109effd640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a019b800 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1094032fd0 tx=0x7f1094004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.574+0000 7f109cff9640 1 -- 172.21.15.37:0/858161291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109403f030 con 0x7f10a01083d0 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.574+0000 7f109cff9640 1 -- 172.21.15.37:0/858161291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094004490 con 0x7f10a01083d0 2024-09-21T01:27:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.574+0000 7f109cff9640 1 -- 172.21.15.37:0/858161291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094035070 con 0x7f10a01083d0 2024-09-21T01:27:47.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.574+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a01a6750 con 0x7f10a01083d0 2024-09-21T01:27:47.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.574+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a01a6c30 con 0x7f10a01083d0 2024-09-21T01:27:47.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.576+0000 7f10ac566740 1 Processor -- start 2024-09-21T01:27:47.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 -- start start 2024-09-21T01:27:47.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109cff9640 1 -- 172.21.15.37:0/858161291 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1094042030 con 0x7f10a01083d0 2024-09-21T01:27:47.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 0x55a2c930a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c930abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c930b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2c9280ea0 con 0x55a2c8f63070 2024-09-21T01:27:47.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a2c92702d0 con 0x55a2c8f42390 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f10ac566740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a2c92740e0 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 0x55a2c930a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 0x55a2c930a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54176/0 (socket says 172.21.15.37:54176) 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 -- 172.21.15.37:0/710664031 learned_addr learned my addr 172.21.15.37:0/710664031 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109effd640 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c930b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109f7fe640 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c930abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 -- 172.21.15.37:0/710664031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 msgr2=0x55a2c930abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c930abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 -- 172.21.15.37:0/710664031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 msgr2=0x55a2c930b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c930b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109ffff640 1 -- 172.21.15.37:0/710664031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c8fce650 con 0x55a2c8f63070 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.577+0000 7f109effd640 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c930b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f109ffff640 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 0x55a2c930a6a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f109800f410 tx=0x7f109800f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504f08f5a86f9070 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f1085ffb640 1 -- 172.21.15.37:0/710664031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098015070 con 0x55a2c8f63070 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f1085ffb640 1 -- 172.21.15.37:0/710664031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1098011bb0 con 0x55a2c8f63070 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f1085ffb640 1 -- 172.21.15.37:0/710664031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098010c00 con 0x55a2c8f63070 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f109cff9640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10880b6540 0x7f10880b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f109f7fe640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10880b6540 0x7f10880b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.578+0000 7f109cff9640 1 -- 172.21.15.37:0/858161291 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f1094107810 con 0x7f10a01083d0 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 -- 172.21.15.37:0/710664031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 msgr2=0x55a2c930a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f109f7fe640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10880b6540 0x7f10880b8a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55a2c9309320 tx=0x7f109000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 0x55a2c930a6a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f109800f410 tx=0x7f109800f8d0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 -- 172.21.15.37:0/710664031 shutdown_connections 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c930b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c930abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 --2- 172.21.15.37:0/710664031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f63070 0x55a2c930a6a0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 -- 172.21.15.37:0/710664031 >> 172.21.15.37:0/710664031 conn(0x55a2c8f57460 msgr2=0x55a2c9308590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 -- 172.21.15.37:0/710664031 shutdown_connections 2024-09-21T01:27:47.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 -- 172.21.15.37:0/710664031 wait complete. 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 -- start start 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.579+0000 7f10ac566740 1 Processor -- start 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9315dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c9316300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2c90d1700 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a2c920b160 con 0x55a2c8f42390 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a2c9318e80 con 0x55a2c8f63070 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f10ac566740 10 client.0 _ll_register_callbacks cb 0x55a2c92249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9315dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9315dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54182/0 (socket says 172.21.15.37:54182) 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 -- 172.21.15.37:0/3302188992 learned_addr learned my addr 172.21.15.37:0/3302188992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109effd640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c9316300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109ffff640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 -- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 msgr2=0x55a2c93221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 -- 172.21.15.37:0/3302188992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 msgr2=0x55a2c9316300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c9316300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.580+0000 7f109f7fe640 1 -- 172.21.15.37:0/3302188992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c9238c90 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9315dc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f109000a780 tx=0x7f10900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931411bdc8e712d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:47.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f107effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f107effd640 1 -- 172.21.15.37:0/3302188992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090027400 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f107effd640 1 -- 172.21.15.37:0/3302188992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f109001f3f0 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1098011bb0 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f107effd640 1 -- 172.21.15.37:0/3302188992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f109001f5f0 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 10 client.17247 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a2c9324b90 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f107effd640 1 -- 172.21.15.37:0/3302188992 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1098011bb0 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f107effd640 1 -- 172.21.15.37:0/3302188992 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f10900277f0 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 10 client.17247 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 10 client.17247 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:27:47.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 20 client.17247 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8f219f0 0x55a2c93280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 4 client.17247 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.581+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2c9282df0 con 0x55a2c8f219f0 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.582+0000 7f109effd640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8f219f0 0x55a2c93280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.582+0000 7f107effd640 10 client.17247 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.582+0000 7f109effd640 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8f219f0 0x55a2c93280a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36aff8eadb3ef053 server_cookie=e4f0d8c6ec903b7f in_seq=0 out_seq=0 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f107effd640 1 -- 172.21.15.37:0/3302188992 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2c9282df0 con 0x55a2c8f219f0 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f107effd640 10 client.17247 handle_command_reply: tid=0 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 client.17247 shutdown 2024-09-21T01:27:47.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 msgr2=0x55a2c9315dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9315dc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f109000a780 tx=0x7f10900046c0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 shutdown_connections 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8f219f0 0x55a2c93280a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f42390 0x55a2c9316300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f107effd640 0 client.17247 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 --2- 172.21.15.37:0/3302188992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9315dc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 >> 172.21.15.37:0/3302188992 conn(0x55a2c8f57460 msgr2=0x55a2c930d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 shutdown_connections 2024-09-21T01:27:47.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 1 -- 172.21.15.37:0/3302188992 wait complete. 2024-09-21T01:27:47.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.583+0000 7f10ac566740 20 client.17247 trim_cache size 0 max 16384 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 Processor -- start 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 -- start start 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9314cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c930deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01af390 con 0x55a2c8f42390 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01b0f00 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f10ac566740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01afa60 con 0x55a2c8f63070 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c930deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c930deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54184/0 (socket says 172.21.15.37:54184) 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 -- 172.21.15.37:0/1964887780 learned_addr learned my addr 172.21.15.37:0/1964887780 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109f7fe640 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9314cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109ffff640 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 -- 172.21.15.37:0/1964887780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 msgr2=0x55a2c93220a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93220a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 -- 172.21.15.37:0/1964887780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f3a1b0 msgr2=0x55a2c9314cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9314cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109effd640 1 -- 172.21.15.37:0/1964887780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2c9316530 con 0x55a2c8f42390 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.597+0000 7f109f7fe640 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9314cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.598+0000 7f109effd640 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c930deb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f10940cd8e0 tx=0x7f109402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca955c787d81c49f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.598+0000 7f10857fa640 1 -- 172.21.15.37:0/1964887780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094049040 con 0x55a2c8f42390 2024-09-21T01:27:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.598+0000 7f10857fa640 1 -- 172.21.15.37:0/1964887780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10940ce0a0 con 0x55a2c8f42390 2024-09-21T01:27:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.598+0000 7f10857fa640 1 -- 172.21.15.37:0/1964887780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940d2070 con 0x55a2c8f42390 2024-09-21T01:27:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 -- 172.21.15.37:0/1964887780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 msgr2=0x55a2c930deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c930deb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f10940cd8e0 tx=0x7f109402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 -- 172.21.15.37:0/1964887780 shutdown_connections 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f63070 0x55a2c93220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c930deb0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 --2- 172.21.15.37:0/1964887780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f3a1b0 0x55a2c9314cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 -- 172.21.15.37:0/1964887780 >> 172.21.15.37:0/1964887780 conn(0x55a2c8f57460 msgr2=0x55a2c930d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 -- 172.21.15.37:0/1964887780 shutdown_connections 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 -- 172.21.15.37:0/1964887780 wait complete. 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 -- start start 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.599+0000 7f10ac566740 1 Processor -- start 2024-09-21T01:27:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c931a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c931a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f63070 0x55a2c931ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01b0830 con 0x55a2c8f42390 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01b0130 con 0x55a2c8f63070 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01ad350 con 0x55a2c8f3a1b0 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f10ac566740 10 client.0 _ll_register_callbacks cb 0x7f1090005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c931a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c931a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54190/0 (socket says 172.21.15.37:54190) 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 -- 172.21.15.37:0/3233056085 learned_addr learned my addr 172.21.15.37:0/3233056085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c931a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109ffff640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f63070 0x55a2c931ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 -- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 msgr2=0x55a2c931a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c931a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 -- 172.21.15.37:0/3233056085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f63070 msgr2=0x55a2c931ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f63070 0x55a2c931ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 -- 172.21.15.37:0/3233056085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2c9391aa0 con 0x55a2c8f42390 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c931a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f109effd640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c931a610 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f10940cac10 tx=0x7f1094009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bfa686859f4c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.600+0000 7f107effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f107effd640 1 -- 172.21.15.37:0/3233056085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094049070 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f107effd640 1 -- 172.21.15.37:0/3233056085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f10940d2040 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10940ce0a0 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f107effd640 1 -- 172.21.15.37:0/3233056085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10940d73c0 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 10 client.17253 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a2c9392d20 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f107effd640 1 -- 172.21.15.37:0/3233056085 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10940ce0a0 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f107effd640 1 -- 172.21.15.37:0/3233056085 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f10940d0ce0 con 0x55a2c8f42390 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 10 client.17253 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 10 client.17253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T01:27:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 20 client.17253 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8ef6da0 0x55a2c9395440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 4 client.17253 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.601+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 --> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2c93039e0 con 0x55a2c8ef6da0 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8ef6da0 0x55a2c9395440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f109f7fe640 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8ef6da0 0x55a2c9395440 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24d0f8d193bbca1f server_cookie=b865a6ecd1d051d8 in_seq=0 out_seq=0 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f107effd640 10 client.17253 ms_handle_connect on v2:172.21.15.144:6838/2711377630 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f107effd640 1 -- 172.21.15.37:0/3233056085 <== mds.1 v2:172.21.15.144:6838/2711377630 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2c93039e0 con 0x55a2c8ef6da0 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f107effd640 10 client.17253 handle_command_reply: tid=0 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f10ac566740 1 client.17253 shutdown 2024-09-21T01:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 msgr2=0x55a2c931a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f10ac566740 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c931a610 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f10940cac10 tx=0x7f1094009560 comp rx=0 tx=0).stop 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 shutdown_connections 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.602+0000 7f10ac566740 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:6838/2711377630,v1:172.21.15.144:6839/2711377630] conn(0x55a2c8ef6da0 0x55a2c9395440 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a2c8f63070 0x55a2c931ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2c8f42390 0x55a2c931a610 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 1 --2- 172.21.15.37:0/3233056085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2c8f3a1b0 0x55a2c931a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f107effd640 0 client.17253 ms_handle_reset on v2:172.21.15.144:6838/2711377630 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 >> 172.21.15.37:0/3233056085 conn(0x55a2c8f57460 msgr2=0x55a2c9307e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 shutdown_connections 2024-09-21T01:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 1 -- 172.21.15.37:0/3233056085 wait complete. 2024-09-21T01:27:47.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10ac566740 20 client.17253 trim_cache size 0 max 16384 2024-09-21T01:27:47.619 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10880b6540 msgr2=0x7f10880b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10880b6540 0x7f10880b8a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55a2c9309320 tx=0x7f109000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 msgr2=0x7f10a019b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a019b800 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1094032fd0 tx=0x7f1094004270 comp rx=0 tx=0).stop 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.603+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 shutdown_connections 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f10880b6540 0x7f10880b8a50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10a0108d20 0x7f10a019bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a01083d0 0x7f10a019b800 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 --2- 172.21.15.37:0/858161291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a0102ae0 0x7f10a019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:47.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 >> 172.21.15.37:0/858161291 conn(0x7f10a0079760 msgr2=0x7f10a01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:47.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 shutdown_connections 2024-09-21T01:27:47.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:47.604+0000 7f10a5ff2640 1 -- 172.21.15.37:0/858161291 wait complete. 2024-09-21T01:27:48.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T01:27:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:49.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:48 smithi037 ceph-mon[31105]: pgmap v711: 97 pgs: 97 active+clean; 7.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 79 MiB/s wr, 445 op/s 2024-09-21T01:27:49.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:48 smithi137 ceph-mon[34607]: pgmap v711: 97 pgs: 97 active+clean; 7.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 79 MiB/s wr, 445 op/s 2024-09-21T01:27:49.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:48 smithi144 ceph-mon[34818]: pgmap v711: 97 pgs: 97 active+clean; 7.8 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 79 MiB/s wr, 445 op/s 2024-09-21T01:27:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 -- 172.21.15.37:0/2924565450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 msgr2=0x7fe4e01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 --2- 172.21.15.37:0/2924565450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e01087e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009900 tx=0x7fe4c802a410 comp rx=0 tx=0).stop 2024-09-21T01:27:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 -- 172.21.15.37:0/2924565450 shutdown_connections 2024-09-21T01:27:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 --2- 172.21.15.37:0/2924565450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4e0108d20 0x7fe4e010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 --2- 172.21.15.37:0/2924565450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e01087e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 --2- 172.21.15.37:0/2924565450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e0102ae0 0x7fe4e0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 -- 172.21.15.37:0/2924565450 >> 172.21.15.37:0/2924565450 conn(0x7fe4e0079760 msgr2=0x7fe4e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 -- 172.21.15.37:0/2924565450 shutdown_connections 2024-09-21T01:27:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.215+0000 7fe4e5681640 1 -- 172.21.15.37:0/2924565450 wait complete. 2024-09-21T01:27:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 Processor -- start 2024-09-21T01:27:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 -- start start 2024-09-21T01:27:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4e0102ae0 0x7fe4e0199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e0108d20 0x7fe4e019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0112990 con 0x7fe4e01083d0 2024-09-21T01:27:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0112810 con 0x7fe4e0102ae0 2024-09-21T01:27:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4e5681640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e0112b10 con 0x7fe4e0108d20 2024-09-21T01:27:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e0199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54218/0 (socket says 172.21.15.37:54218) 2024-09-21T01:27:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 -- 172.21.15.37:0/1752462183 learned_addr learned my addr 172.21.15.37:0/1752462183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4deffd640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4e0102ae0 0x7fe4e0199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e0108d20 0x7fe4e019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 -- 172.21.15.37:0/1752462183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e0108d20 msgr2=0x7fe4e019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e0108d20 0x7fe4e019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 -- 172.21.15.37:0/1752462183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4e0102ae0 msgr2=0x7fe4e0199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4e0102ae0 0x7fe4e0199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.216+0000 7fe4d7fff640 1 -- 172.21.15.37:0/1752462183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e019f2d0 con 0x7fe4e01083d0 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.217+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e0199900 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8006010 tx=0x7fe4c8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.217+0000 7fe4dcff9640 1 -- 172.21.15.37:0/1752462183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c803f030 con 0x7fe4e01083d0 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.217+0000 7fe4dcff9640 1 -- 172.21.15.37:0/1752462183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c8003aa0 con 0x7fe4e01083d0 2024-09-21T01:27:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.217+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e019f560 con 0x7fe4e01083d0 2024-09-21T01:27:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.217+0000 7fe4dcff9640 1 -- 172.21.15.37:0/1752462183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8035070 con 0x7fe4e01083d0 2024-09-21T01:27:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.217+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e01a5d20 con 0x7fe4e01083d0 2024-09-21T01:27:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 Processor -- start 2024-09-21T01:27:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 -- start start 2024-09-21T01:27:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4dcff9640 1 -- 172.21.15.37:0/1752462183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe4c8042030 con 0x7fe4e01083d0 2024-09-21T01:27:49.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a31c342ea0 con 0x55a31bffc1b0 2024-09-21T01:27:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a31c3322d0 con 0x55a31c025070 2024-09-21T01:27:49.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a31c3360e0 con 0x55a31c004390 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54226/0 (socket says 172.21.15.37:54226) 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.220+0000 7fe4deffd640 1 -- 172.21.15.37:0/2871838302 learned_addr learned my addr 172.21.15.37:0/2871838302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4deffd640 1 -- 172.21.15.37:0/2871838302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 msgr2=0x55a31c3ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4deffd640 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4deffd640 1 -- 172.21.15.37:0/2871838302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 msgr2=0x55a31c3cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4deffd640 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4deffd640 1 -- 172.21.15.37:0/2871838302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31c090650 con 0x55a31bffc1b0 2024-09-21T01:27:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4dcff9640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe4cc0b6590 0x7fe4cc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4deffd640 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3cc6a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009c90 tx=0x7fe4d00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6c52aa399e8c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe4cc0b6590 0x7fe4cc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4dcff9640 1 -- 172.21.15.37:0/1752462183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe4c8107780 con 0x7fe4e01083d0 2024-09-21T01:27:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4d57fa640 1 -- 172.21.15.37:0/2871838302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0012450 con 0x55a31bffc1b0 2024-09-21T01:27:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4d57fa640 1 -- 172.21.15.37:0/2871838302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d0012aa0 con 0x55a31bffc1b0 2024-09-21T01:27:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.221+0000 7fe4d57fa640 1 -- 172.21.15.37:0/2871838302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d000fab0 con 0x55a31bffc1b0 2024-09-21T01:27:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/2871838302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 msgr2=0x55a31c3cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe4cc0b6590 0x7fe4cc0b8aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8005fd0 tx=0x7fe4d8009580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3cc6a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009c90 tx=0x7fe4d00117b0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/2871838302 shutdown_connections 2024-09-21T01:27:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3cc6a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/2871838302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/2871838302 >> 172.21.15.37:0/2871838302 conn(0x55a31c019460 msgr2=0x55a31c3ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/2871838302 shutdown_connections 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.222+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/2871838302 wait complete. 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 -- start start 2024-09-21T01:27:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 Processor -- start 2024-09-21T01:27:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31bffc1b0 0x55a31c3dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 0x55a31c3dc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a31c193700 con 0x55a31c004390 2024-09-21T01:27:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a31c2cd160 con 0x55a31bffc1b0 2024-09-21T01:27:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a31c3df200 con 0x55a31c025070 2024-09-21T01:27:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4ebbf5740 10 client.0 _ll_register_callbacks cb 0x55a31c2e69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 0x55a31c3dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.223+0000 7fe4d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 0x55a31c3dc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54234/0 (socket says 172.21.15.37:54234) 2024-09-21T01:27:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 -- 172.21.15.37:0/302080740 learned_addr learned my addr 172.21.15.37:0/302080740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4deffd640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31bffc1b0 0x55a31c3dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 -- 172.21.15.37:0/302080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 msgr2=0x55a31c3e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 -- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31bffc1b0 msgr2=0x55a31c3dc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31bffc1b0 0x55a31c3dc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 -- 172.21.15.37:0/302080740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a31c2fac90 con 0x55a31c004390 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4deffd640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31bffc1b0 0x55a31c3dc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 0x55a31c3dc850 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80c9ee0 tx=0x7fe4c802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c554d30375dc6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4c67fc640 1 -- 172.21.15.37:0/302080740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8049070 con 0x55a31c004390 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4c67fc640 1 -- 172.21.15.37:0/302080740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe4c80d70a0 con 0x55a31c004390 2024-09-21T01:27:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d0012aa0 con 0x55a31c004390 2024-09-21T01:27:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4c67fc640 1 -- 172.21.15.37:0/302080740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe4c80cd260 con 0x55a31c004390 2024-09-21T01:27:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4ebbf5740 10 client.17265 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.224+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a31c3eaf40 con 0x55a31c004390 2024-09-21T01:27:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4c67fc640 1 -- 172.21.15.37:0/302080740 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d0012aa0 con 0x55a31c004390 2024-09-21T01:27:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4c67fc640 1 -- 172.21.15.37:0/302080740 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fe4c8107bb0 con 0x55a31c004390 2024-09-21T01:27:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4ebbf5740 10 client.17265 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4ebbf5740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4ebbf5740 20 client.17265 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfe39f0 0x55a31c3ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4ebbf5740 4 client.17265 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:27:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a31c344df0 con 0x55a31bfe39f0 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.225+0000 7fe4deffd640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfe39f0 0x55a31c3ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.226+0000 7fe4deffd640 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfe39f0 0x55a31c3ee450 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a206369503bcb975 server_cookie=388a507f1f31197 in_seq=0 out_seq=0 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.226+0000 7fe4c67fc640 10 client.17265 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.226+0000 7fe4c67fc640 1 -- 172.21.15.37:0/302080740 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a31c344df0 con 0x55a31bfe39f0 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.226+0000 7fe4c67fc640 10 client.17265 handle_command_reply: tid=0 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 client.17265 shutdown 2024-09-21T01:27:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 msgr2=0x55a31c3dc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 0x55a31c3dc850 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80c9ee0 tx=0x7fe4c802a410 comp rx=0 tx=0).stop 2024-09-21T01:27:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 shutdown_connections 2024-09-21T01:27:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfe39f0 0x55a31c3ee450 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31c004390 0x55a31c3dc850 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/302080740 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31bffc1b0 0x55a31c3dc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 >> 172.21.15.37:0/302080740 conn(0x55a31c019460 msgr2=0x55a31c3ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4c67fc640 0 client.17265 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 shutdown_connections 2024-09-21T01:27:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/302080740 wait complete. 2024-09-21T01:27:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.227+0000 7fe4ebbf5740 20 client.17265 trim_cache size 0 max 16384 2024-09-21T01:27:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.240+0000 7fe4ebbf5740 1 Processor -- start 2024-09-21T01:27:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.240+0000 7fe4ebbf5740 1 -- start start 2024-09-21T01:27:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3e8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01ad0d0 con 0x55a31bffc1b0 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01aec40 con 0x55a31c025070 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01ad7a0 con 0x55a31c004390 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3d27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54242/0 (socket says 172.21.15.37:54242) 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 -- 172.21.15.37:0/3408865741 learned_addr learned my addr 172.21.15.37:0/3408865741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 -- 172.21.15.37:0/3408865741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 msgr2=0x55a31c3ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ddf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 -- 172.21.15.37:0/3408865741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 msgr2=0x55a31c3e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 -- 172.21.15.37:0/3408865741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31c3da810 con 0x55a31bffc1b0 2024-09-21T01:27:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.241+0000 7fe4deffd640 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3d27e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0015020 tx=0x7fe4d0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f0a53e52202db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4d4ff9640 1 -- 172.21.15.37:0/3408865741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d000f980 con 0x55a31bffc1b0 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4d4ff9640 1 -- 172.21.15.37:0/3408865741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d000f560 con 0x55a31bffc1b0 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4d4ff9640 1 -- 172.21.15.37:0/3408865741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d00035f0 con 0x55a31bffc1b0 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/3408865741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 msgr2=0x55a31c3d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3d27e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0015020 tx=0x7fe4d0005f90 comp rx=0 tx=0).stop 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/3408865741 shutdown_connections 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c025070 0x55a31c3e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c004390 0x55a31c3ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/3408865741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3d27e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.242+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/3408865741 >> 172.21.15.37:0/3408865741 conn(0x55a31c019460 msgr2=0x55a31c3dd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/3408865741 shutdown_connections 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/3408865741 wait complete. 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 -- start start 2024-09-21T01:27:49.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 Processor -- start 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c004390 0x55a31c3e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01ae570 con 0x55a31bffc1b0 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01ade70 con 0x55a31c004390 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01ab090 con 0x55a31c025070 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4ebbf5740 10 client.0 _ll_register_callbacks cb 0x7fe4c8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54246/0 (socket says 172.21.15.37:54246) 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.243+0000 7fe4deffd640 1 -- 172.21.15.37:0/1080341282 learned_addr learned my addr 172.21.15.37:0/1080341282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c004390 0x55a31c3e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4df7fe640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4deffd640 1 -- 172.21.15.37:0/1080341282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 msgr2=0x55a31c3e1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4deffd640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4deffd640 1 -- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c004390 msgr2=0x55a31c3e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4deffd640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c004390 0x55a31c3e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4deffd640 1 -- 172.21.15.37:0/1080341282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a31c3e4f90 con 0x55a31bffc1b0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c004390 0x55a31c3e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4deffd640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3e44c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00099d0 tx=0x7fe4d0005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57135920127109 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4c67fc640 1 -- 172.21.15.37:0/1080341282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0005260 con 0x55a31bffc1b0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4c67fc640 1 -- 172.21.15.37:0/1080341282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe4d000f710 con 0x55a31bffc1b0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d000f560 con 0x55a31bffc1b0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4c67fc640 1 -- 172.21.15.37:0/1080341282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe4d000f910 con 0x55a31bffc1b0 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4ebbf5740 10 client.17271 fetch_fsmap learned FSMap version 31 2024-09-21T01:27:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.244+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a31c4591d0 con 0x55a31bffc1b0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4c67fc640 1 -- 172.21.15.37:0/1080341282 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d000f560 con 0x55a31bffc1b0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4c67fc640 1 -- 172.21.15.37:0/1080341282 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7fe4d003b030 con 0x55a31bffc1b0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4ebbf5740 10 client.17271 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4ebbf5740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4ebbf5740 20 client.17271 populate_metadata read hostname 'smithi037' 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfb8da0 0x55a31c45ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4ebbf5740 4 client.17271 mds_command: new command op to 24635 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 --> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a31c3408a0 con 0x55a31bfb8da0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.245+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfb8da0 0x55a31c45ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4c67fc640 10 client.17271 ms_handle_connect on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4d7fff640 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfb8da0 0x55a31c45ba10 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd395df64dadc02a server_cookie=3974a81acdbf270a in_seq=0 out_seq=0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4c67fc640 1 -- 172.21.15.37:0/1080341282 <== mds.0 v2:172.21.15.137:6838/302617634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a31c3408a0 con 0x55a31bfb8da0 2024-09-21T01:27:49.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4c67fc640 10 client.17271 handle_command_reply: tid=0 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 client.17271 shutdown 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 msgr2=0x55a31c3e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3e44c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00099d0 tx=0x7fe4d0005040 comp rx=0 tx=0).stop 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 shutdown_connections 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:6838/302617634,v1:172.21.15.137:6839/302617634] conn(0x55a31bfb8da0 0x55a31c45ba10 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a31c025070 0x55a31c3e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a31c004390 0x55a31c3e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 --2- 172.21.15.37:0/1080341282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a31bffc1b0 0x55a31c3e44c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4c67fc640 0 client.17271 ms_handle_reset on v2:172.21.15.137:6838/302617634 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 >> 172.21.15.37:0/1080341282 conn(0x55a31c019460 msgr2=0x55a31c3cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 shutdown_connections 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 1 -- 172.21.15.37:0/1080341282 wait complete. 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.246+0000 7fe4ebbf5740 20 client.17271 trim_cache size 0 max 16384 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe4cc0b6590 msgr2=0x7fe4cc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe4cc0b6590 0x7fe4cc0b8aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8005fd0 tx=0x7fe4d8009580 comp rx=0 tx=0).stop 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 msgr2=0x7fe4e0199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e0199900 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8006010 tx=0x7fe4c8004060 comp rx=0 tx=0).stop 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 shutdown_connections 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe4cc0b6590 0x7fe4cc0b8aa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e0108d20 0x7fe4e019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4e01083d0 0x7fe4e0199900 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 --2- 172.21.15.37:0/1752462183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4e0102ae0 0x7fe4e0199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:49.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 >> 172.21.15.37:0/1752462183 conn(0x7fe4e0079760 msgr2=0x7fe4e0104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:49.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 shutdown_connections 2024-09-21T01:27:49.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:49.247+0000 7fe4e5681640 1 -- 172.21.15.37:0/1752462183 wait complete. 2024-09-21T01:27:50.172 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T01:27:50.172 INFO:tasks.fwd_scrub:done joining 2024-09-21T01:27:50.172 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T01:27:50.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:27:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.431+0000 7faffd4cc640 1 -- 172.21.15.37:0/1922202509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff81071d0 msgr2=0x7faff81076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.431+0000 7faffd4cc640 1 --2- 172.21.15.37:0/1922202509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff81071d0 0x7faff81076d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009900 tx=0x7fafe802a420 comp rx=0 tx=0).stop 2024-09-21T01:27:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.437+0000 7faffd4cc640 1 -- 172.21.15.37:0/1922202509 shutdown_connections 2024-09-21T01:27:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.437+0000 7faffd4cc640 1 --2- 172.21.15.37:0/1922202509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff81071d0 0x7faff81076d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.437+0000 7faffd4cc640 1 --2- 172.21.15.37:0/1922202509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff8104610 0x7faff8106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.437+0000 7faffd4cc640 1 --2- 172.21.15.37:0/1922202509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faff806c440 0x7faff81040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.437+0000 7faffd4cc640 1 -- 172.21.15.37:0/1922202509 >> 172.21.15.37:0/1922202509 conn(0x7faff80fdee0 msgr2=0x7faff8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:50.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.442+0000 7faffd4cc640 1 -- 172.21.15.37:0/1922202509 shutdown_connections 2024-09-21T01:27:50.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.445+0000 7faffd4cc640 1 -- 172.21.15.37:0/1922202509 wait complete. 2024-09-21T01:27:50.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.446+0000 7faffd4cc640 1 Processor -- start 2024-09-21T01:27:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.451+0000 7faffd4cc640 1 -- start start 2024-09-21T01:27:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.452+0000 7faffd4cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 0x7faff8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.452+0000 7faffd4cc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff8104610 0x7faff80750a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.452+0000 7faffd4cc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faff81071d0 0x7faff8073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.452+0000 7faffd4cc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faff806d6e0 con 0x7faff806c440 2024-09-21T01:27:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.452+0000 7faffd4cc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faff806d560 con 0x7faff8104610 2024-09-21T01:27:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.452+0000 7faffd4cc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faff806d860 con 0x7faff81071d0 2024-09-21T01:27:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.457+0000 7faff6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 0x7faff8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.457+0000 7faff6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 0x7faff8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54256/0 (socket says 172.21.15.37:54256) 2024-09-21T01:27:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.457+0000 7faff6ffd640 1 -- 172.21.15.37:0/3449354232 learned_addr learned my addr 172.21.15.37:0/3449354232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.458+0000 7faff77fe640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faff81071d0 0x7faff8073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.459+0000 7faff67fc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff8104610 0x7faff80750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.460+0000 7faff6ffd640 1 -- 172.21.15.37:0/3449354232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faff81071d0 msgr2=0x7faff8073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.460+0000 7faff6ffd640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faff81071d0 0x7faff8073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.460+0000 7faff6ffd640 1 -- 172.21.15.37:0/3449354232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff8104610 msgr2=0x7faff80750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.460+0000 7faff6ffd640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff8104610 0x7faff80750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.460+0000 7faff6ffd640 1 -- 172.21.15.37:0/3449354232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff8073d40 con 0x7faff806c440 2024-09-21T01:27:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.462+0000 7faff6ffd640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 0x7faff8074a30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faff000eab0 tx=0x7faff000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:50.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.466+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff000ce40 con 0x7faff806c440 2024-09-21T01:27:50.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.467+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faff0011920 con 0x7faff806c440 2024-09-21T01:27:50.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.467+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0010a30 con 0x7faff806c440 2024-09-21T01:27:50.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.468+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff8074030 con 0x7faff806c440 2024-09-21T01:27:50.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.468+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff81b1010 con 0x7faff806c440 2024-09-21T01:27:50.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.474+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff80ffa00 con 0x7faff806c440 2024-09-21T01:27:50.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.480+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7faff0010bd0 con 0x7faff806c440 2024-09-21T01:27:50.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.482+0000 7fafdffff640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fafe00b66a0 0x7fafe00b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.483+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7faff00e7a60 con 0x7faff806c440 2024-09-21T01:27:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.488+0000 7faff67fc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fafe00b66a0 0x7fafe00b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.494+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faff0016030 con 0x7faff806c440 2024-09-21T01:27:50.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.497+0000 7faff67fc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fafe00b66a0 0x7fafe00b8bb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faff806c9f0 tx=0x7fafec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.779+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faff8063fc0 con 0x7faff806c440 2024-09-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.780+0000 7fafdffff640 1 -- 172.21.15.37:0/3449354232 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7faff00ae1a0 con 0x7faff806c440 2024-09-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:27:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.782+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fafe00b66a0 msgr2=0x7fafe00b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.782+0000 7faffd4cc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fafe00b66a0 0x7fafe00b8bb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faff806c9f0 tx=0x7fafec008040 comp rx=0 tx=0).stop 2024-09-21T01:27:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.782+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 msgr2=0x7faff8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.782+0000 7faffd4cc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 0x7faff8074a30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faff000eab0 tx=0x7faff000ef70 comp rx=0 tx=0).stop 2024-09-21T01:27:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 shutdown_connections 2024-09-21T01:27:50.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fafe00b66a0 0x7fafe00b8bb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faff81071d0 0x7faff8073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faff8104610 0x7faff80750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 --2- 172.21.15.37:0/3449354232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faff806c440 0x7faff8074a30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 >> 172.21.15.37:0/3449354232 conn(0x7faff80fdee0 msgr2=0x7faff81054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 shutdown_connections 2024-09-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.783+0000 7faffd4cc640 1 -- 172.21.15.37:0/3449354232 wait complete. 2024-09-21T01:27:50.795 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:09:09.226836+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T01:13:46.784744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T01:13:49.153488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:27:50.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:27:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 -- 172.21.15.37:0/2566895371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7501050c0 msgr2=0x7fe75010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 --2- 172.21.15.37:0/2566895371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7501050c0 0x7fe75010ba60 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe748009900 tx=0x7fe74802a410 comp rx=0 tx=0).stop 2024-09-21T01:27:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 -- 172.21.15.37:0/2566895371 shutdown_connections 2024-09-21T01:27:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 --2- 172.21.15.37:0/2566895371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7501050c0 0x7fe75010ba60 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 --2- 172.21.15.37:0/2566895371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe750104720 0x7fe750104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 --2- 172.21.15.37:0/2566895371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7501036a0 0x7fe750103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 -- 172.21.15.37:0/2566895371 >> 172.21.15.37:0/2566895371 conn(0x7fe7500ff020 msgr2=0x7fe750101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 -- 172.21.15.37:0/2566895371 shutdown_connections 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.912+0000 7fe756e7e640 1 -- 172.21.15.37:0/2566895371 wait complete. 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 Processor -- start 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 -- start start 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 0x7fe750199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 0x7fe75019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7501050c0 0x7fe75019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010f2d0 con 0x7fe750104720 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010f150 con 0x7fe7501050c0 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe756e7e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010f450 con 0x7fe7501036a0 2024-09-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.913+0000 7fe74ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 0x7fe75019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 0x7fe750199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe74ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 0x7fe75019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54270/0 (socket says 172.21.15.37:54270) 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 0x7fe750199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.37:59578/0 (socket says 172.21.15.37:59578) 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe74ffff640 1 -- 172.21.15.37:0/1098039574 learned_addr learned my addr 172.21.15.37:0/1098039574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe75541b640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7501050c0 0x7fe75019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 -- 172.21.15.37:0/1098039574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7501050c0 msgr2=0x7fe75019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7501050c0 0x7fe75019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 -- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 msgr2=0x7fe75019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 0x7fe75019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 -- 172.21.15.37:0/1098039574 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75019b900 con 0x7fe7501036a0 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe74ffff640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 0x7fe75019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe754c1a640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 0x7fe750199ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe73800e9f0 tx=0x7fe73800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73800ccc0 con 0x7fe7501036a0 2024-09-21T01:27:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75019bbf0 con 0x7fe7501036a0 2024-09-21T01:27:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7380108e0 con 0x7fe7501036a0 2024-09-21T01:27:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.914+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738018880 con 0x7fe7501036a0 2024-09-21T01:27:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.915+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a22e0 con 0x7fe7501036a0 2024-09-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.916+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750103b10 con 0x7fe7501036a0 2024-09-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.917+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe738010430 con 0x7fe7501036a0 2024-09-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.918+0000 7fe74dffb640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe73c0b6510 0x7fe73c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.918+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fe7380e7810 con 0x7fe7501036a0 2024-09-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.918+0000 7fe74ffff640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe73c0b6510 0x7fe73c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.919+0000 7fe74ffff640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe73c0b6510 0x7fe73c0b8a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e7c0 tx=0x7fe740009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:50.921+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7380b2480 con 0x7fe7501036a0 2024-09-21T01:27:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.114+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe75002e640 con 0x7fe7501036a0 2024-09-21T01:27:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.115+0000 7fe74dffb640 1 -- 172.21.15.37:0/1098039574 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fe7380b73c0 con 0x7fe7501036a0 2024-09-21T01:27:51.115 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-21T01:27:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe73c0b6510 msgr2=0x7fe73c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe73c0b6510 0x7fe73c0b8a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e7c0 tx=0x7fe740009800 comp rx=0 tx=0).stop 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 msgr2=0x7fe750199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 0x7fe750199ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe73800e9f0 tx=0x7fe73800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 shutdown_connections 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fe73c0b6510 0x7fe73c0b8a20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7501050c0 0x7fe75019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe750104720 0x7fe75019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 --2- 172.21.15.37:0/1098039574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7501036a0 0x7fe750199ec0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.117+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 >> 172.21.15.37:0/1098039574 conn(0x7fe7500ff020 msgr2=0x7fe750107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.118+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 shutdown_connections 2024-09-21T01:27:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.118+0000 7fe756e7e640 1 -- 172.21.15.37:0/1098039574 wait complete. 2024-09-21T01:27:51.128 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:50 smithi037 ceph-mon[31105]: pgmap v712: 97 pgs: 97 active+clean; 6.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 78 MiB/s wr, 463 op/s 2024-09-21T01:27:51.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:27:51.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:50 smithi137 ceph-mon[34607]: pgmap v712: 97 pgs: 97 active+clean; 6.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 78 MiB/s wr, 463 op/s 2024-09-21T01:27:51.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:50 smithi144 ceph-mon[34818]: pgmap v712: 97 pgs: 97 active+clean; 6.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 78 MiB/s wr, 463 op/s 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 -- 172.21.15.37:0/2841085159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff670103640 msgr2=0x7ff670103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 --2- 172.21.15.37:0/2841085159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff670103640 0x7ff670103a50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff664009900 tx=0x7ff66402a410 comp rx=0 tx=0).stop 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 -- 172.21.15.37:0/2841085159 shutdown_connections 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 --2- 172.21.15.37:0/2841085159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff670103fe0 0x7ff67010a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 --2- 172.21.15.37:0/2841085159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff670103640 0x7ff670103a50 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 --2- 172.21.15.37:0/2841085159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6701025c0 0x7ff670102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 -- 172.21.15.37:0/2841085159 >> 172.21.15.37:0/2841085159 conn(0x7ff6700fdf00 msgr2=0x7ff6701003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 -- 172.21.15.37:0/2841085159 shutdown_connections 2024-09-21T01:27:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.246+0000 7ff675124640 1 -- 172.21.15.37:0/2841085159 wait complete. 2024-09-21T01:27:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.247+0000 7ff675124640 1 Processor -- start 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.247+0000 7ff675124640 1 -- start start 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff675124640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 0x7ff67006c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff675124640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff670103640 0x7ff67019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff675124640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff670103fe0 0x7ff6701a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff675124640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff67010e210 con 0x7ff6701025c0 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff675124640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff67010e090 con 0x7ff670103fe0 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff675124640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff67010e390 con 0x7ff670103640 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 0x7ff67006c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 0x7ff67006c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54288/0 (socket says 172.21.15.37:54288) 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 -- 172.21.15.37:0/845397714 learned_addr learned my addr 172.21.15.37:0/845397714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66e59c640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff670103640 0x7ff67019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66f59e640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff670103fe0 0x7ff6701a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 -- 172.21.15.37:0/845397714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff670103640 msgr2=0x7ff67019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff670103640 0x7ff67019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 -- 172.21.15.37:0/845397714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff670103fe0 msgr2=0x7ff6701a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff670103fe0 0x7ff6701a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 -- 172.21.15.37:0/845397714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6701a1a80 con 0x7ff6701025c0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff66ed9d640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 0x7ff67006c090 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff66000d770 tx=0x7ff66000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.248+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660017070 con 0x7ff6701025c0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.249+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6701a1d70 con 0x7ff6701025c0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.249+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6600054d0 con 0x7ff6701025c0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.249+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660004c30 con 0x7ff6701025c0 2024-09-21T01:27:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.249+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6701a2200 con 0x7ff6701025c0 2024-09-21T01:27:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.250+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff670109790 con 0x7ff6701025c0 2024-09-21T01:27:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.251+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff660004dd0 con 0x7ff6701025c0 2024-09-21T01:27:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.252+0000 7ff657fff640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6580b6510 0x7ff6580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.252+0000 7ff66e59c640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6580b6510 0x7ff6580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.252+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7ff6600e7140 con 0x7ff6701025c0 2024-09-21T01:27:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.253+0000 7ff66e59c640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6580b6510 0x7ff6580b8a20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff664000c00 tx=0x7ff664031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:51.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.255+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6600b1db0 con 0x7ff6701025c0 2024-09-21T01:27:51.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.447+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff670063fc0 con 0x7ff6701025c0 2024-09-21T01:27:51.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.447+0000 7ff657fff640 1 -- 172.21.15.37:0/845397714 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7ff6600b6cf0 con 0x7ff6701025c0 2024-09-21T01:27:51.448 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-21T01:27:51.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.449+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6580b6510 msgr2=0x7ff6580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.449+0000 7ff675124640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6580b6510 0x7ff6580b8a20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff664000c00 tx=0x7ff664031400 comp rx=0 tx=0).stop 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.449+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 msgr2=0x7ff67006c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.449+0000 7ff675124640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 0x7ff67006c090 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff66000d770 tx=0x7ff66000dc30 comp rx=0 tx=0).stop 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 shutdown_connections 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7ff6580b6510 0x7ff6580b8a20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff670103fe0 0x7ff6701a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff670103640 0x7ff67019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 --2- 172.21.15.37:0/845397714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6701025c0 0x7ff67006c090 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 >> 172.21.15.37:0/845397714 conn(0x7ff6700fdf00 msgr2=0x7ff670106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 shutdown_connections 2024-09-21T01:27:51.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.450+0000 7ff675124640 1 -- 172.21.15.37:0/845397714 wait complete. 2024-09-21T01:27:51.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.578+0000 7f20e2fa1640 1 -- 172.21.15.37:0/1043034240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1025a0 msgr2=0x7f20dc102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.578+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/1043034240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1025a0 0x7f20dc102a10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009900 tx=0x7f20d002a410 comp rx=0 tx=0).stop 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 -- 172.21.15.37:0/1043034240 shutdown_connections 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/1043034240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 0x7f20dc10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/1043034240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc103620 0x7f20dc103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/1043034240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc1025a0 0x7f20dc102a10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 -- 172.21.15.37:0/1043034240 >> 172.21.15.37:0/1043034240 conn(0x7f20dc0fdee0 msgr2=0x7f20dc100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 -- 172.21.15.37:0/1043034240 shutdown_connections 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 -- 172.21.15.37:0/1043034240 wait complete. 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 Processor -- start 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.579+0000 7f20e2fa1640 1 -- start start 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc1025a0 0x7f20dc06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 0x7f20dc19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 0x7f20dc1a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10e1d0 con 0x7f20dc103620 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10e050 con 0x7f20dc103fc0 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10e350 con 0x7f20dc1025a0 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 0x7f20dc19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 0x7f20dc19ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54298/0 (socket says 172.21.15.37:54298) 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 -- 172.21.15.37:0/852931341 learned_addr learned my addr 172.21.15.37:0/852931341 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e0d3d640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc1025a0 0x7f20dc06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e153e640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 0x7f20dc1a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 -- 172.21.15.37:0/852931341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc1025a0 msgr2=0x7f20dc06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc1025a0 0x7f20dc06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 -- 172.21.15.37:0/852931341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 msgr2=0x7f20dc1a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 0x7f20dc1a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 -- 172.21.15.37:0/852931341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc1a1a40 con 0x7f20dc103620 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e153e640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 0x7f20dc1a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20dbfff640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 0x7f20dc19ecf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d950 tx=0x7f20c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8017070 con 0x7f20dc103620 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc1a1d30 con 0x7f20dc103620 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20c8009c30 con 0x7f20dc103620 2024-09-21T01:27:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.580+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c800f620 con 0x7f20dc103620 2024-09-21T01:27:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.581+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1a21d0 con 0x7f20dc103620 2024-09-21T01:27:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.582+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc109770 con 0x7f20dc103620 2024-09-21T01:27:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.583+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f20c8010460 con 0x7f20dc103620 2024-09-21T01:27:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.584+0000 7f20d9ffb640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20cc0b6510 0x7f20cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.584+0000 7f20e0d3d640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20cc0b6510 0x7f20cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.584+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f20c80e6f80 con 0x7f20dc103620 2024-09-21T01:27:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.584+0000 7f20e0d3d640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20cc0b6510 0x7f20cc0b8a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000c00 tx=0x7f20d0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:51.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.588+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20c80ad7d0 con 0x7f20dc103620 2024-09-21T01:27:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.780+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f20dc063ff0 con 0x7f20dc103620 2024-09-21T01:27:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.781+0000 7f20d9ffb640 1 -- 172.21.15.37:0/852931341 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7f20c8009de0 con 0x7f20dc103620 2024-09-21T01:27:51.781 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20cc0b6510 msgr2=0x7f20cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20cc0b6510 0x7f20cc0b8a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000c00 tx=0x7f20d0031400 comp rx=0 tx=0).stop 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 msgr2=0x7f20dc19ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 0x7f20dc19ecf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d950 tx=0x7f20c800de10 comp rx=0 tx=0).stop 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 shutdown_connections 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f20cc0b6510 0x7f20cc0b8a20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20dc103fc0 0x7f20dc1a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc103620 0x7f20dc19ecf0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 --2- 172.21.15.37:0/852931341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20dc1025a0 0x7f20dc06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 >> 172.21.15.37:0/852931341 conn(0x7f20dc0fdee0 msgr2=0x7f20dc106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:51.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 shutdown_connections 2024-09-21T01:27:51.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.783+0000 7f20e2fa1640 1 -- 172.21.15.37:0/852931341 wait complete. 2024-09-21T01:27:51.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T01:27:51.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 -- 172.21.15.37:0/4027901339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 msgr2=0x7f92fc103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 --2- 172.21.15.37:0/4027901339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc103a00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009900 tx=0x7f92f002a410 comp rx=0 tx=0).stop 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 -- 172.21.15.37:0/4027901339 shutdown_connections 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 --2- 172.21.15.37:0/4027901339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc103f90 0x7f92fc10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 --2- 172.21.15.37:0/4027901339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc1035f0 0x7f92fc103a00 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 --2- 172.21.15.37:0/4027901339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc102570 0x7f92fc1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 -- 172.21.15.37:0/4027901339 >> 172.21.15.37:0/4027901339 conn(0x7f92fc0fdeb0 msgr2=0x7f92fc100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 -- 172.21.15.37:0/4027901339 shutdown_connections 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.908+0000 7f9302fc6640 1 -- 172.21.15.37:0/4027901339 wait complete. 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 Processor -- start 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 -- start start 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 0x7f92fc06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc1035f0 0x7f92fc19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc10e1f0 con 0x7f92fc102570 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc10e070 con 0x7f92fc1035f0 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9302fc6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc10e370 con 0x7f92fc103f90 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 0x7f92fc06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 0x7f92fc06afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54304/0 (socket says 172.21.15.37:54304) 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 -- 172.21.15.37:0/1483526647 learned_addr learned my addr 172.21.15.37:0/1483526647 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f92fbfff640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc1035f0 0x7f92fc19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9301563640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 -- 172.21.15.37:0/1483526647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 msgr2=0x7f92fc1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc1a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 -- 172.21.15.37:0/1483526647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc1035f0 msgr2=0x7f92fc19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc1035f0 0x7f92fc19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9300d62640 1 -- 172.21.15.37:0/1483526647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc1a1a00 con 0x7f92fc102570 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.909+0000 7f9301563640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.910+0000 7f9300d62640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 0x7f92fc06afd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f92f400eb90 tx=0x7f92f400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:51.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.910+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4004d20 con 0x7f92fc102570 2024-09-21T01:27:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.910+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc1a1cf0 con 0x7f92fc102570 2024-09-21T01:27:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.910+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92f400ee90 con 0x7f92fc102570 2024-09-21T01:27:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.910+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4010670 con 0x7f92fc102570 2024-09-21T01:27:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.910+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1a2190 con 0x7f92fc102570 2024-09-21T01:27:51.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.911+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92fc109740 con 0x7f92fc102570 2024-09-21T01:27:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.913+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f92f4010850 con 0x7f92fc102570 2024-09-21T01:27:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.913+0000 7f92f9ffb640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e40b6510 0x7f92e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:27:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.913+0000 7f92fbfff640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e40b6510 0x7f92e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:27:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.913+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f92f40e7b60 con 0x7f92fc102570 2024-09-21T01:27:51.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.914+0000 7f92fbfff640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e40b6510 0x7f92e40b8a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92f0000c00 tx=0x7f92f0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:27:51.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:51.916+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92f4056710 con 0x7f92fc102570 2024-09-21T01:27:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.153+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f92fc02e810 con 0x7f92fc102570 2024-09-21T01:27:52.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.162+0000 7f92f9ffb640 1 -- 172.21.15.37:0/1483526647 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+833523 (secure 0 0 0) 0x7f92f40ae3f0 con 0x7f92fc102570 2024-09-21T01:27:52.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:51 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3449354232' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:27:52.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:51 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1098039574' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:27:52.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:51 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/845397714' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:27:52.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:51 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3449354232' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:27:52.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:51 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1098039574' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:27:52.172 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:51 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/845397714' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:27:52.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:27:52.176 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14152, 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2729102960 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-09-21T01:27:52.177 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2729102960 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/2729102960", 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-09-21T01:06:16.751254+0000", 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24121, 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:27:52.178 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.183 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-21T01:27:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.186 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.187 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-21T01:27:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-21T01:27:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.197 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.198 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.198 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-21T01:27:52.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-21T01:27:52.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:27:52.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-21T01:27:52.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-21T01:27:52.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T01:27:52.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T01:27:52.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:27:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:27:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-21T01:27:52.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:27:52.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.207 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-21T01:27:52.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-21T01:27:52.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:27:52.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.208 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:27:52.208 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:27:52.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-21T01:27:52.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-21T01:27:52.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-21T01:27:52.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:27:52.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:27:52.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.211 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-21T01:27:52.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-21T01:27:52.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:27:52.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:27:52.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.213 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-21T01:27:52.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-21T01:27:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T01:27:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T01:27:52.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:27:52.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:27:52.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.215 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.216 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.217 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.217 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.217 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.222 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-21T01:27:52.230 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:27:52.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:27:52.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:27:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:27:52.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-21T01:27:52.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:27:52.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:27:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:27:52.253 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-21T01:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-21T01:27:52.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:27:52.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba_metrics": { 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:27:52.261 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:27:52.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-21T01:27:52.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-21T01:27:52.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.270 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-21T01:27:52.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-21T01:27:52.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.280 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.282 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:27:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:27:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-21T01:27:52.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:27:52.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:27:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-21T01:27:52.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-21T01:27:52.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.306 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_interval": { 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-21T01:27:52.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.311 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:27:52.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:27:52.313 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.316 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.319 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.319 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.319 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.319 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.321 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.326 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.328 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:27:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:27:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.333 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:27:52.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:27:52.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.333 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.335 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:27:52.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:27:52.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:27:52.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:27:52.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.339 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:27:52.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:27:52.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.340 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.342 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:27:52.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:27:52.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.345 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.346 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:27:52.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.348 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:27:52.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:27:52.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:27:52.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.382 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.394 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.395 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.396 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-21T01:27:52.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.399 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.400 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "sso_oauth2": { 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sso_oauth2", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-21T01:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-21T01:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-21T01:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-21T01:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-21T01:27:52.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:27:52.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.422 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-21T01:27:52.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-21T01:27:52.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T01:27:52.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:27:52.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.424 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-21T01:27:52.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-21T01:27:52.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.427 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:27:52.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.429 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.431 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-21T01:27:52.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-21T01:27:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-21T01:27:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.433 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.434 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-21T01:27:52.434 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.434 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.434 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.435 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.436 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.436 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.436 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-21T01:27:52.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-21T01:27:52.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.454 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-21T01:27:52.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-21T01:27:52.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.465 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.469 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.472 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.476 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T01:27:52.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.485 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:27:52.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-21T01:27:52.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.502 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.503 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.512 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.515 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.516 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-21T01:27:52.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.527 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-21T01:27:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.539 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.541 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.547 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-21T01:27:52.552 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.554 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.555 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:27:52.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.568 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-21T01:27:52.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:52.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-21T01:27:52.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T01:27:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.593 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.595 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.603 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.607 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.614 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-21T01:27:52.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.618 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.619 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-21T01:27:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-21T01:27:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-21T01:27:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-21T01:27:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-21T01:27:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-21T01:27:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-21T01:27:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-21T01:27:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-21T01:27:52.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.638 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.644 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.662 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-21T01:27:52.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.670 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.673 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:27:52.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-21T01:27:52.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T01:27:52.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-21T01:27:52.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-21T01:27:52.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-21T01:27:52.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.689 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.696 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.701 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.707 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.711 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.719 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24140, 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.726 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.732 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-21T01:27:52.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.734 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-21T01:27:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-21T01:27:52.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-21T01:27:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.739 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:27:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:27:52.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:27:52.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:27:52.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.748 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.750 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.755 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-21T01:27:52.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.765 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.769 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.770 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:27:52.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-21T01:27:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:27:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:27:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-21T01:27:52.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-21T01:27:52.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba_metrics": { 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-21T01:27:52.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:52.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.800 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.804 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.805 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:27:52.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-21T01:27:52.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.815 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:27:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:27:52.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_interval": { 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:27:52.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:27:52.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:27:52.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:27:52.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.839 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-21T01:27:52.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-21T01:27:52.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.847 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:27:52.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:27:52.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:27:52.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.858 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.859 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.860 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.861 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:52.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.870 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:27:52.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:27:52.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.872 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:27:52.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:27:52.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.874 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:27:52.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:27:52.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.875 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:27:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:27:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.882 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.882 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.882 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:27:52.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.889 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.892 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.893 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.894 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.895 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.896 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.903 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.910 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "sso_oauth2": { 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sso_oauth2", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-21T01:27:52.925 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.928 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.933 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.936 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-21T01:27:52.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.942 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.943 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.946 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-21T01:27:52.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.948 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-21T01:27:52.951 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.953 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.954 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.955 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.956 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.957 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.958 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.959 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.960 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-21T01:27:52.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T01:27:52.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-21T01:27:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-21T01:27:52.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-21T01:27:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.967 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.968 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.973 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.976 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.977 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:27:52.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:52.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.990 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:27:52.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.992 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:52.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:52.999 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-21T01:27:53.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.002 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.003 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.008 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.010 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.012 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.018 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T01:27:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.023 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.027 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-21T01:27:53.028 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.031 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.035 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.036 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.037 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.043 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.055 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-21T01:27:53.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-21T01:27:53.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.066 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-21T01:27:53.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-21T01:27:53.075 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T01:27:53.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.078 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.080 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:27:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:27:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-21T01:27:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.089 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.101 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.104 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.106 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.108 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-21T01:27:53.111 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.113 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.123 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-21T01:27:53.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-21T01:27:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-21T01:27:53.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.133 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.138 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.141 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.149 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.150 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.156 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.162 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.172 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-21T01:27:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.192 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.194 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:27:53.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-21T01:27:53.203 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:27:53.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.211 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-09-21T01:27:53.219 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.230 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.231 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-21T01:27:53.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:27:53.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:27:53.236 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:27:53.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:27:53.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:27:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.243 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T01:27:53.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-21T01:27:53.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:27:53.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:27:53.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.252 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:27:53.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:27:53.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-21T01:27:53.261 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:27:53.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:27:53.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:27:53.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-21T01:27:53.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:27:53.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-21T01:27:53.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba_metrics": { 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.287 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-21T01:27:53.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-21T01:27:53.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.290 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-21T01:27:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-21T01:27:53.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-21T01:27:53.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:27:53.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:27:53.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.298 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-21T01:27:53.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-21T01:27:53.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_keepalive_interval": { 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:27:53.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:27:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:27:53.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.326 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-21T01:27:53.331 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.334 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.340 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.347 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:27:53.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:27:53.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:27:53.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:27:53.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:27:53.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.376 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-21T01:27:53.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-21T01:27:53.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-21T01:27:53.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.384 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.393 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-21T01:27:53.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-21T01:27:53.393 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "sso_oauth2": { 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sso_oauth2", 2024-09-21T01:27:53.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.396 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.397 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.403 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:27:53.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.416 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-21T01:27:53.418 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-21T01:27:53.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.422 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-21T01:27:53.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-21T01:27:53.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-21T01:27:53.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-21T01:27:53.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:53.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.441 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.450 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-21T01:27:53.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.463 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.474 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.477 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.483 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.484 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.494 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.499 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.508 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.514 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.519 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.522 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.523 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-21T01:27:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-21T01:27:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:27:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.532 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.549 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-21T01:27:53.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.558 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.560 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-09-21T01:27:53.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-21T01:27:53.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-21T01:27:53.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.566 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.567 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.577 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.581 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.582 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.592 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.593 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.605 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.613 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.614 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.620 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.623 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.624 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-21T01:27:53.629 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.632 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.637 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.638 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:27:53.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:27:53.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-21T01:27:53.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.653 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.662 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.666 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.668 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.676 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-21T01:27:53.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-21T01:27:53.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-21T01:27:53.681 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-21T01:27:53.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-21T01:27:53.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T01:27:53.687 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T01:27:53.688 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T01:27:53.689 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-21T01:27:53.690 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 3, 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-09-21T01:27:53.691 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1605150269 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T01:27:53.692 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3816892973 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3851831853 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1137444280 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-21T01:27:53.694 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:27:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e40b6510 msgr2=0x7f92e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e40b6510 0x7f92e40b8a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92f0000c00 tx=0x7f92f0031400 comp rx=0 tx=0).stop 2024-09-21T01:27:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 msgr2=0x7f92fc06afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:27:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 0x7f92fc06afd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f92f400eb90 tx=0x7f92f400c6a0 comp rx=0 tx=0).stop 2024-09-21T01:27:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 shutdown_connections 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f92e40b6510 0x7f92e40b8a20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc103f90 0x7f92fc1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92fc1035f0 0x7f92fc19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 --2- 172.21.15.37:0/1483526647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92fc102570 0x7f92fc06afd0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 >> 172.21.15.37:0/1483526647 conn(0x7f92fc0fdeb0 msgr2=0x7f92fc106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 shutdown_connections 2024-09-21T01:27:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:27:52.168+0000 7f9302fc6640 1 -- 172.21.15.37:0/1483526647 wait complete. 2024-09-21T01:27:53.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:51 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3449354232' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:27:53.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:51 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1098039574' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:27:53.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:51 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/845397714' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:27:53.740 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T01:27:53.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T01:27:53.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:52 smithi037 ceph-mon[31105]: pgmap v713: 97 pgs: 97 active+clean; 6.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 77 MiB/s wr, 514 op/s 2024-09-21T01:27:53.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:52 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/852931341' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:27:53.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:52 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1483526647' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:27:53.742 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:52 smithi144 ceph-mon[34818]: pgmap v713: 97 pgs: 97 active+clean; 6.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 77 MiB/s wr, 514 op/s 2024-09-21T01:27:53.742 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:52 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/852931341' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:27:53.742 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:52 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1483526647' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:27:53.742 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:52 smithi137 ceph-mon[34607]: pgmap v713: 97 pgs: 97 active+clean; 6.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 77 MiB/s wr, 514 op/s 2024-09-21T01:27:53.742 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:52 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/852931341' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:27:53.742 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:52 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1483526647' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:27:54.015 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1068, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1061, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 852320, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 404878, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.241599361, 2024-09-21T01:27:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.089054340, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.089900527, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.053670024, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1060, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.262297977, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000247450 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 575120, 2024-09-21T01:27:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 142528 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 754, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 928, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 186050, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 635362, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.164374315, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.056560066, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.031505293, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.055851970, 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 926, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.091981221, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000099331 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 395840 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 834, 2024-09-21T01:27:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 834, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 221501, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 264389, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.161064675, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.055999574, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.037334857, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.050353808, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 833, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.084152574, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000101023 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-21T01:27:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3805, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.319993903, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000084098 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-09-21T01:27:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-09-21T01:27:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 1, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-09-21T01:27:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:27:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-09-21T01:27:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:27:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_succeeded": 0, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_write_failed": 0 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-09-21T01:27:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 4, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 2, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 4195424, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 4195283, 2024-09-21T01:27:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 4 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 3, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 3, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 0, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 1, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 1, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 0, 2024-09-21T01:27:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 117188, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 316420096 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-09-21T01:27:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-09-21T01:27:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-09-21T01:27:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-09-21T01:27:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 0, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 1, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-09-21T01:27:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 1030, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:27:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:27:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 189383, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 50, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:27:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 7592, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 156, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 8672, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 13, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T01:27:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 2408, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 2408, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2408, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 7.190909004, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.002986257 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2408, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 2409 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 2408, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 2408, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 1575, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 831, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-09-21T01:27:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:27:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-09-21T01:27:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 76, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 2, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 5, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 5, 2024-09-21T01:27:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:27:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 2652, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1005768, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 2652, 2024-09-21T01:27:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2652, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1005768, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T01:27:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 2408, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 1125, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2408, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1125, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 2408, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 2408, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2408, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2408, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-21T01:27:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x558c29d9c5b0": { 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "trackedop": { 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:54.747 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:27:54.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:54 smithi037 ceph-mon[31105]: pgmap v714: 97 pgs: 97 active+clean; 6.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 78 MiB/s wr, 553 op/s 2024-09-21T01:27:55.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:54 smithi137 ceph-mon[34607]: pgmap v714: 97 pgs: 97 active+clean; 6.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 78 MiB/s wr, 553 op/s 2024-09-21T01:27:55.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:54 smithi144 ceph-mon[34818]: pgmap v714: 97 pgs: 97 active+clean; 6.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 78 MiB/s wr, 553 op/s 2024-09-21T01:27:55.554 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T01:27:55.555 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T01:27:55.555 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T01:27:55.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T01:27:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:56.413 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.001513725, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000289277, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:27:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-09-21T01:27:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 179, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 111696, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.027884968, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.023308679, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001280610, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 177, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.020013901, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000113072 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 111696 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 242, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 237, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 536336, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 145152, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T01:27:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.085942321, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.025425073, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.048121008, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 237, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.049727973, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000209822 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 536336, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 145152 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:27:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:27:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:27:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T01:27:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 968, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 239, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 499756, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 239, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 239, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 499756, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:56.425 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:27:56.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:56 smithi037 ceph-mon[31105]: pgmap v715: 97 pgs: 97 active+clean; 6.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 77 MiB/s wr, 536 op/s 2024-09-21T01:27:56.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:27:57.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:56 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:56 smithi137 ceph-mon[34607]: pgmap v715: 97 pgs: 97 active+clean; 6.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 77 MiB/s wr, 536 op/s 2024-09-21T01:27:57.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:56 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:56 smithi144 ceph-mon[34818]: pgmap v715: 97 pgs: 97 active+clean; 6.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 77 MiB/s wr, 536 op/s 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:56 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:57.395 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T01:27:57.395 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T01:27:57.395 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T01:27:57.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T01:27:57.654 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:58.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:27:58.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:27:58.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:57 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:58.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:27:58.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:27:58.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:57 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:58.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:27:58.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:27:58.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:57 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1071, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1064, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 853264, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 406154, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.282658974, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.104953337, 2024-09-21T01:27:58.201 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.080021289, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.085394861, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1063, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.253744196, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000238705 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 575392, 2024-09-21T01:27:58.202 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 143168 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1549, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1722, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 397120, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 887529, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.297561086, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.087335298, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.072314448, 2024-09-21T01:27:58.203 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.125860070, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1721, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.242684850, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000141013 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T01:27:58.204 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 396480 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 4, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 6, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1629, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 1284, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.001534151, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000138816, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001155991, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000108741, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 4, 2024-09-21T01:27:58.205 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.002804413, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000701103 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-09-21T01:27:58.206 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3869, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.172649043, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000044623 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.207 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-09-21T01:27:58.208 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 1, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-09-21T01:27:58.209 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-09-21T01:27:58.210 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:27:58.211 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-09-21T01:27:58.212 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-09-21T01:27:58.213 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_succeeded": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_write_failed": 0 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 3, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-09-21T01:27:58.214 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 2, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 4195200, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 4194892, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 3 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 3, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 3, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 1, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 1, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-09-21T01:27:58.216 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 116608, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 316420096 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.218 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-09-21T01:27:58.220 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.221 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.223 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.225 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-09-21T01:27:58.226 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.227 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 1, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 0, 2024-09-21T01:27:58.228 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 1791, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:27:58.229 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:27:58.230 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:27:58.231 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 197463, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 54, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 7592, 2024-09-21T01:27:58.232 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 156, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 8672, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 13, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-09-21T01:27:58.233 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 2375, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 2375, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2375, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 9.320882166, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.003924581 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2375, 2024-09-21T01:27:58.234 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 2376 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 2375, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 2375, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 1541, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 832, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-09-21T01:27:58.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:27:58.236 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-09-21T01:27:58.237 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 76, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 2, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 6, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 6, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-09-21T01:27:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-09-21T01:27:58.239 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 2620, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1000738, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 2620, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2620, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1000738, 2024-09-21T01:27:58.240 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 2375, 2024-09-21T01:27:58.241 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 901, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2375, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 901, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 2375, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 2375, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 2375, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2375, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x558c49007520": { 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:58.245 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout: "trackedop": { 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:58.246 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:27:59.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:27:58 smithi037 ceph-mon[31105]: pgmap v716: 97 pgs: 97 active+clean; 5.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 67 MiB/s wr, 465 op/s 2024-09-21T01:27:59.126 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T01:27:59.126 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T01:27:59.126 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T01:27:59.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T01:27:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:27:59.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:27:58 smithi137 ceph-mon[34607]: pgmap v716: 97 pgs: 97 active+clean; 5.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 67 MiB/s wr, 465 op/s 2024-09-21T01:27:59.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:27:58 smithi144 ceph-mon[34818]: pgmap v716: 97 pgs: 97 active+clean; 5.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 67 MiB/s wr, 465 op/s 2024-09-21T01:27:59.914 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-21T01:27:59.914 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:27:59.914 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 244, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 239, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 536880, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 146432, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.078879167, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.032278628, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.051004570, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 239, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.044055638, 2024-09-21T01:27:59.915 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000184333 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 536880, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 146432 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 180, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:27:59.916 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 111872, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.029233905, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.024651790, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001441886, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 178, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.030165287, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000169467 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:59.917 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 111872 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000396629, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000324032, 2024-09-21T01:27:59.918 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:27:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:27:59.920 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:27:59.921 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 149024, 2024-09-21T01:27:59.922 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 31, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-09-21T01:27:59.923 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 968, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 241, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 500016, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-09-21T01:27:59.924 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 241, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 241, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 500016, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-21T01:27:59.925 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-21T01:28:00.880 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T01:28:00.880 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T01:28:00.880 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T01:28:00.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T01:28:01.209 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:28:01.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:00 smithi037 ceph-mon[31105]: pgmap v717: 97 pgs: 97 active+clean; 4.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 69 MiB/s wr, 541 op/s 2024-09-21T01:28:01.330 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:00 smithi137 ceph-mon[34607]: pgmap v717: 97 pgs: 97 active+clean; 4.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 69 MiB/s wr, 541 op/s 2024-09-21T01:28:01.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:00 smithi144 ceph-mon[34818]: pgmap v717: 97 pgs: 97 active+clean; 4.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 69 MiB/s wr, 541 op/s 2024-09-21T01:28:01.908 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 6200, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 6317, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1639933, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 398484749, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 17, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 3.562389037, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 2.218723903, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.226201485, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.993082732, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 6316, 2024-09-21T01:28:01.909 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2.792899078, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000442194 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2611, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000718709, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000275 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 5615, 2024-09-21T01:28:01.910 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 5622, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1426299, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 358898040, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 9, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 3.490075528, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 2.297289076, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.142323117, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 1.025401504, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 5623, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 3.513277203, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000624804 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.911 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 954, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000354638, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000371 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 404320 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 619819, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 623087, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 217212306, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 502669932, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 164, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 8, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 47.101682170, 2024-09-21T01:28:01.912 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 25.086458577, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 48.617514394, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 1.684781755, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 623083, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 187.124916620, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000300321 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1006319, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.338991567, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000336 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 664832, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 192640 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.913 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3956, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 482.878044836, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.122062195 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:01.914 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1491, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.047231939, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000031678 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 138, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 137, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 137, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 21.148996954, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.154372240 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.915 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 1, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 322, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 33, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 6, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 27, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 24, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 2, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 9, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 9, 2024-09-21T01:28:01.916 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 2, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 367, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 353, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 12, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 1, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 2, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 1, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 0, 2024-09-21T01:28:01.917 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 241, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 0, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 241, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 93, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 9, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 84, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 148, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 3, 2024-09-21T01:28:01.918 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 209, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 3261, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 614892, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 614702, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 4, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 46 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 0, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 0, 2024-09-21T01:28:01.919 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 7, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 7, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 20, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 13, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:01.920 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 9, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 1, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_started": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_write_failed": 0 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 616012, 2024-09-21T01:28:01.921 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 613923, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 613923, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 2089, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 14929, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 732, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 729, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 729, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 3, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 1, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 17, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 1205260152, 2024-09-21T01:28:01.922 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 1209085565, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 8285, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 2544.628509899, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.307136814 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 30, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 54, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 24, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 19, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 22, 2024-09-21T01:28:01.923 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 3, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 32, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 65, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 33, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 9, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 36, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 27, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 151644, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 398344192 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 283, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 2, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 138, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 17, 2024-09-21T01:28:01.924 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 6, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 22, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.022048571, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001002207 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 50, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 20.933352627, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.418667052 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.925 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 16, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.005155392, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000322212 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.926 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000490296, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000245148 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:01.927 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.928 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 10, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.015349036, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001534903 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.929 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000403349, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000403349 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-09-21T01:28:01.930 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.012975494, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.003243873 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.002135918, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001067959 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.931 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.112966873, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.028241718 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.932 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.001193991, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001193991 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 9, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.024665911, 2024-09-21T01:28:01.934 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002740656 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 16, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.018259496, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.001141218 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:01.935 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 1, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 2, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 1, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 1, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 46, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 46, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 725, 2024-09-21T01:28:01.936 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:01.937 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:01.938 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 308371, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 122, 2024-09-21T01:28:01.939 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 156, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-21T01:28:01.940 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 126895, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 1828, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 12258, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 1205509264, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 37, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 12258, 2024-09-21T01:28:01.941 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 12258, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 726.754397035, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.059288170 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 12258, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 12985 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 12258, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 266, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 11992, 2024-09-21T01:28:01.942 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 300, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 44, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 16, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 8292, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 147, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 2634, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:01.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 250, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 88, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-09-21T01:28:01.944 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 76, 2024-09-21T01:28:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 2, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 12, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 12, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 1197, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 0, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 17 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-09-21T01:28:01.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 513, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 6, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 1549, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 13, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:01.947 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 631630, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 163407401, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 631630, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 631630, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 163407401, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:01.948 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 12258, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 1205510577, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 12258, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1205510577, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 12258, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 12258, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 12258, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 12258, 2024-09-21T01:28:01.950 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 13, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1313, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 13, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:01.951 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 7, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1313, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x55bb9c4fb450": { 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 616012, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1204891261, 2024-09-21T01:28:01.952 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 616012, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 8285, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1204891261, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "trackedop": { 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:01.953 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-21T01:28:02.946 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-21T01:28:02.946 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-21T01:28:02.946 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T01:28:02.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T01:28:03.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:02 smithi137 ceph-mon[34607]: pgmap v718: 97 pgs: 97 active+clean; 4.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 65 MiB/s wr, 567 op/s 2024-09-21T01:28:03.206 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:28:03.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:02 smithi037 ceph-mon[31105]: pgmap v718: 97 pgs: 97 active+clean; 4.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 65 MiB/s wr, 567 op/s 2024-09-21T01:28:03.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:02 smithi144 ceph-mon[34818]: pgmap v718: 97 pgs: 97 active+clean; 4.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 65 MiB/s wr, 567 op/s 2024-09-21T01:28:03.781 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-21T01:28:03.781 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 2283, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 2276, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 403894160, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 793026, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 7, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.557494506, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.127807100, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.337478306, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.078913187, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2275, 2024-09-21T01:28:03.782 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.181847746, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000079933 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 576912, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 146528 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:03.783 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 1194, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 1371, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 423991296, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 777000, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 7, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.518725320, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.059356884, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.391556891, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.049720017, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1370, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.091325487, 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000066660 2024-09-21T01:28:03.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 398832 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 1251, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 1253, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 379003890, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 397825, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 6, 2024-09-21T01:28:03.785 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.465296389, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.051650372, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.337994276, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.058382182, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1251, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.066311173, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000053006 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 6416, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.221322391, 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000034495 2024-09-21T01:28:03.787 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 0, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 0, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.788 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 50, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 4, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 46, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:03.789 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 43, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 2, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-09-21T01:28:03.790 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 4, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 234, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:03.791 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 0, 2024-09-21T01:28:03.792 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 0 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-09-21T01:28:03.793 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:03.794 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_started": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_write_failed": 0 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 616012, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-09-21T01:28:03.795 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 0, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 20, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 80, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 1205260152, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 1209085565, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 1209084966, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 616012 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 21, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 36, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 15, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 10, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 13, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 3, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 50, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 55, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 5, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 0, 2024-09-21T01:28:03.797 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 121804, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 333578240 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.798 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.799 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.802 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-09-21T01:28:03.802 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.802 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.802 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.802 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.803 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:03.804 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.805 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.806 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.807 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-09-21T01:28:03.808 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 1, 2024-09-21T01:28:03.809 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 2, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 1, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 1, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 0, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 0, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 2016, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:03.810 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:03.811 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:03.813 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:03.813 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:03.813 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:03.813 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:03.814 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 238923, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 84, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:03.815 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 156, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 96600, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 1270, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-09-21T01:28:03.816 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 4473, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 26, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 4, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 4473, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4473, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 28.598505386, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.006393584 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 4473, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 4474 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.817 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 4473, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 4473, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 2917, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 1553, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 0, 2024-09-21T01:28:03.818 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 2, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-09-21T01:28:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 76, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-09-21T01:28:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 2, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 11, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 11, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 0, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 2, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 0 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 0, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-09-21T01:28:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 4724, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1206448405, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 4724, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 4724, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1206448405, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 4473, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 1205101092, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 4473, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1205101092, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 4473, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 4473, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 4473, 2024-09-21T01:28:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 4473, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x5591bc69f450": { 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "trackedop": { 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-09-21T01:28:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:03.829 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-21T01:28:04.734 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T01:28:04.735 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T01:28:04.735 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T01:28:04.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T01:28:04.994 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:28:05.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:04 smithi037 ceph-mon[31105]: pgmap v719: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 63 MiB/s wr, 583 op/s 2024-09-21T01:28:05.276 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:04 smithi137 ceph-mon[34607]: pgmap v719: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 63 MiB/s wr, 583 op/s 2024-09-21T01:28:05.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:04 smithi144 ceph-mon[34818]: pgmap v719: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 63 MiB/s wr, 583 op/s 2024-09-21T01:28:05.570 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-21T01:28:05.570 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 455, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 619, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 122416, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 366414, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 27, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.101417688, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.037840377, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.053660904, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.005299476, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 620, 2024-09-21T01:28:05.571 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.069621019, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000112291 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 994, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000253963, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000255 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 359, 2024-09-21T01:28:05.572 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 348, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 642959, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 200523, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 7, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 5, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.053725312, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.025055105, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.040355684, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000585950, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 347, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.050466179, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000145435 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.573 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 118, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000027765, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000235 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 595344, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 150528 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 145, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 325, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 92324, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 547725, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 14, 2024-09-21T01:28:05.574 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 6, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.029900178, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.017019447, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.012891533, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000187277, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 321, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.035693098, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000111193 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 245, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000051364, 2024-09-21T01:28:05.575 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000209 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 400592 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 42, 2024-09-21T01:28:05.576 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.001610081, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000038335 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 2, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000021534, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000010767 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 0, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 0, 2024-09-21T01:28:05.577 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 11, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 10, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 0, 2024-09-21T01:28:05.578 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 10, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 10, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 1, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:05.579 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 22, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 10738144027, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:28:05.580 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 0, 2024-09-21T01:28:05.581 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 0 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 1, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 0, 2024-09-21T01:28:05.582 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:05.583 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_started": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_write_failed": 0 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 4, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 4, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-09-21T01:28:05.584 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 2, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 2, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 2, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 4195424, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 0, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.006501249, 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.002167083 2024-09-21T01:28:05.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 0 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 13, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 13, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 0, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 11, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 12, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 1, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 10, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 10, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 0, 2024-09-21T01:28:05.586 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 117308, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 324808704 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 4, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 0, 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-09-21T01:28:05.587 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.590 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.591 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.593 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.594 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:05.595 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:05.598 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 0, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 1, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 1, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 0, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 0, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 0, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 69, 2024-09-21T01:28:05.599 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:05.600 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:05.601 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 230375, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 80, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-21T01:28:05.602 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 156, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 51192, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 198, 2024-09-21T01:28:05.603 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 38, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 11332, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 33, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 38, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 38, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.231995930, 2024-09-21T01:28:05.604 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.006105156 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 38, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 60 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 38, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 0, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 38, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 0, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 10, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 0, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 3, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 6, 2024-09-21T01:28:05.605 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 6, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 20, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-09-21T01:28:05.606 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-09-21T01:28:05.607 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 76, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 2, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 8, 2024-09-21T01:28:05.608 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 8, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 14, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 0, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 1 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 1, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-09-21T01:28:05.609 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 955, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 754336, 2024-09-21T01:28:05.610 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 955, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 955, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 754336, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:05.611 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 38, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 11332, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 38, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 11332, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.612 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 38, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 38, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 38, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 38, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.613 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-21T01:28:05.614 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x56155ce23380": { 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 4, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1120, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:05.615 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 4, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 3, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1120, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "trackedop": { 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:05.616 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-21T01:28:07.126 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:07 smithi137 ceph-mon[34607]: pgmap v720: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 60 MiB/s wr, 584 op/s 2024-09-21T01:28:07.155 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T01:28:07.155 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T01:28:07.155 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T01:28:07.155 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T01:28:07.406 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:28:07.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:07 smithi144 ceph-mon[34818]: pgmap v720: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 60 MiB/s wr, 584 op/s 2024-09-21T01:28:07.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:07 smithi037 ceph-mon[31105]: pgmap v720: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 60 MiB/s wr, 584 op/s 2024-09-21T01:28:07.992 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-21T01:28:07.992 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:07.992 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 835, 2024-09-21T01:28:07.992 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 837, 2024-09-21T01:28:07.992 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 219981, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 265594, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 6, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 2, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.107882856, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.047443285, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.022521356, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.028692707, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 835, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.039339261, 2024-09-21T01:28:07.993 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000047112 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:07.994 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 3, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 185, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 674, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 401201, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.014360964, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.011454579, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.001347529, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000040554, 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:07.995 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 183, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.011733078, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000064115 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 400560 2024-09-21T01:28:07.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 1089, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 1080, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 860336, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 413794, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 3, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 2, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.171895732, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.068595013, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.061546714, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.040174175, 2024-09-21T01:28:07.997 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1080, 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.072013074, 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000066678 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:07.998 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 581120, 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 149536 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 1, 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-MDSRank": { 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:07.999 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3329, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.135797161, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000040792 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "queue_len": 0, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "complete_latency": { 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.000 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": { 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "request": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "reply": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "reply_latency": { 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_reply": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "forward": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:08.001 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_commit": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_split": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_merge": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_top": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_bottom": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_pinned": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_expired": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "inodes_with_caps": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": 0, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "subtrees": 1, 2024-09-21T01:28:08.002 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_hit": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_forward": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_discover": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "traverse_lock": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "load_cent": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "q": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "exported": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "exported_inodes": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "imported": 0, 2024-09-21T01:28:08.003 INFO:teuthology.orchestra.run.smithi137.stdout: "imported_inodes": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rfiles": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rbytes": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "root_rsnaps": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:08.004 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_file_inodes": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_cap_release": 0, 2024-09-21T01:28:08.005 INFO:teuthology.orchestra.run.smithi137.stdout: "process_request_cap_release": 0 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache": { 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_try_discover": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_send_discover": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_created": 0, 2024-09-21T01:28:08.006 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_enqueued": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "strays_migrated": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_started": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "recovery_completed": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_exportdir": 0, 2024-09-21T01:28:08.007 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_flush": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_started": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "uninline_write_failed": 0 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log": { 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "evlrg": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "evadd": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "evex": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "evtrm": 0, 2024-09-21T01:28:08.008 INFO:teuthology.orchestra.run.smithi137.stdout: "ev": 2, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "evexg": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "evexd": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "segadd": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "segex": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "segtrm": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "seg": 2, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "segmjr": 2, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "segexg": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "segexd": 0, 2024-09-21T01:28:08.009 INFO:teuthology.orchestra.run.smithi137.stdout: "expos": 4194304, 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "wrpos": 4194892, 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "rdpos": 4194352, 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "jlat": { 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: "replayed": 2 2024-09-21T01:28:08.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mem": { 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 3, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "ino+": 3, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "ino-": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "dir": 1, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "dir+": 1, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "dir-": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "dn": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "dn+": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "dn-": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "cap": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "cap+": 0, 2024-09-21T01:28:08.011 INFO:teuthology.orchestra.run.smithi137.stdout: "cap-": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "rss": 116500, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "heap": 315375616 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server": { 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_client_request": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "dispatch_server_request": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_request": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_client_session": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "handle_peer_request": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "req_create_latency": { 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.012 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getattr_latency": { 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "req_link_latency": { 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookup_latency": { 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupino_latency": { 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupname_latency": { 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "req_lssnap_latency": { 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.016 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mkdir_latency": { 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.017 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mknod_latency": { 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "req_mksnap_latency": { 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "req_open_latency": { 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "req_readdir_latency": { 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rename_latency": { 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmdir_latency": { 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:08.020 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setattr_latency": { 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.021 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setlayout_latency": { 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "req_setxattr_latency": { 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "req_symlink_latency": { 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "req_unlink_latency": { 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.023 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessions": { 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "session_count": 0, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "session_add": 0, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "session_remove": 0, 2024-09-21T01:28:08.024 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_open": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions_stale": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "total_load": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "average_load": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "avg_session_uptime": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:08.025 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:08.026 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:08.027 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 181303, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 46, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 156, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:08.028 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 8672, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 13, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter": { 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "op_active": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "op_laggy": 0, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send": 1668, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "op_send_bytes": 21, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "op_resend": 3, 2024-09-21T01:28:08.029 INFO:teuthology.orchestra.run.smithi137.stdout: "op_reply": 1668, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "op_latency": { 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1668, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 13.998758553, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.008392541 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "op_inflight": 0, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "oplen_avg": { 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 1668, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 1669 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "op": 1668, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "op_r": 1668, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "op_w": 0, 2024-09-21T01:28:08.030 INFO:teuthology.orchestra.run.smithi137.stdout: "op_rmw": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "op_pg": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_stat": 831, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_create": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_read": 835, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_write": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writefull": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_writesame": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_append": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_zero": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_truncate": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_delete": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_mapext": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:08.031 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_getxattr": 1, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_setxattr": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_call": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_watch": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_notify": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "osdop_other": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_active": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_send": 0, 2024-09-21T01:28:08.032 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_resend": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "linger_ping": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_active": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_send": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "poolop_resend": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_active": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_send": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "poolstat_resend": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_active": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_send": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "statfs_resend": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "command_active": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "command_send": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "command_resend": 0, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "map_epoch": 76, 2024-09-21T01:28:08.033 INFO:teuthology.orchestra.run.smithi137.stdout: "map_full": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "map_inc": 2, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_sessions": 4, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_open": 4, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_session_close": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_laggy": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_wr": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_rd": 2, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_del": 0 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "oft": { 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_objs": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_updates": 0, 2024-09-21T01:28:08.034 INFO:teuthology.orchestra.run.smithi137.stdout: "omap_total_removes": 0 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "purge_queue": { 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executing_high_water": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed_ops": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_executed": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:08.035 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 1923, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 891926, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 1923, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 1923, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 891926, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.036 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 1668, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 593, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 1668, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 593, 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:08.037 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 1024, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:08.038 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 1668, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 1668, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 1668, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1668, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:08.039 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-write_buf_throttle-0x5581f00472b0": { 2024-09-21T01:28:08.040 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 3758096384, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-09-21T01:28:08.041 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-09-21T01:28:08.042 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-09-21T01:28:08.042 INFO:teuthology.orchestra.run.smithi137.stdout: "trackedop": { 2024-09-21T01:28:08.042 INFO:teuthology.orchestra.run.smithi137.stdout: "slow_ops_count": 0 2024-09-21T01:28:08.042 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-09-21T01:28:08.042 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-21T01:28:08.782 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T01:28:08.782 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T01:28:08.783 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T01:28:08.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T01:28:09.093 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:28:09.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:09 smithi144 ceph-mon[34818]: pgmap v721: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 550 op/s 2024-09-21T01:28:09.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:09 smithi137 ceph-mon[34607]: pgmap v721: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 550 op/s 2024-09-21T01:28:09.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:09 smithi037 ceph-mon[31105]: pgmap v721: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 55 MiB/s wr, 550 op/s 2024-09-21T01:28:09.697 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T01:28:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 104, 2024-09-21T01:28:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 106, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 54925, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 274935, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 27, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 7, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.024819848, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.005241960, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.016718792, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000474717, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 103, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.028469715, 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000276405 2024-09-21T01:28:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 142, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000041644, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000293 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 718, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 872, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 716555, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 285473, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2024-09-21T01:28:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.118448990, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.051729186, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.068039932, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.005765590, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 871, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.059235074, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000068008 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 992, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000371676, 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000374 2024-09-21T01:28:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 601088, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 151808 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 142, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 319, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 91354, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 543325, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 13, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.029792146, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.017505469, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.011780827, 2024-09-21T01:28:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000154831, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 319, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.030057952, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000094225 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 252, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000057643, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000228 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 401664 2024-09-21T01:28:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 35, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.001370898, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000039168 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000021895, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000010947 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 11, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 10, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 10, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 10, 2024-09-21T01:28:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 1, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 1000, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 1, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T01:28:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 22, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 10738144027, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T01:28:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 1, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 2, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 2, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 2, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T01:28:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4194892, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.002133426, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002133426 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 13, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 13, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-21T01:28:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 11, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 12, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 1, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 10, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 10, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 119976, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 324804608 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T01:28:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.716 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T01:28:09.717 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.718 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.722 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T01:28:09.723 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-21T01:28:09.725 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:09.726 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:09.727 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 246295, 2024-09-21T01:28:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 82, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 156, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 51192, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 198, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 35, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 10710, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 33, 2024-09-21T01:28:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 35, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 35, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.205996311, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.005885608 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 35, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 57 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 35, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 0, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 35, 2024-09-21T01:28:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 10, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 1, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 5, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 6, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 20, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T01:28:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T01:28:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 76, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 8, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 8, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 14, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 1 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 960, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 758993, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 960, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 960, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 758993, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 35, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 10710, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 35, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 10710, 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 35, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 35, 2024-09-21T01:28:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 35, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 35, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x561140b5f450": { 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 588, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 1, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 588, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T01:28:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T01:28:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:09.743 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T01:28:10.898 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T01:28:10.898 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T01:28:10.898 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T01:28:10.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T01:28:11.156 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:28:11.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:11 smithi144 ceph-mon[34818]: pgmap v722: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 65 MiB/s wr, 664 op/s 2024-09-21T01:28:11.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:11 smithi137 ceph-mon[34607]: pgmap v722: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 65 MiB/s wr, 664 op/s 2024-09-21T01:28:11.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:11 smithi037 ceph-mon[31105]: pgmap v722: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 65 MiB/s wr, 664 op/s 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1169, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 889, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 328979, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 349491, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 10, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.114140712, 2024-09-21T01:28:12.011 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.047686897, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.074341019, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.005389811, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 888, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.061377677, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000069119 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1903, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000523699, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000275 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 375, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 367, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 639740, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 259426, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 12, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.063495838, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.029214472, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.041988497, 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000305218, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 366, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.038027493, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000103900 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 149, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000031661, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000212 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 589744, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 152448 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 102, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 282, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 52038, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 676745, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 27, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 8, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.034288831, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.015582519, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.016280562, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000523708, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 280, 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.027526885, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000098310 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 139, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000057654, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000414 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 401856 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.016 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 47, 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.001644448, 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000034988 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000023634, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000011817 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 2, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 1, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000951674, 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000951674 2024-09-21T01:28:12.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 1, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 11, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 14, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 14, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 14, 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 1, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 1, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 3, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 1, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 1, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 1000, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 1, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 22, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 10738144027, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:12.021 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 1, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 1, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 1, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 1 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.022 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 2, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:12.023 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T01:28:12.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 3, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 3, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 2, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-21T01:28:12.025 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4195200, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003559303, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001779651 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 17, 2024-09-21T01:28:12.026 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 17, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 15, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 16, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 1, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 14, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 14, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 1, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 1, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 120688, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 324812800 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.027 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 3, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 2, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 10, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000951674, 2024-09-21T01:28:12.028 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000951674 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.029 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.030 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T01:28:12.031 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.033 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.034 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:12.035 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.036 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.037 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.038 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-21T01:28:12.039 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 1, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 1, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 733, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:12.040 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:12.041 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:12.042 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 279023, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 98, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 156, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:12.043 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 68593, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 318, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 39, 2024-09-21T01:28:12.044 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 11513, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 33, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 39, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 39, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.226995967, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.005820409 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 39, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 63 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 39, 2024-09-21T01:28:12.045 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 39, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 10, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 2, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 6, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T01:28:12.046 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 6, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 20, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:12.047 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T01:28:12.048 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 76, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 9, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 9, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 18, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 1 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.049 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:12.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 1642, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 855666, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 1642, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 1642, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 855666, 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:12.051 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 39, 2024-09-21T01:28:12.052 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 11513, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 39, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 11513, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:12.053 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 39, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 39, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 39, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 39, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:12.054 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x555924981520": { 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 3, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 896, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 3, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 896, 2024-09-21T01:28:12.056 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:12.057 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T01:28:12.954 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T01:28:12.954 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T01:28:12.954 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T01:28:12.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T01:28:13.205 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:28:13.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:13 smithi037 ceph-mon[31105]: pgmap v723: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 65 MiB/s wr, 646 op/s 2024-09-21T01:28:13.327 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:13 smithi144 ceph-mon[34818]: pgmap v723: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 65 MiB/s wr, 646 op/s 2024-09-21T01:28:13.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:13 smithi137 ceph-mon[34607]: pgmap v723: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 65 MiB/s wr, 646 op/s 2024-09-21T01:28:13.741 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T01:28:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 2240, 2024-09-21T01:28:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1479, 2024-09-21T01:28:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 1132360, 2024-09-21T01:28:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 605671, 2024-09-21T01:28:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 9, 2024-09-21T01:28:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-21T01:28:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.198764722, 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.084975789, 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.164008175, 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.007083866, 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1479, 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.087778551, 2024-09-21T01:28:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000059349 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2858, 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000785788, 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000274 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 609968, 2024-09-21T01:28:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 157616 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 111, 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 297, 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 55030, 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 539717, 2024-09-21T01:28:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 16, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.036418414, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.017771427, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.015545338, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000737353, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 295, 2024-09-21T01:28:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.029987193, 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000101651 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 185, 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000048279, 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000260 2024-09-21T01:28:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 405024 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 125, 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 127, 2024-09-21T01:28:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 63319, 2024-09-21T01:28:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 265708, 2024-09-21T01:28:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 24, 2024-09-21T01:28:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 8, 2024-09-21T01:28:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.025925455, 2024-09-21T01:28:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.007295978, 2024-09-21T01:28:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.016280283, 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.001918854, 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 125, 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.022726689, 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000181813 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 138, 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000028950, 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000209 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:28:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T01:28:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T01:28:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T01:28:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T01:28:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 78, 2024-09-21T01:28:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.008906384, 2024-09-21T01:28:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000114184 2024-09-21T01:28:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 16, 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000505062, 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000031566 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 6, 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 5, 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 5, 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.010127402, 2024-09-21T01:28:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002025480 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 1, 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 11, 2024-09-21T01:28:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 15, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 1, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 14, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 13, 2024-09-21T01:28:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 8, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 3, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 28, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 22, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T01:28:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 2, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 1, 2024-09-21T01:28:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 1, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 2, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 14, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 22, 2024-09-21T01:28:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 10738144027, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 14, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 14, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 6, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 3, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 5, 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 2, 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 5 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T01:28:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T01:28:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T01:28:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 3, 2024-09-21T01:28:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 2, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 2, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T01:28:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 1, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T01:28:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 18, 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T01:28:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 18, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 2, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T01:28:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-21T01:28:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T01:28:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T01:28:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T01:28:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4220360, 2024-09-21T01:28:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-21T01:28:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 14, 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.062131295, 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.004437949 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T01:28:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 19, 2024-09-21T01:28:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 25, 2024-09-21T01:28:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 6, 2024-09-21T01:28:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 18, 2024-09-21T01:28:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 23, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 5, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 15, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 27, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 12, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 6, 2024-09-21T01:28:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 6, 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 118576, 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 325861376 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 10, 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 1, 2024-09-21T01:28:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 6, 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 13, 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 4, 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000251652, 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000251652 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T01:28:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-21T01:28:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000658700, 2024-09-21T01:28:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000658700 2024-09-21T01:28:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T01:28:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T01:28:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000704355, 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000704355 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T01:28:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T01:28:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T01:28:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.008512695, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.004256347 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-21T01:28:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 2, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 3, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 3, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 2028, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 267323, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 94, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 156, 2024-09-21T01:28:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 77473, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 349, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 83, 2024-09-21T01:28:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 38377, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 33, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 83, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 83, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.560990088, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.006758916 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 83, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 110 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 83, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 15, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 68, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 10, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 1, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 15, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 11, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T01:28:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 14, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 14, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 20, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T01:28:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 76, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 9, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 9, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T01:28:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 21, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 4 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 2, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 2, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 2, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 2, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2472, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 1009901, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2472, 2024-09-21T01:28:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2472, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1009901, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 83, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 38579, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 83, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 38579, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 83, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 83, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 83, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 83, 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 202, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 1, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 202, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55c771bc1380": { 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 18, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 26056, 2024-09-21T01:28:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 18, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 14, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 26056, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T01:28:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:13.815 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T01:28:14.666 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-21T01:28:14.667 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-21T01:28:14.667 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T01:28:14.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T01:28:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:28:15.329 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:15 smithi144 ceph-mon[34818]: pgmap v724: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 67 MiB/s wr, 694 op/s 2024-09-21T01:28:15.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:15 smithi137 ceph-mon[34607]: pgmap v724: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 67 MiB/s wr, 694 op/s 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1106, 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1099, 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 864880, 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 420686, 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-21T01:28:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.167894919, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.072274365, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.057265611, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.036228297, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1098, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.051858897, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000047230 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.452 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 579616, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 150704 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 8, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 190, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 3820, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 495706, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.016825869, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.011718993, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.003345951, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000077780, 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 189, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.013840246, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000073228 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 495008 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1635, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1637, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 442495, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 519937, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.154613889, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.059416929, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.036720215, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.051056062, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1635, 2024-09-21T01:28:15.455 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.084920833, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000051939 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T01:28:15.456 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4151, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.136250839, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000032823 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.457 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T01:28:15.458 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 3, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 3, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 3, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 1, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T01:28:15.459 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:28:15.460 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:28:15.461 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T01:28:15.462 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T01:28:15.463 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 18, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T01:28:15.464 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4220360, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 4218709, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 18 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.465 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 4, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 16, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 12, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 2, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 11, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 3, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 15, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 12, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 116896, 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 316420096 2024-09-21T01:28:15.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.467 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.468 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.470 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.471 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.472 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.473 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.475 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.476 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:28:15.477 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 2, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 2031, 2024-09-21T01:28:15.478 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:28:15.479 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T01:28:15.480 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 182071, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 47, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T01:28:15.481 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7592, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 156, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 14288, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 40, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T01:28:15.482 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 2486, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 2486, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2486, 2024-09-21T01:28:15.483 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 4.882916418, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001964165 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2486, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2487 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 2486, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2486, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T01:28:15.484 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 1623, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 861, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2024-09-21T01:28:15.485 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T01:28:15.486 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 76, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T01:28:15.487 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 2, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 4, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 4, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2745, 2024-09-21T01:28:15.489 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 1047964, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2745, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2745, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1047964, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:15.490 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2486, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 26061, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2486, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 26061, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.491 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2486, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 2486, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2486, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 2486, 2024-09-21T01:28:15.492 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T01:28:15.493 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x557a784d5520": { 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T01:28:15.494 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T01:28:15.495 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T01:28:15.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:15 smithi037 ceph-mon[31105]: pgmap v724: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 67 MiB/s wr, 694 op/s 2024-09-21T01:28:16.290 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T01:28:16.291 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T01:28:16.291 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T01:28:16.302 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T01:28:16.302 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:28:16.302 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:28:16.338 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-21T01:28:16.338 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:28:16.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:28:16.766 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:17.243 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:17 smithi037 ceph-mon[31105]: pgmap v725: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 66 MiB/s wr, 724 op/s 2024-09-21T01:28:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 -- 172.21.15.37:0/2553769947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3341094b0 msgr2=0x7fd3341098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2553769947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3341094b0 0x7fd3341098c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd328009900 tx=0x7fd32802a410 comp rx=0 tx=0).stop 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 -- 172.21.15.37:0/2553769947 shutdown_connections 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2553769947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd334109e00 0x7fd334110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2553769947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3341094b0 0x7fd3341098c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2553769947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd334103bc0 0x7fd334103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 -- 172.21.15.37:0/2553769947 >> 172.21.15.37:0/2553769947 conn(0x7fd33407b910 msgr2=0x7fd33407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 -- 172.21.15.37:0/2553769947 shutdown_connections 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.362+0000 7fd338e7c640 1 -- 172.21.15.37:0/2553769947 wait complete. 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.363+0000 7fd338e7c640 1 Processor -- start 2024-09-21T01:28:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.363+0000 7fd338e7c640 1 -- start start 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd338e7c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd334103bc0 0x7fd334075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd338e7c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3341094b0 0x7fd334075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd338e7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 0x7fd334076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd338e7c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd334113ac0 con 0x7fd334109e00 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd338e7c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd334113940 con 0x7fd334103bc0 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd338e7c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd334113c40 con 0x7fd3341094b0 2024-09-21T01:28:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 0x7fd334076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 0x7fd334076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34302/0 (socket says 172.21.15.37:34302) 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 -- 172.21.15.37:0/2370214832 learned_addr learned my addr 172.21.15.37:0/2370214832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd33259c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd334103bc0 0x7fd334075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd331d9b640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3341094b0 0x7fd334075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 -- 172.21.15.37:0/2370214832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3341094b0 msgr2=0x7fd334075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3341094b0 0x7fd334075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 -- 172.21.15.37:0/2370214832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd334103bc0 msgr2=0x7fd334075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd334103bc0 0x7fd334075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 -- 172.21.15.37:0/2370214832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3341a8790 con 0x7fd334109e00 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.364+0000 7fd332d9d640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 0x7fd334076190 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00eb10 tx=0x7fd32c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.365+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c004b20 con 0x7fd334109e00 2024-09-21T01:28:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.365+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3341a8a80 con 0x7fd334109e00 2024-09-21T01:28:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.365+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32c004cc0 con 0x7fd334109e00 2024-09-21T01:28:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.365+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c010670 con 0x7fd334109e00 2024-09-21T01:28:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.365+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341a8f40 con 0x7fd334109e00 2024-09-21T01:28:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.366+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd334103fd0 con 0x7fd334109e00 2024-09-21T01:28:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.368+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd32c005000 con 0x7fd334109e00 2024-09-21T01:28:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.368+0000 7fd3237fe640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd31c0b6510 0x7fd31c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.368+0000 7fd33259c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd31c0b6510 0x7fd31c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.368+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd32c0e7a10 con 0x7fd334109e00 2024-09-21T01:28:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.369+0000 7fd33259c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd31c0b6510 0x7fd31c0b8a20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd334077160 tx=0x7fd32400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.372+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd32c056710 con 0x7fd334109e00 2024-09-21T01:28:17.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:17 smithi137 ceph-mon[34607]: pgmap v725: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 66 MiB/s wr, 724 op/s 2024-09-21T01:28:17.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:17 smithi144 ceph-mon[34818]: pgmap v725: 97 pgs: 97 active+clean; 4.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 66 MiB/s wr, 724 op/s 2024-09-21T01:28:17.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.572+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd334076a10 con 0x7fd334109e00 2024-09-21T01:28:17.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.572+0000 7fd3237fe640 1 -- 172.21.15.37:0/2370214832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v76) ==== 81+0+591 (secure 0 0 0) 0x7fd334076a10 con 0x7fd334109e00 2024-09-21T01:28:17.573 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2383418046 2024-09-22T01:06:16.751077+0000 2024-09-21T01:28:17.573 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3976496410 2024-09-22T01:06:16.751077+0000 2024-09-21T01:28:17.573 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3304055550 2024-09-22T01:05:50.424453+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3304055550 2024-09-22T01:05:50.424453+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2530616561 2024-09-22T01:05:50.424453+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2065066033 2024-09-22T01:06:16.751077+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1699078547 2024-09-22T01:05:50.424453+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3976496410 2024-09-22T01:06:16.751077+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3851858190 2024-09-22T01:06:16.751077+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/863846747 2024-09-22T01:05:50.424453+0000 2024-09-21T01:28:17.574 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-21T01:28:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd31c0b6510 msgr2=0x7fd31c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd31c0b6510 0x7fd31c0b8a20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd334077160 tx=0x7fd32400b390 comp rx=0 tx=0).stop 2024-09-21T01:28:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 msgr2=0x7fd334076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 0x7fd334076190 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00eb10 tx=0x7fd32c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 shutdown_connections 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd31c0b6510 0x7fd31c0b8a20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd334109e00 0x7fd334076190 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3341094b0 0x7fd334075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 --2- 172.21.15.37:0/2370214832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd334103bc0 0x7fd334075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 >> 172.21.15.37:0/2370214832 conn(0x7fd33407b910 msgr2=0x7fd334105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 shutdown_connections 2024-09-21T01:28:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:17.575+0000 7fd338e7c640 1 -- 172.21.15.37:0/2370214832 wait complete. 2024-09-21T01:28:18.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:18 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2370214832' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:28:18.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:18 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2370214832' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:28:18.499 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:18 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2370214832' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:28:18.931 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T01:28:18.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:28:18.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T01:28:18.995 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:28:18.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:28:18.995 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T01:28:19.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:28:19.044 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-21T01:28:19.105 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:28:19.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:28:19.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:28:19.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:28:19.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-21T01:28:19.149 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:19 smithi037 ceph-mon[31105]: pgmap v726: 97 pgs: 97 active+clean; 3.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 59 MiB/s wr, 680 op/s 2024-09-21T01:28:19.215 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T01:28:19.227 INFO:tasks.cephadm:Teardown begin 2024-09-21T01:28:19.227 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T01:28:19.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:28:19.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:19 smithi137 ceph-mon[34607]: pgmap v726: 97 pgs: 97 active+clean; 3.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 59 MiB/s wr, 680 op/s 2024-09-21T01:28:19.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:19 smithi144 ceph-mon[34818]: pgmap v726: 97 pgs: 97 active+clean; 3.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 59 MiB/s wr, 680 op/s 2024-09-21T01:28:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/2361372720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8102a90 msgr2=0x7f0dd8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/2361372720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8102a90 0x7f0dd8102ea0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009ca0 tx=0x7f0dd402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/2361372720 shutdown_connections 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/2361372720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8108d20 0x7f0dd810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/2361372720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 0x7f0dd81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/2361372720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8102a90 0x7f0dd8102ea0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/2361372720 >> 172.21.15.37:0/2361372720 conn(0x7f0dd8079750 msgr2=0x7f0dd8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:20.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/2361372720 shutdown_connections 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.000+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/2361372720 wait complete. 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 Processor -- start 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 -- start start 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8102a90 0x7f0dd8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 0x7f0dd81998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 0x7f0dd819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8112990 con 0x7f0dd8108d20 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8112810 con 0x7f0dd81083d0 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddfcb2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8112b10 con 0x7f0dd8102a90 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0dde24f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 0x7f0dd819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0dde24f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 0x7f0dd819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34306/0 (socket says 172.21.15.37:34306) 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0dde24f640 1 -- 172.21.15.37:0/1350605571 learned_addr learned my addr 172.21.15.37:0/1350605571 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:20.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddd24d640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 0x7f0dd81998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.001+0000 7f0ddda4e640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8102a90 0x7f0dd8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dde24f640 1 -- 172.21.15.37:0/1350605571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8102a90 msgr2=0x7f0dd8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dde24f640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8102a90 0x7f0dd8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dde24f640 1 -- 172.21.15.37:0/1350605571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 msgr2=0x7f0dd81998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dde24f640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 0x7f0dd81998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dde24f640 1 -- 172.21.15.37:0/1350605571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd819f1d0 con 0x7f0dd8108d20 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0ddda4e640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8102a90 0x7f0dd8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0ddd24d640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 0x7f0dd81998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dde24f640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 0x7f0dd819eb60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000e970 tx=0x7f0dd000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000ccc0 con 0x7f0dd8108d20 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd000ce60 con 0x7f0dd8108d20 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0010430 con 0x7f0dd8108d20 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd819f4c0 con 0x7f0dd8108d20 2024-09-21T01:28:20.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.002+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd81a5ce0 con 0x7f0dd8108d20 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.003+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd8103d10 con 0x7f0dd8108d20 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.005+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0dd00105d0 con 0x7f0dd8108d20 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.005+0000 7f0dceffd640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0dc40b65c0 0x7f0dc40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.006+0000 7f0ddda4e640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0dc40b65c0 0x7f0dc40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.006+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f0dd00e7770 con 0x7f0dd8108d20 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.006+0000 7f0ddda4e640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0dc40b65c0 0x7f0dc40b8ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40094e0 tx=0x7f0dd40093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:20.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.010+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dd00055f0 con 0x7f0dd8108d20 2024-09-21T01:28:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.238+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dd810ab50 con 0x7f0dd8108d20 2024-09-21T01:28:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.239+0000 7f0dceffd640 1 -- 172.21.15.37:0/1350605571 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11977 (secure 0 0 0) 0x7f0dd00ae000 con 0x7f0dd8108d20 2024-09-21T01:28:20.240 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:28:20.240 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"btime":"2024-09-21T01:27:16:685003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:27:16.608200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:28:20.240 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0dc40b65c0 msgr2=0x7f0dc40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0dc40b65c0 0x7f0dc40b8ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40094e0 tx=0x7f0dd40093f0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 msgr2=0x7f0dd819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 0x7f0dd819eb60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000e970 tx=0x7f0dd000ed70 comp rx=0 tx=0).stop 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 shutdown_connections 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f0dc40b65c0 0x7f0dc40b8ad0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd8108d20 0x7f0dd819eb60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd81083d0 0x7f0dd81998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 --2- 172.21.15.37:0/1350605571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dd8102a90 0x7f0dd8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 >> 172.21.15.37:0/1350605571 conn(0x7f0dd8079750 msgr2=0x7f0dd81013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 shutdown_connections 2024-09-21T01:28:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:20.241+0000 7f0ddfcb2640 1 -- 172.21.15.37:0/1350605571 wait complete. 2024-09-21T01:28:20.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:28:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:21.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:21 smithi037 ceph-mon[31105]: pgmap v727: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 53 MiB/s wr, 681 op/s 2024-09-21T01:28:21.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:21 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1350605571' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:28:21.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:21 smithi144 ceph-mon[34818]: pgmap v727: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 53 MiB/s wr, 681 op/s 2024-09-21T01:28:21.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:21 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1350605571' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:28:21.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:21 smithi137 ceph-mon[34607]: pgmap v727: 97 pgs: 97 active+clean; 1.2 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 53 MiB/s wr, 681 op/s 2024-09-21T01:28:21.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:21 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1350605571' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:28:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 -- 172.21.15.37:0/590749461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7484110180 msgr2=0x7f74841125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 --2- 172.21.15.37:0/590749461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7484110180 0x7f74841125a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f747c009ca0 tx=0x7f747c02a950 comp rx=0 tx=0).stop 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 -- 172.21.15.37:0/590749461 shutdown_connections 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 --2- 172.21.15.37:0/590749461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7484110180 0x7f74841125a0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 --2- 172.21.15.37:0/590749461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7484102f20 0x7f748410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 --2- 172.21.15.37:0/590749461 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74841025d0 0x7f74841029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 -- 172.21.15.37:0/590749461 >> 172.21.15.37:0/590749461 conn(0x7f7484079720 msgr2=0x7f7484079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 -- 172.21.15.37:0/590749461 shutdown_connections 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.741+0000 7f748b428640 1 -- 172.21.15.37:0/590749461 wait complete. 2024-09-21T01:28:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 Processor -- start 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 -- start start 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 0x7f748419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7484102f20 0x7f748419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7484110180 0x7f74841a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7484115c70 con 0x7f74841025d0 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7484115af0 con 0x7f7484110180 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.742+0000 7f748b428640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7484115df0 con 0x7f7484102f20 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 0x7f748419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 0x7f748419c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34334/0 (socket says 172.21.15.37:34334) 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 -- 172.21.15.37:0/2752677364 learned_addr learned my addr 172.21.15.37:0/2752677364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74889c3640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7484102f20 0x7f748419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74899c5640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7484110180 0x7f74841a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 -- 172.21.15.37:0/2752677364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7484102f20 msgr2=0x7f748419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7484102f20 0x7f748419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 -- 172.21.15.37:0/2752677364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7484110180 msgr2=0x7f74841a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7484110180 0x7f74841a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 -- 172.21.15.37:0/2752677364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74841a2530 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f74891c4640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 0x7f748419c5c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f748000d950 tx=0x7f748000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480017070 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74841a2820 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7480009c30 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.743+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748000f620 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.744+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74841a8f80 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.744+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f748406c2e0 con 0x7f74841025d0 2024-09-21T01:28:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.746+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7480005030 con 0x7f74841025d0 2024-09-21T01:28:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.747+0000 7f747a7fc640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74700b6510 0x7f74700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.747+0000 7f74889c3640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74700b6510 0x7f74700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.747+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7f74800e6f90 con 0x7f74841025d0 2024-09-21T01:28:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.748+0000 7f74889c3640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74700b6510 0x7f74700b8a20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7484103f80 tx=0x7f747400b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.750+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74800ad820 con 0x7f74841025d0 2024-09-21T01:28:21.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.978+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74841029e0 con 0x7f74841025d0 2024-09-21T01:28:21.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.979+0000 7f747a7fc640 1 -- 172.21.15.37:0/2752677364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11977 (secure 0 0 0) 0x7f7480009de0 con 0x7f74841025d0 2024-09-21T01:28:21.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:28:21.980 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"btime":"2024-09-21T01:27:16:685003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14748,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/417404458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":417404458},{"type":"v1","addr":"172.21.15.37:6835","nonce":417404458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/2567414723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":2567414723},{"type":"v1","addr":"172.21.15.37:6837","nonce":2567414723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:13:51.265572+0000","modified":"2024-09-21T01:27:16.608200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24635,"mds_1":24631,"mds_2":24610,"mds_3":24605,"mds_4":24604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/3638461031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3638461031},{"type":"v1","addr":"172.21.15.37:6839","nonce":3638461031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/3072910125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":3072910125},{"type":"v1","addr":"172.21.15.37:6841","nonce":3072910125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24554":{"gid":24554,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6833/1167918014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":1167918014},{"type":"v1","addr":"172.21.15.137:6833","nonce":1167918014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/299841905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":299841905},{"type":"v1","addr":"172.21.15.144:6833","nonce":299841905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.137:6835/2865149890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2865149890},{"type":"v1","addr":"172.21.15.137:6835","nonce":2865149890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6835/3565351680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3565351680},{"type":"v1","addr":"172.21.15.144:6835","nonce":3565351680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24605":{"gid":24605,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/234673492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":234673492},{"type":"v1","addr":"172.21.15.137:6837","nonce":234673492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.144:6837/3444337683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3444337683},{"type":"v1","addr":"172.21.15.144:6837","nonce":3444337683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/2711377630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":2711377630},{"type":"v1","addr":"172.21.15.144:6839","nonce":2711377630}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6839/302617634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":302617634},{"type":"v1","addr":"172.21.15.137:6839","nonce":302617634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24635,"qdb_cluster":[24635,24610,24631,24605,24604]},"id":1}]} 2024-09-21T01:28:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74700b6510 msgr2=0x7f74700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74700b6510 0x7f74700b8a20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7484103f80 tx=0x7f747400b590 comp rx=0 tx=0).stop 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 msgr2=0x7f748419c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 0x7f748419c5c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f748000d950 tx=0x7f748000de10 comp rx=0 tx=0).stop 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 shutdown_connections 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f74700b6510 0x7f74700b8a20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7484110180 0x7f74841a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7484102f20 0x7f748419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 --2- 172.21.15.37:0/2752677364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74841025d0 0x7f748419c5c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 >> 172.21.15.37:0/2752677364 conn(0x7f7484079720 msgr2=0x7f7484109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.981+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 shutdown_connections 2024-09-21T01:28:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:21.982+0000 7f748b428640 1 -- 172.21.15.37:0/2752677364 wait complete. 2024-09-21T01:28:22.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:22 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2752677364' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:28:22.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:22 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2752677364' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:28:22.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:22 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2752677364' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:28:22.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:28:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:23.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:23 smithi037 ceph-mon[31105]: pgmap v728: 97 pgs: 97 active+clean; 130 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 36 MiB/s wr, 538 op/s 2024-09-21T01:28:23.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:23 smithi137 ceph-mon[34607]: pgmap v728: 97 pgs: 97 active+clean; 130 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 36 MiB/s wr, 538 op/s 2024-09-21T01:28:23.420 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:23 smithi144 ceph-mon[34818]: pgmap v728: 97 pgs: 97 active+clean; 130 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 36 MiB/s wr, 538 op/s 2024-09-21T01:28:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 -- 172.21.15.37:0/3879007779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 msgr2=0x7fd090102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 --2- 172.21.15.37:0/3879007779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090102e80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd078009900 tx=0x7fd07802a410 comp rx=0 tx=0).stop 2024-09-21T01:28:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 -- 172.21.15.37:0/3879007779 shutdown_connections 2024-09-21T01:28:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 --2- 172.21.15.37:0/3879007779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd090108d00 0x7fd09010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 --2- 172.21.15.37:0/3879007779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0901083b0 0x7fd0901087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 --2- 172.21.15.37:0/3879007779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090102e80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 -- 172.21.15.37:0/3879007779 >> 172.21.15.37:0/3879007779 conn(0x7fd090079730 msgr2=0x7fd090079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 -- 172.21.15.37:0/3879007779 shutdown_connections 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.727+0000 7fd096c61640 1 -- 172.21.15.37:0/3879007779 wait complete. 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 Processor -- start 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 -- start start 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090104260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0901083b0 0x7fd0901047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd090108d00 0x7fd090104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd090112970 con 0x7fd090102a70 2024-09-21T01:28:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0901127f0 con 0x7fd0901083b0 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd096c61640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd090112af0 con 0x7fd090108d00 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd0949fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090104260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd0949fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090104260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34342/0 (socket says 172.21.15.37:34342) 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd0949fd640 1 -- 172.21.15.37:0/3491623644 learned_addr learned my addr 172.21.15.37:0/3491623644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.728+0000 7fd0951fe640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd090108d00 0x7fd090104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd08ffff640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0901083b0 0x7fd0901047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd0949fd640 1 -- 172.21.15.37:0/3491623644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd090108d00 msgr2=0x7fd090104ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd0949fd640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd090108d00 0x7fd090104ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd0949fd640 1 -- 172.21.15.37:0/3491623644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0901083b0 msgr2=0x7fd0901047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd0949fd640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0901083b0 0x7fd0901047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd0949fd640 1 -- 172.21.15.37:0/3491623644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0901a8710 con 0x7fd090102a70 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd0949fd640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090104260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd078005940 tx=0x7fd0780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07803f030 con 0x7fd090102a70 2024-09-21T01:28:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0901a89a0 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd078003cb0 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078035070 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.729+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0901a8ed0 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.731+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd090103cf0 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.732+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd078042030 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.733+0000 7fd08dffb640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd07c0b6510 0x7fd07c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.733+0000 7fd08ffff640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd07c0b6510 0x7fd07c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.733+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fd078107b80 con 0x7fd090102a70 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.733+0000 7fd08ffff640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd07c0b6510 0x7fd07c0b8a20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd090100af0 tx=0x7fd08000a780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.737+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0780ce410 con 0x7fd090102a70 2024-09-21T01:28:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.928+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0901a91f0 con 0x7fd090102a70 2024-09-21T01:28:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.929+0000 7fd08dffb640 1 -- 172.21.15.37:0/3491623644 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22713 (secure 0 0 0) 0x7fd0780d27f0 con 0x7fd090102a70 2024-09-21T01:28:23.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-21T01:28:23.930 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"6bc9e062-77b5-11ef-baf5-efdc52797490","created":"2024-09-21T01:05:18.978360+0000","modified":"2024-09-21T01:14:17.917717+0000","last_up_change":"2024-09-21T01:12:58.976769+0000","last_in_change":"2024-09-21T01:12:35.151419+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:09:09.226836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:13:46.784744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:13:49.153488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af3439a3-c611-4fe4-9cc0-1070e5c3f4e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6803","nonce":3448292591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6805","nonce":3448292591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6809","nonce":3448292591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3448292591},{"type":"v1","addr":"172.21.15.37:6807","nonce":3448292591}]},"public_addr":"172.21.15.37:6803/3448292591","cluster_addr":"172.21.15.37:6805/3448292591","heartbeat_back_addr":"172.21.15.37:6809/3448292591","heartbeat_front_addr":"172.21.15.37:6807/3448292591","state":["exists","up"]},{"osd":1,"uuid":"55683e3d-91c3-4a7e-8fd6-e493edcec0f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6801","nonce":806118255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6803","nonce":806118255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6807","nonce":806118255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":806118255},{"type":"v1","addr":"172.21.15.137:6805","nonce":806118255}]},"public_addr":"172.21.15.137:6801/806118255","cluster_addr":"172.21.15.137:6803/806118255","heartbeat_back_addr":"172.21.15.137:6807/806118255","heartbeat_front_addr":"172.21.15.137:6805/806118255","state":["exists","up"]},{"osd":2,"uuid":"d343aa5f-854c-4241-81bb-623964d18857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6801","nonce":4236488029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6803","nonce":4236488029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6807","nonce":4236488029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4236488029},{"type":"v1","addr":"172.21.15.144:6805","nonce":4236488029}]},"public_addr":"172.21.15.144:6801/4236488029","cluster_addr":"172.21.15.144:6803/4236488029","heartbeat_back_addr":"172.21.15.144:6807/4236488029","heartbeat_front_addr":"172.21.15.144:6805/4236488029","state":["exists","up"]},{"osd":3,"uuid":"4a3a46d7-bbc4-4211-a85c-450533a40330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6811","nonce":261274699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6813","nonce":261274699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6817","nonce":261274699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":261274699},{"type":"v1","addr":"172.21.15.37:6815","nonce":261274699}]},"public_addr":"172.21.15.37:6811/261274699","cluster_addr":"172.21.15.37:6813/261274699","heartbeat_back_addr":"172.21.15.37:6817/261274699","heartbeat_front_addr":"172.21.15.37:6815/261274699","state":["exists","up"]},{"osd":4,"uuid":"365b5737-c951-435b-b661-abdfcdc9a3dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6809","nonce":2853866210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6811","nonce":2853866210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6815","nonce":2853866210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2853866210},{"type":"v1","addr":"172.21.15.137:6813","nonce":2853866210}]},"public_addr":"172.21.15.137:6809/2853866210","cluster_addr":"172.21.15.137:6811/2853866210","heartbeat_back_addr":"172.21.15.137:6815/2853866210","heartbeat_front_addr":"172.21.15.137:6813/2853866210","state":["exists","up"]},{"osd":5,"uuid":"020d2837-a187-4fe7-8f77-52d15b00ae13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6809","nonce":2563342587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6811","nonce":2563342587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6815","nonce":2563342587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2563342587},{"type":"v1","addr":"172.21.15.144:6813","nonce":2563342587}]},"public_addr":"172.21.15.144:6809/2563342587","cluster_addr":"172.21.15.144:6811/2563342587","heartbeat_back_addr":"172.21.15.144:6815/2563342587","heartbeat_front_addr":"172.21.15.144:6813/2563342587","state":["exists","up"]},{"osd":6,"uuid":"d35918e8-efad-4939-a7c3-5fdf10f4a93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6819","nonce":1539811253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6821","nonce":1539811253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6825","nonce":1539811253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1539811253},{"type":"v1","addr":"172.21.15.37:6823","nonce":1539811253}]},"public_addr":"172.21.15.37:6819/1539811253","cluster_addr":"172.21.15.37:6821/1539811253","heartbeat_back_addr":"172.21.15.37:6825/1539811253","heartbeat_front_addr":"172.21.15.37:6823/1539811253","state":["exists","up"]},{"osd":7,"uuid":"28fefcbb-3ceb-434b-8919-9c47207921ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6817","nonce":1960224257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6819","nonce":1960224257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6823","nonce":1960224257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":1960224257},{"type":"v1","addr":"172.21.15.137:6821","nonce":1960224257}]},"public_addr":"172.21.15.137:6817/1960224257","cluster_addr":"172.21.15.137:6819/1960224257","heartbeat_back_addr":"172.21.15.137:6823/1960224257","heartbeat_front_addr":"172.21.15.137:6821/1960224257","state":["exists","up"]},{"osd":8,"uuid":"e2931d04-84ea-4aa9-811f-b8dcee437c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6817","nonce":2167195424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6819","nonce":2167195424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6823","nonce":2167195424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2167195424},{"type":"v1","addr":"172.21.15.144:6821","nonce":2167195424}]},"public_addr":"172.21.15.144:6817/2167195424","cluster_addr":"172.21.15.144:6819/2167195424","heartbeat_back_addr":"172.21.15.144:6823/2167195424","heartbeat_front_addr":"172.21.15.144:6821/2167195424","state":["exists","up"]},{"osd":9,"uuid":"01ba8830-71d3-4ca1-9c59-caf80641e235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6827","nonce":3861420573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6829","nonce":3861420573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6833","nonce":3861420573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3861420573},{"type":"v1","addr":"172.21.15.37:6831","nonce":3861420573}]},"public_addr":"172.21.15.37:6827/3861420573","cluster_addr":"172.21.15.37:6829/3861420573","heartbeat_back_addr":"172.21.15.37:6833/3861420573","heartbeat_front_addr":"172.21.15.37:6831/3861420573","state":["exists","up"]},{"osd":10,"uuid":"75ec1bb2-7dfc-404e-857e-214123b35827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6825","nonce":1223382537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6827","nonce":1223382537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6831","nonce":1223382537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":1223382537},{"type":"v1","addr":"172.21.15.137:6829","nonce":1223382537}]},"public_addr":"172.21.15.137:6825/1223382537","cluster_addr":"172.21.15.137:6827/1223382537","heartbeat_back_addr":"172.21.15.137:6831/1223382537","heartbeat_front_addr":"172.21.15.137:6829/1223382537","state":["exists","up"]},{"osd":11,"uuid":"8b9554ef-fc14-4188-8222-c391333fbf97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6825","nonce":679956163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6827","nonce":679956163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6831","nonce":679956163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":679956163},{"type":"v1","addr":"172.21.15.144:6829","nonce":679956163}]},"public_addr":"172.21.15.144:6825/679956163","cluster_addr":"172.21.15.144:6827/679956163","heartbeat_back_addr":"172.21.15.144:6831/679956163","heartbeat_front_addr":"172.21.15.144:6829/679956163","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:14.548871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:08:39.995685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:05.712511+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:31.677912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:09:57.681582+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:22.707544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:10:49.053517+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:14.782074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:11:40.524812+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:06.416289+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:31.447667+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:12:56.748937+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":1}]},{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/2383418046":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6800/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:6801/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6800/3304055550":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2530616561":"2024-09-22T01:05:50.424453+0000","172.21.15.37:0/2065066033":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/1699078547":"2024-09-22T01:05:50.424453+0000","172.21.15.37:6801/3976496410":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/3851858190":"2024-09-22T01:06:16.751077+0000","172.21.15.37:0/863846747":"2024-09-22T01:05:50.424453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:28:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd07c0b6510 msgr2=0x7fd07c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd07c0b6510 0x7fd07c0b8a20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd090100af0 tx=0x7fd08000a780 comp rx=0 tx=0).stop 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 msgr2=0x7fd090104260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090104260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd078005940 tx=0x7fd0780042f0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 shutdown_connections 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fd07c0b6510 0x7fd07c0b8a20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd090108d00 0x7fd090104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd0901083b0 0x7fd0901047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 --2- 172.21.15.37:0/3491623644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd090102a70 0x7fd090104260 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 >> 172.21.15.37:0/3491623644 conn(0x7fd090079730 msgr2=0x7fd090101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 shutdown_connections 2024-09-21T01:28:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:23.932+0000 7fd096c61640 1 -- 172.21.15.37:0/3491623644 wait complete. 2024-09-21T01:28:24.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:24 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/3491623644' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:28:24.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:24 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/3491623644' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:28:24.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:24 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/3491623644' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:28:25.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T01:28:25.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:25 smithi037 ceph-mon[31105]: pgmap v729: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 MiB/s wr, 451 op/s 2024-09-21T01:28:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:25.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:25 smithi137 ceph-mon[34607]: pgmap v729: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 MiB/s wr, 451 op/s 2024-09-21T01:28:25.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:25 smithi144 ceph-mon[34818]: pgmap v729: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 27 MiB/s wr, 451 op/s 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 -- 172.21.15.37:0/3171773165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc102230 msgr2=0x7fa0bc102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 --2- 172.21.15.37:0/3171773165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc102230 0x7fa0bc102640 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00aa10 tx=0x7fa0ac02b720 comp rx=0 tx=0).stop 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 -- 172.21.15.37:0/3171773165 shutdown_connections 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 --2- 172.21.15.37:0/3171773165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 0x7fa0bc10ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 --2- 172.21.15.37:0/3171773165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc107b70 0x7fa0bc107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 --2- 172.21.15.37:0/3171773165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc102230 0x7fa0bc102640 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 -- 172.21.15.37:0/3171773165 >> 172.21.15.37:0/3171773165 conn(0x7fa0bc079e40 msgr2=0x7fa0bc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 -- 172.21.15.37:0/3171773165 shutdown_connections 2024-09-21T01:28:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.780+0000 7fa0c119a640 1 -- 172.21.15.37:0/3171773165 wait complete. 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 Processor -- start 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 -- start start 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc102230 0x7fa0bc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 0x7fa0bc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 0x7fa0bc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111900 con 0x7fa0bc107b70 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111780 con 0x7fa0bc1084c0 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0c119a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc111a80 con 0x7fa0bc102230 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0ba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 0x7fa0bc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0ba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 0x7fa0bc19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54704/0 (socket says 172.21.15.37:54704) 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0ba59c640 1 -- 172.21.15.37:0/2008553177 learned_addr learned my addr 172.21.15.37:0/2008553177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.781+0000 7fa0bad9d640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc102230 0x7fa0bc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0bb59e640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 0x7fa0bc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0ba59c640 1 -- 172.21.15.37:0/2008553177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc102230 msgr2=0x7fa0bc19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0ba59c640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc102230 0x7fa0bc19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0ba59c640 1 -- 172.21.15.37:0/2008553177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 msgr2=0x7fa0bc19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0ba59c640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 0x7fa0bc19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0ba59c640 1 -- 172.21.15.37:0/2008553177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc1a0490 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0bb59e640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 0x7fa0bc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0ba59c640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 0x7fa0bc19aac0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c970 tx=0x7fa0b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0004220 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc1a0780 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0b00043c0 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0004a00 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.782+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc1a6ee0 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.783+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0bc102640 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.785+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa0b00079b0 con 0x7fa0bc107b70 2024-09-21T01:28:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.786+0000 7fa0a3fff640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa0a40b6510 0x7fa0a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.786+0000 7fa0bad9d640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa0a40b6510 0x7fa0a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.786+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8240+0+0 (secure 0 0 0) 0x7fa0b00e7440 con 0x7fa0bc107b70 2024-09-21T01:28:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.787+0000 7fa0bad9d640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa0a40b6510 0x7fa0a40b8a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac030550 tx=0x7fa0ac00a670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:25.789+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0b0014030 con 0x7fa0bc107b70 2024-09-21T01:28:26.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.019+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0bc19b650 con 0x7fa0bc107b70 2024-09-21T01:28:26.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.021+0000 7fa0a3fff640 1 -- 172.21.15.37:0/2008553177 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7fa0b00adcd0 con 0x7fa0bc107b70 2024-09-21T01:28:26.022 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T01:28:26.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.025+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa0a40b6510 msgr2=0x7fa0a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:26.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.025+0000 7fa0c119a640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa0a40b6510 0x7fa0a40b8a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac030550 tx=0x7fa0ac00a670 comp rx=0 tx=0).stop 2024-09-21T01:28:26.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.025+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 msgr2=0x7fa0bc19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.025+0000 7fa0c119a640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 0x7fa0bc19aac0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c970 tx=0x7fa0b000ce30 comp rx=0 tx=0).stop 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 shutdown_connections 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fa0a40b6510 0x7fa0a40b8a20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0bc1084c0 0x7fa0bc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0bc107b70 0x7fa0bc19aac0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 --2- 172.21.15.37:0/2008553177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc102230 0x7fa0bc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 >> 172.21.15.37:0/2008553177 conn(0x7fa0bc079e40 msgr2=0x7fa0bc105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 shutdown_connections 2024-09-21T01:28:26.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:26.026+0000 7fa0c119a640 1 -- 172.21.15.37:0/2008553177 wait complete. 2024-09-21T01:28:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2008553177' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:28:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mon[34607]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:28:26.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mon[34607]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2008553177' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mon[34607]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mon[34607]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e[62649]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e[62649]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mds[62653]: -- 172.21.15.137:0/1622052110 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601eb999860 con 0x5601efb41180 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e[62649]: starting mds.e at 2024-09-21T01:28:26.421 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h[62916]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h[62916]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mds[62920]: -- 172.21.15.137:0/1339512289 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604af37d860 con 0x5604b3525a80 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h[62916]: starting mds.h at 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k[62369]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k[62369]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mds[62373]: -- 172.21.15.137:0/3913006453 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff7e5fd860 con 0x55ff827a5a80 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k[62369]: starting mds.k at 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.422 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.423 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-mds[63203]: -- 172.21.15.137:0/3571112574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1932e3c20 con 0x55e19748b180 2024-09-21T01:28:26.423 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:28:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: starting mds.b at 2024-09-21T01:28:26.423 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f[63515]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.423 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f[63515]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.423 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mds[63519]: -- 172.21.15.144:0/3771100844 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561413a35860 con 0x561417bdd180 2024-09-21T01:28:26.423 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f[63515]: starting mds.f at 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2008553177' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mon[34818]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mon[34818]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2008553177' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mon[34818]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mon[34818]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c[63786]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c[63786]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.424 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c[63786]: starting mds.c at 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i[64058]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i[64058]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i[64058]: starting mds.i at 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l[63247]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l[63247]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-mds[63251]: -- 172.21.15.144:0/4264455987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56466d529860 con 0x5646716d1180 2024-09-21T01:28:26.425 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:28:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l[63247]: starting mds.l at 2024-09-21T01:28:26.500 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g[72650]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.500 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g[72650]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.500 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mds[72666]: -- 172.21.15.37:0/3892033663 <== mon.2 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649cd0f1860 con 0x5649d1299600 2024-09-21T01:28:26.500 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g[72650]: starting mds.g at 2024-09-21T01:28:26.500 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a[73007]: ignoring --setuser ceph since I am not root 2024-09-21T01:28:26.500 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a[73007]: ignoring --setgroup ceph since I am not root 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mds[73011]: -- 172.21.15.37:0/1864875069 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55611c379c20 con 0x556120521600 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a[73007]: starting mds.a at 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a[31101]: 2024-09-21T01:28:26.020+0000 7fd4c9bfc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2008553177' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mon[31105]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mon[31105]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2008553177' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mon[31105]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:28:26.501 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:26 smithi037 ceph-mon[31105]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T01:28:26.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T01:28:27.137 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:27.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:27 smithi037 ceph-mon[31105]: pgmap v730: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 316 op/s 2024-09-21T01:28:27.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:27 smithi137 ceph-mon[34607]: pgmap v730: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 316 op/s 2024-09-21T01:28:27.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:27 smithi144 ceph-mon[34818]: pgmap v730: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 316 op/s 2024-09-21T01:28:27.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 -- 172.21.15.37:0/1819356657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 msgr2=0x7f267810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:27.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 --2- 172.21.15.37:0/1819356657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267810f540 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2670009ca0 tx=0x7f267002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:28:27.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 -- 172.21.15.37:0/1819356657 shutdown_connections 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 --2- 172.21.15.37:0/1819356657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267810f540 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 --2- 172.21.15.37:0/1819356657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26781083c0 0x7f26781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 --2- 172.21.15.37:0/1819356657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2678102a80 0x7f2678102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 -- 172.21.15.37:0/1819356657 >> 172.21.15.37:0/1819356657 conn(0x7f2678079740 msgr2=0x7f2678079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 -- 172.21.15.37:0/1819356657 shutdown_connections 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.682+0000 7f267de49640 1 -- 172.21.15.37:0/1819356657 wait complete. 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 Processor -- start 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 -- start start 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2678102a80 0x7f267819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26781083c0 0x7f267819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2678113aa0 con 0x7f2678108d10 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2678113920 con 0x7f2678102a80 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f267de49640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2678113c20 con 0x7f26781083c0 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f2677fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f2677fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54778/0 (socket says 172.21.15.37:54778) 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f2677fff640 1 -- 172.21.15.37:0/2672668466 learned_addr learned my addr 172.21.15.37:0/2672668466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f26777fe640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2678102a80 0x7f267819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.683+0000 7f2676ffd640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26781083c0 0x7f267819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2677fff640 1 -- 172.21.15.37:0/2672668466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26781083c0 msgr2=0x7f267819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2677fff640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26781083c0 0x7f267819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2677fff640 1 -- 172.21.15.37:0/2672668466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2678102a80 msgr2=0x7f267819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2677fff640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2678102a80 0x7f267819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2677fff640 1 -- 172.21.15.37:0/2672668466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781a0360 con 0x7f2678108d10 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2677fff640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267819fcf0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2670005cc0 tx=0x7f267002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:27.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670003bf0 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2670003d90 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781a05f0 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267002fb20 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.684+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781a6e70 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.685+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678103d00 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.687+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2670004580 con 0x7f2678108d10 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.688+0000 7f2674ff9640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26600b65c0 0x7f26600b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.688+0000 7f26777fe640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26600b65c0 0x7f26600b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.688+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8670+0+0 (secure 0 0 0) 0x7f2670108900 con 0x7f2678108d10 2024-09-21T01:28:27.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.688+0000 7f26777fe640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26600b65c0 0x7f26600b8ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f266800abe0 tx=0x7f266800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:27.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.691+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26700098b0 con 0x7f2678108d10 2024-09-21T01:28:27.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:27.919+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f267810ab00 con 0x7f2678108d10 2024-09-21T01:28:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.072+0000 7f2674ff9640 1 -- 172.21.15.37:0/2672668466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f26700cef80 con 0x7f2678108d10 2024-09-21T01:28:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26600b65c0 msgr2=0x7f26600b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26600b65c0 0x7f26600b8ad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f266800abe0 tx=0x7f266800a2d0 comp rx=0 tx=0).stop 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 msgr2=0x7f267819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267819fcf0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2670005cc0 tx=0x7f267002f380 comp rx=0 tx=0).stop 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 shutdown_connections 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f26600b65c0 0x7f26600b8ad0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2678108d10 0x7f267819fcf0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26781083c0 0x7f267819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 --2- 172.21.15.37:0/2672668466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2678102a80 0x7f267819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 >> 172.21.15.37:0/2672668466 conn(0x7f2678079740 msgr2=0x7f2678105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 shutdown_connections 2024-09-21T01:28:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:28.075+0000 7f267de49640 1 -- 172.21.15.37:0/2672668466 wait complete. 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6832/1620139349,v1:172.21.15.144:6834/1620139349] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6833/2637978210,v1:172.21.15.144:6835/2637978210] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6836/3216104548,v1:172.21.15.144:6838/3216104548] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.144:6837/415146965,v1:172.21.15.144:6839/415146965] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6832/1343179226,v1:172.21.15.137:6834/1343179226] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6833/339298652,v1:172.21.15.137:6835/339298652] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6837/892616338,v1:172.21.15.137:6839/892616338] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.137:6836/1107996808,v1:172.21.15.137:6838/1107996808] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.37:6838/1689544174,v1:172.21.15.37:6840/1689544174] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: mds.? [v2:172.21.15.37:6839/1890188904,v1:172.21.15.37:6841/1890188904] up:boot 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T01:28:28.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:28:28.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:28 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2672668466' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:28:28.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6832/1620139349,v1:172.21.15.144:6834/1620139349] up:boot 2024-09-21T01:28:28.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6833/2637978210,v1:172.21.15.144:6835/2637978210] up:boot 2024-09-21T01:28:28.437 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6836/3216104548,v1:172.21.15.144:6838/3216104548] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.144:6837/415146965,v1:172.21.15.144:6839/415146965] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6832/1343179226,v1:172.21.15.137:6834/1343179226] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6833/339298652,v1:172.21.15.137:6835/339298652] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6837/892616338,v1:172.21.15.137:6839/892616338] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.137:6836/1107996808,v1:172.21.15.137:6838/1107996808] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.37:6838/1689544174,v1:172.21.15.37:6840/1689544174] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: mds.? [v2:172.21.15.37:6839/1890188904,v1:172.21.15.37:6841/1890188904] up:boot 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:28:28.438 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:28 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2672668466' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6832/1620139349,v1:172.21.15.144:6834/1620139349] up:boot 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6833/2637978210,v1:172.21.15.144:6835/2637978210] up:boot 2024-09-21T01:28:28.439 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6836/3216104548,v1:172.21.15.144:6838/3216104548] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.144:6837/415146965,v1:172.21.15.144:6839/415146965] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6832/1343179226,v1:172.21.15.137:6834/1343179226] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6833/339298652,v1:172.21.15.137:6835/339298652] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6837/892616338,v1:172.21.15.137:6839/892616338] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.137:6836/1107996808,v1:172.21.15.137:6838/1107996808] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.37:6838/1689544174,v1:172.21.15.37:6840/1689544174] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: mds.? [v2:172.21.15.37:6839/1890188904,v1:172.21.15.37:6841/1890188904] up:boot 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:28:28.440 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:28:28.441 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:28:28.441 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:28:28.441 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='mgr.14152 172.21.15.37:0/614878593' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:28:28.441 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:28 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2672668466' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:28:28.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T01:28:29.083 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:29.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:29 smithi037 ceph-mon[31105]: pgmap v732: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 102 op/s 2024-09-21T01:28:29.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:29 smithi037 ceph-mon[31105]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:28:29.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:29 smithi037 ceph-mon[31105]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:28:29.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:29 smithi037 ceph-mon[31105]: Cluster is now healthy 2024-09-21T01:28:29.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:29 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/2672668466' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:28:29.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:29 smithi037 ceph-mon[31105]: fsmap 12 up:standby 2024-09-21T01:28:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:29 smithi137 ceph-mon[34607]: pgmap v732: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 102 op/s 2024-09-21T01:28:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:29 smithi137 ceph-mon[34607]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:28:29.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:29 smithi137 ceph-mon[34607]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:29 smithi137 ceph-mon[34607]: Cluster is now healthy 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:29 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/2672668466' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:29 smithi137 ceph-mon[34607]: fsmap 12 up:standby 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:29 smithi144 ceph-mon[34818]: pgmap v732: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.0 KiB/s wr, 102 op/s 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:29 smithi144 ceph-mon[34818]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:29 smithi144 ceph-mon[34818]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:29 smithi144 ceph-mon[34818]: Cluster is now healthy 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:29 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/2672668466' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:28:29.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:29 smithi144 ceph-mon[34818]: fsmap 12 up:standby 2024-09-21T01:28:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.634+0000 7f90683dc640 1 -- 172.21.15.37:0/1471317820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9060105330 msgr2=0x7f906010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.634+0000 7f90683dc640 1 --2- 172.21.15.37:0/1471317820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9060105330 0x7f906010d880 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9054009900 tx=0x7f905402a410 comp rx=0 tx=0).stop 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 -- 172.21.15.37:0/1471317820 shutdown_connections 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 --2- 172.21.15.37:0/1471317820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f906010de40 0x7f9060110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 --2- 172.21.15.37:0/1471317820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9060105330 0x7f906010d880 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 --2- 172.21.15.37:0/1471317820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90601049e0 0x7f9060104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 -- 172.21.15.37:0/1471317820 >> 172.21.15.37:0/1471317820 conn(0x7f9060079750 msgr2=0x7f9060079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 -- 172.21.15.37:0/1471317820 shutdown_connections 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.635+0000 7f90683dc640 1 -- 172.21.15.37:0/1471317820 wait complete. 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 Processor -- start 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 -- start start 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90601049e0 0x7f906019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9060105330 0x7f906019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 0x7f906019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9060113aa0 con 0x7f906010de40 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9060113920 con 0x7f90601049e0 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f90683dc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9060113c20 con 0x7f9060105330 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f9066979640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 0x7f906019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f9066979640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 0x7f906019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54798/0 (socket says 172.21.15.37:54798) 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f9066979640 1 -- 172.21.15.37:0/1405243067 learned_addr learned my addr 172.21.15.37:0/1405243067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f9066178640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90601049e0 0x7f906019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.636+0000 7f9065977640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9060105330 0x7f906019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f9066979640 1 -- 172.21.15.37:0/1405243067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9060105330 msgr2=0x7f906019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f9066979640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9060105330 0x7f906019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f9066979640 1 -- 172.21.15.37:0/1405243067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90601049e0 msgr2=0x7f906019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f9066979640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90601049e0 0x7f906019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f9066979640 1 -- 172.21.15.37:0/1405243067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90601a0420 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f9066979640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 0x7f906019fcf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f905800d750 tx=0x7f905800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058017070 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90601a0710 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90580054d0 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058004c60 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.637+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90601a6e70 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.638+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f906006c280 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.640+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9058009bd0 con 0x7f906010de40 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.640+0000 7f905f7fe640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90480b6510 0x7f90480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.641+0000 7f9066178640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90480b6510 0x7f90480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.641+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8670+0+0 (secure 0 0 0) 0x7f90580e7150 con 0x7f906010de40 2024-09-21T01:28:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.641+0000 7f9066178640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90480b6510 0x7f90480b8a20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f906006c980 tx=0x7f9050009720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.644+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90580b1c10 con 0x7f906010de40 2024-09-21T01:28:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:29.835+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9060104df0 con 0x7f906010de40 2024-09-21T01:28:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.082+0000 7f905f7fe640 1 -- 172.21.15.37:0/1405243067 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7f9060104df0 con 0x7f906010de40 2024-09-21T01:28:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90480b6510 msgr2=0x7f90480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90480b6510 0x7f90480b8a20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f906006c980 tx=0x7f9050009720 comp rx=0 tx=0).stop 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 msgr2=0x7f906019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 0x7f906019fcf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f905800d750 tx=0x7f905800dc10 comp rx=0 tx=0).stop 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 shutdown_connections 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7f90480b6510 0x7f90480b8a20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f906010de40 0x7f906019fcf0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9060105330 0x7f906019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 --2- 172.21.15.37:0/1405243067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90601049e0 0x7f906019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 >> 172.21.15.37:0/1405243067 conn(0x7f9060079750 msgr2=0x7f90601008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.085+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 shutdown_connections 2024-09-21T01:28:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:30.086+0000 7f90683dc640 1 -- 172.21.15.37:0/1405243067 wait complete. 2024-09-21T01:28:30.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:30 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1405243067' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:28:30.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:30 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1405243067' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:28:30.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:30 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1405243067' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:28:30.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T01:28:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:28:31.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:31 smithi037 ceph-mon[31105]: pgmap v733: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 41 op/s 2024-09-21T01:28:31.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:31 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/1405243067' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:28:31.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:31 smithi037 ceph-mon[31105]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:28:31.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:31 smithi137 ceph-mon[34607]: pgmap v733: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 41 op/s 2024-09-21T01:28:31.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:31 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/1405243067' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:28:31.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:31 smithi137 ceph-mon[34607]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:28:31.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:31 smithi144 ceph-mon[34818]: pgmap v733: 97 pgs: 97 active+clean; 5.7 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 41 op/s 2024-09-21T01:28:31.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:31 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/1405243067' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:28:31.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:31 smithi144 ceph-mon[34818]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:28:31.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/3147850053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102fa0 msgr2=0x7fc1d810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:31.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/3147850053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102fa0 0x7fc1d810fcc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009900 tx=0x7fc1c802a480 comp rx=0 tx=0).stop 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/3147850053 shutdown_connections 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/3147850053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d8110200 0x7fc1d8112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/3147850053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102fa0 0x7fc1d810fcc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/3147850053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d8102650 0x7fc1d8102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/3147850053 >> 172.21.15.37:0/3147850053 conn(0x7fc1d8079760 msgr2=0x7fc1d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/3147850053 shutdown_connections 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/3147850053 wait complete. 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.620+0000 7fc1dfbd2640 1 Processor -- start 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 -- start start 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 0x7fc1d819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d8102fa0 0x7fc1d819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d8110200 0x7fc1d81a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8115ca0 con 0x7fc1d8102650 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8115b20 con 0x7fc1d8102fa0 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dfbd2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8115e20 con 0x7fc1d8110200 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 0x7fc1d819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 0x7fc1d819c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54804/0 (socket says 172.21.15.37:54804) 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 -- 172.21.15.37:0/492804904 learned_addr learned my addr 172.21.15.37:0/492804904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd16d640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d8102fa0 0x7fc1d819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1de16f640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d8110200 0x7fc1d81a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 -- 172.21.15.37:0/492804904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d8110200 msgr2=0x7fc1d81a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d8110200 0x7fc1d81a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 -- 172.21.15.37:0/492804904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d8102fa0 msgr2=0x7fc1d819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d8102fa0 0x7fc1d819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.621+0000 7fc1dd96e640 1 -- 172.21.15.37:0/492804904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d81a2540 con 0x7fc1d8102650 2024-09-21T01:28:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.622+0000 7fc1dd96e640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 0x7fc1d819c690 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c920 tx=0x7fc1d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.622+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4007c70 con 0x7fc1d8102650 2024-09-21T01:28:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.622+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1d4007e10 con 0x7fc1d8102650 2024-09-21T01:28:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.622+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d81a2830 con 0x7fc1d8102650 2024-09-21T01:28:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.622+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4018820 con 0x7fc1d8102650 2024-09-21T01:28:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.622+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d81a9050 con 0x7fc1d8102650 2024-09-21T01:28:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.623+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d806c1f0 con 0x7fc1d8102650 2024-09-21T01:28:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.625+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc1d400f450 con 0x7fc1d8102650 2024-09-21T01:28:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.626+0000 7fc1ceffd640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c40b6540 0x7fc1c40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:28:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.626+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8145+0+0 (secure 0 0 0) 0x7fc1d40e7570 con 0x7fc1d8102650 2024-09-21T01:28:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.626+0000 7fc1dd16d640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c40b6540 0x7fc1c40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:28:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.627+0000 7fc1dd16d640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c40b6540 0x7fc1c40b8a50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8031440 tx=0x7fc1c8009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:28:31.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.629+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1d4014030 con 0x7fc1d8102650 2024-09-21T01:28:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:31.822+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc1d8102a60 con 0x7fc1d8102650 2024-09-21T01:28:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.089+0000 7fc1ceffd640 1 -- 172.21.15.37:0/492804904 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7fc1d40adf30 con 0x7fc1d8102650 2024-09-21T01:28:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c40b6540 msgr2=0x7fc1c40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c40b6540 0x7fc1c40b8a50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8031440 tx=0x7fc1c8009560 comp rx=0 tx=0).stop 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 msgr2=0x7fc1d819c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 0x7fc1d819c690 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c920 tx=0x7fc1d400cde0 comp rx=0 tx=0).stop 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 shutdown_connections 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:6800/2729102960,v1:172.21.15.37:6801/2729102960] conn(0x7fc1c40b6540 0x7fc1c40b8a50 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8031440 tx=0x7fc1c8009560 comp rx=0 tx=0).stop 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1d8110200 0x7fc1d81a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d8102fa0 0x7fc1d819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 --2- 172.21.15.37:0/492804904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d8102650 0x7fc1d819c690 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 >> 172.21.15.37:0/492804904 conn(0x7fc1d8079760 msgr2=0x7fc1d8109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:28:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 shutdown_connections 2024-09-21T01:28:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-21T01:28:32.095+0000 7fc1dfbd2640 1 -- 172.21.15.37:0/492804904 wait complete. 2024-09-21T01:28:32.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:32 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/492804904' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:28:32.421 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:32 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/492804904' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:28:32.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:32 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/492804904' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:28:32.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:28:32.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:28:32.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:28:32.871 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T01:28:32.871 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:28:32.897 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:28:32.912 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:28:32.927 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T01:28:32.928 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T01:28:32.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:28:32.982 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:32 smithi037 systemd[1]: Stopping Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:33.170 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:33 smithi144 ceph-mon[34818]: pgmap v735: 65 pgs: 65 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:28:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:33 smithi144 ceph-mon[34818]: from='client.? 172.21.15.37:0/492804904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:28:33.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:33 smithi144 ceph-mon[34818]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:28:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 ceph-mon[31105]: pgmap v735: 65 pgs: 65 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:28:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 ceph-mon[31105]: from='client.? 172.21.15.37:0/492804904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:28:33.250 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 ceph-mon[31105]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:28:33.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:33 smithi137 ceph-mon[34607]: pgmap v735: 65 pgs: 65 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:28:33.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:33 smithi137 ceph-mon[34607]: from='client.? 172.21.15.37:0/492804904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:28:33.420 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:33 smithi137 ceph-mon[34607]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:28:33.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a[31101]: 2024-09-21T01:28:33.266+0000 7fd4cf407640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:33.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a[31101]: 2024-09-21T01:28:33.266+0000 7fd4cf407640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T01:28:33.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 podman[100927]: 2024-09-21 01:28:33.50323957 +0000 UTC m=+0.355929236 container died 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:28:34.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 podman[100927]: 2024-09-21 01:28:33.967991043 +0000 UTC m=+0.820680708 container cleanup 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T01:28:34.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:33 smithi037 bash[100927]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:28:34.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T01:28:34.448 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:34 smithi037 podman[100940]: 2024-09-21 01:28:34.194326952 +0000 UTC m=+0.681656106 container remove 274f4ca53207d086ecc6060a782da3c876ed94ba524f29bb605cfacf0c2bca80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:28:34.448 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:34 smithi037 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T01:28:34.448 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:34 smithi037 systemd[1]: Stopped Ceph mon.a for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:28:34.449 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 21 01:28:34 smithi037 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.a.service: Consumed 27.400s CPU time. 2024-09-21T01:28:34.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:34.465 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T01:28:34.465 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T01:28:34.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.b 2024-09-21T01:28:34.849 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:34 smithi137 systemd[1]: Stopping Ceph mon.b for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:35.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b[34603]: 2024-09-21T01:28:34.847+0000 7f4e0bc20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:35.170 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b[34603]: 2024-09-21T01:28:34.847+0000 7f4e0bc20640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:28:35.171 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:34 smithi137 podman[67080]: 2024-09-21 01:28:34.919278369 +0000 UTC m=+0.204235844 container died d7f3fcde4b7969d1a59a9daf292924f98192315e8d8473ac0535962f4da5b3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:28:35.583 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:35 smithi137 podman[67080]: 2024-09-21 01:28:35.348075385 +0000 UTC m=+0.633032863 container cleanup d7f3fcde4b7969d1a59a9daf292924f98192315e8d8473ac0535962f4da5b3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T01:28:35.583 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:35 smithi137 bash[67080]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b 2024-09-21T01:28:35.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T01:28:35.842 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:35 smithi137 podman[67093]: 2024-09-21 01:28:35.583091934 +0000 UTC m=+0.659284323 container remove d7f3fcde4b7969d1a59a9daf292924f98192315e8d8473ac0535962f4da5b3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:28:35.842 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:35 smithi137 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T01:28:35.842 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:35 smithi137 systemd[1]: Stopped Ceph mon.b for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:28:35.842 INFO:journalctl@ceph.mon.b.smithi137.stdout:Sep 21 01:28:35 smithi137 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.b.service: Consumed 15.428s CPU time. 2024-09-21T01:28:35.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:35.869 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T01:28:35.869 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T01:28:35.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.c 2024-09-21T01:28:36.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:35 smithi144 systemd[1]: Stopping Ceph mon.c for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-c[34814]: 2024-09-21T01:28:36.245+0000 7f0222440640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-c[34814]: 2024-09-21T01:28:36.245+0000 7f0222440640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:28:36.671 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:36 smithi144 podman[67476]: 2024-09-21 01:28:36.31773145 +0000 UTC m=+0.196469168 container died 3aa7a3dee8d747d11f1e1b973a658e83dba2a0e4539a9239b05a777be4c9bdbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-c, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:28:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:36 smithi144 podman[67476]: 2024-09-21 01:28:36.963474025 +0000 UTC m=+0.842211753 container cleanup 3aa7a3dee8d747d11f1e1b973a658e83dba2a0e4539a9239b05a777be4c9bdbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T01:28:37.171 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:36 smithi144 bash[67476]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-c 2024-09-21T01:28:37.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T01:28:37.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:37 smithi144 podman[67488]: 2024-09-21 01:28:37.211133204 +0000 UTC m=+0.889013040 container remove 3aa7a3dee8d747d11f1e1b973a658e83dba2a0e4539a9239b05a777be4c9bdbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mon-c, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T01:28:37.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:37 smithi144 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-21T01:28:37.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:37 smithi144 systemd[1]: Stopped Ceph mon.c for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:28:37.473 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 01:28:37 smithi144 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mon.c.service: Consumed 14.793s CPU time. 2024-09-21T01:28:37.520 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:37.521 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T01:28:37.521 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T01:28:37.521 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:28:37.823 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:28:37 smithi037 systemd[1]: Stopping Ceph mgr.x for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:38.157 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:28:37 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x[31334]: 2024-09-21T01:28:37.821+0000 7f8257aca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:38.157 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:28:37 smithi037 podman[101049]: 2024-09-21 01:28:37.853155252 +0000 UTC m=+0.132794426 container died c3925f9af261d77b221054ca8b5f3c8606c661ef5d3b0c2197fbcb384434231f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:28:38.499 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:28:38 smithi037 podman[101049]: 2024-09-21 01:28:38.365141824 +0000 UTC m=+0.644780984 container cleanup c3925f9af261d77b221054ca8b5f3c8606c661ef5d3b0c2197fbcb384434231f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:28:38.500 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 21 01:28:38 smithi037 bash[101049]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-x 2024-09-21T01:28:38.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T01:28:38.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:38.820 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T01:28:38.820 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T01:28:38.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.y 2024-09-21T01:28:39.170 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:38 smithi137 systemd[1]: Stopping Ceph mgr.y for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:39.454 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:39 smithi137 podman[67201]: 2024-09-21 01:28:39.176269865 +0000 UTC m=+0.164959332 container died b2b3dbcc6196cf51484000e570b628f1857f13b002a391532e39993268fa200c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:28:39.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:39 smithi137 podman[67201]: 2024-09-21 01:28:39.562185 +0000 UTC m=+0.550874466 container cleanup b2b3dbcc6196cf51484000e570b628f1857f13b002a391532e39993268fa200c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:28:39.814 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:39 smithi137 bash[67201]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-y 2024-09-21T01:28:40.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T01:28:40.067 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:39 smithi137 podman[67213]: 2024-09-21 01:28:39.814013351 +0000 UTC m=+0.641722935 container remove b2b3dbcc6196cf51484000e570b628f1857f13b002a391532e39993268fa200c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T01:28:40.067 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:39 smithi137 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T01:28:40.067 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:40 smithi137 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T01:28:40.067 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:40 smithi137 systemd[1]: Stopped Ceph mgr.y for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:28:40.067 INFO:journalctl@ceph.mgr.y.smithi137.stdout:Sep 21 01:28:40 smithi137 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.y.service: Consumed 7.188s CPU time. 2024-09-21T01:28:40.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:40.081 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T01:28:40.081 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T01:28:40.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.z 2024-09-21T01:28:40.421 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 01:28:40 smithi144 systemd[1]: Stopping Ceph mgr.z for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:40.686 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 01:28:40 smithi144 podman[67599]: 2024-09-21 01:28:40.425249615 +0000 UTC m=+0.150740291 container died d50286b96127461539d9eea641c95b584f8182e9c427a89a969905b8fd0313d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:28:41.129 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 01:28:40 smithi144 podman[67599]: 2024-09-21 01:28:40.786125085 +0000 UTC m=+0.511615832 container cleanup d50286b96127461539d9eea641c95b584f8182e9c427a89a969905b8fd0313d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T01:28:41.129 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 01:28:40 smithi144 bash[67599]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mgr-z 2024-09-21T01:28:41.257 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T01:28:41.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:41.293 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T01:28:41.293 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T01:28:41.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.0 2024-09-21T01:28:41.621 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:41 smithi037 systemd[1]: Stopping Ceph osd.0 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:41.999 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0[46813]: 2024-09-21T01:28:41.619+0000 7f3887d99640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:42.000 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0[46813]: 2024-09-21T01:28:41.619+0000 7f3887d99640 -1 osd.0 79 *** Got signal Terminated *** 2024-09-21T01:28:42.000 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0[46813]: 2024-09-21T01:28:41.619+0000 7f3887d99640 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:28:47.495 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:47 smithi037 podman[101170]: 2024-09-21 01:28:47.181111989 +0000 UTC m=+5.687779946 container died 5fdf206c10e32741d11abb290cccee41ae4397561f15e613d74d31a2a2253f05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:28:47.749 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:47 smithi037 podman[101170]: 2024-09-21 01:28:47.704736165 +0000 UTC m=+6.211404120 container cleanup 5fdf206c10e32741d11abb290cccee41ae4397561f15e613d74d31a2a2253f05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:28:47.750 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:47 smithi037 bash[101170]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:28:48.249 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:47 smithi037 podman[101187]: 2024-09-21 01:28:47.956525976 +0000 UTC m=+0.777050830 container remove 5fdf206c10e32741d11abb290cccee41ae4397561f15e613d74d31a2a2253f05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:28:48.685 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:48 smithi037 podman[101275]: 2024-09-21 01:28:48.289936885 +0000 UTC m=+0.016730093 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:28:48.685 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:48 smithi037 podman[101275]: 2024-09-21 01:28:48.432789682 +0000 UTC m=+0.159582889 container create af753608bd2debf56ee3ee0cc50db451415be62c9294a4abf5111b8f6c8753a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T01:28:48.686 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:48 smithi037 podman[101275]: 2024-09-21 01:28:48.68562648 +0000 UTC m=+0.412419697 container init af753608bd2debf56ee3ee0cc50db451415be62c9294a4abf5111b8f6c8753a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T01:28:48.999 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:48 smithi037 podman[101275]: 2024-09-21 01:28:48.689294412 +0000 UTC m=+0.416087620 container start af753608bd2debf56ee3ee0cc50db451415be62c9294a4abf5111b8f6c8753a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:28:49.000 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:48 smithi037 podman[101275]: 2024-09-21 01:28:48.819279013 +0000 UTC m=+0.546072293 container attach af753608bd2debf56ee3ee0cc50db451415be62c9294a4abf5111b8f6c8753a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T01:28:49.449 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 21 01:28:49 smithi037 podman[101275]: 2024-09-21 01:28:49.164585578 +0000 UTC m=+0.891378786 container died af753608bd2debf56ee3ee0cc50db451415be62c9294a4abf5111b8f6c8753a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T01:28:50.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T01:28:50.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:50.065 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T01:28:50.065 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T01:28:50.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.1 2024-09-21T01:28:50.384 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:50 smithi137 systemd[1]: Stopping Ceph osd.1 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:50.670 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1[38550]: 2024-09-21T01:28:50.383+0000 7f0940de6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:50.670 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1[38550]: 2024-09-21T01:28:50.383+0000 7f0940de6640 -1 osd.1 79 *** Got signal Terminated *** 2024-09-21T01:28:50.671 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1[38550]: 2024-09-21T01:28:50.383+0000 7f0940de6640 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:28:56.171 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:55 smithi137 podman[67325]: 2024-09-21 01:28:55.908214695 +0000 UTC m=+5.643840854 container died 2f0c7d4721e19229cbe66663f038782d81720c919a3b76070a526918c10275e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T01:28:56.577 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:56 smithi137 podman[67325]: 2024-09-21 01:28:56.27542637 +0000 UTC m=+6.011052527 container cleanup 2f0c7d4721e19229cbe66663f038782d81720c919a3b76070a526918c10275e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T01:28:56.577 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:56 smithi137 bash[67325]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:28:56.888 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:56 smithi137 podman[67340]: 2024-09-21 01:28:56.576973365 +0000 UTC m=+0.661364597 container remove 2f0c7d4721e19229cbe66663f038782d81720c919a3b76070a526918c10275e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:28:57.170 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:56 smithi137 podman[67430]: 2024-09-21 01:28:56.790778773 +0000 UTC m=+0.015742129 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:28:57.171 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:56 smithi137 podman[67430]: 2024-09-21 01:28:56.902889851 +0000 UTC m=+0.127853199 container create ca55c4ff74dcd8354d56b1e329ecf38bc13cc1a5d78ac9d439b7de31970e7de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T01:28:57.575 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:57 smithi137 podman[67430]: 2024-09-21 01:28:57.197376764 +0000 UTC m=+0.422340112 container init ca55c4ff74dcd8354d56b1e329ecf38bc13cc1a5d78ac9d439b7de31970e7de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:28:57.575 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:57 smithi137 podman[67430]: 2024-09-21 01:28:57.200740424 +0000 UTC m=+0.425703775 container start ca55c4ff74dcd8354d56b1e329ecf38bc13cc1a5d78ac9d439b7de31970e7de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:28:57.575 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:57 smithi137 podman[67430]: 2024-09-21 01:28:57.347591681 +0000 UTC m=+0.572555030 container attach ca55c4ff74dcd8354d56b1e329ecf38bc13cc1a5d78ac9d439b7de31970e7de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:28:57.920 INFO:journalctl@ceph.osd.1.smithi137.stdout:Sep 21 01:28:57 smithi137 podman[67430]: 2024-09-21 01:28:57.575656387 +0000 UTC m=+0.800619738 container died ca55c4ff74dcd8354d56b1e329ecf38bc13cc1a5d78ac9d439b7de31970e7de8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T01:28:58.269 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T01:28:58.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:28:58.310 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T01:28:58.310 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T01:28:58.310 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.2 2024-09-21T01:28:58.657 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:28:58 smithi144 systemd[1]: Stopping Ceph osd.2 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:28:58.921 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:28:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2[39226]: 2024-09-21T01:28:58.655+0000 7f638bc20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:28:58.921 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:28:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2[39226]: 2024-09-21T01:28:58.655+0000 7f638bc20640 -1 osd.2 79 *** Got signal Terminated *** 2024-09-21T01:28:58.921 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:28:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2[39226]: 2024-09-21T01:28:58.655+0000 7f638bc20640 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:04.382 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:04 smithi144 podman[67724]: 2024-09-21 01:29:04.102829571 +0000 UTC m=+5.595893156 container died 5ed4cdd8603b91d4f18dc077f4acee592cc64c38e27b30162e30f1fea2208b68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:29:04.670 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:04 smithi144 podman[67724]: 2024-09-21 01:29:04.490453001 +0000 UTC m=+5.983516575 container cleanup 5ed4cdd8603b91d4f18dc077f4acee592cc64c38e27b30162e30f1fea2208b68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:29:04.671 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:04 smithi144 bash[67724]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:29:05.068 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:04 smithi144 podman[67739]: 2024-09-21 01:29:04.758597539 +0000 UTC m=+0.649557745 container remove 5ed4cdd8603b91d4f18dc077f4acee592cc64c38e27b30162e30f1fea2208b68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:29:05.363 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:05 smithi144 podman[67825]: 2024-09-21 01:29:04.970586319 +0000 UTC m=+0.015995880 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:05.363 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:05 smithi144 podman[67825]: 2024-09-21 01:29:05.109654024 +0000 UTC m=+0.155063582 container create a7f587e35acd14fef5b9debd9984755e19520fbe786c410261c2188a265eaaa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:29:05.363 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:05 smithi144 podman[67825]: 2024-09-21 01:29:05.362518625 +0000 UTC m=+0.407928190 container init a7f587e35acd14fef5b9debd9984755e19520fbe786c410261c2188a265eaaa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:29:05.664 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:05 smithi144 podman[67825]: 2024-09-21 01:29:05.366083576 +0000 UTC m=+0.411493133 container start a7f587e35acd14fef5b9debd9984755e19520fbe786c410261c2188a265eaaa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:29:05.664 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:05 smithi144 podman[67825]: 2024-09-21 01:29:05.470997042 +0000 UTC m=+0.516406599 container attach a7f587e35acd14fef5b9debd9984755e19520fbe786c410261c2188a265eaaa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T01:29:05.920 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 01:29:05 smithi144 podman[67825]: 2024-09-21 01:29:05.664735903 +0000 UTC m=+0.710145473 container died a7f587e35acd14fef5b9debd9984755e19520fbe786c410261c2188a265eaaa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:29:06.343 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T01:29:06.384 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:06.385 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T01:29:06.385 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T01:29:06.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.3 2024-09-21T01:29:06.736 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:06 smithi037 systemd[1]: Stopping Ceph osd.3 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:07.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:06 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:29:06.734+0000 7fcabf965640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:07.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:06 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:29:06.734+0000 7fcabf965640 -1 osd.3 79 *** Got signal Terminated *** 2024-09-21T01:29:07.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:06 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:29:06.734+0000 7fcabf965640 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:08.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:08.249+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:08.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:08.605+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:09.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:09 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:09.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:09.500 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:09 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:09.001+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:09.839 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:09.563+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:10.170 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:09.838+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:10.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:09 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:09.967+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:10.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:10 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:10.266+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:10.824 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:10.545+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:11.170 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:10.823+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:11.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:10 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:10.940+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:11.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:11 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:11.054+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:11.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:11 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:11.245+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:11.749 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:11 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3[53075]: 2024-09-21T01:29:11.358+0000 7fcab7f48640 -1 osd.3 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:45.528863+0000 front 2024-09-21T01:28:45.528905+0000 (oldest deadline 2024-09-21T01:29:10.829095+0000) 2024-09-21T01:29:11.849 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:11.557+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:12.170 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:11.847+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:12.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:11 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:11.902+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:12.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:12 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:12.094+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:12.595 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:12 smithi037 podman[101391]: 2024-09-21 01:29:12.282984945 +0000 UTC m=+5.694613691 container died a693e5fb6b56b258c7444e021486bf1a4da2156827b2da8cd798257eb9335bb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T01:29:12.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:12 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:12.279+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:12.889 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:12 smithi037 podman[101391]: 2024-09-21 01:29:12.777628854 +0000 UTC m=+6.189257600 container cleanup a693e5fb6b56b258c7444e021486bf1a4da2156827b2da8cd798257eb9335bb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:29:12.889 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:12 smithi037 bash[101391]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:29:12.920 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:12.829+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:12.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:12.602+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:13.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:13 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:13.125+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:13.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:12 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:12.888+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:13.250 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101406]: 2024-09-21 01:29:13.079288144 +0000 UTC m=+0.790771071 container remove a693e5fb6b56b258c7444e021486bf1a4da2156827b2da8cd798257eb9335bb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T01:29:13.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:13 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:13.326+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:13.733 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101496]: 2024-09-21 01:29:13.319291978 +0000 UTC m=+0.016443085 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:13.733 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101496]: 2024-09-21 01:29:13.438915392 +0000 UTC m=+0.136066526 container create 12d031bbaaf395d364a04e752742957b42b330d46f6d735dec3c64567d15b6bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:29:13.733 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101496]: 2024-09-21 01:29:13.733314749 +0000 UTC m=+0.430465845 container init 12d031bbaaf395d364a04e752742957b42b330d46f6d735dec3c64567d15b6bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:29:13.920 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:13.792+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:13.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:13.621+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:14.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101496]: 2024-09-21 01:29:13.736782556 +0000 UTC m=+0.433933651 container start 12d031bbaaf395d364a04e752742957b42b330d46f6d735dec3c64567d15b6bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:29:14.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101496]: 2024-09-21 01:29:13.841465635 +0000 UTC m=+0.538616745 container attach 12d031bbaaf395d364a04e752742957b42b330d46f6d735dec3c64567d15b6bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:29:14.000 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 21 01:29:13 smithi037 podman[101496]: 2024-09-21 01:29:13.92986448 +0000 UTC m=+0.627015581 container died 12d031bbaaf395d364a04e752742957b42b330d46f6d735dec3c64567d15b6bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T01:29:14.001 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:13 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:13.873+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:14.499 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:14 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:14.111+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:14.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T01:29:14.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:14 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:14.375+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:14.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:14.676 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T01:29:14.676 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T01:29:14.676 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.4 2024-09-21T01:29:14.920 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:14 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:14.835+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:14.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:14 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:14.604+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:14.999 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:14 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:14.852+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:15.011 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:14 smithi137 systemd[1]: Stopping Ceph osd.4 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:15.350 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:15 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4[44792]: 2024-09-21T01:29:15.009+0000 7f3a5bc47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:15.350 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:15 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4[44792]: 2024-09-21T01:29:15.009+0000 7f3a5bc47640 -1 osd.4 79 *** Got signal Terminated *** 2024-09-21T01:29:15.350 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:15 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4[44792]: 2024-09-21T01:29:15.009+0000 7f3a5bc47640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:15.499 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:15 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:15.075+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:15.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:15 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:15.349+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:15.874 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:15.614+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:16.079 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:15 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:15.822+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:16.170 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:15.873+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:16.499 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:16 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:16.078+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:16.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:16 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:16.302+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:16.906 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:16 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:16.622+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:17.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:16 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:16.918+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:17.171 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:16 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:16.905+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:17.171 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:16 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:16.905+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:17.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:17 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:17.055+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:17.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:16 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:16.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:17.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:16 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:16.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:17.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:17 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:17.342+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:17.899 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:17 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:17.617+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:18.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:17 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:17.876+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:18.171 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:17 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:17.897+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:18.171 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:17 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:17.897+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:18.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:17 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:17.828+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:18.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:17 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:17.828+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:18.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:18.042+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:18.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:18.042+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:18.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:18 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:18.315+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:18.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:18 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:18.315+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:18.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:18 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:18.651+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:19.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:18 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:18.919+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:19.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:18.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:19.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:18.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:19.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:19 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:19.005+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:19.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:19 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:19.005+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:19.420 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:18 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:18.944+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:19.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:18 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:18.944+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:19.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:18 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:18.989+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:19.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:19 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:19.293+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:19.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:19 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:19.293+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:19.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:19 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:19.666+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:20.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:19 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:19.926+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:20.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:20 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:20.029+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:20.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:20 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:20.029+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:20.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:19 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:19.830+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:20.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:19 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:19.830+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:20.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:20 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:20.007+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:20.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:19 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:19.989+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:20.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:19 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:19.989+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:20.670 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:20 smithi137 podman[67548]: 2024-09-21 01:29:20.418435093 +0000 UTC m=+5.545835769 container died 156d638e8f9e0858f73523a2a37fcf68e6414dd7d80218980bce8aa76d82e44a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:29:20.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:20 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:20.276+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:20.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:20 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:20.276+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:20.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:20 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:20.618+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:21.161 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:20 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:20.895+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:21.161 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:20 smithi137 podman[67548]: 2024-09-21 01:29:20.880452673 +0000 UTC m=+6.007853358 container cleanup 156d638e8f9e0858f73523a2a37fcf68e6414dd7d80218980bce8aa76d82e44a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:29:21.162 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:20 smithi137 bash[67548]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:29:21.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:21 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:21.000+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:21.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:21 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:21.000+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:21.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:20 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:20.852+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:21.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:20 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:20.852+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:21.420 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67563]: 2024-09-21 01:29:21.161401629 +0000 UTC m=+0.741202087 container remove 156d638e8f9e0858f73523a2a37fcf68e6414dd7d80218980bce8aa76d82e44a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:29:21.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:21 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:21.243+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:21.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:21 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:21.243+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:21.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:21 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:21.053+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:21.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:21 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:21.004+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:21.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:21 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:21.004+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:21.768 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67653]: 2024-09-21 01:29:21.397427303 +0000 UTC m=+0.016278287 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:21.769 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67653]: 2024-09-21 01:29:21.516169566 +0000 UTC m=+0.135020582 container create c0f367805ba6ae032f1d6dcf606e216ff998401afe1606809319bc9449b28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:29:21.769 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67653]: 2024-09-21 01:29:21.76871544 +0000 UTC m=+0.387566410 container init c0f367805ba6ae032f1d6dcf606e216ff998401afe1606809319bc9449b28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T01:29:21.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:21 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:21.642+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:22.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:21 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:21.924+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:22.170 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67653]: 2024-09-21 01:29:21.772128398 +0000 UTC m=+0.390979371 container start c0f367805ba6ae032f1d6dcf606e216ff998401afe1606809319bc9449b28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:29:22.171 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67653]: 2024-09-21 01:29:21.851933707 +0000 UTC m=+0.470784685 container attach c0f367805ba6ae032f1d6dcf606e216ff998401afe1606809319bc9449b28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True) 2024-09-21T01:29:22.171 INFO:journalctl@ceph.osd.4.smithi137.stdout:Sep 21 01:29:21 smithi137 podman[67653]: 2024-09-21 01:29:21.966962263 +0000 UTC m=+0.585813240 container died c0f367805ba6ae032f1d6dcf606e216ff998401afe1606809319bc9449b28b1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:29:22.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:21 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:21.968+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:22.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:21 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:21.968+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:22.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:21 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:21.865+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:22.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:21 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:21.865+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:22.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:22.015+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:22.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:22.001+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:22.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:22.001+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:22.614 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:22 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:22.231+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:22.614 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:22 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:22.231+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:22.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T01:29:22.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:22.673 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T01:29:22.673 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T01:29:22.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.5 2024-09-21T01:29:22.920 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:22 smithi144 systemd[1]: Stopping Ceph osd.5 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:22.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:22.634+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:23.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:22 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:22.911+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:23.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:22 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:22.979+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:23.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:22 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:22.979+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:23.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:22 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:22.845+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:23.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:22 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:22.845+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:23.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:22.976+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:23.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:22.985+0000 7fb7ad2d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:23.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:22.985+0000 7fb7ad2d5640 -1 osd.5 79 *** Got signal Terminated *** 2024-09-21T01:29:23.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:22 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:22.985+0000 7fb7ad2d5640 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:23.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:23.033+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:23.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:23.033+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:23.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:23 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:23.243+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:23.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:23 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:23.243+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:23.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:23.601+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:24.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:23 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:23.877+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:24.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:23 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:23.950+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:24.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:23 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:23.950+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:24.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:23 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:23.803+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:24.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:23 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:23.803+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:24.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:23 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:23.960+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:24.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:24 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:24.059+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:24.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:24 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:24.059+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:24.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:24 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:24.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:24.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:24 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:24.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:24.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:24 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:24.605+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:25.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:24 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:24.881+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:25.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:24 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:24.990+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:25.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:24 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:24.990+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:25.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:24 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:24.817+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:25.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:24 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:24.817+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:25.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:24 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:24.972+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:25.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:25 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:25.077+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:25.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:25 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:25.077+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:25.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:25 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:25.256+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:25.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:25 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:25.256+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:25.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:25 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:25.586+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:26.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:25 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:25.874+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:26.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:26.004+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:26.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:26.004+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:26.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:25 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:25.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:26.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:25 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:25.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:26.420 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:26.124+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:26.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:26.124+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:26.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:25 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:25.948+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:26.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:25 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:25.948+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:26.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:26.288+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:26.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:26.288+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:26.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:26.612+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:26.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:26.612+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:27.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:26.860+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:27.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:26 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:26.860+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:27.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:26.984+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:27.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:26.984+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:27.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:26.984+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:27.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:26.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:27.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:26.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:27.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:26 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:26.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:27.420 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:27 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:27.164+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.757613+0000 front 2024-09-21T01:28:43.757454+0000 (oldest deadline 2024-09-21T01:29:09.657305+0000) 2024-09-21T01:29:27.421 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:27 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5[45841]: 2024-09-21T01:29:27.164+0000 7fb7a98c0640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:54.358409+0000 front 2024-09-21T01:28:54.358315+0000 (oldest deadline 2024-09-21T01:29:16.658241+0000) 2024-09-21T01:29:27.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:26.938+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:27.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:26 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:26.938+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:27.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:27 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:27.311+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:27.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:27 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:27.311+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:27.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:27 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:27.580+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:27.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:27 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:27.580+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:28.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:27 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:27.875+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:28.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:27 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:27.875+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:28.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:28.020+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:28.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:28.020+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:28.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:28.020+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:28.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:27 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:27.854+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:28.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:27 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:27.854+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:28.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:27 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:27.854+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:28.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:27 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:27.972+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:28.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:27 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:27.972+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:28.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:28 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:28.331+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:28.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:28 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:28.331+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:28.751 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:28 smithi144 podman[67940]: 2024-09-21 01:29:28.440019185 +0000 UTC m=+5.568233551 container died ae54ac663419c12cf745f873db1c43933a257c08ddd0ba9fc5fd4067b949f64d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:29:28.751 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:28 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:28.592+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:28.752 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:28 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:28.592+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:28.974 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:28.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:28.974 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:28.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:28.974 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:28.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:29.004 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:28 smithi144 podman[67940]: 2024-09-21 01:29:28.844541973 +0000 UTC m=+5.972756328 container cleanup ae54ac663419c12cf745f873db1c43933a257c08ddd0ba9fc5fd4067b949f64d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:29:29.004 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:28 smithi144 bash[67940]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:29:29.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:28 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:28.859+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:29.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:28 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:28.859+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:29.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:28.973+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:29.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:28.973+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:29.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:28 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:28.973+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:29.420 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[67955]: 2024-09-21 01:29:29.096240958 +0000 UTC m=+0.659199150 container remove ae54ac663419c12cf745f873db1c43933a257c08ddd0ba9fc5fd4067b949f64d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T01:29:29.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:29 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:29.003+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:29.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:29 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:29.003+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:29.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:29 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:29.294+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:29.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:29 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:29.294+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:29.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:29 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:29.294+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:29.752 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[68042]: 2024-09-21 01:29:29.36080606 +0000 UTC m=+0.015846197 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:29.753 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[68042]: 2024-09-21 01:29:29.488806603 +0000 UTC m=+0.143846729 container create 50b6f96e00876a4cfd4e785cc4ac255b1b39ad34e756b271f38bf217df1f4194 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T01:29:29.753 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[68042]: 2024-09-21 01:29:29.752266234 +0000 UTC m=+0.407306369 container init 50b6f96e00876a4cfd4e785cc4ac255b1b39ad34e756b271f38bf217df1f4194 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T01:29:29.753 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:29 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:29.555+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:29.753 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:29 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:29.555+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:30.041 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[68042]: 2024-09-21 01:29:29.756029299 +0000 UTC m=+0.411069426 container start 50b6f96e00876a4cfd4e785cc4ac255b1b39ad34e756b271f38bf217df1f4194 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T01:29:30.041 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[68042]: 2024-09-21 01:29:29.852103491 +0000 UTC m=+0.507143626 container attach 50b6f96e00876a4cfd4e785cc4ac255b1b39ad34e756b271f38bf217df1f4194 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:29:30.041 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 01:29:29 smithi144 podman[68042]: 2024-09-21 01:29:29.942313277 +0000 UTC m=+0.597353403 container died 50b6f96e00876a4cfd4e785cc4ac255b1b39ad34e756b271f38bf217df1f4194 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:29:30.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:29 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:29.825+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:30.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:29 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:29.825+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:30.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:30.003+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:30.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:30.003+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:30.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:30.003+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:30.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:29 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:29.887+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:30.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:29 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:29.887+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:30.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:29 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:29.887+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:30.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:30 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:30.039+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:30.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:30 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:30.039+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:30.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T01:29:30.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:30.666 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T01:29:30.666 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T01:29:30.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.6 2024-09-21T01:29:30.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:30 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:30.314+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:30.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:30 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:30.314+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:30.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:30 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:30.314+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:30.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:30 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:30.552+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:30.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:30 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:30.552+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:30.973 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 systemd[1]: Stopping Ceph osd.6 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:30.974 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:30.973+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:30.974 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:30.916+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:30.974 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:30.916+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:30.974 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:30.916+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:31.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:30 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:30.821+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:31.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:30 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:30.821+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:31.249 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:30.973+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:31.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:30 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:30.973+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:31.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:31.002+0000 7f862759b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:31.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:31.002+0000 7f862759b640 -1 osd.6 79 *** Got signal Terminated *** 2024-09-21T01:29:31.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:31.002+0000 7f862759b640 -1 osd.6 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:31.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:31 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:31.068+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:31.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:31 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:31.068+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:31.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:31 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:31.318+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:31.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:31 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:31.318+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:31.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:31 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:31.318+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:31.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:31 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:31.504+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:31.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:31 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:31.504+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:32.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:31 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:31.860+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:32.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:31 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:31.860+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:32.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:31.895+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:32.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:31.895+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:32.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:31.895+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:32.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:31.994+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:32.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:31.994+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:32.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:31.994+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:32.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:32 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:32.069+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:32.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:32 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:32.069+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:32.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:32.314+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:32.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:32.314+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:32.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:32.314+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:32.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:32 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:32.470+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:32.921 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:32 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:32.470+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:33.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:32.852+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:33.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:32 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:32.852+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:32 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:32.944+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:32 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:32.944+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:32 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:32.944+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.024+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.024+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.024+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:33.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.024+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.161242+0000 front 2024-09-21T01:29:09.161399+0000 (oldest deadline 2024-09-21T01:29:32.661595+0000) 2024-09-21T01:29:33.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:33 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:33.106+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:33.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:33 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:33.106+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:33.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:33 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:33.292+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:33.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:33 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:33.292+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:33.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:33 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:33.292+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:33.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:33 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:33.424+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:33.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:33 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:33.424+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:34.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:33 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:33.852+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:34.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:33 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:33.852+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:34.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:33.958+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:34.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:33.958+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:34.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:33.958+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:34.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.990+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:34.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.990+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:34.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.990+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:34.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:33 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:33.990+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.161242+0000 front 2024-09-21T01:29:09.161399+0000 (oldest deadline 2024-09-21T01:29:32.661595+0000) 2024-09-21T01:29:34.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:34 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:34.143+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:34.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:34 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:34.143+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:34.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:34 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:34.380+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:34.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:34 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:34.380+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:34.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:34.321+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:34.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:34.321+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:34.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:34.321+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:35.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:34.818+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:35.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:34 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:34.818+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:35.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:34.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:35.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:34.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:35.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:34.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:35.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:34.952+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:35.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:34.952+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:35.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:34.952+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:35.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:34 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:34.952+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.161242+0000 front 2024-09-21T01:29:09.161399+0000 (oldest deadline 2024-09-21T01:29:32.661595+0000) 2024-09-21T01:29:35.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:35 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:35.161+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:35.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:35 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:35.161+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:35.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:35 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:35.161+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:35.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:35 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:35.349+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:35.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:35 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:35.349+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:35.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:35 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:35.349+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:35.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:35.287+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:35.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:35.287+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:35.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:35.287+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:35.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:35.287+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:36.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:35.835+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:36.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:35.835+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:36.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:35 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:35.835+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:35.909+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:35.909+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:35.909+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:35.909+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:35.996+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.056556+0000 front 2024-09-21T01:28:46.056619+0000 (oldest deadline 2024-09-21T01:29:10.057144+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:35.996+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.558385+0000 front 2024-09-21T01:28:53.558318+0000 (oldest deadline 2024-09-21T01:29:17.658080+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:35.996+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.859810+0000 front 2024-09-21T01:29:02.859949+0000 (oldest deadline 2024-09-21T01:29:26.359848+0000) 2024-09-21T01:29:36.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:35 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6[59530]: 2024-09-21T01:29:35.996+0000 7f861fb7e640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.161242+0000 front 2024-09-21T01:29:09.161399+0000 (oldest deadline 2024-09-21T01:29:32.661595+0000) 2024-09-21T01:29:36.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:36.289+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:36.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:36.289+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:36.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:36.289+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:36.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:36.289+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:36.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:36.193+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:36.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:36.193+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:36.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:36.193+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:36.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:36.311+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:36.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:36.311+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:36.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:36 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:36.311+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:36.700 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:36 smithi037 podman[101610]: 2024-09-21 01:29:36.395506222 +0000 UTC m=+5.516798539 container stop 7e4284fcae5febd1e3bbd6983926559943b5bd9a37801c298e2e2d3d696ffa2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:29:36.700 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:36 smithi037 podman[101610]: 2024-09-21 01:29:36.421257935 +0000 UTC m=+5.542550240 container died 7e4284fcae5febd1e3bbd6983926559943b5bd9a37801c298e2e2d3d696ffa2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:29:36.999 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:36 smithi037 podman[101610]: 2024-09-21 01:29:36.798613848 +0000 UTC m=+5.919906152 container cleanup 7e4284fcae5febd1e3bbd6983926559943b5bd9a37801c298e2e2d3d696ffa2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T01:29:37.000 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:36 smithi037 bash[101610]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6 2024-09-21T01:29:37.000 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:36 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:36.927+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:37.000 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:36 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:36.927+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:37.000 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:36 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:36.927+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:37.000 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:36 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:36.927+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:37.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:36.874+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:37.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:36.874+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:37.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:36.874+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:37.500 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101626]: 2024-09-21 01:29:37.100148004 +0000 UTC m=+0.692259398 container remove 7e4284fcae5febd1e3bbd6983926559943b5bd9a37801c298e2e2d3d696ffa2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:29:37.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:37.256+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:37.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:37.256+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:37.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:37.256+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:37.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:37.256+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:37.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:37 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:37.184+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:37.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:37 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:37.184+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:37.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:37 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:37.184+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:37.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:37 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:37.267+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:37.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:37 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:37.267+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:37.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:37 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:37.267+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:37.780 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101711]: 2024-09-21 01:29:37.517723667 +0000 UTC m=+0.111647065 container create 38dcefb4c4ab55168e741c976b2511ebcc9fec38cef66e3595b9dbed84e356ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T01:29:37.780 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101711]: 2024-09-21 01:29:37.422680281 +0000 UTC m=+0.016603688 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:37.780 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101711]: 2024-09-21 01:29:37.780228738 +0000 UTC m=+0.374152143 container init 38dcefb4c4ab55168e741c976b2511ebcc9fec38cef66e3595b9dbed84e356ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T01:29:38.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:37.902+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:38.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:37.902+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:38.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:37 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:37.902+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:38.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:37 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:37.950+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:38.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:37 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:37.950+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:38.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:37 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:37.950+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:38.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:37 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:37.950+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:38.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101711]: 2024-09-21 01:29:37.784007321 +0000 UTC m=+0.377930721 container start 38dcefb4c4ab55168e741c976b2511ebcc9fec38cef66e3595b9dbed84e356ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T01:29:38.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101711]: 2024-09-21 01:29:37.862257107 +0000 UTC m=+0.456180515 container attach 38dcefb4c4ab55168e741c976b2511ebcc9fec38cef66e3595b9dbed84e356ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T01:29:38.250 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 21 01:29:37 smithi037 podman[101711]: 2024-09-21 01:29:37.975078049 +0000 UTC m=+0.569001446 container died 38dcefb4c4ab55168e741c976b2511ebcc9fec38cef66e3595b9dbed84e356ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T01:29:38.441 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:38.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:38.442 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:38.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:38.442 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:38.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:38.442 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:38.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:38.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T01:29:38.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:38.666 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T01:29:38.666 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T01:29:38.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.7 2024-09-21T01:29:38.670 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:38 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:38.218+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:38.670 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:38 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:38.218+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:38.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:38 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:38.218+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:38.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:38 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:38.312+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:38.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:38 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:38.312+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:38.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:38 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:38.312+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:38.975 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 systemd[1]: Stopping Ceph osd.7 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:38.975 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:38.878+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:38.976 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:38.878+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:38.976 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:38.878+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:39.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:38 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:38.955+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:39.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:38 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:38.955+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:39.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:38 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:38.955+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:39.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:38 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:38.955+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:39.411 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:38.974+0000 7fd23dd6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:39.412 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:38.974+0000 7fd23dd6a640 -1 osd.7 79 *** Got signal Terminated *** 2024-09-21T01:29:39.412 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:38 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:38.974+0000 7fd23dd6a640 -1 osd.7 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:39.412 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:39.188+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:39.412 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:39.188+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:39.412 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:39.188+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:39.412 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:39.188+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:39.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:39.267+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:39.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:39.267+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:39.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:39.267+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:39.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:39.307+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:39.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:39.307+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:39.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:39 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:39.307+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:40.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:39.902+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:40.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:39.902+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:40.170 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:39.902+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:40.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:39 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:39.920+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:40.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:39 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:39.920+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:40.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:39 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:39.920+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:40.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:39 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:39.920+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:40.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:40.233+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:40.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:40.233+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:40.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:40.233+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:40.233+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:40 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:40.303+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:40 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:40.303+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:40 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:40.303+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:40 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:40.303+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:40 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:40.303+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:40.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:40 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:40.303+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:41.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:40.909+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:41.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:40.909+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:41.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:40.909+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:41.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:40 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:40.909+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:17.421771+0000 front 2024-09-21T01:29:17.421708+0000 (oldest deadline 2024-09-21T01:29:40.822527+0000) 2024-09-21T01:29:41.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:40 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:40.873+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:41.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:40 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:40.873+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:41.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:40 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:40.873+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:41.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:40 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:40.873+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:41.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:40 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:40.873+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:41.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:41.219+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:41.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:41.219+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:41.219+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:41.219+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:41.219+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:41.339+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:41.339+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:41.339+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:41.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:41.323+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:41.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:41.323+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:41.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:41.323+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:41.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:41 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:41.323+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:42.196 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:41.924+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:42.197 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:41.924+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:42.197 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:41.924+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:42.197 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:41 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:41.924+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:17.421771+0000 front 2024-09-21T01:29:17.421708+0000 (oldest deadline 2024-09-21T01:29:40.822527+0000) 2024-09-21T01:29:42.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:41.836+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:42.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:41.836+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:42.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:41.836+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:42.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:41.836+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:42.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:41 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:41.836+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:42.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:42.196+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:42.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:42.196+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:42.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:42.196+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:42.196+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:42.196+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:42.385+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:42.385+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:42.385+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:42.385+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:42.329+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:42.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:42.329+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:42.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:42.329+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:42.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:42 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:42.329+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:43.198 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:42.920+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:43.198 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:42.920+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:43.198 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:42.920+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:43.198 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:42 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:42.920+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:17.421771+0000 front 2024-09-21T01:29:17.421708+0000 (oldest deadline 2024-09-21T01:29:40.822527+0000) 2024-09-21T01:29:43.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:42 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:42.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:43.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:42 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:42.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:43.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:42 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:42.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:43.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:42 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:42.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:43.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:42 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:42.816+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:43.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:43.197+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:43.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:43.197+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:43.197+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:43.197+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:43.197+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:43.286+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:43.286+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:43.286+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:43.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:43.286+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:43.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:43.419+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:43.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:43.419+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:43.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:43.419+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:43.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:43 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:43.419+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:44.227 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:43.947+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.516739+0000 front 2024-09-21T01:28:52.516824+0000 (oldest deadline 2024-09-21T01:29:16.616882+0000) 2024-09-21T01:29:44.227 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:43.947+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:02.418682+0000 front 2024-09-21T01:29:02.418551+0000 (oldest deadline 2024-09-21T01:29:25.918443+0000) 2024-09-21T01:29:44.227 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:43.947+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:10.420765+0000 front 2024-09-21T01:29:10.420861+0000 (oldest deadline 2024-09-21T01:29:35.120539+0000) 2024-09-21T01:29:44.227 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7[51254]: 2024-09-21T01:29:43.947+0000 7fd23a355640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:17.421771+0000 front 2024-09-21T01:29:17.421708+0000 (oldest deadline 2024-09-21T01:29:40.822527+0000) 2024-09-21T01:29:44.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:43 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:43.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:44.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:43 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:43.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:44.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:43 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:43.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:44.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:43 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:43.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:44.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:43 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:43.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:44.511 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:44 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:44.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:44.512 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:44 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:44.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:44.512 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:44 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:44.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:44.512 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:44 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:44.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:44.512 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:44 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:44.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:44.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:44.397+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:44.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:44.397+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:44.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:44.397+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:44.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:44.397+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:44.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:44.266+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:44.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:44.266+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:44.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:44.266+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:44.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:44 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:44.266+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:44.843 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:44 smithi137 podman[67765]: 2024-09-21 01:29:44.511534072 +0000 UTC m=+5.655890824 container died 4a5261818a4a6e995c2e5a63efedb130804ae62e3eefc4a37e651b22523d8a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T01:29:45.127 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:44 smithi137 podman[67765]: 2024-09-21 01:29:44.942093853 +0000 UTC m=+6.086450606 container cleanup 4a5261818a4a6e995c2e5a63efedb130804ae62e3eefc4a37e651b22523d8a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:29:45.127 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:44 smithi137 bash[67765]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7 2024-09-21T01:29:45.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:44 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:44.860+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:45.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:44 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:44.860+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:45.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:44 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:44.860+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:45.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:44 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:44.860+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:45.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:44 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:44.860+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:45.420 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67784]: 2024-09-21 01:29:45.126689125 +0000 UTC m=+0.612108180 container remove 4a5261818a4a6e995c2e5a63efedb130804ae62e3eefc4a37e651b22523d8a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:29:45.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:45 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:45.213+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:45 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:45.213+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:45 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:45.213+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:45 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:45.213+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:45 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:45.213+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:45.389+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:45.389+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:45.389+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:45.421 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:45.389+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:45.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:45.254+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:45.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:45.254+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:45.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:45.254+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:45.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:45 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:45.254+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:45.880 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67875]: 2024-09-21 01:29:45.552893138 +0000 UTC m=+0.112167195 container create d86e7c400273ab20dacaf34678a96dfae92feebb52e23d5415edff237e6e2733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T01:29:45.880 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67875]: 2024-09-21 01:29:45.456655897 +0000 UTC m=+0.015929917 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:45.880 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67875]: 2024-09-21 01:29:45.779872469 +0000 UTC m=+0.339146480 container init d86e7c400273ab20dacaf34678a96dfae92feebb52e23d5415edff237e6e2733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:29:45.880 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67875]: 2024-09-21 01:29:45.783077484 +0000 UTC m=+0.342351498 container start d86e7c400273ab20dacaf34678a96dfae92feebb52e23d5415edff237e6e2733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T01:29:45.880 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67875]: 2024-09-21 01:29:45.879847577 +0000 UTC m=+0.439121603 container attach d86e7c400273ab20dacaf34678a96dfae92feebb52e23d5415edff237e6e2733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:29:46.171 INFO:journalctl@ceph.osd.7.smithi137.stdout:Sep 21 01:29:45 smithi137 podman[67875]: 2024-09-21 01:29:45.973281014 +0000 UTC m=+0.532555039 container died d86e7c400273ab20dacaf34678a96dfae92feebb52e23d5415edff237e6e2733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T01:29:46.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:45.857+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:46.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:45.857+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:46.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:45.857+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:46.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:45.857+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:46.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:45 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:45.857+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:46.583 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:46 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:46.229+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:46.584 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:46 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:46.229+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:46.584 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:46 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:46.229+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:46.584 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:46 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:46.229+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:46.584 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:46 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:46.229+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:46.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T01:29:46.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:46.651 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T01:29:46.651 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T01:29:46.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.8 2024-09-21T01:29:46.670 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.368+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.368+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.368+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.368+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:46.273+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:46.273+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:46.273+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:46.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:46.273+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:46.984 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 systemd[1]: Stopping Ceph osd.8 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:47.151 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:46 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:46.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:47.151 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:46 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:46.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:47.151 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:46 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:46.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:47.151 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:46 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:46.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:47.151 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:46 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:46.853+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:47.328 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:47.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:47.328 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:47.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:47.328 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:47.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:47.328 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:47.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.984+0000 7f61fa3d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.984+0000 7f61fa3d6640 -1 osd.8 79 *** Got signal Terminated *** 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:46 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:46.984+0000 7f61fa3d6640 -1 osd.8 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:47.327+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:47.327+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:47.327+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:47.329 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:47 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:47.327+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:47.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:47.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:47.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:47.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:47.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:47.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:47.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:47.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:47.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:47.224+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:48.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:47 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:47.891+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:48.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:47 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:47.891+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:48.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:47 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:47.891+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:48.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:47 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:47.891+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:48.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:47 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:47.891+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:48.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:48 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:48.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:48.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:48 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:48.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:48 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:48.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:48 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:48.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:48 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:48.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:48.331+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:48.331+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:48.331+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:48.671 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:48.331+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:48.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:48.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:48.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:48.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:48.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:48.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:48.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:48 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:48.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:49.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:48 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:48.867+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:49.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:48 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:48.867+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:49.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:48 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:48.867+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:49.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:48 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:48.867+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:49.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:48 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:48.867+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:49.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:49 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:49.237+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:49.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:49 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:49.237+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:49.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:49 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:49.237+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:49.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:49 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:49.237+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:49.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:49 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:49.237+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:49.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:49.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:49.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:49.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:49.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:49.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:49.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:49.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:49.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:49.351+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:49.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:49.351+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:49.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:49.351+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:49.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:49.351+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:49.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:49 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:49.351+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:26.664631+0000 front 2024-09-21T01:29:26.664671+0000 (oldest deadline 2024-09-21T01:29:48.964771+0000) 2024-09-21T01:29:50.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:49.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:50.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:49.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:50.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:49.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:50.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:49.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:50.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:49.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:50.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:49 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:49.856+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:50.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:50.202+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:50.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:50.202+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:50.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:50.202+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:50.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:50.202+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:50.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:50 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:50.202+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:50.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:50.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:50.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:50.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:50.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:50.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:50.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:50.188+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:50.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:50.316+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:50.673 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:50.316+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:50.673 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:50.316+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:50.673 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:50.316+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:50.673 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:50 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:50.316+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:26.664631+0000 front 2024-09-21T01:29:26.664671+0000 (oldest deadline 2024-09-21T01:29:48.964771+0000) 2024-09-21T01:29:51.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:50 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:50.879+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:51.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:50 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:50.879+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:51.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:50 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:50.879+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:51.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:50 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:50.879+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:51.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:50 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:50.879+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:51.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:50 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:50.879+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:51 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:51.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:51 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:51.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:51 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:51.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:51 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:51.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:51 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:51.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:51 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:51.218+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:51.172+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:51.172+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:51.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:51.172+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:51.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:51.172+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:51.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:51.284+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:52.457912+0000 front 2024-09-21T01:28:52.457958+0000 (oldest deadline 2024-09-21T01:29:18.357889+0000) 2024-09-21T01:29:51.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:51.284+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.159446+0000 front 2024-09-21T01:29:01.159552+0000 (oldest deadline 2024-09-21T01:29:25.859669+0000) 2024-09-21T01:29:51.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:51.284+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:09.360909+0000 front 2024-09-21T01:29:09.360792+0000 (oldest deadline 2024-09-21T01:29:34.660853+0000) 2024-09-21T01:29:51.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:51.284+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:19.262745+0000 front 2024-09-21T01:29:19.262824+0000 (oldest deadline 2024-09-21T01:29:42.162630+0000) 2024-09-21T01:29:51.672 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8[52144]: 2024-09-21T01:29:51.284+0000 7f61f29b9640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:26.664631+0000 front 2024-09-21T01:29:26.664671+0000 (oldest deadline 2024-09-21T01:29:48.964771+0000) 2024-09-21T01:29:52.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:51 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:51.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:52.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:51 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:51.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:52.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:51 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:51.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:52.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:51 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:51.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:52.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:51 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:51.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:52.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:51 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:51.917+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:52.472 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:52 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:52.178+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:52.473 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:52 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:52.178+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:52.473 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:52 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:52.178+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:52.473 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:52 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:52.178+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:52.473 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:52 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:52.178+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:52.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:52 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:52.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:52.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:52 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:52.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:52.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:52 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:52.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:52.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:52 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:52.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:52.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:52 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:52.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:52.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:52 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:52.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:52.788 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:52 smithi144 podman[68157]: 2024-09-21 01:29:52.472496489 +0000 UTC m=+5.625271310 container died fcdaaa2d8e6ee1a8a05cc270829e4a4229957e4a23bd4095d427b9ecb5e1a136 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:29:53.127 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:52 smithi144 podman[68157]: 2024-09-21 01:29:52.883690348 +0000 UTC m=+6.036465168 container cleanup fcdaaa2d8e6ee1a8a05cc270829e4a4229957e4a23bd4095d427b9ecb5e1a136 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T01:29:53.127 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:52 smithi144 bash[68157]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8 2024-09-21T01:29:53.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:52.872+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:53.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:52.872+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:53.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:52.872+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:53.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:52.872+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:53.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:52.872+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:53.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:52 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:52.872+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:53.420 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:53 smithi144 podman[68177]: 2024-09-21 01:29:53.126804174 +0000 UTC m=+0.650410623 container remove fcdaaa2d8e6ee1a8a05cc270829e4a4229957e4a23bd4095d427b9ecb5e1a136 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:29:53.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:53 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:53.190+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:53.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:53 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:53.190+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:53.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:53 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:53.190+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:53.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:53 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:53.190+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:53.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:53 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:53.191+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:53.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:53 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:53.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:53.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:53 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:53.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:53.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:53 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:53.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:53.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:53 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:53.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:53.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:53 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:53.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:53.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:53 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:53.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:53.830 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:53 smithi144 podman[68262]: 2024-09-21 01:29:53.458913259 +0000 UTC m=+0.015721748 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:29:53.830 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:53 smithi144 podman[68262]: 2024-09-21 01:29:53.594424275 +0000 UTC m=+0.151232803 container create 5c3f024d6f9c2223cdea928b3c2f8d34531471900afafbc9e0b5417f0ff037fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:29:53.830 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:53 smithi144 podman[68262]: 2024-09-21 01:29:53.830044199 +0000 UTC m=+0.386852681 container init 5c3f024d6f9c2223cdea928b3c2f8d34531471900afafbc9e0b5417f0ff037fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T01:29:54.171 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:53 smithi144 podman[68262]: 2024-09-21 01:29:53.833549198 +0000 UTC m=+0.390357686 container start 5c3f024d6f9c2223cdea928b3c2f8d34531471900afafbc9e0b5417f0ff037fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T01:29:54.171 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:53 smithi144 podman[68262]: 2024-09-21 01:29:53.922122441 +0000 UTC m=+0.478930939 container attach 5c3f024d6f9c2223cdea928b3c2f8d34531471900afafbc9e0b5417f0ff037fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T01:29:54.171 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:54 smithi144 podman[68262]: 2024-09-21 01:29:54.018764933 +0000 UTC m=+0.575573416 container died 5c3f024d6f9c2223cdea928b3c2f8d34531471900afafbc9e0b5417f0ff037fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T01:29:54.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:53 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:53.833+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:54.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:53 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:53.833+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:54.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:53 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:53.833+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:54.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:53 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:53.833+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:54.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:53 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:53.833+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:54.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:53 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:53.833+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:54.491 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:54 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:54.210+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:54.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:54 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:54.210+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:54.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:54 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:54.210+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:54.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:54 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:54.210+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:54.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:54 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:54.210+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:54.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:54 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:54.271+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:54.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:54 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:54.271+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:54.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:54 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:54.271+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:54.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:54 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:54.271+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:54.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:54 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:54.271+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:54.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:54 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:54.271+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:54.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T01:29:54.768 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:54 smithi144 podman[68285]: 2024-09-21 01:29:54.67622309 +0000 UTC m=+0.651361407 container remove 5c3f024d6f9c2223cdea928b3c2f8d34531471900afafbc9e0b5417f0ff037fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:29:54.768 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:54 smithi144 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.8.service: Deactivated successfully. 2024-09-21T01:29:54.768 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:54 smithi144 systemd[1]: Stopped Ceph osd.8 for 6bc9e062-77b5-11ef-baf5-efdc52797490. 2024-09-21T01:29:54.768 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 01:29:54 smithi144 systemd[1]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.8.service: Consumed 6min 46.862s CPU time. 2024-09-21T01:29:54.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:29:54.784 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T01:29:54.784 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T01:29:54.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.9 2024-09-21T01:29:55.111 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 systemd[1]: Stopping Ceph osd.9 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:29:55.111 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:54.855+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:55.111 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:54.855+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:54.855+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:54.855+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:54.855+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:54 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:54.855+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.109+0000 7fb9a2410640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.109+0000 7fb9a2410640 -1 osd.9 79 *** Got signal Terminated *** 2024-09-21T01:29:55.112 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.109+0000 7fb9a2410640 -1 osd.9 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:29:55.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:55 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:55.232+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:55.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:55 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:55.232+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:55.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:55 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:55.232+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:55.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:55 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:55.232+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:55 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:55.232+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:55 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:55.232+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:55.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:55.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:55.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:55.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:55.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:55.225+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:56.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.842+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:56.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.842+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:56.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.842+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:56.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.842+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:56.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.842+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:56.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:55 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:55.842+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:56.662 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:56.210+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:56.662 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:56.210+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:56.662 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:56.210+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:56.662 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:56.210+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:56.663 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:56.210+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:56.663 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:56 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:56.210+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:56.670 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:56 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:56.228+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:56.670 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:56 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:56.228+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:56.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:56 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:56.228+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:56.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:56 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:56.228+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:56.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:56 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:56.228+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:57.205 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:56 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:56.801+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:57.205 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:56 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:56.801+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:57.205 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:56 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:56.801+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:57.205 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:56 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:56.801+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:57.205 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:56 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:56.801+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:57.206 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:56 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:56.801+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:57.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:57 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:57.203+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:57.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:57 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:57.203+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:57.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:57 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:57.203+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:57 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:57.203+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:57 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:57.203+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:57 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:57.203+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:57.248+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:57.248+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:57.248+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:57.248+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:57.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:57 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:57.248+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:58.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:57.794+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:58.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:57.794+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:58.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:57.794+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:58.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:57.794+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:58.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:57.794+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:58.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:57 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:57.794+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:58.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:58.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:58.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:58.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:58 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:58.204+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:58.275+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:58.275+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:58.275+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:58.275+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:58.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:58 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:58.275+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:29:59.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:58 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:58.773+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:29:59.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:58 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:58.773+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:29:59.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:58 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:58.773+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:29:59.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:58 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:58.773+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:29:59.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:58 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:58.773+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:29:59.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:58 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:58.773+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:29:59.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:29:59 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:29:59.222+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:59.255+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:59.255+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:59.255+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:59.255+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:29:59.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:29:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:29:59.255+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:00.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:59 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:59.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:43.864264+0000 front 2024-09-21T01:28:43.864656+0000 (oldest deadline 2024-09-21T01:29:08.465001+0000) 2024-09-21T01:30:00.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:59 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:59.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.166382+0000 front 2024-09-21T01:28:53.166399+0000 (oldest deadline 2024-09-21T01:29:16.066408+0000) 2024-09-21T01:30:00.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:59 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:59.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.367433+0000 front 2024-09-21T01:29:01.367316+0000 (oldest deadline 2024-09-21T01:29:26.667436+0000) 2024-09-21T01:30:00.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:59 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:59.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:07.768268+0000 front 2024-09-21T01:29:07.768375+0000 (oldest deadline 2024-09-21T01:29:35.369089+0000) 2024-09-21T01:30:00.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:59 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:59.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.369559+0000 front 2024-09-21T01:29:15.369484+0000 (oldest deadline 2024-09-21T01:29:40.669469+0000) 2024-09-21T01:30:00.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:29:59 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9[66155]: 2024-09-21T01:29:59.823+0000 7fb99a9f3640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:24.770650+0000 front 2024-09-21T01:29:24.770597+0000 (oldest deadline 2024-09-21T01:29:48.870367+0000) 2024-09-21T01:30:00.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:00.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:00 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:00.242+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:00 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:00.288+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:00 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:00.288+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:00 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:00.288+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:00.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:00 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:00.288+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:00.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:00 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:00.288+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:00.750 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:00 smithi037 podman[101825]: 2024-09-21 01:30:00.64662696 +0000 UTC m=+5.659557672 container died 017047f4aec9110cc6e22ab0dc3812ebcade5336f8330d724bc9b44dd4d901e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T01:30:01.249 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 podman[101825]: 2024-09-21 01:30:01.119155864 +0000 UTC m=+6.132086564 container cleanup 017047f4aec9110cc6e22ab0dc3812ebcade5336f8330d724bc9b44dd4d901e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:30:01.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 bash[101825]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9 2024-09-21T01:30:01.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:01.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:01 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:01.264+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:01 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:01.261+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:01 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:01.261+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:01 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:01.261+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:01 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:01.261+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:01.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:01 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:01.261+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:01.735 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 podman[101842]: 2024-09-21 01:30:01.420715762 +0000 UTC m=+0.769023907 container remove 017047f4aec9110cc6e22ab0dc3812ebcade5336f8330d724bc9b44dd4d901e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:30:01.985 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 podman[101928]: 2024-09-21 01:30:01.638153999 +0000 UTC m=+0.016756800 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:30:01.986 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 podman[101928]: 2024-09-21 01:30:01.73797459 +0000 UTC m=+0.116577380 container create b3ae56735f3d5a64c83e5fdc969b2e9a6b4aabf70fca688a0b84294e50b0004c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T01:30:01.986 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 podman[101928]: 2024-09-21 01:30:01.982343874 +0000 UTC m=+0.360946672 container init b3ae56735f3d5a64c83e5fdc969b2e9a6b4aabf70fca688a0b84294e50b0004c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:30:01.986 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:01 smithi037 podman[101928]: 2024-09-21 01:30:01.985805273 +0000 UTC m=+0.364408061 container start b3ae56735f3d5a64c83e5fdc969b2e9a6b4aabf70fca688a0b84294e50b0004c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:30:02.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:02 smithi037 podman[101928]: 2024-09-21 01:30:02.09059043 +0000 UTC m=+0.469193233 container attach b3ae56735f3d5a64c83e5fdc969b2e9a6b4aabf70fca688a0b84294e50b0004c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:30:02.250 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 21 01:30:02 smithi037 podman[101928]: 2024-09-21 01:30:02.18366082 +0000 UTC m=+0.562263625 container died b3ae56735f3d5a64c83e5fdc969b2e9a6b4aabf70fca688a0b84294e50b0004c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T01:30:02.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:02.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:02.223+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:02 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:02.220+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:02 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:02.220+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:02 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:02.220+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:02.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:02 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:02.220+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:02.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:02 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:02.220+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:02.672 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:02 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:02.220+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:02.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T01:30:02.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:02.844 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T01:30:02.844 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T01:30:02.845 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.10 2024-09-21T01:30:03.145 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:02 smithi137 systemd[1]: Stopping Ceph osd.10 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:03.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.144+0000 7fb503ebd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:03.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.144+0000 7fb503ebd640 -1 osd.10 79 *** Got signal Terminated *** 2024-09-21T01:30:03.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.144+0000 7fb503ebd640 -1 osd.10 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:30:03.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:03.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:03.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:03.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:03.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:03.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:03.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:03 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:03.226+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:03.670 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:03.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:03.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:03.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:03.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:03.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:03.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:03.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:03.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:03.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:03.671 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:03.199+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:04.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:04.152+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:04.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:04.152+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:04.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:04.152+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:04.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:04.152+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:04.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:04.152+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:04.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:04 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:04.152+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:04.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:04.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:04.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:04.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:04.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:04.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:04.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:04 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:04.207+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:05.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:05 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:05.110+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:05.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:05 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:05.110+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:05.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:05 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:05.110+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:05.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:05 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:05.110+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:05.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:05 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:05.110+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:05.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:05 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:05.110+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:05.670 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.170+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:05.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.170+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:05.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.170+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:05.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.171+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:05.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.171+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:05.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.171+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:05.671 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:05 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:05.171+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:06.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:06.089+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:06.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:06.089+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:06.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:06.089+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:06.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:06.089+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:06.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:06.089+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:06.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:06 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:06.089+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:06.422 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:06.422 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:06.422 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:06.423 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:06.423 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:06.423 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:06.423 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:06 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:06.162+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:07 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:07.051+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:07 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:07.051+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:07 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:07.051+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:07 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:07.051+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:07 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:07.051+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:07 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:07.051+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:07.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:07.422 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:07.422 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:07 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:07.125+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:08.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:46.302193+0000 front 2024-09-21T01:28:46.302217+0000 (oldest deadline 2024-09-21T01:29:08.002204+0000) 2024-09-21T01:30:08.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6804 osd.1 since back 2024-09-21T01:28:53.903253+0000 front 2024-09-21T01:28:53.903166+0000 (oldest deadline 2024-09-21T01:29:18.003280+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:28:59.704195+0000 front 2024-09-21T01:28:59.704384+0000 (oldest deadline 2024-09-21T01:29:29.104449+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:11.405321+0000 front 2024-09-21T01:29:11.405357+0000 (oldest deadline 2024-09-21T01:29:34.905497+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:16.006413+0000 front 2024-09-21T01:29:16.006453+0000 (oldest deadline 2024-09-21T01:29:40.706504+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.608761+0000 front 2024-09-21T01:29:27.608554+0000 (oldest deadline 2024-09-21T01:29:50.508270+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10[57890]: 2024-09-21T01:30:08.099+0000 7fb5004a8640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:34.009330+0000 front 2024-09-21T01:29:34.009308+0000 (oldest deadline 2024-09-21T01:29:58.109214+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:08.078+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:08.078+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:08.078+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:08.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:08.078+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:08.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:08.078+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:08.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:08 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:08.078+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:08.790 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 podman[67980]: 2024-09-21 01:30:08.504553699 +0000 UTC m=+5.470937360 container died a1977db1fb14aa15ca9ba0f1a4f6acb6bd80cadede3fb8ff5b7df0df293c4b40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:30:09.128 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 podman[67980]: 2024-09-21 01:30:08.893734685 +0000 UTC m=+5.860118349 container cleanup a1977db1fb14aa15ca9ba0f1a4f6acb6bd80cadede3fb8ff5b7df0df293c4b40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:30:09.128 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:08 smithi137 bash[67980]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10 2024-09-21T01:30:09.420 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[67997]: 2024-09-21 01:30:09.128164882 +0000 UTC m=+0.623679845 container remove a1977db1fb14aa15ca9ba0f1a4f6acb6bd80cadede3fb8ff5b7df0df293c4b40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:30:09.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:09.043+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:09.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:09.043+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:09.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:09.043+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:09.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:09.043+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:09.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:09.043+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:09.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:09 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:09.043+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:09.740 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[68086]: 2024-09-21 01:30:09.357152043 +0000 UTC m=+0.016103537 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:30:09.740 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[68086]: 2024-09-21 01:30:09.462153086 +0000 UTC m=+0.121104579 container create f6a3cf1c46123b288b47940278be33159a2e179d63462b6b9d95904f4f4f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:30:09.740 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[68086]: 2024-09-21 01:30:09.664598472 +0000 UTC m=+0.323549971 container init f6a3cf1c46123b288b47940278be33159a2e179d63462b6b9d95904f4f4f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:30:09.740 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[68086]: 2024-09-21 01:30:09.667840774 +0000 UTC m=+0.326792276 container start f6a3cf1c46123b288b47940278be33159a2e179d63462b6b9d95904f4f4f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:30:09.740 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[68086]: 2024-09-21 01:30:09.739603361 +0000 UTC m=+0.398554864 container attach f6a3cf1c46123b288b47940278be33159a2e179d63462b6b9d95904f4f4f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T01:30:10.143 INFO:journalctl@ceph.osd.10.smithi137.stdout:Sep 21 01:30:09 smithi137 podman[68086]: 2024-09-21 01:30:09.851903344 +0000 UTC m=+0.510854839 container died f6a3cf1c46123b288b47940278be33159a2e179d63462b6b9d95904f4f4f05c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:10.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.068+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-21T01:29:42.046025+0000 front 2024-09-21T01:29:42.046047+0000 (oldest deadline 2024-09-21T01:30:09.646487+0000) 2024-09-21T01:30:10.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T01:30:10.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:10.548 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T01:30:10.548 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T01:30:10.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.11 2024-09-21T01:30:10.854 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 systemd[1]: Stopping Ceph osd.11 for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:10.858 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.853+0000 7f52a9b2c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:10.858 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.853+0000 7f52a9b2c640 -1 osd.11 79 *** Got signal Terminated *** 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:10 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:10.853+0000 7f52a9b2c640 -1 osd.11 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:11.171 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:11 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:11.052+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-21T01:29:42.046025+0000 front 2024-09-21T01:29:42.046047+0000 (oldest deadline 2024-09-21T01:30:09.646487+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:12.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:12 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:12.021+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-21T01:29:42.046025+0000 front 2024-09-21T01:29:42.046047+0000 (oldest deadline 2024-09-21T01:30:09.646487+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:13.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.019+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-21T01:29:42.046025+0000 front 2024-09-21T01:29:42.046047+0000 (oldest deadline 2024-09-21T01:30:09.646487+0000) 2024-09-21T01:30:14.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:14.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:14.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:14.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:14.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:14.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:14.422 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:13 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:13.986+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-21T01:29:42.046025+0000 front 2024-09-21T01:29:42.046047+0000 (oldest deadline 2024-09-21T01:30:09.646487+0000) 2024-09-21T01:30:15.420 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-21T01:28:42.135019+0000 front 2024-09-21T01:28:42.135004+0000 (oldest deadline 2024-09-21T01:29:08.535566+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T01:29:01.839139+0000 front 2024-09-21T01:29:01.839174+0000 (oldest deadline 2024-09-21T01:29:26.539380+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-21T01:29:06.539839+0000 front 2024-09-21T01:29:06.539902+0000 (oldest deadline 2024-09-21T01:29:35.340651+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6812 osd.4 since back 2024-09-21T01:29:15.341332+0000 front 2024-09-21T01:29:15.341394+0000 (oldest deadline 2024-09-21T01:29:41.241353+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T01:29:27.944537+0000 front 2024-09-21T01:29:27.944437+0000 (oldest deadline 2024-09-21T01:29:51.444542+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-21T01:29:31.445124+0000 front 2024-09-21T01:29:31.445063+0000 (oldest deadline 2024-09-21T01:30:02.045449+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.137:6820 osd.7 since back 2024-09-21T01:29:42.046025+0000 front 2024-09-21T01:29:42.046047+0000 (oldest deadline 2024-09-21T01:30:09.646487+0000) 2024-09-21T01:30:15.421 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:15 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11[58684]: 2024-09-21T01:30:15.018+0000 7f52a210f640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.144:6820 osd.8 since back 2024-09-21T01:29:51.947539+0000 front 2024-09-21T01:29:51.947570+0000 (oldest deadline 2024-09-21T01:30:14.247520+0000) 2024-09-21T01:30:16.612 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:16 smithi144 podman[68377]: 2024-09-21 01:30:16.312763036 +0000 UTC m=+5.565416520 container died 9d3b9981f3800386fd54cc252f11ab5c976df66c5e355aebee765efee466e921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T01:30:16.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:16 smithi144 podman[68377]: 2024-09-21 01:30:16.694724659 +0000 UTC m=+5.947378132 container cleanup 9d3b9981f3800386fd54cc252f11ab5c976df66c5e355aebee765efee466e921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:30:16.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:16 smithi144 bash[68377]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11 2024-09-21T01:30:17.258 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:16 smithi144 podman[68392]: 2024-09-21 01:30:16.945856817 +0000 UTC m=+0.634598525 container remove 9d3b9981f3800386fd54cc252f11ab5c976df66c5e355aebee765efee466e921 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:30:17.549 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:17 smithi144 podman[68479]: 2024-09-21 01:30:17.160726841 +0000 UTC m=+0.015856827 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:30:17.549 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:17 smithi144 podman[68479]: 2024-09-21 01:30:17.263806496 +0000 UTC m=+0.118936474 container create 82c540e8776aa86ff5ff7643a1b083acbdf7b7d67f205050434dd7fa0f7e52cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:30:17.549 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:17 smithi144 podman[68479]: 2024-09-21 01:30:17.474123148 +0000 UTC m=+0.329253141 container init 82c540e8776aa86ff5ff7643a1b083acbdf7b7d67f205050434dd7fa0f7e52cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T01:30:17.549 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:17 smithi144 podman[68479]: 2024-09-21 01:30:17.477478041 +0000 UTC m=+0.332608020 container start 82c540e8776aa86ff5ff7643a1b083acbdf7b7d67f205050434dd7fa0f7e52cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:30:17.549 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:17 smithi144 podman[68479]: 2024-09-21 01:30:17.548954737 +0000 UTC m=+0.404084734 container attach 82c540e8776aa86ff5ff7643a1b083acbdf7b7d67f205050434dd7fa0f7e52cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T01:30:17.920 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 01:30:17 smithi144 podman[68479]: 2024-09-21 01:30:17.667324657 +0000 UTC m=+0.522454639 container died 82c540e8776aa86ff5ff7643a1b083acbdf7b7d67f205050434dd7fa0f7e52cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:30:18.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T01:30:18.444 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:18.444 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T01:30:18.444 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T01:30:18.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.a 2024-09-21T01:30:18.749 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:30:18 smithi037 systemd[1]: Stopping Ceph mds.a for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:19.249 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:30:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a[73007]: 2024-09-21T01:30:18.829+0000 7f09bde50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:19.250 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:30:18 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a[73007]: 2024-09-21T01:30:18.829+0000 7f09bde50640 -1 mds.a *** got signal Terminated *** 2024-09-21T01:30:22.589 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:30:22 smithi037 podman[102033]: 2024-09-21 01:30:22.285462931 +0000 UTC m=+3.637138127 container died 8cf5976f2e6ce5bbf3eacf5c44a371b24ce09788a6f18a4c3f7087bd29b6d74f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:30:23.000 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:30:22 smithi037 podman[102033]: 2024-09-21 01:30:22.771361055 +0000 UTC m=+4.123036252 container cleanup 8cf5976f2e6ce5bbf3eacf5c44a371b24ce09788a6f18a4c3f7087bd29b6d74f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:30:23.000 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 21 01:30:22 smithi037 bash[102033]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-a 2024-09-21T01:30:23.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T01:30:23.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:23.288 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T01:30:23.288 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T01:30:23.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.d 2024-09-21T01:30:23.626 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:30:23 smithi037 systemd[1]: Stopping Ceph mds.d for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:23.999 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:30:23 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d[71880]: 2024-09-21T01:30:23.625+0000 7fc20f81c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:23.999 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:30:23 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d[71880]: 2024-09-21T01:30:23.625+0000 7fc20f81c640 -1 mds.d *** got signal Terminated *** 2024-09-21T01:30:26.916 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:30:26 smithi037 podman[102165]: 2024-09-21 01:30:26.634116511 +0000 UTC m=+3.109443463 container died c9a7e8a873d5e80de34cabfcd5e4d06e8b5e1cb9dc6263ed45895a0e69f38433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:30:27.249 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:30:27 smithi037 podman[102165]: 2024-09-21 01:30:27.051018054 +0000 UTC m=+3.526344995 container cleanup c9a7e8a873d5e80de34cabfcd5e4d06e8b5e1cb9dc6263ed45895a0e69f38433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T01:30:27.250 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 21 01:30:27 smithi037 bash[102165]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-d 2024-09-21T01:30:27.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T01:30:27.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:27.525 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T01:30:27.525 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T01:30:27.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.g 2024-09-21T01:30:27.872 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:30:27 smithi037 systemd[1]: Stopping Ceph mds.g for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:28.249 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:30:27 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g[72650]: 2024-09-21T01:30:27.870+0000 7fa2201ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:28.250 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:30:27 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g[72650]: 2024-09-21T01:30:27.870+0000 7fa2201ac640 -1 mds.g *** got signal Terminated *** 2024-09-21T01:30:30.547 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:30:30 smithi037 podman[102285]: 2024-09-21 01:30:30.271968516 +0000 UTC m=+2.507667622 container died 70a929329e5798c34beed350838164d2cfa53f34a5c42898d265438f04914137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:30:30.999 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:30:30 smithi037 podman[102285]: 2024-09-21 01:30:30.746748449 +0000 UTC m=+2.982447584 container cleanup 70a929329e5798c34beed350838164d2cfa53f34a5c42898d265438f04914137 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:30:31.000 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 21 01:30:30 smithi037 bash[102285]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-g 2024-09-21T01:30:31.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T01:30:31.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:31.212 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T01:30:31.212 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T01:30:31.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.j 2024-09-21T01:30:31.526 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:30:31 smithi037 systemd[1]: Stopping Ceph mds.j for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:31.999 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:30:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j[71513]: 2024-09-21T01:30:31.525+0000 7f0e234e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:31.999 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:30:31 smithi037 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j[71513]: 2024-09-21T01:30:31.525+0000 7f0e234e2640 -1 mds.j *** got signal Terminated *** 2024-09-21T01:30:35.235 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:30:34 smithi037 podman[102403]: 2024-09-21 01:30:34.933959542 +0000 UTC m=+3.500268926 container died 3542e55098d456a0d6d4afb5798b7483e28f27ddc06d7c5ea7c3ff52be2f6186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T01:30:35.499 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:30:35 smithi037 podman[102403]: 2024-09-21 01:30:35.401133471 +0000 UTC m=+3.967442898 container cleanup 3542e55098d456a0d6d4afb5798b7483e28f27ddc06d7c5ea7c3ff52be2f6186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T01:30:35.499 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 21 01:30:35 smithi037 bash[102403]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-j 2024-09-21T01:30:35.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T01:30:35.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:35.989 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T01:30:35.990 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T01:30:35.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.b 2024-09-21T01:30:36.285 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:30:36 smithi137 systemd[1]: Stopping Ceph mds.b for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:36.670 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:30:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: 2024-09-21T01:30:36.284+0000 7fbe6bd6e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:36.670 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:30:36 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b[63199]: 2024-09-21T01:30:36.284+0000 7fbe6bd6e640 -1 mds.b *** got signal Terminated *** 2024-09-21T01:30:38.460 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:30:38 smithi137 podman[68189]: 2024-09-21 01:30:38.189161866 +0000 UTC m=+2.008902072 container died 8b6428249525b0f7d743104212a8cd0fa976fad48db682cada3d3ba70bb600b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T01:30:38.819 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:30:38 smithi137 podman[68189]: 2024-09-21 01:30:38.559736089 +0000 UTC m=+2.379476296 container cleanup 8b6428249525b0f7d743104212a8cd0fa976fad48db682cada3d3ba70bb600b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:30:38.819 INFO:journalctl@ceph.mds.b.smithi137.stdout:Sep 21 01:30:38 smithi137 bash[68189]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-b 2024-09-21T01:30:38.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T01:30:38.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:38.998 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T01:30:38.998 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T01:30:38.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.e 2024-09-21T01:30:39.420 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:30:39 smithi137 systemd[1]: Stopping Ceph mds.e for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:39.420 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:30:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e[62649]: 2024-09-21T01:30:39.329+0000 7f2004ed6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:39.421 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:30:39 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e[62649]: 2024-09-21T01:30:39.329+0000 7f2004ed6640 -1 mds.e *** got signal Terminated *** 2024-09-21T01:30:42.439 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:30:42 smithi137 podman[68311]: 2024-09-21 01:30:42.177218418 +0000 UTC m=+2.953578543 container died f72a4e880f505e9d6b04012814b48f8e1c32140306f2ca42e501337d09679826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:30:42.814 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:30:42 smithi137 podman[68311]: 2024-09-21 01:30:42.537973529 +0000 UTC m=+3.314333640 container cleanup f72a4e880f505e9d6b04012814b48f8e1c32140306f2ca42e501337d09679826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T01:30:42.814 INFO:journalctl@ceph.mds.e.smithi137.stdout:Sep 21 01:30:42 smithi137 bash[68311]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-e 2024-09-21T01:30:42.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T01:30:43.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:43.010 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T01:30:43.010 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T01:30:43.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.h 2024-09-21T01:30:43.335 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:30:43 smithi137 systemd[1]: Stopping Ceph mds.h for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:43.670 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:30:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h[62916]: 2024-09-21T01:30:43.333+0000 7fbd6253f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:43.670 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:30:43 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h[62916]: 2024-09-21T01:30:43.333+0000 7fbd6253f640 -1 mds.h *** got signal Terminated *** 2024-09-21T01:30:46.420 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:30:46 smithi137 podman[68445]: 2024-09-21 01:30:46.169506553 +0000 UTC m=+2.944879464 container died 457d3d215bf6ac90664e47bb8e33e2d691688465c7a304f22257ff0a00c43e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:30:46.860 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:30:46 smithi137 podman[68445]: 2024-09-21 01:30:46.525262167 +0000 UTC m=+3.300635076 container cleanup 457d3d215bf6ac90664e47bb8e33e2d691688465c7a304f22257ff0a00c43e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:30:46.860 INFO:journalctl@ceph.mds.h.smithi137.stdout:Sep 21 01:30:46 smithi137 bash[68445]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-h 2024-09-21T01:30:47.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T01:30:47.033 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:47.033 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T01:30:47.034 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T01:30:47.034 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.k 2024-09-21T01:30:47.363 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:30:47 smithi137 systemd[1]: Stopping Ceph mds.k for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:47.670 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:30:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k[62369]: 2024-09-21T01:30:47.362+0000 7f00df4b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:47.670 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:30:47 smithi137 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k[62369]: 2024-09-21T01:30:47.362+0000 7f00df4b9640 -1 mds.k *** got signal Terminated *** 2024-09-21T01:30:50.420 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:30:50 smithi137 podman[68565]: 2024-09-21 01:30:50.169406731 +0000 UTC m=+2.919228442 container died 8748a8fb991474cf84e41bcca93d80bf1a62317c7f8380967f75e9031bfc35b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:30:50.788 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:30:50 smithi137 podman[68565]: 2024-09-21 01:30:50.562311916 +0000 UTC m=+3.312133624 container cleanup 8748a8fb991474cf84e41bcca93d80bf1a62317c7f8380967f75e9031bfc35b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:30:50.788 INFO:journalctl@ceph.mds.k.smithi137.stdout:Sep 21 01:30:50 smithi137 bash[68565]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-k 2024-09-21T01:30:50.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T01:30:51.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:51.012 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T01:30:51.012 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T01:30:51.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.c 2024-09-21T01:30:51.319 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:30:51 smithi144 systemd[1]: Stopping Ceph mds.c for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:51.592 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:30:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c[63786]: 2024-09-21T01:30:51.318+0000 7f21fb468640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:51.592 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:30:51 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c[63786]: 2024-09-21T01:30:51.318+0000 7f21fb468640 -1 mds.c *** got signal Terminated *** 2024-09-21T01:30:54.410 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:30:54 smithi144 podman[68581]: 2024-09-21 01:30:54.144803543 +0000 UTC m=+2.926294683 container died 1fba584d2053551498a22069cf5ffa708e03cfb9b191ac76b0550cb646659ea8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T01:30:54.670 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:30:54 smithi144 podman[68581]: 2024-09-21 01:30:54.501366801 +0000 UTC m=+3.282857940 container cleanup 1fba584d2053551498a22069cf5ffa708e03cfb9b191ac76b0550cb646659ea8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T01:30:54.671 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 01:30:54 smithi144 bash[68581]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-c 2024-09-21T01:30:54.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T01:30:54.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:54.957 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T01:30:54.957 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T01:30:54.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.f 2024-09-21T01:30:55.170 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:30:55 smithi144 systemd[1]: Stopping Ceph mds.f for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:55.670 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:30:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f[63515]: 2024-09-21T01:30:55.272+0000 7f7cbea53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:55.670 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:30:55 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f[63515]: 2024-09-21T01:30:55.272+0000 7f7cbea53640 -1 mds.f *** got signal Terminated *** 2024-09-21T01:30:58.420 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:30:58 smithi144 podman[68709]: 2024-09-21 01:30:58.15901821 +0000 UTC m=+2.985780310 container died 7d8ea037f972add8203108908c518f937e0316ce362c0fe092c4737c98aadef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-21T01:30:58.797 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:30:58 smithi144 podman[68709]: 2024-09-21 01:30:58.530063956 +0000 UTC m=+3.356826046 container cleanup 7d8ea037f972add8203108908c518f937e0316ce362c0fe092c4737c98aadef6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T01:30:58.798 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 01:30:58 smithi144 bash[68709]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-f 2024-09-21T01:30:58.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T01:30:58.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:30:58.959 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T01:30:58.959 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T01:30:58.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.i 2024-09-21T01:30:59.384 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:30:59 smithi144 systemd[1]: Stopping Ceph mds.i for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:30:59.670 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:30:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i[64058]: 2024-09-21T01:30:59.384+0000 7fdc72e8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:30:59.671 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:30:59 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i[64058]: 2024-09-21T01:30:59.384+0000 7fdc72e8c640 -1 mds.i *** got signal Terminated *** 2024-09-21T01:31:02.410 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:31:02 smithi144 podman[68830]: 2024-09-21 01:31:02.152574554 +0000 UTC m=+2.961470621 container died 20efc98198f176961a019023e6d0953da9416ce9028aa865306d4914e1b95b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:31:02.670 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:31:02 smithi144 podman[68830]: 2024-09-21 01:31:02.508836147 +0000 UTC m=+3.317732255 container cleanup 20efc98198f176961a019023e6d0953da9416ce9028aa865306d4914e1b95b15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:31:02.671 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 01:31:02 smithi144 bash[68830]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-i 2024-09-21T01:31:02.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T01:31:02.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:31:02.972 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T01:31:02.972 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T01:31:02.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.l 2024-09-21T01:31:03.420 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:03 smithi144 systemd[1]: Stopping Ceph mds.l for 6bc9e062-77b5-11ef-baf5-efdc52797490... 2024-09-21T01:31:03.420 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l[63247]: 2024-09-21T01:31:03.294+0000 7fd9822a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:31:03.420 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:03 smithi144 ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l[63247]: 2024-09-21T01:31:03.294+0000 7fd9822a9640 -1 mds.l *** got signal Terminated *** 2024-09-21T01:31:06.420 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:06 smithi144 podman[68951]: 2024-09-21 01:31:06.1361155 +0000 UTC m=+2.947982442 container died d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:31:06.920 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:06 smithi144 podman[68951]: 2024-09-21 01:31:06.554166439 +0000 UTC m=+3.366033384 container cleanup d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:31:06.920 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:06 smithi144 bash[68951]: ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l 2024-09-21T01:31:06.920 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 01:31:06 smithi144 podman[68962]: 2024-09-21 01:31:06.721706402 +0000 UTC m=+0.505388219 container remove d1f106e72099ebbc7180cb88ad6b3c9222ba997db4932a3eea2242f77fb70813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-6bc9e062-77b5-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T01:31:06.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6bc9e062-77b5-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T01:31:06.996 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:31:06.996 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T01:31:06.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:31:07.210 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:31:09.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:31:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:31:12.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:31:12.843 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:31:15.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:31:15.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:31:15.343 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:31:15.369 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T01:31:15.371 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi037/crash 2024-09-21T01:31:15.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:31:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:31:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:31:15.417 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi137/crash 2024-09-21T01:31:15.418 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:31:15.468 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:31:15.468 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:31:15.470 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi144/crash 2024-09-21T01:31:15.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:31:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:tar: /var/lib/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:31:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:31:15.505 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T01:31:15.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T01:31:15.601 INFO:tasks.cephadm:Compressing logs... 2024-09-21T01:31:15.601 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:31:15.603 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:31:15.606 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:31:15.632 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T01:31:15.632 INFO:teuthology.orchestra.run.smithi137.stderr:: No such file or directory 2024-09-21T01:31:15.633 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T01:31:15.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T01:31:15.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:31:15.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T01:31:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T01:31:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T01:31:15.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T01:31:15.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:31:15.640 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-09-21T01:31:15.640 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T01:31:15.640 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T01:31:15.641 INFO:teuthology.orchestra.run.smithi144.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T01:31:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:31:15.642 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:31:15.642 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T01:31:15.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T01:31:15.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T01:31:15.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T01:31:15.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:31:15.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 86.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T01:31:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi037.stderr: 94.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T01:31:15.650 INFO:teuthology.orchestra.run.smithi037.stderr: 94.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T01:31:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:31:15.708 INFO:teuthology.orchestra.run.smithi144.stderr: 92.7% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T01:31:15.720 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:31:15.740 INFO:teuthology.orchestra.run.smithi137.stderr: 90.3% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:31:15.780 INFO:teuthology.orchestra.run.smithi144.stderr: 90.4% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:31:15.814 INFO:teuthology.orchestra.run.smithi144.stderr: 92.7% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T01:31:15.840 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:31:15.849 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:31:15.852 INFO:teuthology.orchestra.run.smithi137.stderr: 92.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T01:31:15.867 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:31:15.939 INFO:teuthology.orchestra.run.smithi144.stderr: 86.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:31:15.983 INFO:teuthology.orchestra.run.smithi144.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:31:16.054 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:31:16.089 INFO:teuthology.orchestra.run.smithi137.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:31:16.090 INFO:teuthology.orchestra.run.smithi137.stderr: 86.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:31:16.108 INFO:teuthology.orchestra.run.smithi144.stderr: 93.2% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T01:31:16.492 INFO:teuthology.orchestra.run.smithi144.stderr: 92.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T01:31:16.962 INFO:teuthology.orchestra.run.smithi137.stderr: 93.2% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T01:31:16.966 INFO:teuthology.orchestra.run.smithi144.stderr: 94.4% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T01:31:17.112 INFO:teuthology.orchestra.run.smithi037.stderr: 82.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:31:17.206 INFO:teuthology.orchestra.run.smithi037.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:31:17.545 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T01:31:17.719 INFO:teuthology.orchestra.run.smithi137.stderr: 94.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T01:31:17.792 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T01:31:17.896 INFO:teuthology.orchestra.run.smithi037.stderr: 94.4% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T01:31:18.293 INFO:teuthology.orchestra.run.smithi037.stderr: 94.4% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T01:31:22.982 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T01:31:24.344 INFO:teuthology.orchestra.run.smithi137.stderr: 91.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T01:32:57.432 INFO:teuthology.orchestra.run.smithi144.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T01:35:25.245 INFO:teuthology.orchestra.run.smithi144.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T01:35:30.550 INFO:teuthology.orchestra.run.smithi144.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T01:35:30.703 INFO:teuthology.orchestra.run.smithi144.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T01:35:30.705 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-21T01:35:30.705 INFO:teuthology.orchestra.run.smithi144.stderr:real 4m15.085s 2024-09-21T01:35:30.705 INFO:teuthology.orchestra.run.smithi144.stderr:user 4m45.744s 2024-09-21T01:35:30.705 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m12.992s 2024-09-21T01:41:41.502 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T01:42:33.171 INFO:teuthology.orchestra.run.smithi137.stderr: 97.4% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T01:42:46.815 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T01:42:47.391 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T01:43:29.951 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T01:43:29.954 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-21T01:43:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:real 12m14.335s 2024-09-21T01:43:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:user 5m19.338s 2024-09-21T01:43:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m15.065s 2024-09-21T01:47:19.114 INFO:teuthology.orchestra.run.smithi137.stderr: 93.5% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T01:48:04.979 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T01:51:24.114 INFO:teuthology.orchestra.run.smithi137.stderr: 93.7% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T01:52:16.987 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T01:55:15.512 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/6bc9e062-77b5-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T01:55:15.550 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-21T01:55:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:real 23m59.929s 2024-09-21T01:55:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:user 9m7.850s 2024-09-21T01:55:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m29.883s 2024-09-21T01:55:15.551 INFO:tasks.cephadm:Archiving logs... 2024-09-21T01:55:15.552 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi037/log 2024-09-21T01:55:15.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:55:58.050 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi137/log 2024-09-21T01:55:58.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:57:14.221 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi144/log 2024-09-21T01:57:14.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:57:56.923 INFO:tasks.cephadm:Removing cluster... 2024-09-21T01:57:56.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --force 2024-09-21T01:57:57.213 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:57:57.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --force 2024-09-21T01:57:58.552 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:57:59.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6bc9e062-77b5-11ef-baf5-efdc52797490 --force 2024-09-21T01:57:59.739 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 6bc9e062-77b5-11ef-baf5-efdc52797490 2024-09-21T01:58:00.307 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T01:58:00.308 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:58:00.328 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:58:00.347 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:58:00.363 INFO:tasks.cephadm:Teardown complete 2024-09-21T01:58:00.363 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T01:58:00.373 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T01:58:00.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:58:00.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:58:00.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:58:00.509 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T01:58:00.518 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T01:58:00.518 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:58:00.521 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:58:00.523 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:58:00.537 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:58:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:58:00.541 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:58:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:58:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-21T01:58:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +233us[ +233us] +/- 56ms 2024-09-21T01:58:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -799us[ -799us] +/- 49ms 2024-09-21T01:58:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +828us[ +828us] +/- 76ms 2024-09-21T01:58:00.569 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:58:00.570 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:58:00.570 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-21T01:58:00.570 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +201us[ +203us] +/- 56ms 2024-09-21T01:58:00.570 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -821us[ -821us] +/- 49ms 2024-09-21T01:58:00.570 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +824us[ +824us] +/- 76ms 2024-09-21T01:58:00.571 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:58:00.586 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:58:00.586 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-21T01:58:00.586 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 +209us[ +169us] +/- 56ms 2024-09-21T01:58:00.586 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -824us[ -824us] +/- 49ms 2024-09-21T01:58:00.586 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +808us[ +808us] +/- 76ms 2024-09-21T01:58:00.586 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:58:00.599 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T01:58:00.611 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T01:58:00.612 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T01:58:00.621 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:58:00.783 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:58:00.925 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:58:01.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:58:01.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:58:01.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:58:01.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:58:01.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:58:01.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:58:01.099 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T01:58:01.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T01:58:01.202 INFO:teuthology.task.internal:Duration was 3573.477752 seconds 2024-09-21T01:58:01.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T01:58:01.221 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T01:58:01.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:58:01.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:58:01.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:58:01.281 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:58:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:58:01.291 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:58:01.729 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T01:58:01.730 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-21T01:58:01.730 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:58:01.755 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-21T01:58:01.755 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:58:01.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-21T01:58:01.790 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:58:01.829 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T01:58:01.829 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:58:01.832 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:58:01.835 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:58:01.905 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T01:58:01.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:58:01.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:58:01.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:58:02.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T01:58:02.867 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T01:58:02.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:58:02.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:58:02.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:58:02.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T01:58:02.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:58:02.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:58:03.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:58:03.026 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-21T01:58:03.031 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-21T01:58:03.053 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-21T01:58:03.072 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:58:03.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:58:03.096 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:58:03.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:58:03.112 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:58:03.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:58:03.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T01:58:03.143 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T01:58:03.145 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi037 2024-09-21T01:58:03.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:58:03.199 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi137 2024-09-21T01:58:03.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:58:03.236 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913357/remote/smithi144 2024-09-21T01:58:03.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:58:03.276 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T01:58:03.277 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:58:03.279 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:58:03.282 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:58:03.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T01:58:03.338 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T01:58:03.338 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T01:58:03.350 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T01:58:03.350 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:58:03.352 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:58:03.354 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:58:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:58 /home/ubuntu/cephtest 2024-09-21T01:58:03.368 INFO:teuthology.orchestra.run.smithi137.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:58 /home/ubuntu/cephtest 2024-09-21T01:58:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:58 /home/ubuntu/cephtest 2024-09-21T01:58:03.393 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T01:58:03.404 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T01:58:03.429 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} duration: 3573.4777522087097 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T01:58:03.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:58:03.518 INFO:teuthology.run:pass